2024-05-20T16:45:03.530 INFO:root:teuthology version: 0.0.1.dev287+gb9e3da8 2024-05-20T16:45:03.530 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715607 --name pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi --verbose --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/iogen}} --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715607/orig.config.yaml 2024-05-20T16:45:03.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-20T16:45:03.686 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715607 branch: wip-pdonnell-testing-20240517.203521-squid-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/iogen}} email: pdonnell@redhat.com first_in_suite: false job_id: '7715607' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240517.203521-squid-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt dry_run: true install: ceph: flavor: default sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240517.203521-squid-debug sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 9749 sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d sleep_before_teardown: 0 subset: 272/512 suite: fs suite_branch: wip-pdonnell-testing-20240517.203521-squid-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d2b507c724ef6c8295ee0a35d185cdab167fd61d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKG5V6hj9Kqq+cme+OmiRV5bxmLNXlVQucOxxNIyZ10xU6IMAm8hijNA0ERA5eeMUzdHqx+03EdbKt+jl2FnsZE= smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKfsN5UCTZMvQuxOt+QTMBp7VI7Ufx8ELryyXY7tF/E6buVzl6tIXSPhaaIGlgHGplY3aZfa2Z75kJV2ZT7aeiY= smithi171.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA2+TXMRjq/1TFxhkzSmm0vS3AXRG16d02UJILqIoGP+g8XQcFt8HmLZU4RqKZG+3U1dSRYnnUUe9lUH+i3B1q4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - workunit: clients: all: - suites/iogen.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: b9e3da87b1ec7920937cb4902b7e3fd9eda86b4a timestamp: 2024-05-20_15:44:59 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-05-20T16:45:03.687 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d2b507c724ef6c8295ee0a35d185cdab167fd61d/qa; will attempt to use it 2024-05-20T16:45:03.687 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d2b507c724ef6c8295ee0a35d185cdab167fd61d/qa/tasks 2024-05-20T16:45:03.687 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-20T16:45:03.689 INFO:teuthology.task.internal:Checking packages... 2024-05-20T16:45:03.710 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd2b507c724ef6c8295ee0a35d185cdab167fd61d' 2024-05-20T16:45:03.710 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-20T16:45:03.710 INFO:teuthology.packaging:ref: None 2024-05-20T16:45:03.711 INFO:teuthology.packaging:tag: None 2024-05-20T16:45:03.711 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240517.203521-squid-debug 2024-05-20T16:45:03.711 INFO:teuthology.packaging:sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T16:45:03.711 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240517.203521-squid-debug 2024-05-20T16:45:03.940 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2744.gd2b507c7 2024-05-20T16:45:03.941 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-20T16:45:03.947 INFO:teuthology.task.internal:no buildpackages task found 2024-05-20T16:45:03.947 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-20T16:45:03.973 INFO:teuthology.task.internal:Saving configuration 2024-05-20T16:45:03.992 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-20T16:45:03.998 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-20T16:45:04.023 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715607', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-20 16:39:58.714494', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKG5V6hj9Kqq+cme+OmiRV5bxmLNXlVQucOxxNIyZ10xU6IMAm8hijNA0ERA5eeMUzdHqx+03EdbKt+jl2FnsZE='} 2024-05-20T16:45:04.046 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715607', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-20 16:39:58.715961', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKfsN5UCTZMvQuxOt+QTMBp7VI7Ufx8ELryyXY7tF/E6buVzl6tIXSPhaaIGlgHGplY3aZfa2Z75kJV2ZT7aeiY='} 2024-05-20T16:45:04.067 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715607', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-20 16:39:58.717180', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA2+TXMRjq/1TFxhkzSmm0vS3AXRG16d02UJILqIoGP+g8XQcFt8HmLZU4RqKZG+3U1dSRYnnUUe9lUH+i3B1q4='} 2024-05-20T16:45:04.067 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-20T16:45:04.073 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-05-20T16:45:04.073 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-05-20T16:45:04.073 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-05-20T16:45:04.073 INFO:teuthology.run_tasks:Running task console_log... 2024-05-20T16:45:04.165 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd969f6fac0>, signals=[15]) 2024-05-20T16:45:04.165 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-20T16:45:04.173 INFO:teuthology.task.internal:Opening connections... 2024-05-20T16:45:04.173 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T16:45:04.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T16:45:04.260 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2024-05-20T16:45:04.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T16:45:04.342 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T16:45:04.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T16:45:04.421 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-20T16:45:04.428 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2024-05-20T16:45:04.446 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2024-05-20T16:45:04.446 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-05-20T16:45:04.504 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2024-05-20T16:45:04.504 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2024-05-20T16:45:04.505 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2024-05-20T16:45:04.505 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2024-05-20T16:45:04.505 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2024-05-20T16:45:04.505 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2024-05-20T16:45:04.505 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-20T16:45:04.505 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2024-05-20T16:45:04.505 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2024-05-20T16:45:04.505 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-20T16:45:04.505 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2024-05-20T16:45:04.505 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-20T16:45:04.505 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-20T16:45:04.505 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-20T16:45:04.506 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-05-20T16:45:04.538 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-05-20T16:45:04.557 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-05-20T16:45:04.557 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-05-20T16:45:04.615 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2024-05-20T16:45:04.615 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9" 2024-05-20T16:45:04.615 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2024-05-20T16:45:04.615 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2024-05-20T16:45:04.615 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9" 2024-05-20T16:45:04.616 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9" 2024-05-20T16:45:04.616 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-20T16:45:04.616 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2024-05-20T16:45:04.616 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon" 2024-05-20T16:45:04.616 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-20T16:45:04.616 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2024-05-20T16:45:04.616 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-20T16:45:04.616 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-20T16:45:04.616 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-20T16:45:04.616 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-05-20T16:45:04.639 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2024-05-20T16:45:04.656 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2024-05-20T16:45:04.656 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-05-20T16:45:04.713 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream" 2024-05-20T16:45:04.714 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9" 2024-05-20T16:45:04.714 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos" 2024-05-20T16:45:04.714 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora" 2024-05-20T16:45:04.714 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9" 2024-05-20T16:45:04.714 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9" 2024-05-20T16:45:04.714 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-20T16:45:04.714 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2024-05-20T16:45:04.714 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon" 2024-05-20T16:45:04.714 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-20T16:45:04.714 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/" 2024-05-20T16:45:04.714 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-20T16:45:04.714 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-20T16:45:04.714 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-20T16:45:04.715 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-05-20T16:45:04.738 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-20T16:45:04.747 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-20T16:45:04.753 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-20T16:45:04.753 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2024-05-20T16:45:04.756 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2024-05-20T16:45:04.758 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2024-05-20T16:45:04.774 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-20T16:45:04.780 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-20T16:45:04.780 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2024-05-20T16:45:04.813 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2024-05-20T16:45:04.815 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2024-05-20T16:45:04.844 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-20T16:45:04.916 INFO:teuthology.run_tasks:Running task kernel... 2024-05-20T16:45:04.930 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-20T16:45:04.930 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-20T16:45:04.931 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-20T16:45:04.932 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-20T16:45:04.932 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-20T16:45:04.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T16:45:04.948 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-05-20T16:45:04.949 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T16:45:04.949 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T16:45:04.950 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2024-05-20T16:45:04.950 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-05-20T16:45:05.005 INFO:teuthology.orchestra.run.smithi171.stdout:5.14.0-437.el9.x86_64 2024-05-20T16:45:05.005 INFO:teuthology.task.kernel:Running kernel on smithi171: 5.14.0-437.el9.x86_64 2024-05-20T16:45:05.005 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum install -y kernel 2024-05-20T16:45:05.008 INFO:teuthology.orchestra.run.smithi062.stdout:5.14.0-437.el9.x86_64 2024-05-20T16:45:05.008 INFO:teuthology.task.kernel:Running kernel on smithi062: 5.14.0-437.el9.x86_64 2024-05-20T16:45:05.008 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum install -y kernel 2024-05-20T16:45:05.009 INFO:teuthology.orchestra.run.smithi006.stdout:5.14.0-437.el9.x86_64 2024-05-20T16:45:05.009 INFO:teuthology.task.kernel:Running kernel on smithi006: 5.14.0-437.el9.x86_64 2024-05-20T16:45:05.009 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum install -y kernel 2024-05-20T16:45:13.392 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - BaseOS 1.2 MB/s | 8.1 MB 00:06 2024-05-20T16:45:13.486 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - BaseOS 1.2 MB/s | 8.1 MB 00:06 2024-05-20T16:45:13.544 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 1.2 MB/s | 8.1 MB 00:06 2024-05-20T16:45:17.458 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 19 MB 00:03 2024-05-20T16:45:21.721 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 2.7 MB/s | 19 MB 00:07 2024-05-20T16:45:22.957 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - AppStream 2.3 MB/s | 19 MB 00:08 2024-05-20T16:45:29.140 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - CRB 776 kB/s | 6.2 MB 00:08 2024-05-20T16:45:30.758 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 16 kB 00:00 2024-05-20T16:45:32.584 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-05-20T16:45:33.595 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 775 kB/s | 6.2 MB 00:08 2024-05-20T16:45:34.811 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - CRB 781 kB/s | 6.2 MB 00:08 2024-05-20T16:45:35.080 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 16 kB 00:00 2024-05-20T16:45:36.298 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-05-20T16:45:36.313 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 16 kB 00:00 2024-05-20T16:45:37.685 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 49 kB/s | 1.7 kB 00:00 2024-05-20T16:45:39.507 INFO:teuthology.orchestra.run.smithi171.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-20T16:45:39.508 INFO:teuthology.orchestra.run.smithi171.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-20T16:45:39.607 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-05-20T16:45:39.624 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-05-20T16:45:39.624 INFO:teuthology.orchestra.run.smithi171.stdout: Package Architecture Version Repository Size 2024-05-20T16:45:39.624 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-05-20T16:45:39.624 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-05-20T16:45:39.625 INFO:teuthology.orchestra.run.smithi171.stdout: kernel x86_64 5.14.0-447.el9 baseos 576 k 2024-05-20T16:45:39.625 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-05-20T16:45:39.625 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-core x86_64 5.14.0-447.el9 baseos 16 M 2024-05-20T16:45:39.625 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules x86_64 5.14.0-447.el9 baseos 34 M 2024-05-20T16:45:39.625 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-core x86_64 5.14.0-447.el9 baseos 28 M 2024-05-20T16:45:39.625 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:45:39.625 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-05-20T16:45:39.625 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-05-20T16:45:39.625 INFO:teuthology.orchestra.run.smithi171.stdout:Install 4 Packages 2024-05-20T16:45:39.625 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:45:39.625 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 78 M 2024-05-20T16:45:39.625 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 123 M 2024-05-20T16:45:39.625 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-05-20T16:45:39.677 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:39.677 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:39.678 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:39.769 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:39.772 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:39.781 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:39.821 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:39.822 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:39.835 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:39.945 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:39.947 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:39.976 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:40.113 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:40.114 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:40.151 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:40.464 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:40.493 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:40.500 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:45:40.518 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:40.527 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:45:40.535 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:45:40.565 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:40.589 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:40.620 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:40.699 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:40.730 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:40.745 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:40.760 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:40.789 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:40.790 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:40.881 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:40.881 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:40.902 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:40.973 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 4.7 MB/s | 21 MB 00:04 2024-05-20T16:45:41.361 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:41.393 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:41.409 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:41.673 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-05-20T16:45:41.697 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:41.730 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:41.740 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:41.751 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:41.784 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:41.784 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:41.876 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:41.876 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:41.895 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:42.035 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:42.036 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:42.054 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:42.386 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:42.411 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:42.438 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:42.461 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:45:42.486 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:45:42.548 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:45:42.610 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:45:42.648 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:45:42.685 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:45:42.688 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:42.729 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:42.767 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:42.838 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:42.877 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:42.879 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:42.926 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:42.926 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:42.974 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:42.974 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:43.014 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:43.057 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:43.152 INFO:teuthology.orchestra.run.smithi171.stdout:(1/4): kernel-5.14.0-447.el9.x86_64.rpm 165 kB/s | 576 kB 00:03 2024-05-20T16:45:43.207 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:43.225 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:43.461 INFO:teuthology.orchestra.run.smithi171.stdout:(2/4): kernel-core-5.14.0-447.el9.x86_64.rpm 4.1 MB/s | 16 MB 00:03 2024-05-20T16:45:43.514 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:43.645 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-20T16:45:43.646 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-20T16:45:43.739 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-20T16:45:43.750 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-20T16:45:43.750 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-05-20T16:45:43.750 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-20T16:45:43.750 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-20T16:45:43.750 INFO:teuthology.orchestra.run.smithi062.stdout: kernel x86_64 5.14.0-447.el9 baseos 576 k 2024-05-20T16:45:43.750 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-05-20T16:45:43.750 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-core x86_64 5.14.0-447.el9 baseos 16 M 2024-05-20T16:45:43.751 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules x86_64 5.14.0-447.el9 baseos 34 M 2024-05-20T16:45:43.751 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-core x86_64 5.14.0-447.el9 baseos 28 M 2024-05-20T16:45:43.751 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:45:43.751 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-20T16:45:43.751 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-20T16:45:43.751 INFO:teuthology.orchestra.run.smithi062.stdout:Install 4 Packages 2024-05-20T16:45:43.751 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:45:43.751 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 78 M 2024-05-20T16:45:43.751 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 123 M 2024-05-20T16:45:43.751 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-20T16:45:43.844 INFO:teuthology.orchestra.run.smithi171.stdout:(3/4): kernel-modules-5.14.0-447.el9.x86_64.rpm 8.1 MB/s | 34 MB 00:04 2024-05-20T16:45:43.891 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:43.996 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:43.996 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:43.996 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:44.177 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:44.202 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:44.232 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:44.359 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:44.392 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:44.418 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:44.450 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:44.574 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:44.687 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:44.723 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:45:44.767 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:44.858 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:44.880 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:44.899 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:44.917 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:44.946 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:44.947 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:44.971 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:45.042 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:45.042 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:45.061 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:45.162 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:45:45.165 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:45:45.184 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:45:45.384 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T16:45:45.408 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T16:45:45.420 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:45:45.438 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T16:45:45.442 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:45:45.455 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:45:45.525 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:45.536 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:45.554 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:45.631 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:45.695 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:45.712 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:45.713 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:45.726 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:45.751 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:45.751 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:45.788 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:45.795 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:45.822 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:45.832 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:45.850 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:46.267 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:46.290 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-05-20T16:45:46.425 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:46.451 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:46.499 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:46.524 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:46.618 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:46.755 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:45:46.901 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:46.955 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:46.994 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:47.073 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:47.088 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:47.128 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:47.173 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:47.245 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:47.257 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:47.267 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:47.283 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:47.364 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:47.375 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:47.451 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:45:47.462 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:47.521 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:47.528 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:47.558 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:47.622 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:47.688 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:47.728 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:47.985 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:48.044 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:48.116 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:48.119 INFO:teuthology.orchestra.run.smithi171.stdout:(4/4): kernel-modules-core-5.14.0-447.el9.x86_6 5.6 MB/s | 28 MB 00:04 2024-05-20T16:45:48.126 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-05-20T16:45:48.126 INFO:teuthology.orchestra.run.smithi171.stdout:Total 9.2 MB/s | 78 MB 00:08 2024-05-20T16:45:48.145 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:48.186 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:48.220 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:48.230 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-20T16:45:48.230 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-20T16:45:48.317 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:48.321 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-05-20T16:45:48.330 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-05-20T16:45:48.330 INFO:teuthology.orchestra.run.smithi006.stdout: Package Architecture Version Repository Size 2024-05-20T16:45:48.330 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-05-20T16:45:48.330 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-05-20T16:45:48.330 INFO:teuthology.orchestra.run.smithi006.stdout: kernel x86_64 5.14.0-447.el9 baseos 576 k 2024-05-20T16:45:48.331 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2024-05-20T16:45:48.331 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-core x86_64 5.14.0-447.el9 baseos 16 M 2024-05-20T16:45:48.331 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-modules x86_64 5.14.0-447.el9 baseos 34 M 2024-05-20T16:45:48.331 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-modules-core x86_64 5.14.0-447.el9 baseos 28 M 2024-05-20T16:45:48.331 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:45:48.331 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-05-20T16:45:48.331 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-05-20T16:45:48.331 INFO:teuthology.orchestra.run.smithi006.stdout:Install 4 Packages 2024-05-20T16:45:48.331 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:45:48.331 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 78 M 2024-05-20T16:45:48.331 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 123 M 2024-05-20T16:45:48.331 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-05-20T16:45:48.365 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:48.413 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:48.545 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:45:48.545 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:45:48.546 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:45:48.548 INFO:teuthology.orchestra.run.smithi062.stdout:(1/4): kernel-5.14.0-447.el9.x86_64.rpm 124 kB/s | 576 kB 00:04 2024-05-20T16:45:48.692 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:48.745 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:48.747 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:48.748 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:48.784 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:48.805 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-05-20T16:45:49.143 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-05-20T16:45:49.143 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-05-20T16:45:49.179 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:49.205 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:49.207 INFO:teuthology.orchestra.run.smithi062.stdout:(2/4): kernel-core-5.14.0-447.el9.x86_64.rpm 2.9 MB/s | 16 MB 00:05 2024-05-20T16:45:49.234 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:49.264 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:49.294 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:49.337 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:49.425 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:49.446 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:49.482 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:49.500 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:49.501 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:49.502 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:49.541 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:49.577 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:49.597 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:49.607 INFO:teuthology.orchestra.run.smithi062.stdout:(3/4): kernel-modules-5.14.0-447.el9.x86_64.rpm 6.0 MB/s | 34 MB 00:05 2024-05-20T16:45:49.609 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:49.807 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:49.926 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:49.967 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:50.080 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-05-20T16:45:50.080 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-05-20T16:45:50.114 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:50.146 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T16:45:50.166 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:50.201 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:50.253 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:45:50.325 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:50.360 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:45:50.377 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:50.497 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:50.510 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:50.560 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:50.585 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:50.594 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T16:45:50.670 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T16:45:50.679 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T16:45:50.819 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:45:50.845 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:45:50.876 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:45:50.904 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:50.929 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:51.000 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:51.070 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:51.080 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:51.081 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:51.111 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:51.130 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:51.137 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:51.184 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:51.203 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:51.204 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:51.213 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:51.223 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:51.225 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:51.274 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:51.292 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:51.296 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:51.425 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:51.437 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:51.463 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:51.583 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:51.595 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:51.613 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:51.623 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:51.702 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:51.840 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:51.932 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:51.977 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:51.988 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:51.998 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:52.019 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:52.052 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:52.082 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:52.157 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:52.177 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:52.193 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:52.246 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:52.290 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:52.316 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:52.324 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:52.381 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:52.492 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:52.495 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-05-20T16:45:52.534 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:52.584 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:52.691 INFO:teuthology.orchestra.run.smithi006.stdout:(1/4): kernel-5.14.0-447.el9.x86_64.rpm 138 kB/s | 576 kB 00:04 2024-05-20T16:45:52.849 INFO:teuthology.orchestra.run.smithi062.stdout:(4/4): kernel-modules-core-5.14.0-447.el9.x86_6 6.5 MB/s | 28 MB 00:04 2024-05-20T16:45:52.854 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-20T16:45:52.854 INFO:teuthology.orchestra.run.smithi062.stdout:Total 8.6 MB/s | 78 MB 00:09 2024-05-20T16:45:52.958 INFO:teuthology.orchestra.run.smithi006.stdout:(2/4): kernel-core-5.14.0-447.el9.x86_64.rpm 3.5 MB/s | 16 MB 00:04 2024-05-20T16:45:52.962 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:52.999 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:45:53.325 INFO:teuthology.orchestra.run.smithi006.stdout:(3/4): kernel-modules-5.14.0-447.el9.x86_64.rpm 7.1 MB/s | 34 MB 00:04 2024-05-20T16:45:53.347 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-modules-core-5.14.0-447.el9.x86_64 1/4 2024-05-20T16:45:53.354 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:53.430 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-20T16:45:53.568 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-20T16:45:53.707 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:45:53.729 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:53.846 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:45:53.978 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-20T16:45:53.978 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-20T16:45:54.317 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:54.374 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:45:54.439 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T16:45:54.776 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:45:54.822 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:54.921 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-20T16:45:54.922 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-20T16:45:54.959 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:45:55.000 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:55.101 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:45:55.140 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:55.231 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:45:55.395 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:55.494 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:45:55.529 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:45:55.888 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T16:45:55.964 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:45:56.064 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-20T16:45:56.190 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-20T16:45:56.491 INFO:teuthology.orchestra.run.smithi006.stdout:(4/4): kernel-modules-core-5.14.0-447.el9.x86_6 7.4 MB/s | 28 MB 00:03 2024-05-20T16:45:56.497 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-05-20T16:45:56.497 INFO:teuthology.orchestra.run.smithi006.stdout:Total 9.6 MB/s | 78 MB 00:08 2024-05-20T16:45:57.208 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-05-20T16:45:57.496 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-20T16:45:57.603 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-05-20T16:45:57.604 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-05-20T16:45:58.133 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-modules-core-5.14.0-447.el9.x86_64 1/4 2024-05-20T16:45:58.215 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-20T16:45:58.588 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-05-20T16:45:58.588 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-05-20T16:46:00.915 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-20T16:46:00.960 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-5.14.0-447.el9.x86_64 4/4 2024-05-20T16:46:00.991 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-20T16:46:01.140 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-20T16:46:01.155 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-05-20T16:46:01.804 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-modules-core-5.14.0-447.el9.x86_64 1/4 2024-05-20T16:46:01.894 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-20T16:46:04.703 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-20T16:46:04.847 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-20T16:46:05.669 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-core-5.14.0-447.el9.x86_64 4/4 2024-05-20T16:46:06.221 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-20T16:46:06.269 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-5.14.0-447.el9.x86_64 4/4 2024-05-20T16:46:09.928 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-20T16:46:09.967 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-5.14.0-447.el9.x86_64 4/4 2024-05-20T16:46:11.370 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-core-5.14.0-447.el9.x86_64 4/4 2024-05-20T16:46:15.063 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-modules-core-5.14.0-447.el9.x86_64 4/4 2024-05-20T16:46:35.184 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-core-5.14.0-447.el9.x86_64 4/4 2024-05-20T16:46:35.232 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-5.14.0-447.el9.x86_64 4/4 2024-05-20T16:46:35.638 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-5.14.0-447.el9.x86_64 4/4 2024-05-20T16:46:35.638 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-5.14.0-447.el9.x86_64 1/4 2024-05-20T16:46:35.638 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-20T16:46:35.639 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-20T16:46:36.430 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-modules-core-5.14.0-447.el9.x86_64 4/4 2024-05-20T16:46:36.431 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:46:36.431 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-05-20T16:46:36.431 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-5.14.0-447.el9.x86_64 2024-05-20T16:46:36.431 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-core-5.14.0-447.el9.x86_64 2024-05-20T16:46:36.431 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-5.14.0-447.el9.x86_64 2024-05-20T16:46:36.431 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-core-5.14.0-447.el9.x86_64 2024-05-20T16:46:36.431 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:46:36.431 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-05-20T16:46:36.781 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q kernel | sort -rV | head -n 1 2024-05-20T16:46:36.856 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-5.14.0-447.el9.x86_64 2024-05-20T16:46:36.856 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-447.el9.x86_64 2024-05-20T16:46:36.857 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-447.el9.x86_64 2024-05-20T16:46:36.857 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-20T16:46:36.857 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-20T16:46:36.857 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-05-20T16:46:36.858 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi171.front.sepia.ceph.com, path=None, version=distro) 2024-05-20T16:46:36.858 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q kernel | sort -rV | head -n 1 2024-05-20T16:46:36.908 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-5.14.0-447.el9.x86_64 2024-05-20T16:46:36.908 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-447.el9.x86_64 2024-05-20T16:46:36.909 DEBUG:teuthology.orchestra.run.smithi171:> sudo rpm -qi grub2-tools 2024-05-20T16:46:36.946 INFO:teuthology.orchestra.run.smithi171.stdout:Name : grub2-tools 2024-05-20T16:46:36.946 INFO:teuthology.orchestra.run.smithi171.stdout:Epoch : 1 2024-05-20T16:46:36.946 INFO:teuthology.orchestra.run.smithi171.stdout:Version : 2.06 2024-05-20T16:46:36.947 INFO:teuthology.orchestra.run.smithi171.stdout:Release : 68.el9 2024-05-20T16:46:36.947 INFO:teuthology.orchestra.run.smithi171.stdout:Architecture: x86_64 2024-05-20T16:46:36.947 INFO:teuthology.orchestra.run.smithi171.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-20T16:46:36.947 INFO:teuthology.orchestra.run.smithi171.stdout:Group : Unspecified 2024-05-20T16:46:36.947 INFO:teuthology.orchestra.run.smithi171.stdout:Size : 8264254 2024-05-20T16:46:36.947 INFO:teuthology.orchestra.run.smithi171.stdout:License : GPLv3+ 2024-05-20T16:46:36.947 INFO:teuthology.orchestra.run.smithi171.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-20T16:46:36.947 INFO:teuthology.orchestra.run.smithi171.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-20T16:46:36.947 INFO:teuthology.orchestra.run.smithi171.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-20T16:46:36.947 INFO:teuthology.orchestra.run.smithi171.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-20T16:46:36.947 INFO:teuthology.orchestra.run.smithi171.stdout:Packager : builder@centos.org 2024-05-20T16:46:36.947 INFO:teuthology.orchestra.run.smithi171.stdout:Vendor : CentOS 2024-05-20T16:46:36.947 INFO:teuthology.orchestra.run.smithi171.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-20T16:46:36.947 INFO:teuthology.orchestra.run.smithi171.stdout:Summary : Support tools for GRUB. 2024-05-20T16:46:36.948 INFO:teuthology.orchestra.run.smithi171.stdout:Description : 2024-05-20T16:46:36.948 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:46:36.948 INFO:teuthology.orchestra.run.smithi171.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-20T16:46:36.948 INFO:teuthology.orchestra.run.smithi171.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-20T16:46:36.948 INFO:teuthology.orchestra.run.smithi171.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-20T16:46:36.948 INFO:teuthology.orchestra.run.smithi171.stdout:hardware devices. 2024-05-20T16:46:36.948 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:46:36.948 INFO:teuthology.orchestra.run.smithi171.stdout:This subpackage provides tools for support of all platforms. 2024-05-20T16:46:36.949 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-20T16:46:36.949 INFO:teuthology.task.kernel:Updating grub on smithi171 to boot 5.14.0-447.el9.x86_64 2024-05-20T16:46:36.949 DEBUG:teuthology.orchestra.run.smithi171:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-20T16:46:37.566 INFO:teuthology.orchestra.run.smithi171.stderr:Generating grub configuration file ... 2024-05-20T16:46:38.911 INFO:teuthology.orchestra.run.smithi171.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-20T16:46:38.942 INFO:teuthology.orchestra.run.smithi171.stderr:done 2024-05-20T16:46:38.944 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-05-20T16:46:38.959 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.KhfxFhJmoi 2024-05-20T16:46:38.959 DEBUG:teuthology.orchestra.run.smithi171:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.KhfxFhJmoi 2024-05-20T16:46:39.025 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.KhfxFhJmoi 2024-05-20T16:46:39.156 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.KhfxFhJmoi is 6KB 2024-05-20T16:46:39.205 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.KhfxFhJmoi 2024-05-20T16:46:39.220 DEBUG:teuthology.orchestra.run.smithi171:> sudo /bin/ls /boot/loader/entries || true 2024-05-20T16:46:39.286 INFO:teuthology.orchestra.run.smithi171.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-20T16:46:39.286 INFO:teuthology.orchestra.run.smithi171.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-20T16:46:39.286 INFO:teuthology.orchestra.run.smithi171.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-20T16:46:39.286 INFO:teuthology.orchestra.run.smithi171.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-447.el9.x86_64.conf 2024-05-20T16:46:39.287 DEBUG:teuthology.orchestra.run.smithi171:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-447.el9.x86_64 2024-05-20T16:46:39.447 DEBUG:teuthology.orchestra.run.smithi171:> sudo shutdown -r now 2024-05-20T16:46:42.417 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-core-5.14.0-447.el9.x86_64 4/4 2024-05-20T16:46:42.456 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-5.14.0-447.el9.x86_64 4/4 2024-05-20T16:46:42.848 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-5.14.0-447.el9.x86_64 4/4 2024-05-20T16:46:42.848 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-5.14.0-447.el9.x86_64 1/4 2024-05-20T16:46:42.849 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-20T16:46:42.849 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-20T16:46:43.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-modules-core-5.14.0-447.el9.x86_64 4/4 2024-05-20T16:46:43.662 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:46:43.662 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-20T16:46:43.662 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-5.14.0-447.el9.x86_64 2024-05-20T16:46:43.662 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-core-5.14.0-447.el9.x86_64 2024-05-20T16:46:43.662 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-5.14.0-447.el9.x86_64 2024-05-20T16:46:43.662 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-core-5.14.0-447.el9.x86_64 2024-05-20T16:46:43.662 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:46:43.662 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-20T16:46:44.018 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel | sort -rV | head -n 1 2024-05-20T16:46:44.087 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-5.14.0-447.el9.x86_64 2024-05-20T16:46:44.088 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-447.el9.x86_64 2024-05-20T16:46:44.088 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-447.el9.x86_64 2024-05-20T16:46:44.088 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-20T16:46:44.089 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-20T16:46:44.089 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-20T16:46:44.089 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi062.front.sepia.ceph.com, path=None, version=distro) 2024-05-20T16:46:44.089 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel | sort -rV | head -n 1 2024-05-20T16:46:44.140 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-5.14.0-447.el9.x86_64 2024-05-20T16:46:44.141 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-447.el9.x86_64 2024-05-20T16:46:44.141 DEBUG:teuthology.orchestra.run.smithi062:> sudo rpm -qi grub2-tools 2024-05-20T16:46:44.181 INFO:teuthology.orchestra.run.smithi062.stdout:Name : grub2-tools 2024-05-20T16:46:44.181 INFO:teuthology.orchestra.run.smithi062.stdout:Epoch : 1 2024-05-20T16:46:44.181 INFO:teuthology.orchestra.run.smithi062.stdout:Version : 2.06 2024-05-20T16:46:44.181 INFO:teuthology.orchestra.run.smithi062.stdout:Release : 68.el9 2024-05-20T16:46:44.181 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: x86_64 2024-05-20T16:46:44.181 INFO:teuthology.orchestra.run.smithi062.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-20T16:46:44.181 INFO:teuthology.orchestra.run.smithi062.stdout:Group : Unspecified 2024-05-20T16:46:44.181 INFO:teuthology.orchestra.run.smithi062.stdout:Size : 8264254 2024-05-20T16:46:44.181 INFO:teuthology.orchestra.run.smithi062.stdout:License : GPLv3+ 2024-05-20T16:46:44.181 INFO:teuthology.orchestra.run.smithi062.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-20T16:46:44.181 INFO:teuthology.orchestra.run.smithi062.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-20T16:46:44.181 INFO:teuthology.orchestra.run.smithi062.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-20T16:46:44.181 INFO:teuthology.orchestra.run.smithi062.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-20T16:46:44.182 INFO:teuthology.orchestra.run.smithi062.stdout:Packager : builder@centos.org 2024-05-20T16:46:44.182 INFO:teuthology.orchestra.run.smithi062.stdout:Vendor : CentOS 2024-05-20T16:46:44.182 INFO:teuthology.orchestra.run.smithi062.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-20T16:46:44.182 INFO:teuthology.orchestra.run.smithi062.stdout:Summary : Support tools for GRUB. 2024-05-20T16:46:44.182 INFO:teuthology.orchestra.run.smithi062.stdout:Description : 2024-05-20T16:46:44.182 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:46:44.182 INFO:teuthology.orchestra.run.smithi062.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-20T16:46:44.183 INFO:teuthology.orchestra.run.smithi062.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-20T16:46:44.183 INFO:teuthology.orchestra.run.smithi062.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-20T16:46:44.183 INFO:teuthology.orchestra.run.smithi062.stdout:hardware devices. 2024-05-20T16:46:44.183 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:46:44.183 INFO:teuthology.orchestra.run.smithi062.stdout:This subpackage provides tools for support of all platforms. 2024-05-20T16:46:44.184 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-20T16:46:44.184 INFO:teuthology.task.kernel:Updating grub on smithi062 to boot 5.14.0-447.el9.x86_64 2024-05-20T16:46:44.184 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-20T16:46:44.766 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2024-05-20T16:46:46.003 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-core-5.14.0-447.el9.x86_64 4/4 2024-05-20T16:46:46.043 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-modules-5.14.0-447.el9.x86_64 4/4 2024-05-20T16:46:46.271 INFO:teuthology.orchestra.run.smithi062.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-20T16:46:46.289 INFO:teuthology.orchestra.run.smithi062.stderr:done 2024-05-20T16:46:46.291 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-05-20T16:46:46.306 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.mGsuu4epGp 2024-05-20T16:46:46.306 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.mGsuu4epGp 2024-05-20T16:46:46.372 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.mGsuu4epGp 2024-05-20T16:46:46.515 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.mGsuu4epGp is 6KB 2024-05-20T16:46:46.538 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-5.14.0-447.el9.x86_64 4/4 2024-05-20T16:46:46.538 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-5.14.0-447.el9.x86_64 1/4 2024-05-20T16:46:46.539 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-20T16:46:46.539 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-20T16:46:46.564 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.mGsuu4epGp 2024-05-20T16:46:46.578 DEBUG:teuthology.orchestra.run.smithi062:> sudo /bin/ls /boot/loader/entries || true 2024-05-20T16:46:46.640 INFO:teuthology.orchestra.run.smithi062.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-20T16:46:46.641 INFO:teuthology.orchestra.run.smithi062.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-20T16:46:46.641 INFO:teuthology.orchestra.run.smithi062.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-20T16:46:46.641 INFO:teuthology.orchestra.run.smithi062.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-447.el9.x86_64.conf 2024-05-20T16:46:46.642 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-447.el9.x86_64 2024-05-20T16:46:46.773 DEBUG:teuthology.orchestra.run.smithi062:> sudo shutdown -r now 2024-05-20T16:46:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-modules-core-5.14.0-447.el9.x86_64 4/4 2024-05-20T16:46:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:46:47.377 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-05-20T16:46:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-5.14.0-447.el9.x86_64 2024-05-20T16:46:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-core-5.14.0-447.el9.x86_64 2024-05-20T16:46:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-modules-5.14.0-447.el9.x86_64 2024-05-20T16:46:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-modules-core-5.14.0-447.el9.x86_64 2024-05-20T16:46:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:46:47.377 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-05-20T16:46:47.723 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel | sort -rV | head -n 1 2024-05-20T16:46:47.807 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-5.14.0-447.el9.x86_64 2024-05-20T16:46:47.807 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-447.el9.x86_64 2024-05-20T16:46:47.807 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-447.el9.x86_64 2024-05-20T16:46:47.807 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-20T16:46:47.807 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-20T16:46:47.807 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-20T16:46:47.808 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi006.front.sepia.ceph.com, path=None, version=distro) 2024-05-20T16:46:47.808 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel | sort -rV | head -n 1 2024-05-20T16:46:47.859 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-5.14.0-447.el9.x86_64 2024-05-20T16:46:47.859 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-447.el9.x86_64 2024-05-20T16:46:47.860 DEBUG:teuthology.orchestra.run.smithi006:> sudo rpm -qi grub2-tools 2024-05-20T16:46:47.900 INFO:teuthology.orchestra.run.smithi006.stdout:Name : grub2-tools 2024-05-20T16:46:47.900 INFO:teuthology.orchestra.run.smithi006.stdout:Epoch : 1 2024-05-20T16:46:47.900 INFO:teuthology.orchestra.run.smithi006.stdout:Version : 2.06 2024-05-20T16:46:47.900 INFO:teuthology.orchestra.run.smithi006.stdout:Release : 68.el9 2024-05-20T16:46:47.901 INFO:teuthology.orchestra.run.smithi006.stdout:Architecture: x86_64 2024-05-20T16:46:47.901 INFO:teuthology.orchestra.run.smithi006.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-20T16:46:47.901 INFO:teuthology.orchestra.run.smithi006.stdout:Group : Unspecified 2024-05-20T16:46:47.901 INFO:teuthology.orchestra.run.smithi006.stdout:Size : 8264254 2024-05-20T16:46:47.901 INFO:teuthology.orchestra.run.smithi006.stdout:License : GPLv3+ 2024-05-20T16:46:47.901 INFO:teuthology.orchestra.run.smithi006.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-20T16:46:47.901 INFO:teuthology.orchestra.run.smithi006.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-20T16:46:47.901 INFO:teuthology.orchestra.run.smithi006.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-20T16:46:47.901 INFO:teuthology.orchestra.run.smithi006.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-20T16:46:47.901 INFO:teuthology.orchestra.run.smithi006.stdout:Packager : builder@centos.org 2024-05-20T16:46:47.901 INFO:teuthology.orchestra.run.smithi006.stdout:Vendor : CentOS 2024-05-20T16:46:47.901 INFO:teuthology.orchestra.run.smithi006.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-20T16:46:47.901 INFO:teuthology.orchestra.run.smithi006.stdout:Summary : Support tools for GRUB. 2024-05-20T16:46:47.902 INFO:teuthology.orchestra.run.smithi006.stdout:Description : 2024-05-20T16:46:47.902 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:46:47.902 INFO:teuthology.orchestra.run.smithi006.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-20T16:46:47.902 INFO:teuthology.orchestra.run.smithi006.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-20T16:46:47.902 INFO:teuthology.orchestra.run.smithi006.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-20T16:46:47.902 INFO:teuthology.orchestra.run.smithi006.stdout:hardware devices. 2024-05-20T16:46:47.902 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:46:47.902 INFO:teuthology.orchestra.run.smithi006.stdout:This subpackage provides tools for support of all platforms. 2024-05-20T16:46:47.903 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-20T16:46:47.903 INFO:teuthology.task.kernel:Updating grub on smithi006 to boot 5.14.0-447.el9.x86_64 2024-05-20T16:46:47.903 DEBUG:teuthology.orchestra.run.smithi006:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-20T16:46:48.532 INFO:teuthology.orchestra.run.smithi006.stderr:Generating grub configuration file ... 2024-05-20T16:46:49.945 INFO:teuthology.orchestra.run.smithi006.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-20T16:46:49.964 INFO:teuthology.orchestra.run.smithi006.stderr:done 2024-05-20T16:46:49.967 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2024-05-20T16:46:49.982 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.SDif8a91II 2024-05-20T16:46:49.982 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SDif8a91II 2024-05-20T16:46:50.048 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.SDif8a91II 2024-05-20T16:46:50.184 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.SDif8a91II is 6KB 2024-05-20T16:46:50.232 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.SDif8a91II 2024-05-20T16:46:50.247 DEBUG:teuthology.orchestra.run.smithi006:> sudo /bin/ls /boot/loader/entries || true 2024-05-20T16:46:50.312 INFO:teuthology.orchestra.run.smithi006.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-20T16:46:50.313 INFO:teuthology.orchestra.run.smithi006.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-20T16:46:50.313 INFO:teuthology.orchestra.run.smithi006.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-20T16:46:50.313 INFO:teuthology.orchestra.run.smithi006.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-447.el9.x86_64.conf 2024-05-20T16:46:50.314 DEBUG:teuthology.orchestra.run.smithi006:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-447.el9.x86_64 2024-05-20T16:46:50.466 DEBUG:teuthology.orchestra.run.smithi006:> sudo shutdown -r now 2024-05-20T16:47:09.466 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-05-20T16:47:09.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-05-20T16:47:09.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T16:47:16.782 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-20T16:47:16.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-20T16:47:16.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T16:47:20.473 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-20T16:47:20.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-05-20T16:47:20.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T16:47:28.030 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-05-20T16:47:35.202 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-05-20T16:47:37.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-05-20T16:47:37.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T16:47:40.094 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-05-20T16:47:44.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-20T16:47:44.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T16:47:47.262 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-05-20T16:47:52.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-05-20T16:47:52.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T16:47:59.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-20T16:47:59.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T16:48:10.526 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-05-20T16:48:17.694 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-05-20T16:48:20.480 DEBUG:teuthology.orchestra.remote:timed out 2024-05-20T16:48:25.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-05-20T16:48:25.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T16:48:25.934 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-05-20T16:48:26.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-05-20T16:48:26.620 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-447.el9.x86_64"... 2024-05-20T16:48:26.620 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-05-20T16:48:26.635 INFO:teuthology.orchestra.run.smithi171.stdout:5.14.0-447.el9.x86_64 2024-05-20T16:48:26.635 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-447.el9.x86_64 vs 5.14.0-447.el9.x86_64 2024-05-20T16:48:26.635 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-20T16:48:26.635 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-20T16:48:27.636 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-05-20T16:48:27.637 DEBUG:teuthology.orchestra.run.smithi171:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-20T16:48:27.721 INFO:teuthology.orchestra.run.smithi171.stdout:ttyS1 2024-05-20T16:48:27.768 DEBUG:teuthology.parallel:result is None 2024-05-20T16:48:29.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-05-20T16:48:29.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T16:48:29.770 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-05-20T16:48:30.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-05-20T16:48:30.186 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-447.el9.x86_64"... 2024-05-20T16:48:30.186 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2024-05-20T16:48:30.201 INFO:teuthology.orchestra.run.smithi006.stdout:5.14.0-447.el9.x86_64 2024-05-20T16:48:30.202 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-447.el9.x86_64 vs 5.14.0-447.el9.x86_64 2024-05-20T16:48:30.202 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-20T16:48:30.202 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-20T16:48:31.202 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-20T16:48:31.203 DEBUG:teuthology.orchestra.run.smithi006:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-20T16:48:31.294 INFO:teuthology.orchestra.run.smithi006.stdout:ttyS1 2024-05-20T16:48:31.340 DEBUG:teuthology.parallel:result is None 2024-05-20T16:48:32.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-20T16:48:32.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T16:48:33.120 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-05-20T16:48:33.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-20T16:48:33.524 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-447.el9.x86_64"... 2024-05-20T16:48:33.524 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-05-20T16:48:33.583 INFO:teuthology.orchestra.run.smithi062.stdout:5.14.0-447.el9.x86_64 2024-05-20T16:48:33.583 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-447.el9.x86_64 vs 5.14.0-447.el9.x86_64 2024-05-20T16:48:33.583 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-20T16:48:33.583 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-20T16:48:34.585 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-20T16:48:34.585 DEBUG:teuthology.orchestra.run.smithi062:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-20T16:48:34.686 INFO:teuthology.orchestra.run.smithi062.stdout:ttyS1 2024-05-20T16:48:34.722 DEBUG:teuthology.parallel:result is None 2024-05-20T16:48:34.722 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-20T16:48:34.734 INFO:teuthology.task.internal:Creating test directory... 2024-05-20T16:48:34.734 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-20T16:48:34.737 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-20T16:48:34.740 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-20T16:48:34.760 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-20T16:48:34.772 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-20T16:48:34.788 INFO:teuthology.task.internal:Creating archive directory... 2024-05-20T16:48:34.788 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-20T16:48:34.794 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-20T16:48:34.803 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-20T16:48:34.853 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-20T16:48:34.865 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-20T16:48:34.865 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-20T16:48:34.868 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-20T16:48:34.870 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-20T16:48:34.900 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-20T16:48:34.901 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-20T16:48:34.911 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-20T16:48:34.912 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-20T16:48:34.994 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-20T16:48:35.013 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-20T16:48:35.015 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-20T16:48:35.026 INFO:teuthology.task.internal:Configuring sudo... 2024-05-20T16:48:35.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-20T16:48:35.028 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-20T16:48:35.031 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-20T16:48:35.077 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-20T16:48:35.088 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-20T16:48:35.088 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-20T16:48:35.094 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-20T16:48:35.096 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-20T16:48:35.121 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-20T16:48:35.189 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-20T16:48:35.239 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-20T16:48:35.318 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-20T16:48:35.362 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T16:48:35.363 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-20T16:48:35.428 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-20T16:48:35.488 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-20T16:48:35.563 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-20T16:48:35.617 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-20T16:48:35.663 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-20T16:48:35.663 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-20T16:48:35.730 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-20T16:48:35.774 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-20T16:48:35.831 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-20T16:48:35.919 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-20T16:48:35.960 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T16:48:35.960 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-20T16:48:36.027 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2024-05-20T16:48:36.030 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2024-05-20T16:48:36.033 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart 2024-05-20T16:48:36.076 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-20T16:48:36.109 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-20T16:48:36.126 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-20T16:48:36.594 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-20T16:48:36.603 INFO:teuthology.task.internal:Starting timer... 2024-05-20T16:48:36.603 INFO:teuthology.run_tasks:Running task pcp... 2024-05-20T16:48:36.619 INFO:teuthology.run_tasks:Running task selinux... 2024-05-20T16:48:36.633 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-20T16:48:36.633 DEBUG:teuthology.orchestra.run.smithi006:> sudo service auditd rotate 2024-05-20T16:48:36.724 INFO:teuthology.orchestra.run.smithi006.stdout:Rotating logs: 2024-05-20T16:48:36.726 DEBUG:teuthology.orchestra.run.smithi062:> sudo service auditd rotate 2024-05-20T16:48:36.784 INFO:teuthology.orchestra.run.smithi062.stdout:Rotating logs: 2024-05-20T16:48:36.786 DEBUG:teuthology.orchestra.run.smithi171:> sudo service auditd rotate 2024-05-20T16:48:36.862 INFO:teuthology.orchestra.run.smithi171.stdout:Rotating logs: 2024-05-20T16:48:36.864 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-20T16:48:36.864 DEBUG:teuthology.orchestra.run.smithi006:> /usr/sbin/getenforce 2024-05-20T16:48:36.896 INFO:teuthology.orchestra.run.smithi006.stdout:Permissive 2024-05-20T16:48:36.896 DEBUG:teuthology.orchestra.run.smithi062:> /usr/sbin/getenforce 2024-05-20T16:48:36.919 INFO:teuthology.orchestra.run.smithi062.stdout:Permissive 2024-05-20T16:48:36.919 DEBUG:teuthology.orchestra.run.smithi171:> /usr/sbin/getenforce 2024-05-20T16:48:36.941 INFO:teuthology.orchestra.run.smithi171.stdout:Permissive 2024-05-20T16:48:36.941 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi006.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi062.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi171.front.sepia.ceph.com': 'permissive'} 2024-05-20T16:48:36.941 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-20T16:48:36.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T16:48:36.971 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-20T16:48:36.996 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T16:48:36.997 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-20T16:48:37.025 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T16:48:37.026 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-20T16:48:37.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo /usr/sbin/setenforce permissive 2024-05-20T16:48:37.054 DEBUG:teuthology.orchestra.run.smithi062:> sudo /usr/sbin/setenforce permissive 2024-05-20T16:48:37.079 DEBUG:teuthology.orchestra.run.smithi171:> sudo /usr/sbin/setenforce permissive 2024-05-20T16:48:37.109 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-20T16:48:37.125 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-20T16:48:37.128 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-20T16:48:37.257 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-20T16:48:37.269 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-20T16:48:37.270 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi062.front.sepia.ceph.com,smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-20T16:53:07.552 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi062.front.sepia.ceph.com'), Remote(name='ubuntu@smithi171.front.sepia.ceph.com')] 2024-05-20T16:53:07.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-05-20T16:53:07.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T16:53:07.633 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-05-20T16:53:07.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-05-20T16:53:07.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-20T16:53:07.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T16:53:07.793 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-05-20T16:53:07.879 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-20T16:53:07.879 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-05-20T16:53:07.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T16:53:07.961 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-05-20T16:53:08.042 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-05-20T16:53:08.043 INFO:teuthology.run_tasks:Running task clock... 2024-05-20T16:53:08.053 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-20T16:53:08.053 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-20T16:53:08.053 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-20T16:53:08.056 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-20T16:53:08.056 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-20T16:53:08.058 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-20T16:53:08.058 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-20T16:53:08.086 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-20T16:53:08.088 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-20T16:53:08.101 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-20T16:53:08.104 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-20T16:53:08.112 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-20T16:53:08.126 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-20T16:53:08.127 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: ntpd: command not found 2024-05-20T16:53:08.131 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: ntpd: command not found 2024-05-20T16:53:08.139 INFO:teuthology.orchestra.run.smithi006.stdout:506 Cannot talk to daemon 2024-05-20T16:53:08.142 INFO:teuthology.orchestra.run.smithi062.stdout:506 Cannot talk to daemon 2024-05-20T16:53:08.149 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: ntpd: command not found 2024-05-20T16:53:08.154 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-20T16:53:08.157 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-20T16:53:08.160 INFO:teuthology.orchestra.run.smithi171.stdout:506 Cannot talk to daemon 2024-05-20T16:53:08.169 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-20T16:53:08.172 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-20T16:53:08.174 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-20T16:53:08.188 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-20T16:53:08.226 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-05-20T16:53:08.230 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-20T16:53:08.230 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-05-20T16:53:08.230 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T16:53:08.230 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T16:53:08.230 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T16:53:08.230 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T16:53:08.230 INFO:teuthology.orchestra.run.smithi006.stderr:bash: line 1: ntpq: command not found 2024-05-20T16:53:08.233 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-20T16:53:08.233 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2024-05-20T16:53:08.234 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T16:53:08.234 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T16:53:08.234 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T16:53:08.234 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T16:53:08.243 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-05-20T16:53:08.246 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-20T16:53:08.246 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-05-20T16:53:08.246 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T16:53:08.246 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T16:53:08.246 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T16:53:08.246 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T16:53:08.247 INFO:teuthology.run_tasks:Running task install... 2024-05-20T16:53:08.255 DEBUG:teuthology.task.install:project ceph 2024-05-20T16:53:08.256 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d'}} 2024-05-20T16:53:08.256 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d'} 2024-05-20T16:53:08.256 INFO:teuthology.task.install:Using flavor: default 2024-05-20T16:53:08.261 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-20T16:53:08.261 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-20T16:53:08.262 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d', 'tag': None, 'wait_for_package': False} 2024-05-20T16:53:08.262 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T16:53:08.264 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d', 'tag': None, 'wait_for_package': False} 2024-05-20T16:53:08.264 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T16:53:08.265 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d', 'tag': None, 'wait_for_package': False} 2024-05-20T16:53:08.266 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T16:53:08.418 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/ 2024-05-20T16:53:08.418 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2744.gd2b507c7 2024-05-20T16:53:08.478 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/ 2024-05-20T16:53:08.478 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2744.gd2b507c7 2024-05-20T16:53:08.490 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/ 2024-05-20T16:53:08.490 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2744.gd2b507c7 2024-05-20T16:53:08.738 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-20T16:53:08.739 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T16:53:08.739 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-20T16:53:08.765 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-20T16:53:08.765 DEBUG:teuthology.orchestra.run.smithi171:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2b507c724ef6c8295ee0a35d185cdab167fd61d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-20T16:53:08.798 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-20T16:53:08.798 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T16:53:08.799 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-20T16:53:08.814 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-20T16:53:08.814 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-20T16:53:08.814 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-20T16:53:08.827 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-20T16:53:08.827 DEBUG:teuthology.orchestra.run.smithi006:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2b507c724ef6c8295ee0a35d185cdab167fd61d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-20T16:53:08.831 DEBUG:teuthology.orchestra.run.smithi171:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-20T16:53:08.847 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-20T16:53:08.847 DEBUG:teuthology.orchestra.run.smithi062:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2b507c724ef6c8295ee0a35d185cdab167fd61d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-20T16:53:08.894 DEBUG:teuthology.orchestra.run.smithi006:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-20T16:53:08.906 DEBUG:teuthology.orchestra.run.smithi171:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-20T16:53:08.919 DEBUG:teuthology.orchestra.run.smithi062:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-20T16:53:08.970 INFO:teuthology.orchestra.run.smithi171.stdout:check_obsoletes = 1 2024-05-20T16:53:08.971 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum clean all 2024-05-20T16:53:08.973 DEBUG:teuthology.orchestra.run.smithi006:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-20T16:53:08.998 DEBUG:teuthology.orchestra.run.smithi062:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-20T16:53:09.042 INFO:teuthology.orchestra.run.smithi006.stdout:check_obsoletes = 1 2024-05-20T16:53:09.044 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum clean all 2024-05-20T16:53:09.066 INFO:teuthology.orchestra.run.smithi062.stdout:check_obsoletes = 1 2024-05-20T16:53:09.067 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum clean all 2024-05-20T16:53:09.210 INFO:teuthology.orchestra.run.smithi171.stdout:45 files removed 2024-05-20T16:53:09.237 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-20T16:53:09.284 INFO:teuthology.orchestra.run.smithi006.stdout:45 files removed 2024-05-20T16:53:09.307 INFO:teuthology.orchestra.run.smithi062.stdout:45 files removed 2024-05-20T16:53:09.311 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-20T16:53:09.334 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-20T16:53:09.972 INFO:teuthology.orchestra.run.smithi171.stdout:ceph packages for x86_64 181 kB/s | 83 kB 00:00 2024-05-20T16:53:10.045 INFO:teuthology.orchestra.run.smithi062.stdout:ceph packages for x86_64 198 kB/s | 83 kB 00:00 2024-05-20T16:53:10.069 INFO:teuthology.orchestra.run.smithi006.stdout:ceph packages for x86_64 177 kB/s | 83 kB 00:00 2024-05-20T16:53:10.364 INFO:teuthology.orchestra.run.smithi171.stdout:ceph noarch packages 34 kB/s | 11 kB 00:00 2024-05-20T16:53:10.411 INFO:teuthology.orchestra.run.smithi006.stdout:ceph noarch packages 40 kB/s | 11 kB 00:00 2024-05-20T16:53:10.421 INFO:teuthology.orchestra.run.smithi062.stdout:ceph noarch packages 36 kB/s | 11 kB 00:00 2024-05-20T16:53:10.723 INFO:teuthology.orchestra.run.smithi171.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2024-05-20T16:53:10.795 INFO:teuthology.orchestra.run.smithi006.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2024-05-20T16:53:10.846 INFO:teuthology.orchestra.run.smithi062.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-05-20T16:53:17.214 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - BaseOS 1.3 MB/s | 8.1 MB 00:06 2024-05-20T16:53:17.764 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 1.2 MB/s | 8.1 MB 00:06 2024-05-20T16:53:17.779 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - BaseOS 1.2 MB/s | 8.1 MB 00:06 2024-05-20T16:53:24.935 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - AppStream 2.9 MB/s | 19 MB 00:06 2024-05-20T16:53:25.175 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 3.0 MB/s | 19 MB 00:06 2024-05-20T16:53:25.182 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - AppStream 3.0 MB/s | 19 MB 00:06 2024-05-20T16:53:35.364 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 972 kB/s | 6.2 MB 00:06 2024-05-20T16:53:35.593 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - CRB 893 kB/s | 6.2 MB 00:07 2024-05-20T16:53:35.762 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - CRB 918 kB/s | 6.2 MB 00:06 2024-05-20T16:53:37.032 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 16 kB 00:00 2024-05-20T16:53:37.349 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 16 kB 00:00 2024-05-20T16:53:38.045 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 16 kB 00:01 2024-05-20T16:53:38.442 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-05-20T16:53:39.238 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 20 MB/s | 21 MB 00:01 2024-05-20T16:53:43.759 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-05-20T16:53:44.463 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-20T16:53:44.836 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 2.9 MB/s | 21 MB 00:07 2024-05-20T16:53:46.003 INFO:teuthology.orchestra.run.smithi062.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-20T16:53:46.003 INFO:teuthology.orchestra.run.smithi062.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-20T16:53:46.014 INFO:teuthology.orchestra.run.smithi062.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-20T16:53:46.015 INFO:teuthology.orchestra.run.smithi062.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-20T16:53:46.016 INFO:teuthology.orchestra.run.smithi062.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-20T16:53:46.017 INFO:teuthology.orchestra.run.smithi062.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-20T16:53:46.018 INFO:teuthology.orchestra.run.smithi062.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-20T16:53:46.021 INFO:teuthology.orchestra.run.smithi062.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-20T16:53:46.022 INFO:teuthology.orchestra.run.smithi062.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-20T16:53:46.088 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-20T16:53:46.114 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-05-20T16:53:46.115 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-05-20T16:53:46.115 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-05-20T16:53:46.115 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-20T16:53:46.115 INFO:teuthology.orchestra.run.smithi062.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-20T16:53:46.115 INFO:teuthology.orchestra.run.smithi062.stdout: ceph x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 6.6 k 2024-05-20T16:53:46.115 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 5.4 M 2024-05-20T16:53:46.115 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 863 k 2024-05-20T16:53:46.115 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 147 k 2024-05-20T16:53:46.115 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 1.5 M 2024-05-20T16:53:46.116 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 142 k 2024-05-20T16:53:46.116 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 3.5 M 2024-05-20T16:53:46.116 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 7.4 M 2024-05-20T16:53:46.116 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 49 k 2024-05-20T16:53:46.116 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 9.8 M 2024-05-20T16:53:46.116 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 46 M 2024-05-20T16:53:46.116 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 264 k 2024-05-20T16:53:46.116 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 763 k 2024-05-20T16:53:46.116 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 221 k 2024-05-20T16:53:46.117 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-shell x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 27 k 2024-05-20T16:53:46.117 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-top noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 18 k 2024-05-20T16:53:46.117 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-05-20T16:53:46.117 INFO:teuthology.orchestra.run.smithi062.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-20T16:53:46.117 INFO:teuthology.orchestra.run.smithi062.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-20T16:53:46.117 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 32 k 2024-05-20T16:53:46.118 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 756 k 2024-05-20T16:53:46.118 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 127 k 2024-05-20T16:53:46.118 INFO:teuthology.orchestra.run.smithi062.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-20T16:53:46.118 INFO:teuthology.orchestra.run.smithi062.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-20T16:53:46.118 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-20T16:53:46.118 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-20T16:53:46.118 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-20T16:53:46.118 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-20T16:53:46.118 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 161 k 2024-05-20T16:53:46.118 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 320 k 2024-05-20T16:53:46.119 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 299 k 2024-05-20T16:53:46.119 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 99 k 2024-05-20T16:53:46.119 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 86 k 2024-05-20T16:53:46.119 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.0 M 2024-05-20T16:53:46.119 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 169 k 2024-05-20T16:53:46.119 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-20T16:53:46.119 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrading: 2024-05-20T16:53:46.119 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-20T16:53:46.119 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-20T16:53:46.119 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-20T16:53:46.120 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-20T16:53:46.120 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-05-20T16:53:46.120 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-05-20T16:53:46.120 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-05-20T16:53:46.120 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.3 M 2024-05-20T16:53:46.120 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.1 M 2024-05-20T16:53:46.120 INFO:teuthology.orchestra.run.smithi062.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-20T16:53:46.120 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-20T16:53:46.120 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-05-20T16:53:46.120 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-20T16:53:46.120 INFO:teuthology.orchestra.run.smithi062.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-20T16:53:46.121 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-20T16:53:46.121 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 19 M 2024-05-20T16:53:46.121 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 32 k 2024-05-20T16:53:46.121 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 2.3 M 2024-05-20T16:53:46.121 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 249 k 2024-05-20T16:53:46.121 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 4.9 M 2024-05-20T16:53:46.121 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 18 M 2024-05-20T16:53:46.121 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 16 k 2024-05-20T16:53:46.121 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 25 k 2024-05-20T16:53:46.121 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-20T16:53:46.121 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-20T16:53:46.121 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-20T16:53:46.121 INFO:teuthology.orchestra.run.smithi062.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-20T16:53:46.122 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-20T16:53:46.122 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-20T16:53:46.122 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-20T16:53:46.122 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-20T16:53:46.122 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 158 k 2024-05-20T16:53:46.122 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-20T16:53:46.122 INFO:teuthology.orchestra.run.smithi062.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-20T16:53:46.122 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-20T16:53:46.122 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-20T16:53:46.122 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-20T16:53:46.122 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 497 k 2024-05-20T16:53:46.123 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-20T16:53:46.123 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 5.0 M 2024-05-20T16:53:46.123 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-20T16:53:46.123 INFO:teuthology.orchestra.run.smithi062.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-20T16:53:46.123 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-20T16:53:46.123 INFO:teuthology.orchestra.run.smithi062.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-20T16:53:46.123 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-20T16:53:46.123 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-20T16:53:46.123 INFO:teuthology.orchestra.run.smithi062.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-20T16:53:46.123 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-20T16:53:46.123 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-20T16:53:46.123 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-20T16:53:46.124 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-20T16:53:46.124 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-20T16:53:46.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-20T16:53:46.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-20T16:53:46.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-20T16:53:46.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-20T16:53:46.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-20T16:53:46.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 45 k 2024-05-20T16:53:46.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 135 k 2024-05-20T16:53:46.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-20T16:53:46.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-20T16:53:46.124 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-20T16:53:46.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-20T16:53:46.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-20T16:53:46.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-05-20T16:53:46.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-20T16:53:46.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-20T16:53:46.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-20T16:53:46.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-20T16:53:46.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-20T16:53:46.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-20T16:53:46.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-20T16:53:46.126 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-20T16:53:46.126 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-20T16:53:46.126 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-20T16:53:46.126 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-05-20T16:53:46.126 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-20T16:53:46.126 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-20T16:53:46.126 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-20T16:53:46.126 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-20T16:53:46.126 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-20T16:53:46.126 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-20T16:53:46.127 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-20T16:53:46.127 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-20T16:53:46.127 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-20T16:53:46.127 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-20T16:53:46.127 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-20T16:53:46.127 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-20T16:53:46.127 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-20T16:53:46.127 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-20T16:53:46.127 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-20T16:53:46.127 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-20T16:53:46.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-20T16:53:46.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-20T16:53:46.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-20T16:53:46.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-20T16:53:46.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-20T16:53:46.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-20T16:53:46.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-20T16:53:46.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-20T16:53:46.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-20T16:53:46.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-20T16:53:46.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-20T16:53:46.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-20T16:53:46.128 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-20T16:53:46.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-20T16:53:46.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-20T16:53:46.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-20T16:53:46.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-20T16:53:46.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-20T16:53:46.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-20T16:53:46.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-20T16:53:46.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-20T16:53:46.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-20T16:53:46.129 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-20T16:53:46.129 INFO:teuthology.orchestra.run.smithi062.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-20T16:53:46.130 INFO:teuthology.orchestra.run.smithi062.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-20T16:53:46.130 INFO:teuthology.orchestra.run.smithi062.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-20T16:53:46.130 INFO:teuthology.orchestra.run.smithi062.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-20T16:53:46.130 INFO:teuthology.orchestra.run.smithi062.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-20T16:53:46.130 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-20T16:53:46.130 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-20T16:53:46.130 INFO:teuthology.orchestra.run.smithi062.stdout:Installing weak dependencies: 2024-05-20T16:53:46.130 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-20T16:53:46.130 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:53:46.130 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-20T16:53:46.130 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-05-20T16:53:46.130 INFO:teuthology.orchestra.run.smithi062.stdout:Install 148 Packages 2024-05-20T16:53:46.131 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade 11 Packages 2024-05-20T16:53:46.131 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:53:46.131 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 222 M 2024-05-20T16:53:46.131 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-20T16:53:46.648 INFO:teuthology.orchestra.run.smithi171.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-20T16:53:46.649 INFO:teuthology.orchestra.run.smithi171.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-20T16:53:46.660 INFO:teuthology.orchestra.run.smithi171.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-20T16:53:46.661 INFO:teuthology.orchestra.run.smithi171.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-20T16:53:46.661 INFO:teuthology.orchestra.run.smithi171.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-20T16:53:46.663 INFO:teuthology.orchestra.run.smithi171.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-20T16:53:46.664 INFO:teuthology.orchestra.run.smithi171.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-20T16:53:46.666 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-20T16:53:46.667 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-20T16:53:46.731 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-05-20T16:53:46.747 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================= 2024-05-20T16:53:46.747 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-05-20T16:53:46.747 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================= 2024-05-20T16:53:46.747 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-05-20T16:53:46.747 INFO:teuthology.orchestra.run.smithi171.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-20T16:53:46.747 INFO:teuthology.orchestra.run.smithi171.stdout: ceph x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 6.6 k 2024-05-20T16:53:46.747 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 5.4 M 2024-05-20T16:53:46.747 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 863 k 2024-05-20T16:53:46.747 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 147 k 2024-05-20T16:53:46.747 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 1.5 M 2024-05-20T16:53:46.748 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 142 k 2024-05-20T16:53:46.748 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 3.5 M 2024-05-20T16:53:46.748 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 7.4 M 2024-05-20T16:53:46.748 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 49 k 2024-05-20T16:53:46.748 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 9.8 M 2024-05-20T16:53:46.748 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 46 M 2024-05-20T16:53:46.748 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 264 k 2024-05-20T16:53:46.748 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 763 k 2024-05-20T16:53:46.748 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 221 k 2024-05-20T16:53:46.748 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-shell x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 27 k 2024-05-20T16:53:46.748 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 18 k 2024-05-20T16:53:46.748 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-05-20T16:53:46.748 INFO:teuthology.orchestra.run.smithi171.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-20T16:53:46.748 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-20T16:53:46.749 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 32 k 2024-05-20T16:53:46.749 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 756 k 2024-05-20T16:53:46.749 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 127 k 2024-05-20T16:53:46.749 INFO:teuthology.orchestra.run.smithi171.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-20T16:53:46.749 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-20T16:53:46.749 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-20T16:53:46.749 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-20T16:53:46.749 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-20T16:53:46.749 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-20T16:53:46.749 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 161 k 2024-05-20T16:53:46.749 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 320 k 2024-05-20T16:53:46.749 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 299 k 2024-05-20T16:53:46.749 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 99 k 2024-05-20T16:53:46.749 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 86 k 2024-05-20T16:53:46.750 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.0 M 2024-05-20T16:53:46.750 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 169 k 2024-05-20T16:53:46.750 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-20T16:53:46.750 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrading: 2024-05-20T16:53:46.750 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-20T16:53:46.750 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-20T16:53:46.750 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-20T16:53:46.750 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-20T16:53:46.750 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-05-20T16:53:46.750 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-05-20T16:53:46.750 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-05-20T16:53:46.750 INFO:teuthology.orchestra.run.smithi171.stdout: librados2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.3 M 2024-05-20T16:53:46.750 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.1 M 2024-05-20T16:53:46.751 INFO:teuthology.orchestra.run.smithi171.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-20T16:53:46.751 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-20T16:53:46.751 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-05-20T16:53:46.751 INFO:teuthology.orchestra.run.smithi171.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-20T16:53:46.751 INFO:teuthology.orchestra.run.smithi171.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-20T16:53:46.751 INFO:teuthology.orchestra.run.smithi171.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-20T16:53:46.751 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 19 M 2024-05-20T16:53:46.751 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 32 k 2024-05-20T16:53:46.751 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 2.3 M 2024-05-20T16:53:46.751 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 249 k 2024-05-20T16:53:46.751 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 4.9 M 2024-05-20T16:53:46.751 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 18 M 2024-05-20T16:53:46.751 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 16 k 2024-05-20T16:53:46.752 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 25 k 2024-05-20T16:53:46.752 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-20T16:53:46.752 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-20T16:53:46.752 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-20T16:53:46.752 INFO:teuthology.orchestra.run.smithi171.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-20T16:53:46.752 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-20T16:53:46.752 INFO:teuthology.orchestra.run.smithi171.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-20T16:53:46.752 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-20T16:53:46.752 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-20T16:53:46.752 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 158 k 2024-05-20T16:53:46.752 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-20T16:53:46.752 INFO:teuthology.orchestra.run.smithi171.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-20T16:53:46.752 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-20T16:53:46.752 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-20T16:53:46.752 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-20T16:53:46.753 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 497 k 2024-05-20T16:53:46.753 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-20T16:53:46.753 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 5.0 M 2024-05-20T16:53:46.753 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-20T16:53:46.753 INFO:teuthology.orchestra.run.smithi171.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-20T16:53:46.753 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-20T16:53:46.753 INFO:teuthology.orchestra.run.smithi171.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-20T16:53:46.753 INFO:teuthology.orchestra.run.smithi171.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-20T16:53:46.753 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-20T16:53:46.753 INFO:teuthology.orchestra.run.smithi171.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-20T16:53:46.753 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-20T16:53:46.753 INFO:teuthology.orchestra.run.smithi171.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-20T16:53:46.754 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-20T16:53:46.754 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-20T16:53:46.754 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-20T16:53:46.754 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-20T16:53:46.754 INFO:teuthology.orchestra.run.smithi171.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-20T16:53:46.754 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-20T16:53:46.754 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-20T16:53:46.754 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-20T16:53:46.754 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 45 k 2024-05-20T16:53:46.754 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 135 k 2024-05-20T16:53:46.754 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-20T16:53:46.754 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-20T16:53:46.754 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-20T16:53:46.754 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-20T16:53:46.755 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-20T16:53:46.755 INFO:teuthology.orchestra.run.smithi171.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-05-20T16:53:46.755 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-20T16:53:46.755 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-20T16:53:46.755 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-20T16:53:46.755 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-20T16:53:46.755 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-20T16:53:46.755 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-20T16:53:46.755 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-20T16:53:46.755 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-20T16:53:46.755 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-20T16:53:46.755 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-20T16:53:46.755 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-05-20T16:53:46.756 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-20T16:53:46.756 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-20T16:53:46.756 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-20T16:53:46.756 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-20T16:53:46.756 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-20T16:53:46.756 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-20T16:53:46.756 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-20T16:53:46.756 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-20T16:53:46.756 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-20T16:53:46.756 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-20T16:53:46.756 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-20T16:53:46.756 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-20T16:53:46.756 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-20T16:53:46.757 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-20T16:53:46.757 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-20T16:53:46.757 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-20T16:53:46.757 INFO:teuthology.orchestra.run.smithi171.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-20T16:53:46.757 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-20T16:53:46.757 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-20T16:53:46.757 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-20T16:53:46.757 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-20T16:53:46.757 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-20T16:53:46.757 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-20T16:53:46.757 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-20T16:53:46.757 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-20T16:53:46.757 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-20T16:53:46.757 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-20T16:53:46.758 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-20T16:53:46.758 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-20T16:53:46.758 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-20T16:53:46.758 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-20T16:53:46.758 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-20T16:53:46.758 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-20T16:53:46.758 INFO:teuthology.orchestra.run.smithi171.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-20T16:53:46.758 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-20T16:53:46.759 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-20T16:53:46.759 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-20T16:53:46.759 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-20T16:53:46.759 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-20T16:53:46.759 INFO:teuthology.orchestra.run.smithi171.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-20T16:53:46.759 INFO:teuthology.orchestra.run.smithi171.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-20T16:53:46.759 INFO:teuthology.orchestra.run.smithi171.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-20T16:53:46.759 INFO:teuthology.orchestra.run.smithi171.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-20T16:53:46.759 INFO:teuthology.orchestra.run.smithi171.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-20T16:53:46.759 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-20T16:53:46.759 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-20T16:53:46.759 INFO:teuthology.orchestra.run.smithi171.stdout:Installing weak dependencies: 2024-05-20T16:53:46.760 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-20T16:53:46.760 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:53:46.760 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-05-20T16:53:46.760 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================= 2024-05-20T16:53:46.760 INFO:teuthology.orchestra.run.smithi171.stdout:Install 148 Packages 2024-05-20T16:53:46.760 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrade 11 Packages 2024-05-20T16:53:46.760 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:53:46.760 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 222 M 2024-05-20T16:53:46.761 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-05-20T16:53:47.202 INFO:teuthology.orchestra.run.smithi062.stdout:(1/159): ceph-19.0.0-2744.gd2b507c7.el9.x86_64. 16 kB/s | 6.6 kB 00:00 2024-05-20T16:53:47.498 INFO:teuthology.orchestra.run.smithi171.stdout:(1/159): ceph-19.0.0-2744.gd2b507c7.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-05-20T16:53:47.827 INFO:teuthology.orchestra.run.smithi062.stdout:(2/159): ceph-base-19.0.0-2744.gd2b507c7.el9.x8 5.3 MB/s | 5.4 MB 00:01 2024-05-20T16:53:47.861 INFO:teuthology.orchestra.run.smithi062.stdout:(3/159): ceph-fuse-19.0.0-2744.gd2b507c7.el9.x8 1.3 MB/s | 863 kB 00:00 2024-05-20T16:53:47.936 INFO:teuthology.orchestra.run.smithi062.stdout:(4/159): ceph-immutable-object-cache-19.0.0-274 1.3 MB/s | 147 kB 00:00 2024-05-20T16:53:48.111 INFO:teuthology.orchestra.run.smithi062.stdout:(5/159): ceph-mgr-19.0.0-2744.gd2b507c7.el9.x86 8.5 MB/s | 1.5 MB 00:00 2024-05-20T16:53:48.178 INFO:teuthology.orchestra.run.smithi062.stdout:(6/159): ceph-mds-19.0.0-2744.gd2b507c7.el9.x86 7.1 MB/s | 2.3 MB 00:00 2024-05-20T16:53:48.290 INFO:teuthology.orchestra.run.smithi171.stdout:(2/159): ceph-fuse-19.0.0-2744.gd2b507c7.el9.x8 1.1 MB/s | 863 kB 00:00 2024-05-20T16:53:48.579 INFO:teuthology.orchestra.run.smithi062.stdout:(7/159): ceph-mon-19.0.0-2744.gd2b507c7.el9.x86 10 MB/s | 4.9 MB 00:00 2024-05-20T16:53:48.782 INFO:teuthology.orchestra.run.smithi171.stdout:(3/159): ceph-immutable-object-cache-19.0.0-274 299 kB/s | 147 kB 00:00 2024-05-20T16:53:49.537 INFO:teuthology.orchestra.run.smithi062.stdout:(8/159): ceph-radosgw-19.0.0-2744.gd2b507c7.el9 10 MB/s | 9.8 MB 00:00 2024-05-20T16:53:49.629 INFO:teuthology.orchestra.run.smithi062.stdout:(9/159): ceph-selinux-19.0.0-2744.gd2b507c7.el9 274 kB/s | 25 kB 00:00 2024-05-20T16:53:50.117 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-05-20T16:53:50.455 INFO:teuthology.orchestra.run.smithi062.stdout:(10/159): ceph-osd-19.0.0-2744.gd2b507c7.el9.x8 7.8 MB/s | 18 MB 00:02 2024-05-20T16:53:50.490 INFO:teuthology.orchestra.run.smithi171.stdout:(4/159): ceph-mds-19.0.0-2744.gd2b507c7.el9.x86 1.3 MB/s | 2.3 MB 00:01 2024-05-20T16:53:50.557 INFO:teuthology.orchestra.run.smithi171.stdout:(5/159): ceph-base-19.0.0-2744.gd2b507c7.el9.x8 1.6 MB/s | 5.4 MB 00:03 2024-05-20T16:53:50.563 INFO:teuthology.orchestra.run.smithi062.stdout:(11/159): cephfs-mirror-19.0.0-2744.gd2b507c7.e 2.0 MB/s | 221 kB 00:00 2024-05-20T16:53:50.671 INFO:teuthology.orchestra.run.smithi062.stdout:(12/159): cephfs-shell-19.0.0-2744.gd2b507c7.el 250 kB/s | 27 kB 00:00 2024-05-20T16:53:50.772 INFO:teuthology.orchestra.run.smithi062.stdout:(13/159): libcephfs-devel-19.0.0-2744.gd2b507c7 317 kB/s | 32 kB 00:00 2024-05-20T16:53:50.964 INFO:teuthology.orchestra.run.smithi062.stdout:(14/159): libcephfs2-19.0.0-2744.gd2b507c7.el9. 3.9 MB/s | 756 kB 00:00 2024-05-20T16:53:51.081 INFO:teuthology.orchestra.run.smithi062.stdout:(15/159): libcephsqlite-19.0.0-2744.gd2b507c7.e 1.3 MB/s | 158 kB 00:00 2024-05-20T16:53:51.181 INFO:teuthology.orchestra.run.smithi062.stdout:(16/159): librados-devel-19.0.0-2744.gd2b507c7. 1.2 MB/s | 127 kB 00:00 2024-05-20T16:53:51.315 INFO:teuthology.orchestra.run.smithi062.stdout:(17/159): libradosstriper1-19.0.0-2744.gd2b507c 3.6 MB/s | 497 kB 00:00 2024-05-20T16:53:51.433 INFO:teuthology.orchestra.run.smithi171.stdout:(6/159): ceph-mgr-19.0.0-2744.gd2b507c7.el9.x86 1.6 MB/s | 1.5 MB 00:00 2024-05-20T16:53:52.007 INFO:teuthology.orchestra.run.smithi062.stdout:(18/159): librgw2-19.0.0-2744.gd2b507c7.el9.x86 7.3 MB/s | 5.0 MB 00:00 2024-05-20T16:53:52.115 INFO:teuthology.orchestra.run.smithi062.stdout:(19/159): python3-ceph-argparse-19.0.0-2744.gd2 417 kB/s | 45 kB 00:00 2024-05-20T16:53:52.224 INFO:teuthology.orchestra.run.smithi062.stdout:(20/159): python3-ceph-common-19.0.0-2744.gd2b5 1.2 MB/s | 135 kB 00:00 2024-05-20T16:53:52.299 INFO:teuthology.orchestra.run.smithi171.stdout:(7/159): ceph-common-19.0.0-2744.gd2b507c7.el9. 3.8 MB/s | 19 MB 00:05 2024-05-20T16:53:52.341 INFO:teuthology.orchestra.run.smithi062.stdout:(21/159): python3-cephfs-19.0.0-2744.gd2b507c7. 1.3 MB/s | 161 kB 00:00 2024-05-20T16:53:52.351 INFO:teuthology.orchestra.run.smithi006.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-20T16:53:52.352 INFO:teuthology.orchestra.run.smithi006.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-20T16:53:52.363 INFO:teuthology.orchestra.run.smithi006.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-20T16:53:52.364 INFO:teuthology.orchestra.run.smithi006.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-20T16:53:52.365 INFO:teuthology.orchestra.run.smithi006.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-20T16:53:52.366 INFO:teuthology.orchestra.run.smithi006.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-20T16:53:52.367 INFO:teuthology.orchestra.run.smithi006.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-20T16:53:52.370 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-20T16:53:52.371 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-20T16:53:52.436 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-05-20T16:53:52.458 INFO:teuthology.orchestra.run.smithi062.stdout:(22/159): python3-rados-19.0.0-2744.gd2b507c7.e 2.7 MB/s | 320 kB 00:00 2024-05-20T16:53:52.458 INFO:teuthology.orchestra.run.smithi006.stdout:======================================================================================= 2024-05-20T16:53:52.458 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2024-05-20T16:53:52.458 INFO:teuthology.orchestra.run.smithi006.stdout:======================================================================================= 2024-05-20T16:53:52.458 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-05-20T16:53:52.459 INFO:teuthology.orchestra.run.smithi006.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-20T16:53:52.459 INFO:teuthology.orchestra.run.smithi006.stdout: ceph x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 6.6 k 2024-05-20T16:53:52.459 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 5.4 M 2024-05-20T16:53:52.459 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 863 k 2024-05-20T16:53:52.459 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 147 k 2024-05-20T16:53:52.459 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 1.5 M 2024-05-20T16:53:52.459 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 142 k 2024-05-20T16:53:52.459 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 3.5 M 2024-05-20T16:53:52.459 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 7.4 M 2024-05-20T16:53:52.459 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 49 k 2024-05-20T16:53:52.459 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 9.8 M 2024-05-20T16:53:52.459 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 46 M 2024-05-20T16:53:52.459 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 264 k 2024-05-20T16:53:52.460 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 763 k 2024-05-20T16:53:52.460 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 221 k 2024-05-20T16:53:52.460 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-shell x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 27 k 2024-05-20T16:53:52.460 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 18 k 2024-05-20T16:53:52.460 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-05-20T16:53:52.460 INFO:teuthology.orchestra.run.smithi006.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-20T16:53:52.460 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-20T16:53:52.460 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 32 k 2024-05-20T16:53:52.460 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 756 k 2024-05-20T16:53:52.460 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 127 k 2024-05-20T16:53:52.460 INFO:teuthology.orchestra.run.smithi006.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-20T16:53:52.460 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-20T16:53:52.460 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-20T16:53:52.460 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-20T16:53:52.461 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-20T16:53:52.461 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-20T16:53:52.461 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 161 k 2024-05-20T16:53:52.461 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 320 k 2024-05-20T16:53:52.461 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 299 k 2024-05-20T16:53:52.461 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 99 k 2024-05-20T16:53:52.461 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 86 k 2024-05-20T16:53:52.461 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.0 M 2024-05-20T16:53:52.461 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 169 k 2024-05-20T16:53:52.461 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-20T16:53:52.461 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrading: 2024-05-20T16:53:52.461 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-20T16:53:52.461 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-20T16:53:52.462 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-20T16:53:52.462 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-20T16:53:52.462 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-05-20T16:53:52.462 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-05-20T16:53:52.462 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-05-20T16:53:52.462 INFO:teuthology.orchestra.run.smithi006.stdout: librados2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.3 M 2024-05-20T16:53:52.462 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.1 M 2024-05-20T16:53:52.462 INFO:teuthology.orchestra.run.smithi006.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-20T16:53:52.462 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-20T16:53:52.462 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2024-05-20T16:53:52.462 INFO:teuthology.orchestra.run.smithi006.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-20T16:53:52.463 INFO:teuthology.orchestra.run.smithi006.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-20T16:53:52.463 INFO:teuthology.orchestra.run.smithi006.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-20T16:53:52.463 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 19 M 2024-05-20T16:53:52.463 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 32 k 2024-05-20T16:53:52.463 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 2.3 M 2024-05-20T16:53:52.463 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 249 k 2024-05-20T16:53:52.463 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 4.9 M 2024-05-20T16:53:52.463 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 18 M 2024-05-20T16:53:52.463 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 16 k 2024-05-20T16:53:52.463 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 25 k 2024-05-20T16:53:52.464 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-20T16:53:52.464 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-20T16:53:52.464 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-20T16:53:52.464 INFO:teuthology.orchestra.run.smithi006.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-20T16:53:52.464 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-20T16:53:52.464 INFO:teuthology.orchestra.run.smithi006.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-20T16:53:52.464 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-20T16:53:52.464 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-20T16:53:52.464 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 158 k 2024-05-20T16:53:52.464 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-20T16:53:52.464 INFO:teuthology.orchestra.run.smithi006.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-20T16:53:52.464 INFO:teuthology.orchestra.run.smithi006.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-20T16:53:52.464 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-20T16:53:52.465 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-20T16:53:52.465 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 497 k 2024-05-20T16:53:52.465 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-20T16:53:52.465 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 5.0 M 2024-05-20T16:53:52.465 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-20T16:53:52.465 INFO:teuthology.orchestra.run.smithi006.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-20T16:53:52.465 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-20T16:53:52.465 INFO:teuthology.orchestra.run.smithi006.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-20T16:53:52.465 INFO:teuthology.orchestra.run.smithi006.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-20T16:53:52.465 INFO:teuthology.orchestra.run.smithi006.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-20T16:53:52.466 INFO:teuthology.orchestra.run.smithi006.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-20T16:53:52.466 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-20T16:53:52.466 INFO:teuthology.orchestra.run.smithi006.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-20T16:53:52.466 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-20T16:53:52.466 INFO:teuthology.orchestra.run.smithi006.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-20T16:53:52.466 INFO:teuthology.orchestra.run.smithi006.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-20T16:53:52.466 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-20T16:53:52.466 INFO:teuthology.orchestra.run.smithi006.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-20T16:53:52.466 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-20T16:53:52.466 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-20T16:53:52.466 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-20T16:53:52.466 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 45 k 2024-05-20T16:53:52.467 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 135 k 2024-05-20T16:53:52.467 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-20T16:53:52.467 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-20T16:53:52.467 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-20T16:53:52.467 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-20T16:53:52.467 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-20T16:53:52.467 INFO:teuthology.orchestra.run.smithi006.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-05-20T16:53:52.467 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-20T16:53:52.467 INFO:teuthology.orchestra.run.smithi006.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-20T16:53:52.467 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-20T16:53:52.467 INFO:teuthology.orchestra.run.smithi006.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-20T16:53:52.468 INFO:teuthology.orchestra.run.smithi006.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-20T16:53:52.468 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-20T16:53:52.468 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-20T16:53:52.468 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-20T16:53:52.468 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-20T16:53:52.468 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-20T16:53:52.468 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-05-20T16:53:52.468 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-20T16:53:52.468 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-20T16:53:52.468 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-20T16:53:52.468 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-20T16:53:52.468 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-20T16:53:52.468 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-20T16:53:52.469 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-20T16:53:52.469 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-20T16:53:52.469 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-20T16:53:52.469 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-20T16:53:52.469 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-20T16:53:52.469 INFO:teuthology.orchestra.run.smithi006.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-20T16:53:52.469 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-20T16:53:52.469 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-20T16:53:52.469 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-20T16:53:52.469 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-20T16:53:52.469 INFO:teuthology.orchestra.run.smithi006.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-20T16:53:52.469 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-20T16:53:52.469 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-20T16:53:52.469 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-20T16:53:52.470 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-20T16:53:52.470 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-20T16:53:52.470 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-20T16:53:52.470 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-20T16:53:52.470 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-20T16:53:52.470 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-20T16:53:52.470 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-20T16:53:52.470 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-20T16:53:52.470 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-20T16:53:52.470 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-20T16:53:52.470 INFO:teuthology.orchestra.run.smithi006.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-20T16:53:52.470 INFO:teuthology.orchestra.run.smithi006.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-20T16:53:52.470 INFO:teuthology.orchestra.run.smithi006.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-20T16:53:52.471 INFO:teuthology.orchestra.run.smithi006.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-20T16:53:52.471 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-20T16:53:52.471 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-20T16:53:52.471 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-20T16:53:52.471 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-20T16:53:52.471 INFO:teuthology.orchestra.run.smithi006.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-20T16:53:52.471 INFO:teuthology.orchestra.run.smithi006.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-20T16:53:52.471 INFO:teuthology.orchestra.run.smithi006.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-20T16:53:52.471 INFO:teuthology.orchestra.run.smithi006.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-20T16:53:52.472 INFO:teuthology.orchestra.run.smithi006.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-20T16:53:52.472 INFO:teuthology.orchestra.run.smithi006.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-20T16:53:52.472 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-20T16:53:52.472 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-20T16:53:52.472 INFO:teuthology.orchestra.run.smithi006.stdout:Installing weak dependencies: 2024-05-20T16:53:52.472 INFO:teuthology.orchestra.run.smithi006.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-20T16:53:52.472 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:53:52.472 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-05-20T16:53:52.472 INFO:teuthology.orchestra.run.smithi006.stdout:======================================================================================= 2024-05-20T16:53:52.472 INFO:teuthology.orchestra.run.smithi006.stdout:Install 148 Packages 2024-05-20T16:53:52.472 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrade 11 Packages 2024-05-20T16:53:52.472 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:53:52.473 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 222 M 2024-05-20T16:53:52.473 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-05-20T16:53:52.583 INFO:teuthology.orchestra.run.smithi062.stdout:(23/159): python3-rbd-19.0.0-2744.gd2b507c7.el9 2.3 MB/s | 299 kB 00:00 2024-05-20T16:53:52.708 INFO:teuthology.orchestra.run.smithi062.stdout:(24/159): python3-rgw-19.0.0-2744.gd2b507c7.el9 794 kB/s | 99 kB 00:00 2024-05-20T16:53:52.817 INFO:teuthology.orchestra.run.smithi062.stdout:(25/159): rbd-fuse-19.0.0-2744.gd2b507c7.el9.x8 793 kB/s | 86 kB 00:00 2024-05-20T16:53:53.258 INFO:teuthology.orchestra.run.smithi171.stdout:(8/159): ceph-mon-19.0.0-2744.gd2b507c7.el9.x86 1.8 MB/s | 4.9 MB 00:02 2024-05-20T16:53:53.284 INFO:teuthology.orchestra.run.smithi062.stdout:(26/159): rbd-mirror-19.0.0-2744.gd2b507c7.el9. 6.5 MB/s | 3.0 MB 00:00 2024-05-20T16:53:53.293 INFO:teuthology.orchestra.run.smithi006.stdout:(1/159): ceph-19.0.0-2744.gd2b507c7.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-05-20T16:53:53.350 INFO:teuthology.orchestra.run.smithi171.stdout:(9/159): ceph-selinux-19.0.0-2744.gd2b507c7.el9 274 kB/s | 25 kB 00:00 2024-05-20T16:53:53.401 INFO:teuthology.orchestra.run.smithi062.stdout:(27/159): rbd-nbd-19.0.0-2744.gd2b507c7.el9.x86 1.4 MB/s | 169 kB 00:00 2024-05-20T16:53:53.509 INFO:teuthology.orchestra.run.smithi062.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2744.g 293 kB/s | 32 kB 00:00 2024-05-20T16:53:53.618 INFO:teuthology.orchestra.run.smithi062.stdout:(29/159): ceph-mgr-cephadm-19.0.0-2744.gd2b507c 1.3 MB/s | 142 kB 00:00 2024-05-20T16:53:53.743 INFO:teuthology.orchestra.run.smithi006.stdout:(2/159): ceph-fuse-19.0.0-2744.gd2b507c7.el9.x8 1.9 MB/s | 863 kB 00:00 2024-05-20T16:53:53.844 INFO:teuthology.orchestra.run.smithi006.stdout:(3/159): ceph-immutable-object-cache-19.0.0-274 1.4 MB/s | 147 kB 00:00 2024-05-20T16:53:54.436 INFO:teuthology.orchestra.run.smithi006.stdout:(4/159): ceph-mds-19.0.0-2744.gd2b507c7.el9.x86 3.8 MB/s | 2.3 MB 00:00 2024-05-20T16:53:54.475 INFO:teuthology.orchestra.run.smithi171.stdout:(10/159): ceph-radosgw-19.0.0-2744.gd2b507c7.el 4.5 MB/s | 9.8 MB 00:02 2024-05-20T16:53:54.510 INFO:teuthology.orchestra.run.smithi062.stdout:(30/159): ceph-test-19.0.0-2744.gd2b507c7.el9.x 9.5 MB/s | 46 MB 00:04 2024-05-20T16:53:54.577 INFO:teuthology.orchestra.run.smithi062.stdout:(31/159): ceph-mgr-dashboard-19.0.0-2744.gd2b50 3.7 MB/s | 3.5 MB 00:00 2024-05-20T16:53:54.592 INFO:teuthology.orchestra.run.smithi171.stdout:(11/159): cephfs-mirror-19.0.0-2744.gd2b507c7.e 1.9 MB/s | 221 kB 00:00 2024-05-20T16:53:54.669 INFO:teuthology.orchestra.run.smithi006.stdout:(5/159): ceph-mgr-19.0.0-2744.gd2b507c7.el9.x86 6.4 MB/s | 1.5 MB 00:00 2024-05-20T16:53:54.702 INFO:teuthology.orchestra.run.smithi062.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2744.gd2 2.0 MB/s | 249 kB 00:00 2024-05-20T16:53:54.717 INFO:teuthology.orchestra.run.smithi171.stdout:(12/159): cephfs-shell-19.0.0-2744.gd2b507c7.el 216 kB/s | 27 kB 00:00 2024-05-20T16:53:54.802 INFO:teuthology.orchestra.run.smithi062.stdout:(33/159): ceph-mgr-rook-19.0.0-2744.gd2b507c7.e 493 kB/s | 49 kB 00:00 2024-05-20T16:53:54.817 INFO:teuthology.orchestra.run.smithi171.stdout:(13/159): libcephfs-devel-19.0.0-2744.gd2b507c7 317 kB/s | 32 kB 00:00 2024-05-20T16:53:54.919 INFO:teuthology.orchestra.run.smithi062.stdout:(34/159): ceph-prometheus-alerts-19.0.0-2744.gd 141 kB/s | 16 kB 00:00 2024-05-20T16:53:55.053 INFO:teuthology.orchestra.run.smithi062.stdout:(35/159): ceph-volume-19.0.0-2744.gd2b507c7.el9 1.9 MB/s | 264 kB 00:00 2024-05-20T16:53:55.118 INFO:teuthology.orchestra.run.smithi171.stdout:(14/159): libcephfs2-19.0.0-2744.gd2b507c7.el9. 2.5 MB/s | 756 kB 00:00 2024-05-20T16:53:55.226 INFO:teuthology.orchestra.run.smithi171.stdout:(15/159): libcephsqlite-19.0.0-2744.gd2b507c7.e 1.4 MB/s | 158 kB 00:00 2024-05-20T16:53:55.328 INFO:teuthology.orchestra.run.smithi062.stdout:(36/159): cephadm-19.0.0-2744.gd2b507c7.el9.noa 2.7 MB/s | 763 kB 00:00 2024-05-20T16:53:55.343 INFO:teuthology.orchestra.run.smithi171.stdout:(16/159): librados-devel-19.0.0-2744.gd2b507c7. 1.1 MB/s | 127 kB 00:00 2024-05-20T16:53:55.419 INFO:teuthology.orchestra.run.smithi006.stdout:(6/159): ceph-mon-19.0.0-2744.gd2b507c7.el9.x86 6.5 MB/s | 4.9 MB 00:00 2024-05-20T16:53:55.429 INFO:teuthology.orchestra.run.smithi062.stdout:(37/159): cephfs-top-19.0.0-2744.gd2b507c7.el9. 182 kB/s | 18 kB 00:00 2024-05-20T16:53:55.588 INFO:teuthology.orchestra.run.smithi062.stdout:(38/159): fuse-2.9.9-15.el9.x86_64.rpm 507 kB/s | 80 kB 00:00 2024-05-20T16:53:55.610 INFO:teuthology.orchestra.run.smithi171.stdout:(17/159): libradosstriper1-19.0.0-2744.gd2b507c 1.8 MB/s | 497 kB 00:00 2024-05-20T16:53:55.721 INFO:teuthology.orchestra.run.smithi062.stdout:(39/159): libgfortran-11.4.1-3.el9.x86_64.rpm 5.9 MB/s | 803 kB 00:00 2024-05-20T16:53:55.771 INFO:teuthology.orchestra.run.smithi062.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-05-20T16:53:55.822 INFO:teuthology.orchestra.run.smithi062.stdout:(41/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-05-20T16:53:55.913 INFO:teuthology.orchestra.run.smithi062.stdout:(42/159): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-05-20T16:53:55.964 INFO:teuthology.orchestra.run.smithi062.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-05-20T16:53:56.031 INFO:teuthology.orchestra.run.smithi062.stdout:(44/159): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-05-20T16:53:56.081 INFO:teuthology.orchestra.run.smithi062.stdout:(45/159): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-05-20T16:53:56.131 INFO:teuthology.orchestra.run.smithi062.stdout:(46/159): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-05-20T16:53:56.215 INFO:teuthology.orchestra.run.smithi062.stdout:(47/159): ceph-mgr-diskprediction-local-19.0.0- 4.3 MB/s | 7.4 MB 00:01 2024-05-20T16:53:56.420 INFO:teuthology.orchestra.run.smithi006.stdout:(7/159): ceph-common-19.0.0-2744.gd2b507c7.el9. 5.6 MB/s | 19 MB 00:03 2024-05-20T16:53:57.173 INFO:teuthology.orchestra.run.smithi062.stdout:(48/159): automake-1.16.2-8.el9.noarch.rpm 661 kB/s | 689 kB 00:01 2024-05-20T16:53:57.316 INFO:teuthology.orchestra.run.smithi062.stdout:(49/159): boost-program-options-1.75.0-8.el9.x8 754 kB/s | 107 kB 00:00 2024-05-20T16:53:57.349 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:53:57.416 INFO:teuthology.orchestra.run.smithi062.stdout:(50/159): bison-3.7.4-5.el9.x86_64.rpm 786 kB/s | 943 kB 00:01 2024-05-20T16:53:57.418 INFO:teuthology.orchestra.run.smithi171.stdout:(18/159): librgw2-19.0.0-2744.gd2b507c7.el9.x86 2.8 MB/s | 5.0 MB 00:01 2024-05-20T16:53:57.516 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:53:57.544 INFO:teuthology.orchestra.run.smithi171.stdout:(19/159): python3-ceph-argparse-19.0.0-2744.gd2 361 kB/s | 45 kB 00:00 2024-05-20T16:53:57.549 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:53:57.652 INFO:teuthology.orchestra.run.smithi171.stdout:(20/159): python3-ceph-common-19.0.0-2744.gd2b5 1.2 MB/s | 135 kB 00:00 2024-05-20T16:53:57.691 INFO:teuthology.orchestra.run.smithi062.stdout:(51/159): flex-2.6.4-9.el9.x86_64.rpm 1.2 MB/s | 313 kB 00:00 2024-05-20T16:53:57.750 INFO:teuthology.orchestra.run.smithi062.stdout:(52/159): flexiblas-3.0.4-8.el9.x86_64.rpm 561 kB/s | 33 kB 00:00 2024-05-20T16:53:57.753 INFO:teuthology.orchestra.run.smithi171.stdout:(21/159): python3-cephfs-19.0.0-2744.gd2b507c7. 1.6 MB/s | 161 kB 00:00 2024-05-20T16:53:57.878 INFO:teuthology.orchestra.run.smithi006.stdout:(8/159): ceph-radosgw-19.0.0-2744.gd2b507c7.el9 6.8 MB/s | 9.8 MB 00:01 2024-05-20T16:53:57.953 INFO:teuthology.orchestra.run.smithi171.stdout:(22/159): python3-rados-19.0.0-2744.gd2b507c7.e 1.6 MB/s | 320 kB 00:00 2024-05-20T16:53:58.024 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:53:58.095 INFO:teuthology.orchestra.run.smithi006.stdout:(9/159): ceph-osd-19.0.0-2744.gd2b507c7.el9.x86 6.6 MB/s | 18 MB 00:02 2024-05-20T16:53:58.120 INFO:teuthology.orchestra.run.smithi006.stdout:(10/159): ceph-selinux-19.0.0-2744.gd2b507c7.el 104 kB/s | 25 kB 00:00 2024-05-20T16:53:58.145 INFO:teuthology.orchestra.run.smithi171.stdout:(23/159): python3-rbd-19.0.0-2744.gd2b507c7.el9 1.5 MB/s | 299 kB 00:00 2024-05-20T16:53:58.229 INFO:teuthology.orchestra.run.smithi006.stdout:(11/159): cephfs-mirror-19.0.0-2744.gd2b507c7.e 2.0 MB/s | 221 kB 00:00 2024-05-20T16:53:58.270 INFO:teuthology.orchestra.run.smithi171.stdout:(24/159): python3-rgw-19.0.0-2744.gd2b507c7.el9 795 kB/s | 99 kB 00:00 2024-05-20T16:53:58.337 INFO:teuthology.orchestra.run.smithi006.stdout:(12/159): cephfs-shell-19.0.0-2744.gd2b507c7.el 250 kB/s | 27 kB 00:00 2024-05-20T16:53:58.351 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:53:58.376 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:53:58.387 INFO:teuthology.orchestra.run.smithi171.stdout:(25/159): rbd-fuse-19.0.0-2744.gd2b507c7.el9.x8 735 kB/s | 86 kB 00:00 2024-05-20T16:53:58.446 INFO:teuthology.orchestra.run.smithi006.stdout:(13/159): libcephfs-devel-19.0.0-2744.gd2b507c7 293 kB/s | 32 kB 00:00 2024-05-20T16:53:58.463 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:53:58.503 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:53:58.587 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:53:58.605 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:53:58.638 INFO:teuthology.orchestra.run.smithi006.stdout:(14/159): libcephfs2-19.0.0-2744.gd2b507c7.el9. 3.9 MB/s | 756 kB 00:00 2024-05-20T16:53:58.661 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:53:58.742 INFO:teuthology.orchestra.run.smithi062.stdout:(53/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.0 MB/s | 3.0 MB 00:00 2024-05-20T16:53:58.755 INFO:teuthology.orchestra.run.smithi006.stdout:(15/159): libcephsqlite-19.0.0-2744.gd2b507c7.e 1.3 MB/s | 158 kB 00:00 2024-05-20T16:53:58.771 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:53:58.800 INFO:teuthology.orchestra.run.smithi062.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-05-20T16:53:58.872 INFO:teuthology.orchestra.run.smithi006.stdout:(16/159): librados-devel-19.0.0-2744.gd2b507c7. 1.1 MB/s | 127 kB 00:00 2024-05-20T16:53:58.884 INFO:teuthology.orchestra.run.smithi062.stdout:(55/159): libaio-devel-0.3.111-13.el9.x86_64.rp 200 kB/s | 11 kB 00:00 2024-05-20T16:53:58.888 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:53:58.942 INFO:teuthology.orchestra.run.smithi062.stdout:(56/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-05-20T16:53:58.947 INFO:teuthology.orchestra.run.smithi006.stdout:(17/159): ceph-base-19.0.0-2744.gd2b507c7.el9.x 922 kB/s | 5.4 MB 00:05 2024-05-20T16:53:59.001 INFO:teuthology.orchestra.run.smithi062.stdout:(57/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 777 kB/s | 45 kB 00:00 2024-05-20T16:53:59.006 INFO:teuthology.orchestra.run.smithi006.stdout:(18/159): libradosstriper1-19.0.0-2744.gd2b507c 3.6 MB/s | 497 kB 00:00 2024-05-20T16:53:59.052 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:53:59.115 INFO:teuthology.orchestra.run.smithi006.stdout:(19/159): python3-ceph-argparse-19.0.0-2744.gd2 416 kB/s | 45 kB 00:00 2024-05-20T16:53:59.143 INFO:teuthology.orchestra.run.smithi062.stdout:(58/159): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-05-20T16:53:59.248 INFO:teuthology.orchestra.run.smithi006.stdout:(20/159): python3-ceph-common-19.0.0-2744.gd2b5 1.0 MB/s | 135 kB 00:00 2024-05-20T16:53:59.310 INFO:teuthology.orchestra.run.smithi062.stdout:(59/159): libtool-2.4.6-45.el9.x86_64.rpm 4.1 MB/s | 582 kB 00:00 2024-05-20T16:53:59.369 INFO:teuthology.orchestra.run.smithi062.stdout:(60/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 436 kB/s | 25 kB 00:00 2024-05-20T16:53:59.373 INFO:teuthology.orchestra.run.smithi006.stdout:(21/159): python3-cephfs-19.0.0-2744.gd2b507c7. 1.3 MB/s | 161 kB 00:00 2024-05-20T16:53:59.427 INFO:teuthology.orchestra.run.smithi062.stdout:(61/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 814 kB/s | 47 kB 00:00 2024-05-20T16:53:59.428 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:53:59.437 INFO:teuthology.orchestra.run.smithi171.stdout:(26/159): rbd-mirror-19.0.0-2744.gd2b507c7.el9. 2.9 MB/s | 3.0 MB 00:01 2024-05-20T16:53:59.469 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:53:59.490 INFO:teuthology.orchestra.run.smithi006.stdout:(22/159): python3-rados-19.0.0-2744.gd2b507c7.e 2.7 MB/s | 320 kB 00:00 2024-05-20T16:53:59.553 INFO:teuthology.orchestra.run.smithi062.stdout:(62/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-05-20T16:53:59.571 INFO:teuthology.orchestra.run.smithi171.stdout:(27/159): rbd-nbd-19.0.0-2744.gd2b507c7.el9.x86 1.2 MB/s | 169 kB 00:00 2024-05-20T16:53:59.574 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:53:59.624 INFO:teuthology.orchestra.run.smithi006.stdout:(23/159): python3-rbd-19.0.0-2744.gd2b507c7.el9 2.2 MB/s | 299 kB 00:00 2024-05-20T16:53:59.628 INFO:teuthology.orchestra.run.smithi062.stdout:(63/159): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-05-20T16:53:59.659 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:53:59.687 INFO:teuthology.orchestra.run.smithi062.stdout:(64/159): openblas-0.3.21-2.el9.x86_64.rpm 606 kB/s | 35 kB 00:00 2024-05-20T16:53:59.749 INFO:teuthology.orchestra.run.smithi006.stdout:(24/159): python3-rgw-19.0.0-2744.gd2b507c7.el9 795 kB/s | 99 kB 00:00 2024-05-20T16:53:59.763 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:53:59.802 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:53:59.846 INFO:teuthology.orchestra.run.smithi171.stdout:(28/159): ceph-osd-19.0.0-2744.gd2b507c7.el9.x8 2.1 MB/s | 18 MB 00:08 2024-05-20T16:53:59.872 INFO:teuthology.orchestra.run.smithi171.stdout:(29/159): ceph-grafana-dashboards-19.0.0-2744.g 105 kB/s | 32 kB 00:00 2024-05-20T16:53:59.875 INFO:teuthology.orchestra.run.smithi006.stdout:(25/159): rbd-fuse-19.0.0-2744.gd2b507c7.el9.x8 686 kB/s | 86 kB 00:00 2024-05-20T16:53:59.898 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:53:59.947 INFO:teuthology.orchestra.run.smithi171.stdout:(30/159): ceph-mgr-cephadm-19.0.0-2744.gd2b507c 1.4 MB/s | 142 kB 00:00 2024-05-20T16:53:59.977 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:00.167 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:00.337 INFO:teuthology.orchestra.run.smithi062.stdout:(65/159): openblas-openmp-0.3.21-2.el9.x86_64.r 7.6 MB/s | 4.7 MB 00:00 2024-05-20T16:54:00.379 INFO:teuthology.orchestra.run.smithi062.stdout:(66/159): elfutils-libelf-devel-0.191-4.el9.x86 7.1 kB/s | 22 kB 00:03 2024-05-20T16:54:00.434 INFO:teuthology.orchestra.run.smithi006.stdout:(26/159): rbd-mirror-19.0.0-2744.gd2b507c7.el9. 5.4 MB/s | 3.0 MB 00:00 2024-05-20T16:54:00.559 INFO:teuthology.orchestra.run.smithi006.stdout:(27/159): rbd-nbd-19.0.0-2744.gd2b507c7.el9.x86 1.3 MB/s | 169 kB 00:00 2024-05-20T16:54:00.709 INFO:teuthology.orchestra.run.smithi006.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2744.g 211 kB/s | 32 kB 00:00 2024-05-20T16:54:00.779 INFO:teuthology.orchestra.run.smithi062.stdout:(67/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-05-20T16:54:00.843 INFO:teuthology.orchestra.run.smithi006.stdout:(29/159): ceph-mgr-cephadm-19.0.0-2744.gd2b507c 1.0 MB/s | 142 kB 00:00 2024-05-20T16:54:01.264 INFO:teuthology.orchestra.run.smithi171.stdout:(31/159): ceph-mgr-dashboard-19.0.0-2744.gd2b50 2.5 MB/s | 3.5 MB 00:01 2024-05-20T16:54:01.276 INFO:teuthology.orchestra.run.smithi062.stdout:(68/159): ceph-common-19.0.0-2744.gd2b507c7.el9 1.3 MB/s | 19 MB 00:14 2024-05-20T16:54:01.313 INFO:teuthology.orchestra.run.smithi062.stdout:(69/159): postgresql-contrib-13.14-1.el9.x86_64 1.7 MB/s | 911 kB 00:00 2024-05-20T16:54:01.460 INFO:teuthology.orchestra.run.smithi006.stdout:(30/159): ceph-mgr-dashboard-19.0.0-2744.gd2b50 5.7 MB/s | 3.5 MB 00:00 2024-05-20T16:54:01.473 INFO:teuthology.orchestra.run.smithi171.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2744.gd2 1.2 MB/s | 249 kB 00:00 2024-05-20T16:54:01.606 INFO:teuthology.orchestra.run.smithi171.stdout:(33/159): ceph-mgr-rook-19.0.0-2744.gd2b507c7.e 370 kB/s | 49 kB 00:00 2024-05-20T16:54:01.740 INFO:teuthology.orchestra.run.smithi171.stdout:(34/159): ceph-mgr-diskprediction-local-19.0.0- 4.1 MB/s | 7.4 MB 00:01 2024-05-20T16:54:01.765 INFO:teuthology.orchestra.run.smithi171.stdout:(35/159): ceph-prometheus-alerts-19.0.0-2744.gd 104 kB/s | 16 kB 00:00 2024-05-20T16:54:01.824 INFO:teuthology.orchestra.run.smithi171.stdout:(36/159): ceph-volume-19.0.0-2744.gd2b507c7.el9 3.1 MB/s | 264 kB 00:00 2024-05-20T16:54:01.846 INFO:teuthology.orchestra.run.smithi062.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 234 kB/s | 133 kB 00:00 2024-05-20T16:54:01.908 INFO:teuthology.orchestra.run.smithi171.stdout:(37/159): cephfs-top-19.0.0-2744.gd2b507c7.el9. 219 kB/s | 18 kB 00:00 2024-05-20T16:54:02.058 INFO:teuthology.orchestra.run.smithi171.stdout:(38/159): fuse-2.9.9-15.el9.x86_64.rpm 536 kB/s | 80 kB 00:00 2024-05-20T16:54:02.100 INFO:teuthology.orchestra.run.smithi171.stdout:(39/159): cephadm-19.0.0-2744.gd2b507c7.el9.noa 2.2 MB/s | 763 kB 00:00 2024-05-20T16:54:02.225 INFO:teuthology.orchestra.run.smithi171.stdout:(40/159): libgfortran-11.4.1-3.el9.x86_64.rpm 4.7 MB/s | 803 kB 00:00 2024-05-20T16:54:02.313 INFO:teuthology.orchestra.run.smithi062.stdout:(71/159): postgresql-13.14-1.el9.x86_64.rpm 841 kB/s | 1.6 MB 00:01 2024-05-20T16:54:02.317 INFO:teuthology.orchestra.run.smithi171.stdout:(41/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-05-20T16:54:02.397 INFO:teuthology.orchestra.run.smithi062.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-05-20T16:54:02.417 INFO:teuthology.orchestra.run.smithi171.stdout:(42/159): libquadmath-11.4.1-3.el9.x86_64.rpm 615 kB/s | 195 kB 00:00 2024-05-20T16:54:02.476 INFO:teuthology.orchestra.run.smithi171.stdout:(43/159): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.2 MB 00:00 2024-05-20T16:54:02.510 INFO:teuthology.orchestra.run.smithi006.stdout:(31/159): librgw2-19.0.0-2744.gd2b507c7.el9.x86 1.4 MB/s | 5.0 MB 00:03 2024-05-20T16:54:02.535 INFO:teuthology.orchestra.run.smithi171.stdout:(44/159): python3-ply-3.11-14.el9.noarch.rpm 909 kB/s | 106 kB 00:00 2024-05-20T16:54:02.560 INFO:teuthology.orchestra.run.smithi171.stdout:(45/159): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-05-20T16:54:02.610 INFO:teuthology.orchestra.run.smithi006.stdout:(32/159): ceph-mgr-diskprediction-local-19.0.0- 6.4 MB/s | 7.4 MB 00:01 2024-05-20T16:54:02.627 INFO:teuthology.orchestra.run.smithi171.stdout:(46/159): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 215 kB 00:00 2024-05-20T16:54:02.652 INFO:teuthology.orchestra.run.smithi171.stdout:(47/159): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-05-20T16:54:02.702 INFO:teuthology.orchestra.run.smithi006.stdout:(33/159): ceph-mgr-modules-core-19.0.0-2744.gd2 1.3 MB/s | 249 kB 00:00 2024-05-20T16:54:02.728 INFO:teuthology.orchestra.run.smithi006.stdout:(34/159): ceph-mgr-rook-19.0.0-2744.gd2b507c7.e 422 kB/s | 49 kB 00:00 2024-05-20T16:54:02.786 INFO:teuthology.orchestra.run.smithi006.stdout:(35/159): ceph-prometheus-alerts-19.0.0-2744.gd 197 kB/s | 16 kB 00:00 2024-05-20T16:54:02.845 INFO:teuthology.orchestra.run.smithi006.stdout:(36/159): ceph-volume-19.0.0-2744.gd2b507c7.el9 2.2 MB/s | 264 kB 00:00 2024-05-20T16:54:02.847 INFO:teuthology.orchestra.run.smithi062.stdout:(73/159): postgresql-server-13.14-1.el9.x86_64. 3.8 MB/s | 5.8 MB 00:01 2024-05-20T16:54:02.899 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 216.31.0.2) 2024-05-20T16:54:02.945 INFO:teuthology.orchestra.run.smithi006.stdout:(37/159): cephfs-top-19.0.0-2744.gd2b507c7.el9. 182 kB/s | 18 kB 00:00 2024-05-20T16:54:03.003 INFO:teuthology.orchestra.run.smithi171.stdout:(48/159): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 689 kB 00:00 2024-05-20T16:54:03.036 INFO:teuthology.orchestra.run.smithi171.stdout:(49/159): bison-3.7.4-5.el9.x86_64.rpm 2.4 MB/s | 943 kB 00:00 2024-05-20T16:54:03.078 INFO:teuthology.orchestra.run.smithi171.stdout:(50/159): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-05-20T16:54:03.082 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:03.089 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 216.31.0.2) 2024-05-20T16:54:03.122 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 199.223.246.113) 2024-05-20T16:54:03.145 INFO:teuthology.orchestra.run.smithi171.stdout:(51/159): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-05-20T16:54:03.229 INFO:teuthology.orchestra.run.smithi171.stdout:(52/159): flexiblas-3.0.4-8.el9.x86_64.rpm 581 kB/s | 33 kB 00:00 2024-05-20T16:54:03.254 INFO:teuthology.orchestra.run.smithi006.stdout:(38/159): cephadm-19.0.0-2744.gd2b507c7.el9.noa 1.6 MB/s | 763 kB 00:00 2024-05-20T16:54:03.270 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:03.279 INFO:teuthology.orchestra.run.smithi006.stdout:(39/159): fuse-2.9.9-15.el9.x86_64.rpm 241 kB/s | 80 kB 00:00 2024-05-20T16:54:03.310 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:03.400 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:03.479 INFO:teuthology.orchestra.run.smithi171.stdout:(53/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-05-20T16:54:03.529 INFO:teuthology.orchestra.run.smithi171.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-05-20T16:54:03.580 INFO:teuthology.orchestra.run.smithi171.stdout:(55/159): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-05-20T16:54:03.581 INFO:teuthology.orchestra.run.smithi062.stdout:(74/159): protobuf-3.14.0-13.el9.x86_64.rpm 596 kB/s | 1.0 MB 00:01 2024-05-20T16:54:03.624 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 104.251.122.5) 2024-05-20T16:54:03.647 INFO:teuthology.orchestra.run.smithi171.stdout:(56/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 160 kB 00:00 2024-05-20T16:54:03.729 INFO:teuthology.orchestra.run.smithi006.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 434 kB/s | 195 kB 00:00 2024-05-20T16:54:03.730 INFO:teuthology.orchestra.run.smithi171.stdout:(57/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 791 kB/s | 45 kB 00:00 2024-05-20T16:54:03.756 INFO:teuthology.orchestra.run.smithi062.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 1.4 MB/s | 244 kB 00:00 2024-05-20T16:54:03.828 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 216.31.0.2) 2024-05-20T16:54:03.887 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 216.31.0.2) 2024-05-20T16:54:03.903 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 199.223.246.113) 2024-05-20T16:54:03.981 INFO:teuthology.orchestra.run.smithi171.stdout:(58/159): librdkafka-1.6.1-102.el9.x86_64.rpm 2.6 MB/s | 662 kB 00:00 2024-05-20T16:54:03.995 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:04.052 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 104.251.122.5) 2024-05-20T16:54:04.075 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 163.114.130.31) 2024-05-20T16:54:04.154 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 163.114.130.31) 2024-05-20T16:54:04.203 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T16:54:04.286 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T16:54:04.304 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T16:54:04.306 INFO:teuthology.orchestra.run.smithi171.stdout:(59/159): libtool-2.4.6-45.el9.x86_64.rpm 1.8 MB/s | 582 kB 00:00 2024-05-20T16:54:04.323 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:04.359 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T16:54:04.365 INFO:teuthology.orchestra.run.smithi171.stdout:(60/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 437 kB/s | 25 kB 00:00 2024-05-20T16:54:04.415 INFO:teuthology.orchestra.run.smithi171.stdout:(61/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-05-20T16:54:04.420 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 163.237.219.7) 2024-05-20T16:54:04.422 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 104.251.122.5) 2024-05-20T16:54:04.474 INFO:teuthology.orchestra.run.smithi171.stdout:(62/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-05-20T16:54:04.495 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:04.540 INFO:teuthology.orchestra.run.smithi171.stdout:(63/159): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-05-20T16:54:04.546 INFO:teuthology.orchestra.run.smithi006.stdout:(41/159): ceph-test-19.0.0-2744.gd2b507c7.el9.x 7.2 MB/s | 46 MB 00:06 2024-05-20T16:54:04.553 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 163.237.219.7) 2024-05-20T16:54:04.571 INFO:teuthology.orchestra.run.smithi006.stdout:(42/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 301 kB/s | 253 kB 00:00 2024-05-20T16:54:04.591 INFO:teuthology.orchestra.run.smithi171.stdout:(64/159): openblas-0.3.21-2.el9.x86_64.rpm 705 kB/s | 35 kB 00:00 2024-05-20T16:54:04.605 INFO:teuthology.orchestra.run.smithi006.stdout:(43/159): libgfortran-11.4.1-3.el9.x86_64.rpm 594 kB/s | 803 kB 00:01 2024-05-20T16:54:04.717 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T16:54:04.749 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 104.251.122.5) 2024-05-20T16:54:04.764 INFO:teuthology.orchestra.run.smithi006.stdout:(44/159): python3-ply-3.11-14.el9.noarch.rpm 555 kB/s | 106 kB 00:00 2024-05-20T16:54:04.769 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 163.114.130.31) 2024-05-20T16:54:04.789 INFO:teuthology.orchestra.run.smithi006.stdout:(45/159): python3-pycparser-2.20-6.el9.noarch.r 737 kB/s | 135 kB 00:00 2024-05-20T16:54:04.863 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 163.114.130.31) 2024-05-20T16:54:04.865 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:04.880 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T16:54:04.883 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:04.899 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T16:54:04.915 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T16:54:04.923 INFO:teuthology.orchestra.run.smithi006.stdout:(46/159): python3-requests-2.25.1-8.el9.noarch. 787 kB/s | 125 kB 00:00 2024-05-20T16:54:04.939 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:04.962 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:04.970 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T16:54:04.973 INFO:teuthology.orchestra.run.smithi006.stdout:(47/159): python3-urllib3-1.26.5-5.el9.noarch.r 1.1 MB/s | 215 kB 00:00 2024-05-20T16:54:05.001 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 163.237.219.7) 2024-05-20T16:54:05.030 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 163.237.219.7) 2024-05-20T16:54:05.049 INFO:teuthology.orchestra.run.smithi171.stdout:(65/159): openblas-openmp-0.3.21-2.el9.x86_64.r 11 MB/s | 4.7 MB 00:00 2024-05-20T16:54:05.079 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T16:54:05.112 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T16:54:05.118 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 162.255.226.75) 2024-05-20T16:54:05.122 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:05.157 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:54:05.174 INFO:teuthology.orchestra.run.smithi006.stdout:(48/159): automake-1.16.2-8.el9.noarch.rpm 2.7 MB/s | 689 kB 00:00 2024-05-20T16:54:05.192 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T16:54:05.198 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:05.207 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 162.255.226.75) 2024-05-20T16:54:05.214 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 162.255.226.75) 2024-05-20T16:54:05.232 INFO:teuthology.orchestra.run.smithi006.stdout:(49/159): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-05-20T16:54:05.237 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 162.255.226.75) 2024-05-20T16:54:05.253 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 206.82.17.213) 2024-05-20T16:54:05.266 INFO:teuthology.orchestra.run.smithi006.stdout:(50/159): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-05-20T16:54:05.266 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:05.284 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:05.305 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 206.82.17.213) 2024-05-20T16:54:05.324 INFO:teuthology.orchestra.run.smithi006.stdout:(51/159): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-05-20T16:54:05.326 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:05.378 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 206.82.17.213) 2024-05-20T16:54:05.404 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 206.82.17.213) 2024-05-20T16:54:05.405 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:05.408 INFO:teuthology.orchestra.run.smithi006.stdout:(52/159): flexiblas-3.0.4-8.el9.x86_64.rpm 595 kB/s | 33 kB 00:00 2024-05-20T16:54:05.409 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 67.222.0.49) 2024-05-20T16:54:05.438 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:05.453 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 67.222.0.49) 2024-05-20T16:54:05.478 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:05.483 INFO:teuthology.orchestra.run.smithi171.stdout:(66/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-05-20T16:54:05.499 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 67.222.0.49) 2024-05-20T16:54:05.522 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:54:05.539 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 67.222.0.49) 2024-05-20T16:54:05.568 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:05.579 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 104.167.241.199) 2024-05-20T16:54:05.589 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:05.646 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 104.167.241.199) 2024-05-20T16:54:05.646 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:05.658 INFO:teuthology.orchestra.run.smithi171.stdout:(67/159): postgresql-13.14-1.el9.x86_64.rpm 9.1 MB/s | 1.6 MB 00:00 2024-05-20T16:54:05.695 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:05.695 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:54:05.717 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:05.758 INFO:teuthology.orchestra.run.smithi171.stdout:(68/159): postgresql-contrib-13.14-1.el9.x86_64 9.0 MB/s | 911 kB 00:00 2024-05-20T16:54:05.781 INFO:teuthology.orchestra.run.smithi062.stdout:(76/159): python3-babel-2.9.1-2.el9.noarch.rpm 1.8 MB/s | 6.0 MB 00:03 2024-05-20T16:54:05.808 INFO:teuthology.orchestra.run.smithi006.stdout:(53/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.5 MB/s | 3.0 MB 00:00 2024-05-20T16:54:05.819 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 104.167.241.199) 2024-05-20T16:54:05.834 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:05.834 INFO:teuthology.orchestra.run.smithi171.stdout:(69/159): postgresql-private-libs-13.14-1.el9.x 2.5 MB/s | 133 kB 00:00 2024-05-20T16:54:05.835 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:05.867 INFO:teuthology.orchestra.run.smithi006.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 321 kB/s | 18 kB 00:00 2024-05-20T16:54:05.884 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:54:05.889 INFO:teuthology.orchestra.run.smithi062.stdout:(77/159): python3-jsonpatch-1.21-16.el9.noarch. 317 kB/s | 26 kB 00:00 2024-05-20T16:54:05.901 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 104.167.241.199) 2024-05-20T16:54:05.912 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:05.934 INFO:teuthology.orchestra.run.smithi006.stdout:(55/159): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-05-20T16:54:05.948 INFO:teuthology.orchestra.run.smithi062.stdout:(78/159): python3-colorama-0.4.6-3.el9.noarch.r 20 kB/s | 61 kB 00:03 2024-05-20T16:54:05.954 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:05.973 INFO:teuthology.orchestra.run.smithi062.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 232 kB/s | 19 kB 00:00 2024-05-20T16:54:05.993 INFO:teuthology.orchestra.run.smithi006.stdout:(56/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-05-20T16:54:06.007 INFO:teuthology.orchestra.run.smithi062.stdout:(80/159): python3-jinja2-2.11.3-6.el9.noarch.rp 110 kB/s | 248 kB 00:02 2024-05-20T16:54:06.033 INFO:teuthology.orchestra.run.smithi062.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 591 kB/s | 35 kB 00:00 2024-05-20T16:54:06.054 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:06.068 INFO:teuthology.orchestra.run.smithi006.stdout:(57/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 912 kB/s | 45 kB 00:00 2024-05-20T16:54:06.069 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:06.110 INFO:teuthology.orchestra.run.smithi006.stdout:(58/159): python3-cryptography-36.0.1-4.el9.x86 803 kB/s | 1.2 MB 00:01 2024-05-20T16:54:06.151 INFO:teuthology.orchestra.run.smithi171.stdout:(70/159): elfutils-libelf-devel-0.191-4.el9.x86 7.0 kB/s | 22 kB 00:03 2024-05-20T16:54:06.160 INFO:teuthology.orchestra.run.smithi006.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 7.1 MB/s | 662 kB 00:00 2024-05-20T16:54:06.191 INFO:teuthology.orchestra.run.smithi062.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-05-20T16:54:06.211 INFO:teuthology.orchestra.run.smithi006.stdout:(60/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 513 kB/s | 25 kB 00:00 2024-05-20T16:54:06.269 INFO:teuthology.orchestra.run.smithi006.stdout:(61/159): libtool-2.4.6-45.el9.x86_64.rpm 3.6 MB/s | 582 kB 00:00 2024-05-20T16:54:06.286 INFO:teuthology.orchestra.run.smithi006.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-05-20T16:54:06.291 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:06.309 INFO:teuthology.orchestra.run.smithi171.stdout:(71/159): postgresql-server-13.14-1.el9.x86_64. 12 MB/s | 5.8 MB 00:00 2024-05-20T16:54:06.345 INFO:teuthology.orchestra.run.smithi006.stdout:(63/159): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-05-20T16:54:06.360 INFO:teuthology.orchestra.run.smithi171.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-05-20T16:54:06.378 INFO:teuthology.orchestra.run.smithi006.stdout:(64/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-05-20T16:54:06.408 INFO:teuthology.orchestra.run.smithi062.stdout:(83/159): python3-oauthlib-3.1.1-5.el9.noarch.r 1.0 MB/s | 222 kB 00:00 2024-05-20T16:54:06.429 INFO:teuthology.orchestra.run.smithi006.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 422 kB/s | 35 kB 00:00 2024-05-20T16:54:06.467 INFO:teuthology.orchestra.run.smithi062.stdout:(84/159): python3-mako-1.1.4-6.el9.noarch.rpm 332 kB/s | 172 kB 00:00 2024-05-20T16:54:06.492 INFO:teuthology.orchestra.run.smithi062.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 922 kB/s | 77 kB 00:00 2024-05-20T16:54:06.501 INFO:teuthology.orchestra.run.smithi171.stdout:(73/159): protobuf-3.14.0-13.el9.x86_64.rpm 2.9 MB/s | 1.0 MB 00:00 2024-05-20T16:54:06.532 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 163.237.219.7) 2024-05-20T16:54:06.600 INFO:teuthology.orchestra.run.smithi062.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 316 kB/s | 42 kB 00:00 2024-05-20T16:54:06.661 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 163.237.219.7) 2024-05-20T16:54:06.665 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:06.667 INFO:teuthology.orchestra.run.smithi062.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 1.5 MB/s | 269 kB 00:00 2024-05-20T16:54:06.706 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T16:54:06.844 INFO:teuthology.orchestra.run.smithi171.stdout:(74/159): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-05-20T16:54:06.851 INFO:teuthology.orchestra.run.smithi062.stdout:(88/159): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-05-20T16:54:06.863 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T16:54:06.902 INFO:teuthology.orchestra.run.smithi171.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 4.2 MB/s | 244 kB 00:00 2024-05-20T16:54:06.909 INFO:teuthology.orchestra.run.smithi062.stdout:(89/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 514 kB/s | 159 kB 00:00 2024-05-20T16:54:06.931 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 163.237.219.7) 2024-05-20T16:54:06.935 INFO:teuthology.orchestra.run.smithi062.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 610 kB/s | 51 kB 00:00 2024-05-20T16:54:06.965 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 163.237.219.7) 2024-05-20T16:54:06.984 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T16:54:07.003 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T16:54:07.010 INFO:teuthology.orchestra.run.smithi062.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 535 kB/s | 54 kB 00:00 2024-05-20T16:54:07.054 INFO:teuthology.orchestra.run.smithi006.stdout:(66/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 7.1 MB/s | 4.4 MB 00:00 2024-05-20T16:54:07.102 INFO:teuthology.orchestra.run.smithi062.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 454 kB/s | 42 kB 00:00 2024-05-20T16:54:07.202 INFO:teuthology.orchestra.run.smithi062.stdout:(93/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 441 kB/s | 44 kB 00:00 2024-05-20T16:54:07.221 INFO:teuthology.orchestra.run.smithi006.stdout:(67/159): openblas-openmp-0.3.21-2.el9.x86_64.r 5.8 MB/s | 4.7 MB 00:00 2024-05-20T16:54:07.223 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:07.340 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 104.251.122.5) 2024-05-20T16:54:07.347 INFO:teuthology.orchestra.run.smithi006.stdout:(68/159): postgresql-13.14-1.el9.x86_64.rpm 5.5 MB/s | 1.6 MB 00:00 2024-05-20T16:54:07.422 INFO:teuthology.orchestra.run.smithi006.stdout:(69/159): postgresql-contrib-13.14-1.el9.x86_64 4.5 MB/s | 911 kB 00:00 2024-05-20T16:54:07.444 INFO:teuthology.orchestra.run.smithi062.stdout:(94/159): qatlib-24.02.0-1.el9.x86_64.rpm 914 kB/s | 221 kB 00:00 2024-05-20T16:54:07.447 INFO:teuthology.orchestra.run.smithi006.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 1.7 MB/s | 133 kB 00:00 2024-05-20T16:54:07.503 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 104.251.122.5) 2024-05-20T16:54:07.511 INFO:teuthology.orchestra.run.smithi062.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 539 kB/s | 36 kB 00:00 2024-05-20T16:54:07.603 INFO:teuthology.orchestra.run.smithi062.stdout:(96/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 518 kB/s | 47 kB 00:00 2024-05-20T16:54:07.630 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:07.694 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T16:54:07.735 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 104.251.122.5) 2024-05-20T16:54:07.908 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T16:54:07.919 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 104.251.122.5) 2024-05-20T16:54:07.938 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T16:54:07.962 INFO:teuthology.orchestra.run.smithi062.stdout:(97/159): socat-1.7.4.1-5.el9.x86_64.rpm 851 kB/s | 305 kB 00:00 2024-05-20T16:54:08.006 INFO:teuthology.orchestra.run.smithi006.stdout:(71/159): protobuf-3.14.0-13.el9.x86_64.rpm 1.8 MB/s | 1.0 MB 00:00 2024-05-20T16:54:08.028 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:08.045 INFO:teuthology.orchestra.run.smithi062.stdout:(98/159): uuid-1.6.2-55.el9.x86_64.rpm 700 kB/s | 58 kB 00:00 2024-05-20T16:54:08.090 INFO:teuthology.orchestra.run.smithi006.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-05-20T16:54:08.135 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T16:54:08.188 INFO:teuthology.orchestra.run.smithi062.stdout:(99/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 662 kB/s | 94 kB 00:00 2024-05-20T16:54:08.210 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:08.246 INFO:teuthology.orchestra.run.smithi062.stdout:(100/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-05-20T16:54:08.252 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:08.313 INFO:teuthology.orchestra.run.smithi062.stdout:(101/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 672 kB/s | 45 kB 00:00 2024-05-20T16:54:08.341 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T16:54:08.359 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T16:54:08.380 INFO:teuthology.orchestra.run.smithi062.stdout:(102/159): lua-devel-5.4.4-4.el9.x86_64.rpm 334 kB/s | 22 kB 00:00 2024-05-20T16:54:08.381 INFO:teuthology.orchestra.run.smithi006.stdout:(73/159): postgresql-server-13.14-1.el9.x86_64. 6.0 MB/s | 5.8 MB 00:00 2024-05-20T16:54:08.413 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:08.414 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T16:54:08.426 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 163.237.219.7) 2024-05-20T16:54:08.482 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:08.507 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 206.82.17.213) 2024-05-20T16:54:08.538 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T16:54:08.555 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T16:54:08.629 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T16:54:08.643 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 163.237.219.7) 2024-05-20T16:54:08.679 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 206.82.17.213) 2024-05-20T16:54:08.689 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 206.82.17.213) 2024-05-20T16:54:08.693 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:08.705 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T16:54:08.706 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 206.82.17.213) 2024-05-20T16:54:08.723 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 199.223.246.113) 2024-05-20T16:54:08.740 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 199.223.246.113) 2024-05-20T16:54:08.763 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 162.255.226.75) 2024-05-20T16:54:08.781 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 162.255.226.75) 2024-05-20T16:54:08.798 INFO:teuthology.orchestra.run.smithi006.stdout:(74/159): elfutils-libelf-devel-0.191-4.el9.x86 6.1 kB/s | 22 kB 00:03 2024-05-20T16:54:08.824 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T16:54:08.844 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T16:54:08.853 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 162.255.226.75) 2024-05-20T16:54:08.873 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 162.255.226.75) 2024-05-20T16:54:08.898 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T16:54:08.899 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 67.222.0.49) 2024-05-20T16:54:08.914 INFO:teuthology.orchestra.run.smithi062.stdout:(103/159): protobuf-compiler-3.14.0-13.el9.x86_ 1.6 MB/s | 863 kB 00:00 2024-05-20T16:54:08.915 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 67.222.0.49) 2024-05-20T16:54:08.950 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 206.82.17.213) 2024-05-20T16:54:08.996 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 67.222.0.49) 2024-05-20T16:54:08.998 INFO:teuthology.orchestra.run.smithi006.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 1.2 MB/s | 244 kB 00:00 2024-05-20T16:54:09.011 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 67.222.0.49) 2024-05-20T16:54:09.056 INFO:teuthology.orchestra.run.smithi062.stdout:(104/159): python3-numpy-1.20.1-5.el9.x86_64.rp 1.7 MB/s | 5.1 MB 00:03 2024-05-20T16:54:09.056 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 163.237.219.7) 2024-05-20T16:54:09.071 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 216.31.0.2) 2024-05-20T16:54:09.078 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 206.82.17.213) 2024-05-20T16:54:09.085 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 216.31.0.2) 2024-05-20T16:54:09.090 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 163.237.219.7) 2024-05-20T16:54:09.112 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 199.223.246.113) 2024-05-20T16:54:09.113 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T16:54:09.137 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T16:54:09.151 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 162.255.226.75) 2024-05-20T16:54:09.155 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T16:54:09.211 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 216.31.0.2) 2024-05-20T16:54:09.224 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T16:54:09.233 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 216.31.0.2) 2024-05-20T16:54:09.248 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 206.82.17.213) 2024-05-20T16:54:09.256 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 162.255.226.75) 2024-05-20T16:54:09.271 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 206.82.17.213) 2024-05-20T16:54:09.288 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 199.223.246.113) 2024-05-20T16:54:09.509 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 162.255.226.75) 2024-05-20T16:54:09.509 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 162.255.226.75) 2024-05-20T16:54:09.510 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T16:54:09.510 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T16:54:09.636 INFO:teuthology.orchestra.run.smithi171.stdout:(76/159): ceph-test-19.0.0-2744.gd2b507c7.el9.x 2.9 MB/s | 46 MB 00:16 2024-05-20T16:54:09.637 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 163.114.130.31) 2024-05-20T16:54:09.646 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 163.114.130.31) 2024-05-20T16:54:09.739 INFO:teuthology.orchestra.run.smithi062.stdout:(105/159): gperftools-libs-2.9.1-2.el9.x86_64.r 453 kB/s | 309 kB 00:00 2024-05-20T16:54:09.761 INFO:teuthology.orchestra.run.smithi171.stdout:(77/159): python3-jsonpatch-1.21-16.el9.noarch. 207 kB/s | 26 kB 00:00 2024-05-20T16:54:09.763 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 163.114.130.31) 2024-05-20T16:54:09.764 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 163.114.130.31) 2024-05-20T16:54:09.767 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T16:54:09.806 INFO:teuthology.orchestra.run.smithi062.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 291 kB/s | 19 kB 00:00 2024-05-20T16:54:09.811 INFO:teuthology.orchestra.run.smithi171.stdout:(78/159): python3-jsonpointer-2.0-4.el9.noarch. 398 kB/s | 19 kB 00:00 2024-05-20T16:54:09.838 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T16:54:09.848 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 104.167.241.199) 2024-05-20T16:54:09.849 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 104.167.241.199) 2024-05-20T16:54:09.898 INFO:teuthology.orchestra.run.smithi062.stdout:(107/159): abseil-cpp-20211102.0-3.el9.x86_64.r 557 kB/s | 548 kB 00:00 2024-05-20T16:54:09.957 INFO:teuthology.orchestra.run.smithi062.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 444 kB/s | 26 kB 00:00 2024-05-20T16:54:09.961 INFO:teuthology.orchestra.run.smithi171.stdout:(79/159): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-05-20T16:54:10.012 INFO:teuthology.orchestra.run.smithi171.stdout:(80/159): python3-markupsafe-1.1.1-12.el9.x86_6 710 kB/s | 35 kB 00:00 2024-05-20T16:54:10.012 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 104.167.241.199) 2024-05-20T16:54:10.016 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 104.167.241.199) 2024-05-20T16:54:10.024 INFO:teuthology.orchestra.run.smithi006.stdout:(76/159): python3-babel-2.9.1-2.el9.noarch.rpm 3.1 MB/s | 6.0 MB 00:01 2024-05-20T16:54:10.049 INFO:teuthology.orchestra.run.smithi062.stdout:(109/159): liboath-2.6.7-2.el9.x86_64.rpm 530 kB/s | 49 kB 00:00 2024-05-20T16:54:10.099 INFO:teuthology.orchestra.run.smithi006.stdout:(77/159): python3-jsonpatch-1.21-16.el9.noarch. 528 kB/s | 26 kB 00:00 2024-05-20T16:54:10.141 INFO:teuthology.orchestra.run.smithi062.stdout:(110/159): libunwind-1.6.2-1.el9.x86_64.rpm 734 kB/s | 67 kB 00:00 2024-05-20T16:54:10.145 INFO:teuthology.orchestra.run.smithi171.stdout:(81/159): python3-colorama-0.4.6-3.el9.noarch.r 17 kB/s | 61 kB 00:03 2024-05-20T16:54:10.171 INFO:teuthology.orchestra.run.smithi171.stdout:(82/159): python3-jinja2-2.11.3-6.el9.noarch.rp 76 kB/s | 248 kB 00:03 2024-05-20T16:54:10.174 INFO:teuthology.orchestra.run.smithi006.stdout:(78/159): python3-jsonpointer-2.0-4.el9.noarch. 255 kB/s | 19 kB 00:00 2024-05-20T16:54:10.258 INFO:teuthology.orchestra.run.smithi006.stdout:(79/159): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-05-20T16:54:10.299 INFO:teuthology.orchestra.run.smithi062.stdout:(111/159): luarocks-3.9.2-5.el9.noarch.rpm 957 kB/s | 151 kB 00:00 2024-05-20T16:54:10.302 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 104.251.122.5) 2024-05-20T16:54:10.329 INFO:teuthology.orchestra.run.smithi171.stdout:(83/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 250 kB 00:00 2024-05-20T16:54:10.355 INFO:teuthology.orchestra.run.smithi171.stdout:(84/159): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 222 kB 00:00 2024-05-20T16:54:10.367 INFO:teuthology.orchestra.run.smithi006.stdout:(80/159): python3-markupsafe-1.1.1-12.el9.x86_6 321 kB/s | 35 kB 00:00 2024-05-20T16:54:10.379 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 104.251.122.5) 2024-05-20T16:54:10.380 INFO:teuthology.orchestra.run.smithi171.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-05-20T16:54:10.439 INFO:teuthology.orchestra.run.smithi171.stdout:(86/159): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-05-20T16:54:10.464 INFO:teuthology.orchestra.run.smithi171.stdout:(87/159): python3-prettytable-0.7.2-27.el9.noar 388 kB/s | 42 kB 00:00 2024-05-20T16:54:10.497 INFO:teuthology.orchestra.run.smithi171.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-05-20T16:54:10.556 INFO:teuthology.orchestra.run.smithi171.stdout:(89/159): python3-pytz-2021.1-5.el9.noarch.rpm 872 kB/s | 51 kB 00:00 2024-05-20T16:54:10.582 INFO:teuthology.orchestra.run.smithi171.stdout:(90/159): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-05-20T16:54:10.615 INFO:teuthology.orchestra.run.smithi171.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 915 kB/s | 54 kB 00:00 2024-05-20T16:54:10.687 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 104.251.122.5) 2024-05-20T16:54:10.690 INFO:teuthology.orchestra.run.smithi171.stdout:(92/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.5 MB/s | 5.1 MB 00:00 2024-05-20T16:54:10.716 INFO:teuthology.orchestra.run.smithi171.stdout:(93/159): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-05-20T16:54:10.758 INFO:teuthology.orchestra.run.smithi171.stdout:(94/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 661 kB/s | 44 kB 00:00 2024-05-20T16:54:10.764 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 104.251.122.5) 2024-05-20T16:54:10.775 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 216.31.2.234) 2024-05-20T16:54:10.783 INFO:teuthology.orchestra.run.smithi171.stdout:(95/159): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-05-20T16:54:10.808 INFO:teuthology.orchestra.run.smithi062.stdout:(112/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.6 MB/s | 839 kB 00:00 2024-05-20T16:54:10.825 INFO:teuthology.orchestra.run.smithi171.stdout:(96/159): qatlib-service-24.02.0-1.el9.x86_64.r 536 kB/s | 36 kB 00:00 2024-05-20T16:54:10.849 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 216.31.2.234) 2024-05-20T16:54:10.934 INFO:teuthology.orchestra.run.smithi171.stdout:(97/159): socat-1.7.4.1-5.el9.x86_64.rpm 2.7 MB/s | 305 kB 00:00 2024-05-20T16:54:10.937 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 216.31.2.234) 2024-05-20T16:54:10.967 INFO:teuthology.orchestra.run.smithi171.stdout:(98/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 257 kB/s | 47 kB 00:00 2024-05-20T16:54:11.006 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 216.31.2.234) 2024-05-20T16:54:11.032 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 104.167.241.199) 2024-05-20T16:54:11.076 INFO:teuthology.orchestra.run.smithi171.stdout:(99/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 866 kB/s | 94 kB 00:00 2024-05-20T16:54:11.100 INFO:teuthology.orchestra.run.smithi062.stdout:(113/159): python3-asyncssh-2.13.2-5.el9.noarch 1.8 MB/s | 548 kB 00:00 2024-05-20T16:54:11.126 INFO:teuthology.orchestra.run.smithi171.stdout:(100/159): uuid-1.6.2-55.el9.x86_64.rpm 301 kB/s | 58 kB 00:00 2024-05-20T16:54:11.152 INFO:teuthology.orchestra.run.smithi171.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 844 kB/s | 64 kB 00:00 2024-05-20T16:54:11.184 INFO:teuthology.orchestra.run.smithi062.stdout:(114/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 521 kB/s | 43 kB 00:00 2024-05-20T16:54:11.193 INFO:teuthology.orchestra.run.smithi171.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 668 kB/s | 45 kB 00:00 2024-05-20T16:54:11.218 INFO:teuthology.orchestra.run.smithi171.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 333 kB/s | 22 kB 00:00 2024-05-20T16:54:11.225 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 104.167.241.199) 2024-05-20T16:54:11.267 INFO:teuthology.orchestra.run.smithi062.stdout:(115/159): python3-cachetools-4.2.4-1.el9.noarc 387 kB/s | 32 kB 00:00 2024-05-20T16:54:11.295 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 67.222.0.49) 2024-05-20T16:54:11.326 INFO:teuthology.orchestra.run.smithi062.stdout:(116/159): python3-certifi-2021.10.8-2.el9.noar 258 kB/s | 15 kB 00:00 2024-05-20T16:54:11.372 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 104.167.241.199) 2024-05-20T16:54:11.382 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 67.222.0.49) 2024-05-20T16:54:11.412 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 104.167.241.199) 2024-05-20T16:54:11.418 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 163.114.130.31) 2024-05-20T16:54:11.426 INFO:teuthology.orchestra.run.smithi062.stdout:(117/159): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-05-20T16:54:11.427 INFO:teuthology.orchestra.run.smithi171.stdout:(104/159): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-05-20T16:54:11.455 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 67.222.0.49) 2024-05-20T16:54:11.479 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 67.222.0.49) 2024-05-20T16:54:11.494 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 163.114.130.31) 2024-05-20T16:54:11.499 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 163.114.130.31) 2024-05-20T16:54:11.577 INFO:teuthology.orchestra.run.smithi062.stdout:(118/159): python3-cherrypy-18.6.1-2.el9.noarch 2.3 MB/s | 358 kB 00:00 2024-05-20T16:54:11.617 INFO:teuthology.orchestra.run.smithi006.stdout:(81/159): python3-colorama-0.4.6-3.el9.noarch.r 19 kB/s | 61 kB 00:03 2024-05-20T16:54:11.618 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 163.114.130.31) 2024-05-20T16:54:11.684 INFO:teuthology.orchestra.run.smithi006.stdout:(82/159): python3-jinja2-2.11.3-6.el9.noarch.rp 93 kB/s | 248 kB 00:02 2024-05-20T16:54:11.702 INFO:teuthology.orchestra.run.smithi062.stdout:(119/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-05-20T16:54:11.753 INFO:teuthology.orchestra.run.smithi171.stdout:(105/159): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-05-20T16:54:11.777 INFO:teuthology.orchestra.run.smithi062.stdout:(120/159): libarrow-9.0.0-11.el9.x86_64.rpm 2.2 MB/s | 4.4 MB 00:01 2024-05-20T16:54:11.827 INFO:teuthology.orchestra.run.smithi062.stdout:(121/159): python3-google-auth-2.29.0-1.el9.noa 1.6 MB/s | 206 kB 00:00 2024-05-20T16:54:11.868 INFO:teuthology.orchestra.run.smithi006.stdout:(83/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.0 MB/s | 250 kB 00:00 2024-05-20T16:54:11.886 INFO:teuthology.orchestra.run.smithi062.stdout:(122/159): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-05-20T16:54:11.893 INFO:teuthology.orchestra.run.smithi006.stdout:(84/159): python3-oauthlib-3.1.1-5.el9.noarch.r 1.0 MB/s | 222 kB 00:00 2024-05-20T16:54:11.936 INFO:teuthology.orchestra.run.smithi062.stdout:(123/159): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-05-20T16:54:11.943 INFO:teuthology.orchestra.run.smithi006.stdout:(85/159): python3-prettytable-0.7.2-27.el9.noar 846 kB/s | 42 kB 00:00 2024-05-20T16:54:11.953 INFO:teuthology.orchestra.run.smithi171.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 97 kB/s | 19 kB 00:00 2024-05-20T16:54:11.968 INFO:teuthology.orchestra.run.smithi006.stdout:(86/159): python3-packaging-20.9-5.el9.noarch.r 767 kB/s | 77 kB 00:00 2024-05-20T16:54:11.978 INFO:teuthology.orchestra.run.smithi171.stdout:(107/159): gperftools-libs-2.9.1-2.el9.x86_64.r 561 kB/s | 309 kB 00:00 2024-05-20T16:54:11.987 INFO:teuthology.orchestra.run.smithi062.stdout:(124/159): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-05-20T16:54:12.011 INFO:teuthology.orchestra.run.smithi006.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-05-20T16:54:12.045 INFO:teuthology.orchestra.run.smithi062.stdout:(125/159): python3-jaraco-collections-3.0.0-8.e 397 kB/s | 23 kB 00:00 2024-05-20T16:54:12.078 INFO:teuthology.orchestra.run.smithi006.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-05-20T16:54:12.078 INFO:teuthology.orchestra.run.smithi171.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 260 kB/s | 26 kB 00:00 2024-05-20T16:54:12.137 INFO:teuthology.orchestra.run.smithi062.stdout:(126/159): python3-grpcio-1.46.7-10.el9.x86_64. 5.7 MB/s | 2.0 MB 00:00 2024-05-20T16:54:12.144 INFO:teuthology.orchestra.run.smithi006.stdout:(89/159): python3-pytz-2021.1-5.el9.noarch.rpm 764 kB/s | 51 kB 00:00 2024-05-20T16:54:12.154 INFO:teuthology.orchestra.run.smithi062.stdout:(127/159): python3-jaraco-functools-3.5.0-2.el9 179 kB/s | 19 kB 00:00 2024-05-20T16:54:12.179 INFO:teuthology.orchestra.run.smithi171.stdout:(109/159): liboath-2.6.7-2.el9.x86_64.rpm 484 kB/s | 49 kB 00:00 2024-05-20T16:54:12.213 INFO:teuthology.orchestra.run.smithi062.stdout:(128/159): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-05-20T16:54:12.228 INFO:teuthology.orchestra.run.smithi006.stdout:(90/159): python3-requests-oauthlib-1.3.0-12.el 644 kB/s | 54 kB 00:00 2024-05-20T16:54:12.253 INFO:teuthology.orchestra.run.smithi006.stdout:(91/159): python3-pyasn1-modules-0.4.8-6.el9.no 1.1 MB/s | 279 kB 00:00 2024-05-20T16:54:12.296 INFO:teuthology.orchestra.run.smithi062.stdout:(129/159): python3-logutils-0.3.5-21.el9.noarch 556 kB/s | 46 kB 00:00 2024-05-20T16:54:12.329 INFO:teuthology.orchestra.run.smithi171.stdout:(110/159): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-05-20T16:54:12.354 INFO:teuthology.orchestra.run.smithi006.stdout:(92/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.6 MB/s | 5.1 MB 00:01 2024-05-20T16:54:12.355 INFO:teuthology.orchestra.run.smithi171.stdout:(111/159): libunwind-1.6.2-1.el9.x86_64.rpm 384 kB/s | 67 kB 00:00 2024-05-20T16:54:12.372 INFO:teuthology.orchestra.run.smithi062.stdout:(130/159): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-05-20T16:54:12.379 INFO:teuthology.orchestra.run.smithi006.stdout:(93/159): python3-toml-0.10.2-6.el9.noarch.rpm 332 kB/s | 42 kB 00:00 2024-05-20T16:54:12.413 INFO:teuthology.orchestra.run.smithi006.stdout:(94/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 753 kB/s | 44 kB 00:00 2024-05-20T16:54:12.430 INFO:teuthology.orchestra.run.smithi171.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-05-20T16:54:12.438 INFO:teuthology.orchestra.run.smithi062.stdout:(131/159): python3-natsort-7.1.1-5.el9.noarch.r 868 kB/s | 58 kB 00:00 2024-05-20T16:54:12.446 INFO:teuthology.orchestra.run.smithi006.stdout:(95/159): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-05-20T16:54:12.472 INFO:teuthology.orchestra.run.smithi006.stdout:(96/159): qatlib-service-24.02.0-1.el9.x86_64.r 611 kB/s | 36 kB 00:00 2024-05-20T16:54:12.505 INFO:teuthology.orchestra.run.smithi006.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-05-20T16:54:12.522 INFO:teuthology.orchestra.run.smithi062.stdout:(132/159): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-05-20T16:54:12.547 INFO:teuthology.orchestra.run.smithi062.stdout:(133/159): python3-pecan-1.4.2-3.el9.noarch.rpm 2.5 MB/s | 272 kB 00:00 2024-05-20T16:54:12.555 INFO:teuthology.orchestra.run.smithi171.stdout:(113/159): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-05-20T16:54:12.572 INFO:teuthology.orchestra.run.smithi006.stdout:(98/159): uuid-1.6.2-55.el9.x86_64.rpm 867 kB/s | 58 kB 00:00 2024-05-20T16:54:12.580 INFO:teuthology.orchestra.run.smithi171.stdout:(114/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.6 MB/s | 839 kB 00:00 2024-05-20T16:54:12.589 INFO:teuthology.orchestra.run.smithi062.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 246 kB/s | 16 kB 00:00 2024-05-20T16:54:12.615 INFO:teuthology.orchestra.run.smithi062.stdout:(135/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-05-20T16:54:12.639 INFO:teuthology.orchestra.run.smithi006.stdout:(99/159): socat-1.7.4.1-5.el9.x86_64.rpm 1.8 MB/s | 305 kB 00:00 2024-05-20T16:54:12.648 INFO:teuthology.orchestra.run.smithi171.stdout:(115/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 472 kB/s | 43 kB 00:00 2024-05-20T16:54:12.657 INFO:teuthology.orchestra.run.smithi062.stdout:(136/159): python3-pyperclip-1.8.2-2.el9.noarch 420 kB/s | 28 kB 00:00 2024-05-20T16:54:12.664 INFO:teuthology.orchestra.run.smithi006.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.0 MB/s | 94 kB 00:00 2024-05-20T16:54:12.682 INFO:teuthology.orchestra.run.smithi062.stdout:(137/159): python3-repoze-lru-0.7-16.el9.noarch 459 kB/s | 31 kB 00:00 2024-05-20T16:54:12.706 INFO:teuthology.orchestra.run.smithi006.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 953 kB/s | 64 kB 00:00 2024-05-20T16:54:12.723 INFO:teuthology.orchestra.run.smithi171.stdout:(116/159): python3-cachetools-4.2.4-1.el9.noarc 226 kB/s | 32 kB 00:00 2024-05-20T16:54:12.732 INFO:teuthology.orchestra.run.smithi006.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 666 kB/s | 45 kB 00:00 2024-05-20T16:54:12.732 INFO:teuthology.orchestra.run.smithi062.stdout:(138/159): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-05-20T16:54:12.748 INFO:teuthology.orchestra.run.smithi171.stdout:(117/159): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2024-05-20T16:54:12.758 INFO:teuthology.orchestra.run.smithi062.stdout:(139/159): python3-rsa-4.9-2.el9.noarch.rpm 787 kB/s | 59 kB 00:00 2024-05-20T16:54:12.774 INFO:teuthology.orchestra.run.smithi006.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 334 kB/s | 22 kB 00:00 2024-05-20T16:54:12.799 INFO:teuthology.orchestra.run.smithi062.stdout:(140/159): python3-tempora-5.0.0-2.el9.noarch.r 535 kB/s | 36 kB 00:00 2024-05-20T16:54:12.807 INFO:teuthology.orchestra.run.smithi171.stdout:(118/159): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-05-20T16:54:12.825 INFO:teuthology.orchestra.run.smithi062.stdout:(141/159): python3-typing-extensions-4.4.0-2.el 761 kB/s | 51 kB 00:00 2024-05-20T16:54:12.849 INFO:teuthology.orchestra.run.smithi171.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-05-20T16:54:12.907 INFO:teuthology.orchestra.run.smithi171.stdout:(120/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-05-20T16:54:12.909 INFO:teuthology.orchestra.run.smithi062.stdout:(142/159): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-05-20T16:54:12.924 INFO:teuthology.orchestra.run.smithi006.stdout:(104/159): protobuf-compiler-3.14.0-13.el9.x86_ 4.4 MB/s | 863 kB 00:00 2024-05-20T16:54:12.934 INFO:teuthology.orchestra.run.smithi062.stdout:(143/159): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-05-20T16:54:12.949 INFO:teuthology.orchestra.run.smithi171.stdout:(121/159): python3-google-auth-2.29.0-1.el9.noa 2.0 MB/s | 206 kB 00:00 2024-05-20T16:54:13.018 INFO:teuthology.orchestra.run.smithi062.stdout:(144/159): python3-zc-lockfile-2.0-10.el9.noarc 239 kB/s | 20 kB 00:00 2024-05-20T16:54:13.083 INFO:teuthology.orchestra.run.smithi171.stdout:(122/159): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-05-20T16:54:13.101 INFO:teuthology.orchestra.run.smithi062.stdout:(145/159): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-05-20T16:54:13.175 INFO:teuthology.orchestra.run.smithi171.stdout:(123/159): python3-jaraco-8.2.1-3.el9.noarch.rp 117 kB/s | 11 kB 00:00 2024-05-20T16:54:13.208 INFO:teuthology.orchestra.run.smithi171.stdout:(124/159): python3-grpcio-1.46.7-10.el9.x86_64. 6.8 MB/s | 2.0 MB 00:00 2024-05-20T16:54:13.259 INFO:teuthology.orchestra.run.smithi171.stdout:(125/159): python3-jaraco-classes-3.2.1-5.el9.n 211 kB/s | 18 kB 00:00 2024-05-20T16:54:13.300 INFO:teuthology.orchestra.run.smithi171.stdout:(126/159): python3-jaraco-collections-3.0.0-8.e 251 kB/s | 23 kB 00:00 2024-05-20T16:54:13.351 INFO:teuthology.orchestra.run.smithi171.stdout:(127/159): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-05-20T16:54:13.368 INFO:teuthology.orchestra.run.smithi062.stdout:(146/159): python3-werkzeug-2.0.3-3.el9.1.noarc 932 kB/s | 427 kB 00:00 2024-05-20T16:54:13.393 INFO:teuthology.orchestra.run.smithi171.stdout:(128/159): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2024-05-20T16:54:13.493 INFO:teuthology.orchestra.run.smithi171.stdout:(129/159): python3-logutils-0.3.5-21.el9.noarch 463 kB/s | 46 kB 00:00 2024-05-20T16:54:13.527 INFO:teuthology.orchestra.run.smithi062.stdout:(147/159): thrift-0.15.0-2.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-05-20T16:54:13.527 INFO:teuthology.orchestra.run.smithi171.stdout:(130/159): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-05-20T16:54:13.586 INFO:teuthology.orchestra.run.smithi171.stdout:(131/159): python3-more-itertools-8.12.0-2.el9. 857 kB/s | 79 kB 00:00 2024-05-20T16:54:13.619 INFO:teuthology.orchestra.run.smithi171.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 627 kB/s | 58 kB 00:00 2024-05-20T16:54:13.694 INFO:teuthology.orchestra.run.smithi171.stdout:(133/159): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-05-20T16:54:13.728 INFO:teuthology.orchestra.run.smithi171.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 151 kB/s | 16 kB 00:00 2024-05-20T16:54:13.785 INFO:teuthology.orchestra.run.smithi062.stdout:(148/159): librados2-19.0.0-2744.gd2b507c7.el9. 7.9 MB/s | 3.3 MB 00:00 2024-05-20T16:54:13.795 INFO:teuthology.orchestra.run.smithi171.stdout:(135/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 897 kB/s | 90 kB 00:00 2024-05-20T16:54:13.837 INFO:teuthology.orchestra.run.smithi171.stdout:(136/159): python3-pyperclip-1.8.2-2.el9.noarch 259 kB/s | 28 kB 00:00 2024-05-20T16:54:13.946 INFO:teuthology.orchestra.run.smithi171.stdout:(137/159): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-05-20T16:54:13.952 INFO:teuthology.orchestra.run.smithi062.stdout:(149/159): librbd1-19.0.0-2744.gd2b507c7.el9.x8 7.3 MB/s | 3.1 MB 00:00 2024-05-20T16:54:14.038 INFO:teuthology.orchestra.run.smithi171.stdout:(138/159): python3-rsa-4.9-2.el9.noarch.rpm 646 kB/s | 59 kB 00:00 2024-05-20T16:54:14.130 INFO:teuthology.orchestra.run.smithi171.stdout:(139/159): python3-tempora-5.0.0-2.el9.noarch.r 390 kB/s | 36 kB 00:00 2024-05-20T16:54:14.194 INFO:teuthology.orchestra.run.smithi062.stdout:(150/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.2 MB/s | 16 MB 00:07 2024-05-20T16:54:14.205 INFO:teuthology.orchestra.run.smithi171.stdout:(140/159): python3-repoze-lru-0.7-16.el9.noarch 75 kB/s | 31 kB 00:00 2024-05-20T16:54:14.239 INFO:teuthology.orchestra.run.smithi171.stdout:(141/159): python3-typing-extensions-4.4.0-2.el 469 kB/s | 51 kB 00:00 2024-05-20T16:54:14.348 INFO:teuthology.orchestra.run.smithi171.stdout:(142/159): python3-websocket-client-1.2.3-2.el9 828 kB/s | 90 kB 00:00 2024-05-20T16:54:14.403 INFO:teuthology.orchestra.run.smithi062.stdout:(151/159): NetworkManager-1.47.90-1.el9.x86_64. 3.7 MB/s | 2.3 MB 00:00 2024-05-20T16:54:14.428 INFO:teuthology.orchestra.run.smithi062.stdout:(152/159): NetworkManager-team-1.47.90-1.el9.x8 178 kB/s | 41 kB 00:00 2024-05-20T16:54:14.478 INFO:teuthology.orchestra.run.smithi062.stdout:(153/159): NetworkManager-tui-1.47.90-1.el9.x86 3.2 MB/s | 248 kB 00:00 2024-05-20T16:54:14.479 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:14.489 INFO:teuthology.orchestra.run.smithi171.stdout:(143/159): python3-webob-1.8.7-6.el9.noarch.rpm 809 kB/s | 230 kB 00:00 2024-05-20T16:54:14.515 INFO:teuthology.orchestra.run.smithi171.stdout:(144/159): python3-werkzeug-2.0.3-3.el9.1.noarc 2.5 MB/s | 427 kB 00:00 2024-05-20T16:54:14.554 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:14.582 INFO:teuthology.orchestra.run.smithi171.stdout:(145/159): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-05-20T16:54:14.614 INFO:teuthology.orchestra.run.smithi062.stdout:(154/159): NetworkManager-libnm-1.47.90-1.el9.x 2.7 MB/s | 1.8 MB 00:00 2024-05-20T16:54:14.640 INFO:teuthology.orchestra.run.smithi171.stdout:(146/159): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2024-05-20T16:54:14.653 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:14.683 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:14.693 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:14.741 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:14.741 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:14.762 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:14.781 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:14.783 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:14.783 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:14.799 INFO:teuthology.orchestra.run.smithi006.stdout:(105/159): gperftools-libs-2.9.1-2.el9.x86_64.r 165 kB/s | 309 kB 00:01 2024-05-20T16:54:14.802 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:14.819 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:54:14.819 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:54:14.835 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:54:14.899 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:14.900 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:14.907 INFO:teuthology.orchestra.run.smithi171.stdout:(147/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-05-20T16:54:14.918 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:15.049 INFO:teuthology.orchestra.run.smithi171.stdout:(148/159): librados2-19.0.0-2744.gd2b507c7.el9. 8.1 MB/s | 3.3 MB 00:00 2024-05-20T16:54:15.059 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:15.073 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:15.100 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:15.157 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:15.170 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:15.201 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:15.258 INFO:teuthology.orchestra.run.smithi006.stdout:(106/159): abseil-cpp-20211102.0-3.el9.x86_64.r 221 kB/s | 548 kB 00:02 2024-05-20T16:54:15.275 INFO:teuthology.orchestra.run.smithi006.stdout:(107/159): grpc-data-1.46.7-10.el9.noarch.rpm 41 kB/s | 19 kB 00:00 2024-05-20T16:54:15.339 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:15.349 INFO:teuthology.orchestra.run.smithi171.stdout:(149/159): librbd1-19.0.0-2744.gd2b507c7.el9.x8 7.0 MB/s | 3.1 MB 00:00 2024-05-20T16:54:15.354 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:15.381 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:15.578 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:15.579 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:15.585 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:15.658 INFO:teuthology.orchestra.run.smithi171.stdout:(150/159): thrift-0.15.0-2.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-05-20T16:54:15.700 INFO:teuthology.orchestra.run.smithi171.stdout:(151/159): NetworkManager-1.47.90-1.el9.x86_64. 3.6 MB/s | 2.3 MB 00:00 2024-05-20T16:54:15.800 INFO:teuthology.orchestra.run.smithi171.stdout:(152/159): NetworkManager-libnm-1.47.90-1.el9.x 4.0 MB/s | 1.8 MB 00:00 2024-05-20T16:54:15.826 INFO:teuthology.orchestra.run.smithi171.stdout:(153/159): NetworkManager-tui-1.47.90-1.el9.x86 1.9 MB/s | 248 kB 00:00 2024-05-20T16:54:15.850 INFO:teuthology.orchestra.run.smithi171.stdout:(154/159): NetworkManager-team-1.47.90-1.el9.x8 216 kB/s | 41 kB 00:00 2024-05-20T16:54:15.851 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:15.862 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:15.943 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:15.986 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:16.006 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:16.009 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:16.034 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:16.035 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:16.058 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:16.068 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:16.071 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:54:16.089 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:54:16.108 INFO:teuthology.orchestra.run.smithi006.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 31 kB/s | 26 kB 00:00 2024-05-20T16:54:16.113 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:16.113 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:16.169 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:54:16.190 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:16.216 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:16.239 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:54:16.243 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:16.250 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:54:16.314 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:16.326 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:16.327 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:54:16.406 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:16.473 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:16.486 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:16.491 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:16.527 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:16.562 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:16.570 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:16.584 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:16.588 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:16.609 INFO:teuthology.orchestra.run.smithi006.stdout:(109/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.7 MB/s | 16 MB 00:04 2024-05-20T16:54:16.644 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:16.734 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:16.747 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:16.783 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:17.112 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:17.117 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:17.130 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:17.131 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:17.151 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:54:17.163 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:54:17.164 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:17.168 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:17.198 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:17.204 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:17.204 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:54:17.240 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:17.247 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:17.282 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:17.300 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:17.329 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:17.374 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:17.401 INFO:teuthology.orchestra.run.smithi006.stdout:(110/159): libarrow-9.0.0-11.el9.x86_64.rpm 2.1 MB/s | 4.4 MB 00:02 2024-05-20T16:54:17.401 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:17.417 INFO:teuthology.orchestra.run.smithi006.stdout:(111/159): liboath-2.6.7-2.el9.x86_64.rpm 37 kB/s | 49 kB 00:01 2024-05-20T16:54:17.443 INFO:teuthology.orchestra.run.smithi006.stdout:(112/159): libunwind-1.6.2-1.el9.x86_64.rpm 81 kB/s | 67 kB 00:00 2024-05-20T16:54:17.497 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:17.511 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:17.528 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:17.544 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:17.575 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:17.605 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:17.630 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:17.644 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:17.700 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:17.718 INFO:teuthology.orchestra.run.smithi006.stdout:(113/159): luarocks-3.9.2-5.el9.noarch.rpm 551 kB/s | 151 kB 00:00 2024-05-20T16:54:17.743 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:17.753 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:17.785 INFO:teuthology.orchestra.run.smithi006.stdout:(114/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.4 MB/s | 839 kB 00:00 2024-05-20T16:54:17.787 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:17.852 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:17.872 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:17.872 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:17.944 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:17.944 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:18.007 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:18.027 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:18.033 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:18.110 INFO:teuthology.orchestra.run.smithi006.stdout:(115/159): python3-asyncssh-2.13.2-5.el9.noarch 822 kB/s | 548 kB 00:00 2024-05-20T16:54:18.128 INFO:teuthology.orchestra.run.smithi062.stdout:(155/159): elfutils-libs-0.191-4.el9.x86_64.rpm 74 kB/s | 260 kB 00:03 2024-05-20T16:54:18.130 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:18.135 INFO:teuthology.orchestra.run.smithi006.stdout:(116/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 104 kB/s | 43 kB 00:00 2024-05-20T16:54:18.154 INFO:teuthology.orchestra.run.smithi062.stdout:(156/159): elfutils-debuginfod-client-0.191-4.e 9.8 kB/s | 37 kB 00:03 2024-05-20T16:54:18.160 INFO:teuthology.orchestra.run.smithi006.stdout:(117/159): python3-cachetools-4.2.4-1.el9.noarc 86 kB/s | 32 kB 00:00 2024-05-20T16:54:18.182 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:18.204 INFO:teuthology.orchestra.run.smithi062.stdout:(157/159): elfutils-libelf-0.191-4.el9.x86_64.r 55 kB/s | 207 kB 00:03 2024-05-20T16:54:18.231 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:18.262 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:18.317 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:18.354 INFO:teuthology.orchestra.run.smithi062.stdout:(158/159): openssl-3.2.1-1.el9.x86_64.rpm 6.0 MB/s | 1.3 MB 00:00 2024-05-20T16:54:18.370 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:18.410 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:18.463 INFO:teuthology.orchestra.run.smithi062.stdout:(159/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 7.8 MB/s | 2.4 MB 00:00 2024-05-20T16:54:18.470 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-20T16:54:18.470 INFO:teuthology.orchestra.run.smithi062.stdout:Total 6.9 MB/s | 222 MB 00:32 2024-05-20T16:54:18.525 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:18.568 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:18.570 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:18.612 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:18.612 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:18.636 INFO:teuthology.orchestra.run.smithi006.stdout:(118/159): python3-certifi-2021.10.8-2.el9.noar 32 kB/s | 15 kB 00:00 2024-05-20T16:54:18.657 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:18.657 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:18.679 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:18.698 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:18.743 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:54:18.762 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:54:18.782 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:54:18.869 INFO:teuthology.orchestra.run.smithi006.stdout:(119/159): python3-cheroot-8.6.0-4.el9.noarch.r 242 kB/s | 172 kB 00:00 2024-05-20T16:54:18.894 INFO:teuthology.orchestra.run.smithi006.stdout:(120/159): python3-cherrypy-18.6.1-2.el9.noarch 489 kB/s | 358 kB 00:00 2024-05-20T16:54:18.902 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:54:18.924 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:54:18.944 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.31.0.2) 2024-05-20T16:54:18.953 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:18.956 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:19.034 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:19.042 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:19.103 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:19.104 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:19.111 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:19.154 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:19.154 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:19.230 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:19.271 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:19.310 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:19.320 INFO:teuthology.orchestra.run.smithi006.stdout:(121/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 443 kB/s | 303 kB 00:00 2024-05-20T16:54:19.334 INFO:teuthology.orchestra.run.smithi171.stdout:(155/159): elfutils-debuginfod-client-0.191-4.e 10 kB/s | 37 kB 00:03 2024-05-20T16:54:19.362 INFO:teuthology.orchestra.run.smithi006.stdout:(122/159): python3-google-auth-2.29.0-1.el9.noa 441 kB/s | 206 kB 00:00 2024-05-20T16:54:19.400 INFO:teuthology.orchestra.run.smithi171.stdout:(156/159): elfutils-libelf-0.191-4.el9.x86_64.r 58 kB/s | 207 kB 00:03 2024-05-20T16:54:19.426 INFO:teuthology.orchestra.run.smithi171.stdout:(157/159): elfutils-libs-0.191-4.el9.x86_64.rpm 73 kB/s | 260 kB 00:03 2024-05-20T16:54:19.676 INFO:teuthology.orchestra.run.smithi171.stdout:(158/159): openssl-3.2.1-1.el9.x86_64.rpm 4.0 MB/s | 1.3 MB 00:00 2024-05-20T16:54:19.703 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-20T16:54:19.879 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-20T16:54:19.880 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-20T16:54:19.928 INFO:teuthology.orchestra.run.smithi006.stdout:(123/159): python3-grpcio-1.46.7-10.el9.x86_64. 2.0 MB/s | 2.0 MB 00:01 2024-05-20T16:54:19.954 INFO:teuthology.orchestra.run.smithi006.stdout:(124/159): python3-grpcio-tools-1.46.7-10.el9.x 228 kB/s | 144 kB 00:00 2024-05-20T16:54:19.979 INFO:teuthology.orchestra.run.smithi006.stdout:(125/159): python3-jaraco-8.2.1-3.el9.noarch.rp 17 kB/s | 11 kB 00:00 2024-05-20T16:54:20.026 INFO:teuthology.orchestra.run.smithi171.stdout:(159/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 3.8 MB/s | 2.4 MB 00:00 2024-05-20T16:54:20.034 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-05-20T16:54:20.034 INFO:teuthology.orchestra.run.smithi171.stdout:Total 6.7 MB/s | 222 MB 00:33 2024-05-20T16:54:20.429 INFO:teuthology.orchestra.run.smithi006.stdout:(126/159): python3-jaraco-classes-3.2.1-5.el9.n 39 kB/s | 18 kB 00:00 2024-05-20T16:54:20.454 INFO:teuthology.orchestra.run.smithi006.stdout:(127/159): python3-jaraco-collections-3.0.0-8.e 49 kB/s | 23 kB 00:00 2024-05-20T16:54:20.838 INFO:teuthology.orchestra.run.smithi006.stdout:(128/159): python3-jaraco-functools-3.5.0-2.el9 23 kB/s | 19 kB 00:00 2024-05-20T16:54:20.880 INFO:teuthology.orchestra.run.smithi006.stdout:(129/159): python3-jaraco-text-3.2.0-6.el9.noar 46 kB/s | 20 kB 00:00 2024-05-20T16:54:21.226 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-05-20T16:54:21.384 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-05-20T16:54:21.385 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-05-20T16:54:21.472 INFO:teuthology.orchestra.run.smithi006.stdout:(130/159): python3-kubernetes-26.1.0-2.el9.noar 1.0 MB/s | 1.0 MB 00:01 2024-05-20T16:54:21.497 INFO:teuthology.orchestra.run.smithi006.stdout:(131/159): python3-logutils-0.3.5-21.el9.noarch 70 kB/s | 46 kB 00:00 2024-05-20T16:54:21.522 INFO:teuthology.orchestra.run.smithi006.stdout:(132/159): python3-more-itertools-8.12.0-2.el9. 123 kB/s | 79 kB 00:00 2024-05-20T16:54:22.014 INFO:teuthology.orchestra.run.smithi006.stdout:(133/159): python3-natsort-7.1.1-5.el9.noarch.r 117 kB/s | 58 kB 00:00 2024-05-20T16:54:22.056 INFO:teuthology.orchestra.run.smithi006.stdout:(134/159): python3-pecan-1.4.2-3.el9.noarch.rpm 511 kB/s | 272 kB 00:00 2024-05-20T16:54:22.081 INFO:teuthology.orchestra.run.smithi006.stdout:(135/159): python3-portend-3.1.0-2.el9.noarch.r 29 kB/s | 16 kB 00:00 2024-05-20T16:54:22.193 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-20T16:54:22.193 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-20T16:54:22.481 INFO:teuthology.orchestra.run.smithi006.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 193 kB/s | 90 kB 00:00 2024-05-20T16:54:22.523 INFO:teuthology.orchestra.run.smithi006.stdout:(137/159): python3-pyperclip-1.8.2-2.el9.noarch 60 kB/s | 28 kB 00:00 2024-05-20T16:54:22.549 INFO:teuthology.orchestra.run.smithi006.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 66 kB/s | 31 kB 00:00 2024-05-20T16:54:22.974 INFO:teuthology.orchestra.run.smithi006.stdout:(139/159): python3-routes-2.5.1-5.el9.noarch.rp 383 kB/s | 188 kB 00:00 2024-05-20T16:54:23.008 INFO:teuthology.orchestra.run.smithi006.stdout:(140/159): python3-rsa-4.9-2.el9.noarch.rpm 129 kB/s | 59 kB 00:00 2024-05-20T16:54:23.033 INFO:teuthology.orchestra.run.smithi006.stdout:(141/159): python3-tempora-5.0.0-2.el9.noarch.r 74 kB/s | 36 kB 00:00 2024-05-20T16:54:23.516 INFO:teuthology.orchestra.run.smithi006.stdout:(142/159): python3-typing-extensions-4.4.0-2.el 94 kB/s | 51 kB 00:00 2024-05-20T16:54:23.591 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-05-20T16:54:23.591 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-05-20T16:54:24.008 INFO:teuthology.orchestra.run.smithi006.stdout:(143/159): python3-webob-1.8.7-6.el9.noarch.rpm 235 kB/s | 230 kB 00:00 2024-05-20T16:54:24.033 INFO:teuthology.orchestra.run.smithi006.stdout:(144/159): python3-websocket-client-1.2.3-2.el9 90 kB/s | 90 kB 00:00 2024-05-20T16:54:24.509 INFO:teuthology.orchestra.run.smithi006.stdout:(145/159): python3-werkzeug-2.0.3-3.el9.1.noarc 430 kB/s | 427 kB 00:00 2024-05-20T16:54:24.534 INFO:teuthology.orchestra.run.smithi006.stdout:(146/159): python3-zc-lockfile-2.0-10.el9.noarc 40 kB/s | 20 kB 00:00 2024-05-20T16:54:24.743 INFO:teuthology.orchestra.run.smithi006.stdout:(147/159): re2-20211101-3.el9.x86_64.rpm 271 kB/s | 192 kB 00:00 2024-05-20T16:54:24.959 INFO:teuthology.orchestra.run.smithi006.stdout:(148/159): librados2-19.0.0-2744.gd2b507c7.el9. 7.8 MB/s | 3.3 MB 00:00 2024-05-20T16:54:25.160 INFO:teuthology.orchestra.run.smithi006.stdout:(149/159): librbd1-19.0.0-2744.gd2b507c7.el9.x8 7.4 MB/s | 3.1 MB 00:00 2024-05-20T16:54:26.143 INFO:teuthology.orchestra.run.smithi006.stdout:(150/159): thrift-0.15.0-2.el9.x86_64.rpm 991 kB/s | 1.6 MB 00:01 2024-05-20T16:54:26.310 INFO:teuthology.orchestra.run.smithi006.stdout:(151/159): NetworkManager-team-1.47.90-1.el9.x8 249 kB/s | 41 kB 00:00 2024-05-20T16:54:26.911 INFO:teuthology.orchestra.run.smithi006.stdout:(152/159): NetworkManager-tui-1.47.90-1.el9.x86 413 kB/s | 248 kB 00:00 2024-05-20T16:54:26.948 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T16:54:27.102 INFO:teuthology.orchestra.run.smithi006.stdout:(153/159): NetworkManager-1.47.90-1.el9.x86_64. 1.1 MB/s | 2.3 MB 00:02 2024-05-20T16:54:27.103 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T16:54:27.136 INFO:teuthology.orchestra.run.smithi006.stdout:(154/159): NetworkManager-libnm-1.47.90-1.el9.x 934 kB/s | 1.8 MB 00:01 2024-05-20T16:54:27.136 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:27.137 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T16:54:27.201 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T16:54:27.202 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T16:54:27.234 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:27.237 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.31.2.234) 2024-05-20T16:54:27.268 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:27.269 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:27.273 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:27.305 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 163.237.219.7) 2024-05-20T16:54:27.320 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:27.322 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:27.404 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:27.437 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:27.437 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:27.471 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T16:54:27.914 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:27.943 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:27.986 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:28.259 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:28.284 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:28.293 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:54:28.317 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:54:28.349 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://centos-stream-distro.1gservers.com/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 104.251.122.5) 2024-05-20T16:54:28.349 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:28.366 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T16:54:28.367 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:28.428 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:28.497 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:28.510 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-20T16:54:28.534 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:28.577 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://atl.mirrors.knownhost.com/centos/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 67.222.0.49) 2024-05-20T16:54:28.577 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:28.601 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-05-20T16:54:28.616 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:28.644 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-05-20T16:54:28.646 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:28.718 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-05-20T16:54:28.751 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-05-20T16:54:28.760 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:28.762 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:28.778 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:28.779 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:28.830 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-05-20T16:54:28.839 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T16:54:28.849 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:28.857 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:28.858 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:28.912 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T16:54:28.913 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:28.913 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:28.932 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:28.979 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-05-20T16:54:29.030 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:29.032 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:29.050 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.servaxnet.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 162.255.226.75) 2024-05-20T16:54:29.246 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:29.249 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:29.263 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:29.331 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-05-20T16:54:29.444 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T16:54:29.555 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T16:54:29.579 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T16:54:29.606 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:29.626 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:29.631 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:29.668 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T16:54:29.674 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T16:54:29.674 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:29.700 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 10/170 2024-05-20T16:54:29.712 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:29.720 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:29.752 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-05-20T16:54:29.757 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:29.792 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T16:54:29.804 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:29.831 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-05-20T16:54:29.849 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:29.884 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:29.931 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-05-20T16:54:29.967 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-05-20T16:54:29.970 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:29.978 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-05-20T16:54:30.014 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:30.015 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-05-20T16:54:30.042 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T16:54:30.048 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-05-20T16:54:30.057 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://repos.eggycrew.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 104.167.241.199) 2024-05-20T16:54:30.089 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-05-20T16:54:30.115 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-05-20T16:54:30.128 INFO:teuthology.orchestra.run.smithi006.stdout:(155/159): elfutils-libelf-0.191-4.el9.x86_64.r 68 kB/s | 207 kB 00:03 2024-05-20T16:54:30.150 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T16:54:30.153 INFO:teuthology.orchestra.run.smithi006.stdout:(156/159): elfutils-debuginfod-client-0.191-4.e 11 kB/s | 37 kB 00:03 2024-05-20T16:54:30.164 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-05-20T16:54:30.177 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 15/170 2024-05-20T16:54:30.178 INFO:teuthology.orchestra.run.smithi006.stdout:(157/159): elfutils-libs-0.191-4.el9.x86_64.rpm 85 kB/s | 260 kB 00:03 2024-05-20T16:54:30.239 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 15/170 2024-05-20T16:54:30.261 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-20T16:54:30.284 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-20T16:54:30.489 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-20T16:54:30.501 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-05-20T16:54:30.624 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T16:54:30.647 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-20T16:54:30.653 INFO:teuthology.orchestra.run.smithi006.stdout:(158/159): openssl-3.2.1-1.el9.x86_64.rpm 2.6 MB/s | 1.3 MB 00:00 2024-05-20T16:54:30.750 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T16:54:30.776 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T16:54:30.783 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-20T16:54:30.826 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-20T16:54:30.862 INFO:teuthology.orchestra.run.smithi006.stdout:(159/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 3.4 MB/s | 2.4 MB 00:00 2024-05-20T16:54:30.867 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T16:54:30.868 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-05-20T16:54:30.869 INFO:teuthology.orchestra.run.smithi006.stdout:Total 5.8 MB/s | 222 MB 00:38 2024-05-20T16:54:30.905 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 10/170 2024-05-20T16:54:30.950 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-05-20T16:54:30.951 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T16:54:31.027 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T16:54:31.148 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-05-20T16:54:31.211 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-05-20T16:54:31.240 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T16:54:31.242 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T16:54:31.344 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T16:54:31.353 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-05-20T16:54:31.374 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 15/170 2024-05-20T16:54:31.437 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 15/170 2024-05-20T16:54:31.450 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-05-20T16:54:31.458 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-20T16:54:31.480 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-20T16:54:31.491 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-05-20T16:54:31.527 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-05-20T16:54:31.602 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-05-20T16:54:31.643 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-05-20T16:54:31.686 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-05-20T16:54:31.702 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-20T16:54:31.719 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-05-20T16:54:31.746 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-05-20T16:54:31.817 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-05-20T16:54:31.881 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-20T16:54:31.886 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-05-20T16:54:31.915 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-05-20T16:54:31.959 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-05-20T16:54:32.039 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-05-20T16:54:32.064 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-20T16:54:32.070 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9. 34/170 2024-05-20T16:54:32.073 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-05-20T16:54:32.114 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el 35/170 2024-05-20T16:54:32.124 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-20T16:54:32.142 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_6 36/170 2024-05-20T16:54:32.215 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-05-20T16:54:32.238 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T16:54:32.251 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-05-20T16:54:32.251 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-05-20T16:54:32.266 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-05-20T16:54:32.326 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T16:54:32.344 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-05-20T16:54:32.489 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-05-20T16:54:32.523 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T16:54:32.552 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-05-20T16:54:32.632 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-05-20T16:54:32.737 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-05-20T16:54:32.773 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-05-20T16:54:32.808 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-05-20T16:54:32.873 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-05-20T16:54:32.907 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-05-20T16:54:32.950 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-05-20T16:54:32.984 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-05-20T16:54:33.010 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-05-20T16:54:33.080 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-05-20T16:54:33.108 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-05-20T16:54:33.133 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-05-20T16:54:33.163 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-05-20T16:54:33.191 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-05-20T16:54:33.199 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-05-20T16:54:33.225 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-05-20T16:54:33.262 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-05-20T16:54:33.276 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-05-20T16:54:33.312 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-05-20T16:54:33.336 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9. 34/170 2024-05-20T16:54:33.349 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_6 47/170 2024-05-20T16:54:33.379 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el 35/170 2024-05-20T16:54:33.391 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-05-20T16:54:33.409 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_6 36/170 2024-05-20T16:54:33.481 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-05-20T16:54:33.532 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-05-20T16:54:33.545 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-05-20T16:54:33.594 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-05-20T16:54:33.607 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-05-20T16:54:33.649 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-05-20T16:54:33.723 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-05-20T16:54:33.741 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-05-20T16:54:33.760 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-05-20T16:54:33.792 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-05-20T16:54:33.797 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-05-20T16:54:33.844 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-05-20T16:54:33.879 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-05-20T16:54:33.923 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-05-20T16:54:33.965 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-05-20T16:54:34.110 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-05-20T16:54:34.150 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-05-20T16:54:34.192 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-05-20T16:54:34.289 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-05-20T16:54:34.324 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-05-20T16:54:34.339 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-05-20T16:54:34.361 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-05-20T16:54:34.390 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-05-20T16:54:34.414 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-05-20T16:54:34.430 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-05-20T16:54:34.466 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-05-20T16:54:34.504 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-05-20T16:54:34.520 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-05-20T16:54:34.552 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-05-20T16:54:34.562 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-05-20T16:54:34.562 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-05-20T16:54:34.590 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_6 47/170 2024-05-20T16:54:34.632 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-05-20T16:54:34.655 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-05-20T16:54:34.688 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-05-20T16:54:34.728 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-05-20T16:54:34.759 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-05-20T16:54:34.794 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-05-20T16:54:34.798 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-05-20T16:54:34.830 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-05-20T16:54:34.859 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-05-20T16:54:34.860 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-05-20T16:54:34.894 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-05-20T16:54:34.915 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-05-20T16:54:34.927 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-05-20T16:54:34.969 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-05-20T16:54:34.988 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-05-20T16:54:35.006 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-05-20T16:54:35.018 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-05-20T16:54:35.055 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-05-20T16:54:35.095 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-05-20T16:54:35.119 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-05-20T16:54:35.146 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-05-20T16:54:35.154 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-05-20T16:54:35.176 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-05-20T16:54:35.197 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-05-20T16:54:35.223 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-05-20T16:54:35.239 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-05-20T16:54:35.335 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-05-20T16:54:35.378 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-05-20T16:54:35.386 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-05-20T16:54:35.433 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-05-20T16:54:35.474 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-05-20T16:54:35.569 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-05-20T16:54:35.632 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-05-20T16:54:35.674 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-05-20T16:54:35.706 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-05-20T16:54:35.731 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-05-20T16:54:35.832 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-05-20T16:54:35.968 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-05-20T16:54:36.005 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-05-20T16:54:36.033 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-05-20T16:54:36.067 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-05-20T16:54:36.106 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-05-20T16:54:36.145 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-05-20T16:54:36.148 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-05-20T16:54:36.175 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-05-20T16:54:36.192 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-05-20T16:54:36.210 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-05-20T16:54:36.225 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-05-20T16:54:36.243 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-05-20T16:54:36.285 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-05-20T16:54:36.319 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-05-20T16:54:36.327 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-05-20T16:54:36.381 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-05-20T16:54:36.408 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-05-20T16:54:36.434 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-05-20T16:54:36.458 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-05-20T16:54:36.490 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-05-20T16:54:36.525 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-05-20T16:54:36.537 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-05-20T16:54:36.561 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-05-20T16:54:36.644 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-05-20T16:54:36.708 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-05-20T16:54:36.746 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-05-20T16:54:36.775 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-05-20T16:54:36.856 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-05-20T16:54:37.447 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-05-20T16:54:37.505 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-05-20T16:54:37.538 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-05-20T16:54:37.549 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-05-20T16:54:37.638 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-05-20T16:54:37.669 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-05-20T16:54:37.693 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-05-20T16:54:37.746 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-05-20T16:54:37.834 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-05-20T16:54:37.874 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-05-20T16:54:38.052 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-05-20T16:54:38.080 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-05-20T16:54:38.158 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-05-20T16:54:38.828 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-05-20T16:54:38.947 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-05-20T16:54:39.001 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-05-20T16:54:39.089 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-05-20T16:54:39.117 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-05-20T16:54:39.150 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-05-20T16:54:39.488 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-05-20T16:54:39.529 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 103/170 2024-05-20T16:54:39.621 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 103/170 2024-05-20T16:54:39.651 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 104/170 2024-05-20T16:54:39.687 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-05-20T16:54:40.192 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-05-20T16:54:40.223 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-05-20T16:54:40.224 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 107/170 2024-05-20T16:54:40.295 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 107/170 2024-05-20T16:54:40.308 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-05-20T16:54:40.326 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 108/170 2024-05-20T16:54:40.336 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-05-20T16:54:40.369 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-05-20T16:54:40.698 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-05-20T16:54:40.840 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 103/170 2024-05-20T16:54:40.934 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 103/170 2024-05-20T16:54:40.962 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 104/170 2024-05-20T16:54:40.998 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-05-20T16:54:41.136 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-05-20T16:54:41.234 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-05-20T16:54:41.273 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-05-20T16:54:41.342 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-05-20T16:54:41.405 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-05-20T16:54:41.435 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-05-20T16:54:41.484 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-05-20T16:54:41.485 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-05-20T16:54:41.510 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 107/170 2024-05-20T16:54:41.581 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 107/170 2024-05-20T16:54:41.611 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 108/170 2024-05-20T16:54:41.837 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-05-20T16:54:41.960 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T16:54:42.080 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T16:54:42.103 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T16:54:42.196 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T16:54:42.224 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 10/170 2024-05-20T16:54:42.279 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-05-20T16:54:42.492 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-05-20T16:54:42.548 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-05-20T16:54:42.575 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T16:54:42.666 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T16:54:42.675 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T16:54:42.693 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 15/170 2024-05-20T16:54:42.714 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T16:54:42.756 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 15/170 2024-05-20T16:54:42.778 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-20T16:54:42.802 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-20T16:54:42.956 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-20T16:54:43.129 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-20T16:54:43.275 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-20T16:54:43.306 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T16:54:43.327 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-20T16:54:43.342 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 110/170 2024-05-20T16:54:43.434 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T16:54:43.436 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 110/170 2024-05-20T16:54:43.436 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-20T16:54:43.436 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-20T16:54:43.436 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:54:43.469 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 111/170 2024-05-20T16:54:43.495 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T16:54:43.693 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T16:54:43.804 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-05-20T16:54:43.882 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T16:54:43.908 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-05-20T16:54:43.918 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T16:54:43.943 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-05-20T16:54:43.978 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-05-20T16:54:44.052 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-05-20T16:54:44.102 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-05-20T16:54:44.146 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-05-20T16:54:44.178 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-05-20T16:54:44.205 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-05-20T16:54:44.277 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-05-20T16:54:44.329 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-05-20T16:54:44.358 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-05-20T16:54:44.394 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-05-20T16:54:44.480 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-05-20T16:54:44.487 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T16:54:44.513 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9. 34/170 2024-05-20T16:54:44.521 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 110/170 2024-05-20T16:54:44.557 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el 35/170 2024-05-20T16:54:44.586 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_6 36/170 2024-05-20T16:54:44.611 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 110/170 2024-05-20T16:54:44.611 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-20T16:54:44.611 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-20T16:54:44.611 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:54:44.639 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 111/170 2024-05-20T16:54:44.658 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-05-20T16:54:44.709 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-05-20T16:54:44.786 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-05-20T16:54:44.923 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-05-20T16:54:44.979 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-05-20T16:54:45.536 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-05-20T16:54:45.626 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-05-20T16:54:45.661 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-05-20T16:54:45.710 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-05-20T16:54:45.747 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-05-20T16:54:45.785 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_6 47/170 2024-05-20T16:54:45.827 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-05-20T16:54:45.989 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-05-20T16:54:46.029 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-05-20T16:54:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-05-20T16:54:46.159 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-05-20T16:54:46.196 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-05-20T16:54:46.224 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-05-20T16:54:46.272 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-05-20T16:54:46.307 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-05-20T16:54:46.351 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-05-20T16:54:46.393 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-05-20T16:54:46.537 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-05-20T16:54:46.578 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-05-20T16:54:46.619 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-05-20T16:54:46.716 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-05-20T16:54:46.752 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-05-20T16:54:46.793 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-05-20T16:54:46.826 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-05-20T16:54:46.851 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-05-20T16:54:46.959 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-05-20T16:54:47.090 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-05-20T16:54:47.125 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-05-20T16:54:47.163 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-05-20T16:54:47.196 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-05-20T16:54:47.243 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-05-20T16:54:47.275 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-05-20T16:54:47.304 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-05-20T16:54:47.339 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-05-20T16:54:47.372 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-05-20T16:54:47.414 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-05-20T16:54:47.448 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-05-20T16:54:47.538 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-05-20T16:54:47.592 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-05-20T16:54:47.627 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-05-20T16:54:47.674 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-05-20T16:54:47.785 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-05-20T16:54:47.837 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-05-20T16:54:48.596 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-05-20T16:54:48.644 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-05-20T16:54:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-05-20T16:54:48.805 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-05-20T16:54:48.859 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-05-20T16:54:48.904 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-05-20T16:54:48.994 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-05-20T16:54:49.030 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-05-20T16:54:49.214 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-05-20T16:54:49.245 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-05-20T16:54:49.326 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-05-20T16:54:50.025 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-05-20T16:54:50.147 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-05-20T16:54:51.482 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-05-20T16:54:51.582 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-05-20T16:54:51.610 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-05-20T16:54:51.646 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-05-20T16:54:51.980 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-05-20T16:54:52.022 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 103/170 2024-05-20T16:54:52.114 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 103/170 2024-05-20T16:54:52.144 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 104/170 2024-05-20T16:54:52.181 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-05-20T16:54:52.684 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-05-20T16:54:52.709 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 107/170 2024-05-20T16:54:52.767 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 107/170 2024-05-20T16:54:52.794 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 108/170 2024-05-20T16:54:55.030 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T16:54:55.074 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T16:54:55.641 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 111/170 2024-05-20T16:54:55.641 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /sys 2024-05-20T16:54:55.641 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /proc 2024-05-20T16:54:55.642 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /mnt 2024-05-20T16:54:55.642 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /var/tmp 2024-05-20T16:54:55.642 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /home 2024-05-20T16:54:55.642 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /root 2024-05-20T16:54:55.642 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /tmp 2024-05-20T16:54:55.642 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:54:55.666 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T16:54:55.702 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 110/170 2024-05-20T16:54:55.795 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 110/170 2024-05-20T16:54:55.796 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-20T16:54:55.796 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-20T16:54:55.796 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:54:55.811 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 112/170 2024-05-20T16:54:55.829 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 111/170 2024-05-20T16:54:55.830 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 112/170 2024-05-20T16:54:55.830 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:54:55.831 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-20T16:54:55.831 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:54:56.451 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 111/170 2024-05-20T16:54:56.451 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /sys 2024-05-20T16:54:56.451 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /proc 2024-05-20T16:54:56.451 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /mnt 2024-05-20T16:54:56.451 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /var/tmp 2024-05-20T16:54:56.451 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /home 2024-05-20T16:54:56.451 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /root 2024-05-20T16:54:56.451 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /tmp 2024-05-20T16:54:56.452 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:54:56.625 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 112/170 2024-05-20T16:54:56.641 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 112/170 2024-05-20T16:54:56.641 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:54:56.642 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-20T16:54:56.642 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:54:57.464 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 113/170 2024-05-20T16:54:57.492 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 113/170 2024-05-20T16:54:57.492 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:54:57.492 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-20T16:54:57.493 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-20T16:54:57.493 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-20T16:54:57.493 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:54:57.723 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 114/170 2024-05-20T16:54:57.747 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 114/170 2024-05-20T16:54:57.748 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:54:57.748 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-20T16:54:57.748 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-20T16:54:57.748 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-20T16:54:57.748 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:54:58.213 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 113/170 2024-05-20T16:54:58.238 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 113/170 2024-05-20T16:54:58.238 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:54:58.238 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-20T16:54:58.238 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-20T16:54:58.238 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-20T16:54:58.238 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:54:58.240 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 115/170 2024-05-20T16:54:58.265 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 115/170 2024-05-20T16:54:58.265 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:54:58.265 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-20T16:54:58.265 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-20T16:54:58.265 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-20T16:54:58.266 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:54:58.379 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-05-20T16:54:58.437 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-05-20T16:54:58.462 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 114/170 2024-05-20T16:54:58.486 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 114/170 2024-05-20T16:54:58.486 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:54:58.486 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-20T16:54:58.486 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-20T16:54:58.486 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-20T16:54:58.486 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:54:58.501 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-05-20T16:54:58.697 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-05-20T16:54:58.750 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-05-20T16:54:58.831 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-05-20T16:54:58.921 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-05-20T16:54:58.963 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 115/170 2024-05-20T16:54:58.986 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 115/170 2024-05-20T16:54:58.986 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:54:58.986 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-20T16:54:58.986 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-20T16:54:58.986 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-20T16:54:58.987 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:54:59.070 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-05-20T16:54:59.101 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-05-20T16:54:59.117 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-05-20T16:54:59.158 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-05-20T16:54:59.166 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-05-20T16:54:59.197 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-05-20T16:54:59.222 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-05-20T16:54:59.411 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-05-20T16:54:59.472 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-05-20T16:54:59.550 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-05-20T16:54:59.580 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 127/170 2024-05-20T16:54:59.607 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 127/170 2024-05-20T16:54:59.639 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.e 128/170 2024-05-20T16:54:59.647 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-05-20T16:54:59.703 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7. 129/170 2024-05-20T16:54:59.738 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 130/170 2024-05-20T16:54:59.788 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-05-20T16:54:59.830 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-05-20T16:54:59.869 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-05-20T16:54:59.898 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-05-20T16:55:00.277 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 127/170 2024-05-20T16:55:00.304 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 127/170 2024-05-20T16:55:00.336 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.e 128/170 2024-05-20T16:55:00.398 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7. 129/170 2024-05-20T16:55:00.425 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 130/170 2024-05-20T16:55:00.830 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 130/170 2024-05-20T16:55:00.873 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 131/170 2024-05-20T16:55:01.466 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 130/170 2024-05-20T16:55:01.505 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 131/170 2024-05-20T16:55:01.892 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 131/170 2024-05-20T16:55:01.915 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 132/170 2024-05-20T16:55:02.024 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 132/170 2024-05-20T16:55:02.196 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el 133/170 2024-05-20T16:55:02.226 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 134/170 2024-05-20T16:55:02.251 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 134/170 2024-05-20T16:55:02.251 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:55:02.251 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-20T16:55:02.252 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-20T16:55:02.252 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-20T16:55:02.252 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:55:02.302 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 135/170 2024-05-20T16:55:02.314 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 135/170 2024-05-20T16:55:02.415 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 136/170 2024-05-20T16:55:02.470 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 131/170 2024-05-20T16:55:02.487 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 137/170 2024-05-20T16:55:02.505 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 132/170 2024-05-20T16:55:02.609 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 132/170 2024-05-20T16:55:02.789 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el 133/170 2024-05-20T16:55:02.816 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 134/170 2024-05-20T16:55:02.840 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 134/170 2024-05-20T16:55:02.840 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:55:02.840 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-20T16:55:02.841 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-20T16:55:02.841 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-20T16:55:02.841 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:55:02.892 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 135/170 2024-05-20T16:55:02.904 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 135/170 2024-05-20T16:55:03.002 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 136/170 2024-05-20T16:55:03.058 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 137/170 2024-05-20T16:55:03.448 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-05-20T16:55:03.487 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 139/170 2024-05-20T16:55:03.512 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 139/170 2024-05-20T16:55:03.512 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:55:03.512 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-20T16:55:03.512 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-20T16:55:03.512 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-20T16:55:03.513 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:55:03.555 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 140/170 2024-05-20T16:55:03.578 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 140/170 2024-05-20T16:55:03.579 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:55:03.579 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-20T16:55:03.579 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:55:03.630 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 141/170 2024-05-20T16:55:03.654 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 141/170 2024-05-20T16:55:03.655 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:55:03.655 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-20T16:55:03.655 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-20T16:55:03.655 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-20T16:55:03.655 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:55:03.978 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-05-20T16:55:03.981 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 142/170 2024-05-20T16:55:04.004 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 139/170 2024-05-20T16:55:04.005 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 142/170 2024-05-20T16:55:04.005 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:55:04.005 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-20T16:55:04.005 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-20T16:55:04.005 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-20T16:55:04.006 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:55:04.027 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 139/170 2024-05-20T16:55:04.028 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:55:04.028 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-20T16:55:04.028 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-20T16:55:04.028 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-20T16:55:04.028 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:55:04.071 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 140/170 2024-05-20T16:55:04.094 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 140/170 2024-05-20T16:55:04.094 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:55:04.095 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-20T16:55:04.095 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:55:04.147 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 141/170 2024-05-20T16:55:04.171 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 141/170 2024-05-20T16:55:04.171 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:55:04.171 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-20T16:55:04.171 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-20T16:55:04.171 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-20T16:55:04.171 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:55:04.481 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 142/170 2024-05-20T16:55:04.505 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 142/170 2024-05-20T16:55:04.505 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:55:04.505 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-20T16:55:04.505 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-20T16:55:04.505 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-20T16:55:04.505 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:55:08.480 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 111/170 2024-05-20T16:55:08.481 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /sys 2024-05-20T16:55:08.481 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /proc 2024-05-20T16:55:08.481 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /mnt 2024-05-20T16:55:08.481 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /var/tmp 2024-05-20T16:55:08.481 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /home 2024-05-20T16:55:08.481 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /root 2024-05-20T16:55:08.482 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /tmp 2024-05-20T16:55:08.482 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:55:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 112/170 2024-05-20T16:55:08.677 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 112/170 2024-05-20T16:55:08.677 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:55:08.678 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-20T16:55:08.678 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:55:08.869 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 143/170 2024-05-20T16:55:08.910 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 144/170 2024-05-20T16:55:08.951 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 145/170 2024-05-20T16:55:08.982 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-05-20T16:55:09.010 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-05-20T16:55:09.086 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 143/170 2024-05-20T16:55:09.136 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 144/170 2024-05-20T16:55:09.177 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 145/170 2024-05-20T16:55:09.208 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 148/170 2024-05-20T16:55:09.209 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-05-20T16:55:09.237 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-05-20T16:55:09.256 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-05-20T16:55:09.298 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_ 150/170 2024-05-20T16:55:09.338 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-05-20T16:55:09.367 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 152/170 2024-05-20T16:55:09.413 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 153/170 2024-05-20T16:55:09.428 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 148/170 2024-05-20T16:55:09.468 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-05-20T16:55:09.509 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_ 150/170 2024-05-20T16:55:09.550 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-05-20T16:55:09.579 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 152/170 2024-05-20T16:55:09.617 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 153/170 2024-05-20T16:55:10.010 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T16:55:10.052 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T16:55:10.073 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T16:55:10.262 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T16:55:10.301 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T16:55:10.306 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 113/170 2024-05-20T16:55:10.321 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T16:55:10.334 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 113/170 2024-05-20T16:55:10.334 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:55:10.334 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-20T16:55:10.334 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-20T16:55:10.334 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-20T16:55:10.334 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:55:10.590 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 114/170 2024-05-20T16:55:10.614 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 114/170 2024-05-20T16:55:10.614 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:55:10.614 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-20T16:55:10.614 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-20T16:55:10.614 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-20T16:55:10.614 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:55:10.994 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 155/170 2024-05-20T16:55:11.090 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-05-20T16:55:11.107 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 115/170 2024-05-20T16:55:11.131 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 115/170 2024-05-20T16:55:11.131 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:55:11.131 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-20T16:55:11.132 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-20T16:55:11.132 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-20T16:55:11.132 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:55:11.133 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-05-20T16:55:11.193 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 155/170 2024-05-20T16:55:11.238 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-05-20T16:55:11.239 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-05-20T16:55:11.277 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-05-20T16:55:11.284 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-05-20T16:55:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-05-20T16:55:11.301 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-20T16:55:11.326 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-05-20T16:55:11.327 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-05-20T16:55:11.353 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-05-20T16:55:11.354 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-20T16:55:11.360 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-05-20T16:55:11.410 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-05-20T16:55:11.430 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-20T16:55:11.439 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-05-20T16:55:11.462 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-05-20T16:55:11.463 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-20T16:55:11.472 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-20T16:55:11.498 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-05-20T16:55:11.530 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-20T16:55:11.549 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-05-20T16:55:11.549 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-20T16:55:11.554 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-05-20T16:55:11.564 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-05-20T16:55:11.569 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T16:55:11.569 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T16:55:11.617 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-05-20T16:55:11.634 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-20T16:55:11.668 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-05-20T16:55:11.668 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-20T16:55:11.697 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-05-20T16:55:11.752 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-20T16:55:11.758 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T16:55:11.758 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-20T16:55:11.785 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-05-20T16:55:11.791 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T16:55:11.791 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T16:55:11.795 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-05-20T16:55:11.842 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-20T16:55:11.866 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-05-20T16:55:11.935 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-20T16:55:11.938 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-05-20T16:55:11.972 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T16:55:11.972 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-20T16:55:11.983 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-05-20T16:55:12.026 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-05-20T16:55:12.056 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-20T16:55:12.059 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-05-20T16:55:12.089 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-05-20T16:55:12.155 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-20T16:55:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 127/170 2024-05-20T16:55:12.684 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 127/170 2024-05-20T16:55:12.707 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.e 128/170 2024-05-20T16:55:12.764 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7. 129/170 2024-05-20T16:55:12.789 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 130/170 2024-05-20T16:55:13.881 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 130/170 2024-05-20T16:55:13.918 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 131/170 2024-05-20T16:55:14.935 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 131/170 2024-05-20T16:55:14.960 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 132/170 2024-05-20T16:55:15.068 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 132/170 2024-05-20T16:55:15.250 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el 133/170 2024-05-20T16:55:15.280 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 134/170 2024-05-20T16:55:15.305 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 134/170 2024-05-20T16:55:15.305 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:55:15.305 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-20T16:55:15.305 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-20T16:55:15.305 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-20T16:55:15.305 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:55:15.355 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 135/170 2024-05-20T16:55:15.367 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 135/170 2024-05-20T16:55:15.469 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 136/170 2024-05-20T16:55:15.531 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 137/170 2024-05-20T16:55:16.493 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-05-20T16:55:16.517 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 139/170 2024-05-20T16:55:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 139/170 2024-05-20T16:55:16.541 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:55:16.541 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-20T16:55:16.541 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-20T16:55:16.541 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-20T16:55:16.541 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:55:16.584 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 140/170 2024-05-20T16:55:16.607 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 140/170 2024-05-20T16:55:16.607 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:55:16.607 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-20T16:55:16.608 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:55:16.659 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 141/170 2024-05-20T16:55:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 141/170 2024-05-20T16:55:16.684 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:55:16.684 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-20T16:55:16.684 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-20T16:55:16.684 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-20T16:55:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:55:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 142/170 2024-05-20T16:55:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 142/170 2024-05-20T16:55:17.043 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T16:55:17.043 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-20T16:55:17.043 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-20T16:55:17.043 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-20T16:55:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:55:17.843 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-20T16:55:17.844 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 1/170 2024-05-20T16:55:17.844 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 2/170 2024-05-20T16:55:17.844 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 3/170 2024-05-20T16:55:17.844 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 4/170 2024-05-20T16:55:17.844 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 5/170 2024-05-20T16:55:17.844 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 6/170 2024-05-20T16:55:17.844 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 7/170 2024-05-20T16:55:17.844 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T16:55:17.844 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T16:55:17.844 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 10/170 2024-05-20T16:55:17.845 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 11/170 2024-05-20T16:55:17.845 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 12/170 2024-05-20T16:55:17.845 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 13/170 2024-05-20T16:55:17.845 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T16:55:17.845 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_ 15/170 2024-05-20T16:55:17.845 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 16/170 2024-05-20T16:55:17.845 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 17/170 2024-05-20T16:55:17.845 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_6 18/170 2024-05-20T16:55:17.845 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 19/170 2024-05-20T16:55:17.845 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 20/170 2024-05-20T16:55:17.846 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el 21/170 2024-05-20T16:55:17.846 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9. 22/170 2024-05-20T16:55:17.846 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_6 23/170 2024-05-20T16:55:17.846 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 24/170 2024-05-20T16:55:17.846 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 25/170 2024-05-20T16:55:17.846 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 26/170 2024-05-20T16:55:17.846 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 27/170 2024-05-20T16:55:17.846 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 28/170 2024-05-20T16:55:17.846 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 29/170 2024-05-20T16:55:17.846 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7. 30/170 2024-05-20T16:55:17.846 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 31/170 2024-05-20T16:55:17.847 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 32/170 2024-05-20T16:55:17.847 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 33/170 2024-05-20T16:55:17.847 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el 34/170 2024-05-20T16:55:17.847 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 35/170 2024-05-20T16:55:17.847 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.e 36/170 2024-05-20T16:55:17.847 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 37/170 2024-05-20T16:55:17.847 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 38/170 2024-05-20T16:55:17.847 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 39/170 2024-05-20T16:55:17.847 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-05-20T16:55:17.848 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-05-20T16:55:17.848 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-05-20T16:55:17.848 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-05-20T16:55:17.848 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-05-20T16:55:17.848 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-05-20T16:55:17.848 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-05-20T16:55:17.848 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-05-20T16:55:17.848 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-05-20T16:55:17.848 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-05-20T16:55:17.848 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-05-20T16:55:17.848 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-05-20T16:55:17.848 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-05-20T16:55:17.849 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-05-20T16:55:17.849 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-05-20T16:55:17.849 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-05-20T16:55:17.849 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-05-20T16:55:17.849 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-05-20T16:55:17.849 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-05-20T16:55:17.849 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-05-20T16:55:17.849 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-05-20T16:55:17.849 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-05-20T16:55:17.849 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-05-20T16:55:17.849 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-05-20T16:55:17.850 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-05-20T16:55:17.850 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-05-20T16:55:17.850 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-05-20T16:55:17.850 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-05-20T16:55:17.850 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-05-20T16:55:17.850 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-05-20T16:55:17.850 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-05-20T16:55:17.850 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-05-20T16:55:17.850 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-05-20T16:55:17.850 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-05-20T16:55:17.851 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-05-20T16:55:17.851 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-05-20T16:55:17.851 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-05-20T16:55:17.851 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-05-20T16:55:17.851 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-05-20T16:55:17.851 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-05-20T16:55:17.851 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-05-20T16:55:17.851 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-05-20T16:55:17.851 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-05-20T16:55:17.851 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-05-20T16:55:17.851 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-05-20T16:55:17.852 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-05-20T16:55:17.852 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-05-20T16:55:17.852 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-05-20T16:55:17.852 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-05-20T16:55:17.852 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-05-20T16:55:17.852 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-05-20T16:55:17.852 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-05-20T16:55:17.852 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-05-20T16:55:17.852 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-05-20T16:55:17.852 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-05-20T16:55:17.852 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-05-20T16:55:17.853 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-05-20T16:55:17.853 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-05-20T16:55:17.853 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-05-20T16:55:17.853 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-05-20T16:55:17.853 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-05-20T16:55:17.853 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-05-20T16:55:17.853 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-05-20T16:55:17.853 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-05-20T16:55:17.853 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-05-20T16:55:17.853 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-05-20T16:55:17.853 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-05-20T16:55:17.854 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-05-20T16:55:17.854 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-05-20T16:55:17.854 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-05-20T16:55:17.854 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-05-20T16:55:17.854 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-05-20T16:55:17.854 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-05-20T16:55:17.855 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-05-20T16:55:17.855 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-05-20T16:55:17.855 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-05-20T16:55:17.855 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-05-20T16:55:17.855 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-05-20T16:55:17.855 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-05-20T16:55:17.855 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-05-20T16:55:17.855 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-05-20T16:55:17.855 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-05-20T16:55:17.855 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-05-20T16:55:17.857 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-05-20T16:55:17.857 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-05-20T16:55:17.857 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-05-20T16:55:17.857 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-05-20T16:55:17.857 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-05-20T16:55:17.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-05-20T16:55:17.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-05-20T16:55:17.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-05-20T16:55:17.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-05-20T16:55:17.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-05-20T16:55:17.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-05-20T16:55:17.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-05-20T16:55:17.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-05-20T16:55:17.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-05-20T16:55:17.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-05-20T16:55:17.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-05-20T16:55:17.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-05-20T16:55:17.859 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-05-20T16:55:17.859 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-05-20T16:55:17.859 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-05-20T16:55:17.859 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-05-20T16:55:17.859 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-05-20T16:55:17.859 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-05-20T16:55:17.859 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-05-20T16:55:17.859 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-05-20T16:55:17.859 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-05-20T16:55:17.859 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 149/170 2024-05-20T16:55:17.859 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-05-20T16:55:17.859 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 151/170 2024-05-20T16:55:17.860 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-05-20T16:55:17.860 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/170 2024-05-20T16:55:17.860 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-05-20T16:55:17.860 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/170 2024-05-20T16:55:17.860 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-05-20T16:55:17.860 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/170 2024-05-20T16:55:17.860 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-05-20T16:55:17.860 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/170 2024-05-20T16:55:17.860 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-20T16:55:17.860 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-05-20T16:55:17.860 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-05-20T16:55:17.860 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-05-20T16:55:17.861 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-05-20T16:55:17.861 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-05-20T16:55:17.861 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-05-20T16:55:17.861 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-05-20T16:55:17.861 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-05-20T16:55:17.861 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-05-20T16:55:18.005 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-20T16:55:18.005 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 1/170 2024-05-20T16:55:18.005 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 2/170 2024-05-20T16:55:18.005 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 3/170 2024-05-20T16:55:18.005 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 4/170 2024-05-20T16:55:18.006 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 5/170 2024-05-20T16:55:18.006 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 6/170 2024-05-20T16:55:18.006 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 7/170 2024-05-20T16:55:18.006 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T16:55:18.006 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T16:55:18.006 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 10/170 2024-05-20T16:55:18.006 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 11/170 2024-05-20T16:55:18.006 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 12/170 2024-05-20T16:55:18.006 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 13/170 2024-05-20T16:55:18.006 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T16:55:18.006 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_ 15/170 2024-05-20T16:55:18.006 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 16/170 2024-05-20T16:55:18.006 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 17/170 2024-05-20T16:55:18.007 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_6 18/170 2024-05-20T16:55:18.007 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 19/170 2024-05-20T16:55:18.007 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 20/170 2024-05-20T16:55:18.007 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el 21/170 2024-05-20T16:55:18.007 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9. 22/170 2024-05-20T16:55:18.007 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_6 23/170 2024-05-20T16:55:18.007 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 24/170 2024-05-20T16:55:18.007 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 25/170 2024-05-20T16:55:18.007 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 26/170 2024-05-20T16:55:18.007 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 27/170 2024-05-20T16:55:18.007 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 28/170 2024-05-20T16:55:18.007 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 29/170 2024-05-20T16:55:18.019 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7. 30/170 2024-05-20T16:55:18.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 31/170 2024-05-20T16:55:18.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 32/170 2024-05-20T16:55:18.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 33/170 2024-05-20T16:55:18.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el 34/170 2024-05-20T16:55:18.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 35/170 2024-05-20T16:55:18.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.e 36/170 2024-05-20T16:55:18.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 37/170 2024-05-20T16:55:18.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 38/170 2024-05-20T16:55:18.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 39/170 2024-05-20T16:55:18.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-05-20T16:55:18.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-05-20T16:55:18.020 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-05-20T16:55:18.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-05-20T16:55:18.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-05-20T16:55:18.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-05-20T16:55:18.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-05-20T16:55:18.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-05-20T16:55:18.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-05-20T16:55:18.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-05-20T16:55:18.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-05-20T16:55:18.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-05-20T16:55:18.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-05-20T16:55:18.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-05-20T16:55:18.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-05-20T16:55:18.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-05-20T16:55:18.021 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-05-20T16:55:18.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-05-20T16:55:18.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-05-20T16:55:18.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-05-20T16:55:18.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-05-20T16:55:18.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-05-20T16:55:18.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-05-20T16:55:18.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-05-20T16:55:18.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-05-20T16:55:18.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-05-20T16:55:18.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-05-20T16:55:18.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-05-20T16:55:18.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-05-20T16:55:18.022 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-05-20T16:55:18.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-05-20T16:55:18.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-05-20T16:55:18.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-05-20T16:55:18.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-05-20T16:55:18.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-05-20T16:55:18.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-05-20T16:55:18.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-05-20T16:55:18.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-05-20T16:55:18.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-05-20T16:55:18.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-05-20T16:55:18.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-05-20T16:55:18.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-05-20T16:55:18.023 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-05-20T16:55:18.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-05-20T16:55:18.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-05-20T16:55:18.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-05-20T16:55:18.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-05-20T16:55:18.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-05-20T16:55:18.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-05-20T16:55:18.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-05-20T16:55:18.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-05-20T16:55:18.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-05-20T16:55:18.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-05-20T16:55:18.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-05-20T16:55:18.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-05-20T16:55:18.024 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-05-20T16:55:18.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-05-20T16:55:18.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-05-20T16:55:18.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-05-20T16:55:18.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-05-20T16:55:18.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-05-20T16:55:18.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-05-20T16:55:18.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-05-20T16:55:18.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-05-20T16:55:18.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-05-20T16:55:18.025 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-05-20T16:55:18.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-05-20T16:55:18.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-05-20T16:55:18.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-05-20T16:55:18.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-05-20T16:55:18.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-05-20T16:55:18.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-05-20T16:55:18.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-05-20T16:55:18.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-05-20T16:55:18.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-05-20T16:55:18.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-05-20T16:55:18.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-05-20T16:55:18.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-05-20T16:55:18.026 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-05-20T16:55:18.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-05-20T16:55:18.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-05-20T16:55:18.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-05-20T16:55:18.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-05-20T16:55:18.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-05-20T16:55:18.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-05-20T16:55:18.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-05-20T16:55:18.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-05-20T16:55:18.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-05-20T16:55:18.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-05-20T16:55:18.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-05-20T16:55:18.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-05-20T16:55:18.027 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-05-20T16:55:18.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-05-20T16:55:18.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-05-20T16:55:18.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-05-20T16:55:18.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-05-20T16:55:18.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-05-20T16:55:18.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-05-20T16:55:18.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-05-20T16:55:18.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-05-20T16:55:18.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-05-20T16:55:18.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-05-20T16:55:18.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-05-20T16:55:18.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-05-20T16:55:18.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-05-20T16:55:18.028 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-05-20T16:55:18.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-05-20T16:55:18.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-05-20T16:55:18.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-05-20T16:55:18.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 149/170 2024-05-20T16:55:18.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-05-20T16:55:18.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 151/170 2024-05-20T16:55:18.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-05-20T16:55:18.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/170 2024-05-20T16:55:18.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-05-20T16:55:18.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/170 2024-05-20T16:55:18.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-05-20T16:55:18.029 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/170 2024-05-20T16:55:18.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-05-20T16:55:18.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/170 2024-05-20T16:55:18.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-20T16:55:18.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-05-20T16:55:18.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-05-20T16:55:18.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-05-20T16:55:18.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-05-20T16:55:18.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-05-20T16:55:18.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-05-20T16:55:18.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-05-20T16:55:18.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-05-20T16:55:18.030 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-05-20T16:55:20.661 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-05-20T16:55:20.661 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:55:20.661 INFO:teuthology.orchestra.run.smithi062.stdout:Upgraded: 2024-05-20T16:55:20.661 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-20T16:55:20.661 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-20T16:55:20.661 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-20T16:55:20.662 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-20T16:55:20.662 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-05-20T16:55:20.662 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-05-20T16:55:20.662 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-05-20T16:55:20.662 INFO:teuthology.orchestra.run.smithi062.stdout: librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.662 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.662 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-20T16:55:20.662 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-20T16:55:20.662 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-20T16:55:20.662 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-20T16:55:20.662 INFO:teuthology.orchestra.run.smithi062.stdout: automake-1.16.2-8.el9.noarch 2024-05-20T16:55:20.662 INFO:teuthology.orchestra.run.smithi062.stdout: bison-3.7.4-5.el9.x86_64 2024-05-20T16:55:20.663 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-20T16:55:20.663 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.663 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.663 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.663 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.663 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:20.663 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.663 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.663 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.663 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:20.663 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:20.663 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:20.663 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:20.664 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:20.664 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.664 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.664 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:20.664 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.664 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.664 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.664 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:20.664 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:20.664 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.664 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.664 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:20.664 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-05-20T16:55:20.664 INFO:teuthology.orchestra.run.smithi062.stdout: flex-2.6.4-9.el9.x86_64 2024-05-20T16:55:20.665 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-20T16:55:20.665 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-20T16:55:20.665 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-20T16:55:20.665 INFO:teuthology.orchestra.run.smithi062.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-20T16:55:20.665 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-20T16:55:20.665 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-20T16:55:20.665 INFO:teuthology.orchestra.run.smithi062.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-20T16:55:20.665 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-20T16:55:20.665 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-20T16:55:20.665 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.665 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.665 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.665 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-20T16:55:20.666 INFO:teuthology.orchestra.run.smithi062.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-20T16:55:20.666 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-20T16:55:20.666 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-20T16:55:20.666 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-20T16:55:20.666 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.666 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.666 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-20T16:55:20.666 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.666 INFO:teuthology.orchestra.run.smithi062.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-20T16:55:20.666 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-20T16:55:20.666 INFO:teuthology.orchestra.run.smithi062.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-20T16:55:20.666 INFO:teuthology.orchestra.run.smithi062.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-20T16:55:20.666 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-20T16:55:20.667 INFO:teuthology.orchestra.run.smithi062.stdout: lua-5.4.4-4.el9.x86_64 2024-05-20T16:55:20.667 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-20T16:55:20.667 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-20T16:55:20.667 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-20T16:55:20.667 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-20T16:55:20.667 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-20T16:55:20.667 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-20T16:55:20.667 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-13.14-1.el9.x86_64 2024-05-20T16:55:20.667 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-20T16:55:20.667 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-20T16:55:20.668 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-20T16:55:20.668 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-20T16:55:20.668 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-20T16:55:20.668 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-20T16:55:20.668 INFO:teuthology.orchestra.run.smithi062.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-20T16:55:20.668 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-20T16:55:20.668 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-20T16:55:20.668 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-20T16:55:20.668 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.668 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.668 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.668 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-20T16:55:20.668 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-20T16:55:20.669 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-20T16:55:20.669 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-20T16:55:20.669 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-20T16:55:20.669 INFO:teuthology.orchestra.run.smithi062.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-05-20T16:55:20.669 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-20T16:55:20.669 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-20T16:55:20.669 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-20T16:55:20.669 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-20T16:55:20.669 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-20T16:55:20.669 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-20T16:55:20.669 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-20T16:55:20.669 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-20T16:55:20.670 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-20T16:55:20.670 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-20T16:55:20.670 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-05-20T16:55:20.670 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-20T16:55:20.670 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-20T16:55:20.670 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-20T16:55:20.670 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-20T16:55:20.670 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-20T16:55:20.670 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-20T16:55:20.670 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-20T16:55:20.670 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-20T16:55:20.670 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-20T16:55:20.670 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-20T16:55:20.670 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-20T16:55:20.671 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-20T16:55:20.671 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-20T16:55:20.671 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply-3.11-14.el9.noarch 2024-05-20T16:55:20.671 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-20T16:55:20.671 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-20T16:55:20.671 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-20T16:55:20.671 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-20T16:55:20.671 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-20T16:55:20.671 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-20T16:55:20.671 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-20T16:55:20.671 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-20T16:55:20.671 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-20T16:55:20.671 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.671 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-20T16:55:20.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-20T16:55:20.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-20T16:55:20.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-20T16:55:20.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-20T16:55:20.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-20T16:55:20.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-20T16:55:20.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-20T16:55:20.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-20T16:55:20.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-20T16:55:20.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-20T16:55:20.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-20T16:55:20.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-20T16:55:20.673 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-20T16:55:20.673 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-20T16:55:20.673 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-20T16:55:20.673 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-20T16:55:20.673 INFO:teuthology.orchestra.run.smithi062.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-20T16:55:20.673 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.673 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.673 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.673 INFO:teuthology.orchestra.run.smithi062.stdout: re2-1:20211101-3.el9.x86_64 2024-05-20T16:55:20.673 INFO:teuthology.orchestra.run.smithi062.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-20T16:55:20.674 INFO:teuthology.orchestra.run.smithi062.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-20T16:55:20.674 INFO:teuthology.orchestra.run.smithi062.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-20T16:55:20.674 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-20T16:55:20.674 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-20T16:55:20.675 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-20T16:55:20.675 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-20T16:55:20.675 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-20T16:55:20.675 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-05-20T16:55:20.675 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:55:20.675 INFO:teuthology.orchestra.run.smithi171.stdout:Upgraded: 2024-05-20T16:55:20.675 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-20T16:55:20.675 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-20T16:55:20.675 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-20T16:55:20.675 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-20T16:55:20.676 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-05-20T16:55:20.676 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-05-20T16:55:20.676 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-05-20T16:55:20.676 INFO:teuthology.orchestra.run.smithi171.stdout: librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.676 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.676 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-20T16:55:20.676 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-20T16:55:20.676 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-05-20T16:55:20.676 INFO:teuthology.orchestra.run.smithi171.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-20T16:55:20.676 INFO:teuthology.orchestra.run.smithi171.stdout: automake-1.16.2-8.el9.noarch 2024-05-20T16:55:20.676 INFO:teuthology.orchestra.run.smithi171.stdout: bison-3.7.4-5.el9.x86_64 2024-05-20T16:55:20.676 INFO:teuthology.orchestra.run.smithi171.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-20T16:55:20.676 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.676 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.677 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.677 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.677 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:20.677 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.677 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.677 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.677 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:20.677 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:20.677 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:20.677 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:20.677 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:20.677 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.677 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.677 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:20.678 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.678 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.678 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.678 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:20.678 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:20.678 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.678 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.678 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:20.678 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-05-20T16:55:20.678 INFO:teuthology.orchestra.run.smithi171.stdout: flex-2.6.4-9.el9.x86_64 2024-05-20T16:55:20.678 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-20T16:55:20.678 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-20T16:55:20.678 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-20T16:55:20.679 INFO:teuthology.orchestra.run.smithi171.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-20T16:55:20.679 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-20T16:55:20.679 INFO:teuthology.orchestra.run.smithi171.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-20T16:55:20.679 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-20T16:55:20.679 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-20T16:55:20.679 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-20T16:55:20.679 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.679 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.679 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.679 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-20T16:55:20.679 INFO:teuthology.orchestra.run.smithi171.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-20T16:55:20.679 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-20T16:55:20.679 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-20T16:55:20.679 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-20T16:55:20.680 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.680 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.680 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-20T16:55:20.680 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.680 INFO:teuthology.orchestra.run.smithi171.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-20T16:55:20.680 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-20T16:55:20.680 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-20T16:55:20.680 INFO:teuthology.orchestra.run.smithi171.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-20T16:55:20.680 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-20T16:55:20.681 INFO:teuthology.orchestra.run.smithi171.stdout: lua-5.4.4-4.el9.x86_64 2024-05-20T16:55:20.681 INFO:teuthology.orchestra.run.smithi171.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-20T16:55:20.681 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-20T16:55:20.681 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-20T16:55:20.681 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-20T16:55:20.681 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-20T16:55:20.681 INFO:teuthology.orchestra.run.smithi171.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-20T16:55:20.681 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-13.14-1.el9.x86_64 2024-05-20T16:55:20.681 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-20T16:55:20.681 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-20T16:55:20.682 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-20T16:55:20.682 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-20T16:55:20.682 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-20T16:55:20.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-20T16:55:20.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-20T16:55:20.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-20T16:55:20.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-20T16:55:20.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-20T16:55:20.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-20T16:55:20.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-20T16:55:20.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-20T16:55:20.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-20T16:55:20.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-20T16:55:20.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-05-20T16:55:20.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-20T16:55:20.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-20T16:55:20.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-20T16:55:20.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-20T16:55:20.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-20T16:55:20.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-20T16:55:20.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-20T16:55:20.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-20T16:55:20.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-20T16:55:20.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-20T16:55:20.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-05-20T16:55:20.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-20T16:55:20.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-20T16:55:20.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-20T16:55:20.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-20T16:55:20.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-20T16:55:20.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-20T16:55:20.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-20T16:55:20.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-20T16:55:20.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-20T16:55:20.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-20T16:55:20.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-20T16:55:20.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-20T16:55:20.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-20T16:55:20.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply-3.11-14.el9.noarch 2024-05-20T16:55:20.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-20T16:55:20.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-20T16:55:20.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-20T16:55:20.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-20T16:55:20.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-20T16:55:20.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-20T16:55:20.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-20T16:55:20.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-20T16:55:20.687 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-20T16:55:20.687 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.687 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.687 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-20T16:55:20.687 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-20T16:55:20.687 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-20T16:55:20.687 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.687 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-20T16:55:20.687 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-20T16:55:20.687 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-20T16:55:20.687 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-20T16:55:20.687 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-20T16:55:20.687 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-20T16:55:20.687 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-20T16:55:20.688 INFO:teuthology.orchestra.run.smithi171.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-20T16:55:20.688 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-20T16:55:20.688 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-20T16:55:20.688 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-20T16:55:20.688 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-20T16:55:20.688 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-20T16:55:20.688 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-20T16:55:20.688 INFO:teuthology.orchestra.run.smithi171.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-20T16:55:20.688 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.688 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.688 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:20.688 INFO:teuthology.orchestra.run.smithi171.stdout: re2-1:20211101-3.el9.x86_64 2024-05-20T16:55:20.688 INFO:teuthology.orchestra.run.smithi171.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-20T16:55:20.689 INFO:teuthology.orchestra.run.smithi171.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-20T16:55:20.689 INFO:teuthology.orchestra.run.smithi171.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-20T16:55:20.689 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-20T16:55:20.689 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-20T16:55:20.689 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-20T16:55:20.689 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:55:20.689 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-05-20T16:55:21.154 DEBUG:teuthology.parallel:result is None 2024-05-20T16:55:21.271 DEBUG:teuthology.parallel:result is None 2024-05-20T16:55:21.856 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 143/170 2024-05-20T16:55:21.898 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 144/170 2024-05-20T16:55:21.938 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 145/170 2024-05-20T16:55:21.969 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-05-20T16:55:21.996 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-05-20T16:55:22.195 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 148/170 2024-05-20T16:55:22.243 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-05-20T16:55:22.282 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_ 150/170 2024-05-20T16:55:22.324 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-05-20T16:55:22.354 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 152/170 2024-05-20T16:55:22.400 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 153/170 2024-05-20T16:55:22.999 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T16:55:23.039 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T16:55:23.060 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T16:55:23.964 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 155/170 2024-05-20T16:55:24.060 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-05-20T16:55:24.103 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-05-20T16:55:24.208 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-05-20T16:55:24.238 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-05-20T16:55:24.263 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-20T16:55:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-05-20T16:55:24.315 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-05-20T16:55:24.315 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-20T16:55:24.383 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-20T16:55:24.424 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-05-20T16:55:24.424 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-20T16:55:24.492 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-20T16:55:24.517 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-05-20T16:55:24.522 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T16:55:24.522 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T16:55:24.711 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T16:55:24.711 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-20T16:55:24.787 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-20T16:55:24.811 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-05-20T16:55:24.880 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-20T16:55:30.526 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-20T16:55:30.527 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 1/170 2024-05-20T16:55:30.527 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 2/170 2024-05-20T16:55:30.527 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 3/170 2024-05-20T16:55:30.527 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 4/170 2024-05-20T16:55:30.527 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 5/170 2024-05-20T16:55:30.527 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 6/170 2024-05-20T16:55:30.527 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 7/170 2024-05-20T16:55:30.527 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T16:55:30.527 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T16:55:30.527 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 10/170 2024-05-20T16:55:30.527 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 11/170 2024-05-20T16:55:30.527 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 12/170 2024-05-20T16:55:30.527 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 13/170 2024-05-20T16:55:30.528 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T16:55:30.528 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_ 15/170 2024-05-20T16:55:30.528 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 16/170 2024-05-20T16:55:30.528 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 17/170 2024-05-20T16:55:30.528 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_6 18/170 2024-05-20T16:55:30.528 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 19/170 2024-05-20T16:55:30.528 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 20/170 2024-05-20T16:55:30.528 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el 21/170 2024-05-20T16:55:30.528 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9. 22/170 2024-05-20T16:55:30.528 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_6 23/170 2024-05-20T16:55:30.528 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 24/170 2024-05-20T16:55:30.528 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 25/170 2024-05-20T16:55:30.528 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 26/170 2024-05-20T16:55:30.528 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 27/170 2024-05-20T16:55:30.529 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 28/170 2024-05-20T16:55:30.529 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 29/170 2024-05-20T16:55:30.529 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7. 30/170 2024-05-20T16:55:30.529 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 31/170 2024-05-20T16:55:30.529 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 32/170 2024-05-20T16:55:30.529 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 33/170 2024-05-20T16:55:30.529 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el 34/170 2024-05-20T16:55:30.529 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 35/170 2024-05-20T16:55:30.529 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.e 36/170 2024-05-20T16:55:30.529 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 37/170 2024-05-20T16:55:30.529 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 38/170 2024-05-20T16:55:30.529 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 39/170 2024-05-20T16:55:30.529 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-05-20T16:55:30.529 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-05-20T16:55:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-05-20T16:55:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-05-20T16:55:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-05-20T16:55:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-05-20T16:55:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-05-20T16:55:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-05-20T16:55:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-05-20T16:55:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-05-20T16:55:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-05-20T16:55:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-05-20T16:55:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-05-20T16:55:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-05-20T16:55:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-05-20T16:55:30.531 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-05-20T16:55:30.531 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-05-20T16:55:30.531 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-05-20T16:55:30.531 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-05-20T16:55:30.531 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-05-20T16:55:30.531 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-05-20T16:55:30.531 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-05-20T16:55:30.531 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-05-20T16:55:30.531 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-05-20T16:55:30.531 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-05-20T16:55:30.531 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-05-20T16:55:30.531 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-05-20T16:55:30.531 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-05-20T16:55:30.531 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-05-20T16:55:30.532 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-05-20T16:55:30.532 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-05-20T16:55:30.532 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-05-20T16:55:30.532 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-05-20T16:55:30.532 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-05-20T16:55:30.532 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-05-20T16:55:30.532 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-05-20T16:55:30.532 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-05-20T16:55:30.532 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-05-20T16:55:30.532 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-05-20T16:55:30.532 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-05-20T16:55:30.532 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-05-20T16:55:30.532 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-05-20T16:55:30.532 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-05-20T16:55:30.533 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-05-20T16:55:30.533 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-05-20T16:55:30.533 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-05-20T16:55:30.533 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-05-20T16:55:30.533 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-05-20T16:55:30.533 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-05-20T16:55:30.533 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-05-20T16:55:30.533 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-05-20T16:55:30.533 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-05-20T16:55:30.533 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-05-20T16:55:30.533 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-05-20T16:55:30.533 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-05-20T16:55:30.533 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-05-20T16:55:30.533 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-05-20T16:55:30.534 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-05-20T16:55:30.534 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-05-20T16:55:30.534 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-05-20T16:55:30.534 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-05-20T16:55:30.534 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-05-20T16:55:30.534 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-05-20T16:55:30.534 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-05-20T16:55:30.534 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-05-20T16:55:30.534 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-05-20T16:55:30.534 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-05-20T16:55:30.534 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-05-20T16:55:30.534 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-05-20T16:55:30.535 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-05-20T16:55:30.535 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-05-20T16:55:30.535 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-05-20T16:55:30.535 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-05-20T16:55:30.535 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-05-20T16:55:30.535 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-05-20T16:55:30.535 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-05-20T16:55:30.535 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-05-20T16:55:30.535 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-05-20T16:55:30.535 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-05-20T16:55:30.535 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-05-20T16:55:30.535 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-05-20T16:55:30.535 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-05-20T16:55:30.535 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-05-20T16:55:30.536 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-05-20T16:55:30.536 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-05-20T16:55:30.536 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-05-20T16:55:30.536 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-05-20T16:55:30.536 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-05-20T16:55:30.536 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-05-20T16:55:30.536 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-05-20T16:55:30.536 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-05-20T16:55:30.536 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-05-20T16:55:30.536 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-05-20T16:55:30.536 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-05-20T16:55:30.536 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-05-20T16:55:30.536 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-05-20T16:55:30.536 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-05-20T16:55:30.536 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-05-20T16:55:30.537 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-05-20T16:55:30.537 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-05-20T16:55:30.537 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-05-20T16:55:30.537 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-05-20T16:55:30.537 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-05-20T16:55:30.537 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-05-20T16:55:30.537 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-05-20T16:55:30.537 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-05-20T16:55:30.537 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-05-20T16:55:30.537 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-05-20T16:55:30.537 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-05-20T16:55:30.537 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 149/170 2024-05-20T16:55:30.537 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-05-20T16:55:30.538 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 151/170 2024-05-20T16:55:30.538 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-05-20T16:55:30.538 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/170 2024-05-20T16:55:30.538 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-05-20T16:55:30.538 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/170 2024-05-20T16:55:30.538 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-05-20T16:55:30.538 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/170 2024-05-20T16:55:30.538 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-05-20T16:55:30.538 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/170 2024-05-20T16:55:30.538 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-20T16:55:30.538 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-05-20T16:55:30.538 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-05-20T16:55:30.538 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-05-20T16:55:30.538 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-05-20T16:55:30.539 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-05-20T16:55:30.539 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-05-20T16:55:30.539 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-05-20T16:55:30.539 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-05-20T16:55:30.539 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-05-20T16:55:33.621 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-05-20T16:55:33.622 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:55:33.622 INFO:teuthology.orchestra.run.smithi006.stdout:Upgraded: 2024-05-20T16:55:33.622 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-20T16:55:33.622 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-20T16:55:33.622 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-20T16:55:33.622 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-20T16:55:33.622 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-05-20T16:55:33.622 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-05-20T16:55:33.622 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-05-20T16:55:33.622 INFO:teuthology.orchestra.run.smithi006.stdout: librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.623 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.623 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-20T16:55:33.623 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-20T16:55:33.623 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-05-20T16:55:33.623 INFO:teuthology.orchestra.run.smithi006.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-20T16:55:33.623 INFO:teuthology.orchestra.run.smithi006.stdout: automake-1.16.2-8.el9.noarch 2024-05-20T16:55:33.623 INFO:teuthology.orchestra.run.smithi006.stdout: bison-3.7.4-5.el9.x86_64 2024-05-20T16:55:33.623 INFO:teuthology.orchestra.run.smithi006.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-20T16:55:33.623 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.623 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.623 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.623 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.624 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:33.624 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.624 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.624 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.624 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:33.624 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:33.624 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:33.624 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:33.624 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:33.624 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.624 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.624 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:33.624 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.625 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.625 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.625 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:33.625 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:33.625 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.625 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.625 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T16:55:33.625 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-05-20T16:55:33.625 INFO:teuthology.orchestra.run.smithi006.stdout: flex-2.6.4-9.el9.x86_64 2024-05-20T16:55:33.625 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-20T16:55:33.625 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-20T16:55:33.625 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-20T16:55:33.625 INFO:teuthology.orchestra.run.smithi006.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-20T16:55:33.626 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-20T16:55:33.626 INFO:teuthology.orchestra.run.smithi006.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-20T16:55:33.626 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-20T16:55:33.626 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-20T16:55:33.626 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-20T16:55:33.626 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.626 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.626 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.626 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-20T16:55:33.626 INFO:teuthology.orchestra.run.smithi006.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-20T16:55:33.626 INFO:teuthology.orchestra.run.smithi006.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-20T16:55:33.626 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-20T16:55:33.626 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-20T16:55:33.627 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.627 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.627 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-20T16:55:33.627 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.627 INFO:teuthology.orchestra.run.smithi006.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-20T16:55:33.627 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-20T16:55:33.627 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-20T16:55:33.627 INFO:teuthology.orchestra.run.smithi006.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-20T16:55:33.627 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-20T16:55:33.627 INFO:teuthology.orchestra.run.smithi006.stdout: lua-5.4.4-4.el9.x86_64 2024-05-20T16:55:33.627 INFO:teuthology.orchestra.run.smithi006.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-20T16:55:33.627 INFO:teuthology.orchestra.run.smithi006.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-20T16:55:33.627 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-20T16:55:33.627 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-20T16:55:33.628 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-20T16:55:33.628 INFO:teuthology.orchestra.run.smithi006.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-20T16:55:33.628 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-13.14-1.el9.x86_64 2024-05-20T16:55:33.628 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-20T16:55:33.628 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-20T16:55:33.628 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-20T16:55:33.628 INFO:teuthology.orchestra.run.smithi006.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-20T16:55:33.628 INFO:teuthology.orchestra.run.smithi006.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-20T16:55:33.628 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-20T16:55:33.628 INFO:teuthology.orchestra.run.smithi006.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-20T16:55:33.628 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-20T16:55:33.628 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-20T16:55:33.629 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-20T16:55:33.629 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.629 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.629 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.629 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-20T16:55:33.629 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-20T16:55:33.629 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-20T16:55:33.629 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-20T16:55:33.629 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-20T16:55:33.629 INFO:teuthology.orchestra.run.smithi006.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-05-20T16:55:33.629 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-20T16:55:33.629 INFO:teuthology.orchestra.run.smithi006.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-20T16:55:33.629 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-20T16:55:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-20T16:55:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-20T16:55:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-20T16:55:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-20T16:55:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-20T16:55:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-20T16:55:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-20T16:55:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-05-20T16:55:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-20T16:55:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-20T16:55:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-20T16:55:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-20T16:55:33.630 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-20T16:55:33.631 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-20T16:55:33.631 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-20T16:55:33.631 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-20T16:55:33.631 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-20T16:55:33.631 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-20T16:55:33.631 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-20T16:55:33.631 INFO:teuthology.orchestra.run.smithi006.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-20T16:55:33.631 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-20T16:55:33.631 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ply-3.11-14.el9.noarch 2024-05-20T16:55:33.631 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-20T16:55:33.631 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-20T16:55:33.631 INFO:teuthology.orchestra.run.smithi006.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-20T16:55:33.631 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-20T16:55:33.632 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-20T16:55:33.632 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-20T16:55:33.632 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-20T16:55:33.632 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-20T16:55:33.632 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-20T16:55:33.632 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.632 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.632 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-20T16:55:33.632 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-20T16:55:33.632 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-20T16:55:33.632 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.632 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-20T16:55:33.632 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-20T16:55:33.632 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-20T16:55:33.633 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-20T16:55:33.633 INFO:teuthology.orchestra.run.smithi006.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-20T16:55:33.633 INFO:teuthology.orchestra.run.smithi006.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-20T16:55:33.633 INFO:teuthology.orchestra.run.smithi006.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-20T16:55:33.633 INFO:teuthology.orchestra.run.smithi006.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-20T16:55:33.633 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-20T16:55:33.633 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-20T16:55:33.633 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-20T16:55:33.633 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-20T16:55:33.633 INFO:teuthology.orchestra.run.smithi006.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-20T16:55:33.633 INFO:teuthology.orchestra.run.smithi006.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-20T16:55:33.633 INFO:teuthology.orchestra.run.smithi006.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-20T16:55:33.633 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.634 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.634 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T16:55:33.634 INFO:teuthology.orchestra.run.smithi006.stdout: re2-1:20211101-3.el9.x86_64 2024-05-20T16:55:33.634 INFO:teuthology.orchestra.run.smithi006.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-20T16:55:33.634 INFO:teuthology.orchestra.run.smithi006.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-20T16:55:33.634 INFO:teuthology.orchestra.run.smithi006.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-20T16:55:33.634 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-20T16:55:33.634 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-20T16:55:33.635 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-20T16:55:33.635 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:55:33.635 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-05-20T16:55:34.059 DEBUG:teuthology.parallel:result is None 2024-05-20T16:55:34.060 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T16:55:34.199 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-20T16:55:34.221 INFO:teuthology.orchestra.run.smithi006.stdout:19.0.0-2744.gd2b507c7.el9 2024-05-20T16:55:34.222 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2744.gd2b507c7.el9 2024-05-20T16:55:34.222 INFO:teuthology.task.install:The correct ceph version 19.0.0-2744.gd2b507c7 is installed. 2024-05-20T16:55:34.224 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T16:55:34.361 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-20T16:55:34.390 INFO:teuthology.orchestra.run.smithi062.stdout:19.0.0-2744.gd2b507c7.el9 2024-05-20T16:55:34.390 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2744.gd2b507c7.el9 2024-05-20T16:55:34.391 INFO:teuthology.task.install:The correct ceph version 19.0.0-2744.gd2b507c7 is installed. 2024-05-20T16:55:34.392 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T16:55:34.618 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-20T16:55:34.645 INFO:teuthology.orchestra.run.smithi171.stdout:19.0.0-2744.gd2b507c7.el9 2024-05-20T16:55:34.645 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2744.gd2b507c7.el9 2024-05-20T16:55:34.645 INFO:teuthology.task.install:The correct ceph version 19.0.0-2744.gd2b507c7 is installed. 2024-05-20T16:55:34.647 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-20T16:55:34.648 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T16:55:34.648 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-20T16:55:34.678 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-20T16:55:34.678 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-20T16:55:34.712 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T16:55:34.712 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-20T16:55:34.744 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-20T16:55:34.744 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T16:55:34.744 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2024-05-20T16:55:34.772 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-20T16:55:34.839 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-20T16:55:34.839 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2024-05-20T16:55:34.870 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-20T16:55:34.940 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T16:55:34.940 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper 2024-05-20T16:55:34.970 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-20T16:55:35.040 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-20T16:55:35.040 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T16:55:35.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-20T16:55:35.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-20T16:55:35.133 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-20T16:55:35.134 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-20T16:55:35.164 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-20T16:55:35.233 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T16:55:35.233 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-20T16:55:35.263 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-20T16:55:35.332 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-20T16:55:35.332 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T16:55:35.332 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/stdin-killer 2024-05-20T16:55:35.359 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-20T16:55:35.426 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-20T16:55:35.426 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2024-05-20T16:55:35.456 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-20T16:55:35.527 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T16:55:35.527 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/stdin-killer 2024-05-20T16:55:35.556 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-20T16:55:35.623 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-20T16:55:35.721 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d', 'subvols': {'create': 2}} 2024-05-20T16:55:35.721 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T16:55:35.722 INFO:tasks.cephadm:Cluster fsid is c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:55:35.722 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-20T16:55:35.722 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.6', 'mon.b': '172.21.15.62', 'mon.c': '172.21.15.171'} 2024-05-20T16:55:35.722 INFO:tasks.cephadm:First mon is mon.a on smithi006 2024-05-20T16:55:35.722 INFO:tasks.cephadm:First mgr is x 2024-05-20T16:55:35.722 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-20T16:55:35.722 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname $(hostname -s) 2024-05-20T16:55:35.751 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname $(hostname -s) 2024-05-20T16:55:35.782 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname $(hostname -s) 2024-05-20T16:55:35.812 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-20T16:55:35.812 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T16:55:36.108 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79503/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-2744-gd2b507c7', 'node_name': '172.21.5.39+adami09', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-2744.gd2b507c7'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-17 22:05:47.367530', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240517.203521-squid-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-05-20T16:55:36.465 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-pdonnell-testing-20240517.203521-squid-debug, sha1 d2b507c724ef6c8295ee0a35d185cdab167fd61d from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T16:55:36.466 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/x86_64/flavors/default/cephadm 2024-05-20T16:55:36.466 DEBUG:teuthology.orchestra.run.smithi006:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-20T16:55:37.113 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r--. 1 ubuntu ubuntu 782070 May 20 16:55 /home/ubuntu/cephtest/cephadm 2024-05-20T16:55:37.114 DEBUG:teuthology.orchestra.run.smithi062:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-20T16:55:37.562 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r--. 1 ubuntu ubuntu 782070 May 20 16:55 /home/ubuntu/cephtest/cephadm 2024-05-20T16:55:37.562 DEBUG:teuthology.orchestra.run.smithi171:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-20T16:55:38.133 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r--. 1 ubuntu ubuntu 782070 May 20 16:55 /home/ubuntu/cephtest/cephadm 2024-05-20T16:55:38.133 DEBUG:teuthology.orchestra.run.smithi006:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-20T16:55:38.154 DEBUG:teuthology.orchestra.run.smithi062:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-20T16:55:38.174 DEBUG:teuthology.orchestra.run.smithi171:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-20T16:55:38.210 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d on all hosts... 2024-05-20T16:55:38.210 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d pull 2024-05-20T16:55:38.213 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d pull 2024-05-20T16:55:38.217 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d pull 2024-05-20T16:55:39.084 INFO:teuthology.orchestra.run.smithi062.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d... 2024-05-20T16:55:39.118 INFO:teuthology.orchestra.run.smithi171.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d... 2024-05-20T16:55:39.248 INFO:teuthology.orchestra.run.smithi006.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d... 2024-05-20T16:56:10.833 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T16:56:10.833 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 19.0.0-2744-gd2b507c7 (d2b507c724ef6c8295ee0a35d185cdab167fd61d) squid (dev)", 2024-05-20T16:56:10.833 INFO:teuthology.orchestra.run.smithi006.stdout: "image_id": "cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3", 2024-05-20T16:56:10.833 INFO:teuthology.orchestra.run.smithi006.stdout: "repo_digests": [ 2024-05-20T16:56:10.833 INFO:teuthology.orchestra.run.smithi006.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708" 2024-05-20T16:56:10.833 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T16:56:10.834 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T16:56:25.934 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-05-20T16:56:25.934 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_version": "ceph version 19.0.0-2744-gd2b507c7 (d2b507c724ef6c8295ee0a35d185cdab167fd61d) squid (dev)", 2024-05-20T16:56:25.934 INFO:teuthology.orchestra.run.smithi171.stdout: "image_id": "cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3", 2024-05-20T16:56:25.934 INFO:teuthology.orchestra.run.smithi171.stdout: "repo_digests": [ 2024-05-20T16:56:25.934 INFO:teuthology.orchestra.run.smithi171.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708" 2024-05-20T16:56:25.934 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-05-20T16:56:25.934 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-05-20T16:56:26.134 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-20T16:56:26.134 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_version": "ceph version 19.0.0-2744-gd2b507c7 (d2b507c724ef6c8295ee0a35d185cdab167fd61d) squid (dev)", 2024-05-20T16:56:26.134 INFO:teuthology.orchestra.run.smithi062.stdout: "image_id": "cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3", 2024-05-20T16:56:26.134 INFO:teuthology.orchestra.run.smithi062.stdout: "repo_digests": [ 2024-05-20T16:56:26.134 INFO:teuthology.orchestra.run.smithi062.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708" 2024-05-20T16:56:26.134 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-20T16:56:26.134 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-20T16:56:26.160 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph 2024-05-20T16:56:26.195 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph 2024-05-20T16:56:26.224 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph 2024-05-20T16:56:26.251 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /etc/ceph 2024-05-20T16:56:26.280 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /etc/ceph 2024-05-20T16:56:26.306 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /etc/ceph 2024-05-20T16:56:26.330 INFO:tasks.cephadm:Writing seed config... 2024-05-20T16:56:26.331 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-20T16:56:26.331 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-20T16:56:26.332 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-20T16:56:26.332 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-20T16:56:26.332 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-20T16:56:26.332 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-20T16:56:26.332 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-20T16:56:26.332 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-20T16:56:26.332 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-05-20T16:56:26.332 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-05-20T16:56:26.332 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-05-20T16:56:26.332 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-05-20T16:56:26.332 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-20T16:56:26.332 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-20T16:56:26.332 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-20T16:56:26.332 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-20T16:56:26.332 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-05-20T16:56:26.332 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-20T16:56:26.333 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-20T16:56:26.333 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-20T16:56:26.333 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-05-20T16:56:26.333 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-05-20T16:56:26.333 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-20T16:56:26.333 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-20T16:56:26.333 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-20T16:56:26.333 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-20T16:56:26.333 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-20T16:56:26.333 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-05-20T16:56:26.333 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-20T16:56:26.333 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-20T16:56:26.333 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-20T16:56:26.333 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-05-20T16:56:26.333 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-05-20T16:56:26.334 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-20T16:56:26.334 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-20T16:56:26.334 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-05-20T16:56:26.334 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-20T16:56:26.334 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-20T16:56:26.334 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-20T16:56:26.334 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-20T16:56:26.334 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-20T16:56:26.334 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-20T16:56:26.334 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-20T16:56:26.334 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-05-20T16:56:26.335 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T16:56:26.335 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-20T16:56:26.352 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c726c954-16c9-11ef-bc9a-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-20T16:56:26.353 DEBUG:teuthology.orchestra.run.smithi006:mon.a> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mon.a.service 2024-05-20T16:56:26.395 DEBUG:teuthology.orchestra.run.smithi006:mgr.x> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mgr.x.service 2024-05-20T16:56:26.438 INFO:tasks.cephadm:Bootstrapping... 2024-05-20T16:56:26.438 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d -v bootstrap --fsid c726c954-16c9-11ef-bc9a-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.6 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-20T16:56:26.639 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-05-20T16:56:26.639 INFO:teuthology.orchestra.run.smithi006.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d', '-v', 'bootstrap', '--fsid', 'c726c954-16c9-11ef-bc9a-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.6', '--skip-admin-label'] 2024-05-20T16:56:26.640 INFO:teuthology.orchestra.run.smithi006.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-20T16:56:26.640 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying podman|docker is present... 2024-05-20T16:56:26.670 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stdout 5.0.2 2024-05-20T16:56:26.670 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying lvm2 is present... 2024-05-20T16:56:26.671 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying time synchronization is in place... 2024-05-20T16:56:26.679 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-20T16:56:26.679 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-20T16:56:26.686 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-20T16:56:26.686 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2024-05-20T16:56:26.694 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout enabled 2024-05-20T16:56:26.701 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout active 2024-05-20T16:56:26.701 INFO:teuthology.orchestra.run.smithi006.stdout:Unit chronyd.service is enabled and running 2024-05-20T16:56:26.701 INFO:teuthology.orchestra.run.smithi006.stdout:Repeating the final host check... 2024-05-20T16:56:26.730 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stdout 5.0.2 2024-05-20T16:56:26.731 INFO:teuthology.orchestra.run.smithi006.stdout:podman (/bin/podman) version 5.0.2 is present 2024-05-20T16:56:26.731 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl is present 2024-05-20T16:56:26.731 INFO:teuthology.orchestra.run.smithi006.stdout:lvcreate is present 2024-05-20T16:56:26.738 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-20T16:56:26.739 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-20T16:56:26.747 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-20T16:56:26.747 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2024-05-20T16:56:26.754 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout enabled 2024-05-20T16:56:26.762 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout active 2024-05-20T16:56:26.762 INFO:teuthology.orchestra.run.smithi006.stdout:Unit chronyd.service is enabled and running 2024-05-20T16:56:26.762 INFO:teuthology.orchestra.run.smithi006.stdout:Host looks OK 2024-05-20T16:56:26.762 INFO:teuthology.orchestra.run.smithi006.stdout:Cluster fsid: c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:56:26.762 INFO:teuthology.orchestra.run.smithi006.stdout:Acquiring lock 140585382950272 on /run/cephadm/c726c954-16c9-11ef-bc9a-c7b262605968.lock 2024-05-20T16:56:26.763 INFO:teuthology.orchestra.run.smithi006.stdout:Lock 140585382950272 acquired on /run/cephadm/c726c954-16c9-11ef-bc9a-c7b262605968.lock 2024-05-20T16:56:26.763 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying IP 172.21.15.6 port 3300 ... 2024-05-20T16:56:26.763 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying IP 172.21.15.6 port 6789 ... 2024-05-20T16:56:26.763 INFO:teuthology.orchestra.run.smithi006.stdout:Base mon IP(s) is [172.21.15.6:3300, 172.21.15.6:6789], mon addrv is [v2:172.21.15.6:3300,v1:172.21.15.6:6789] 2024-05-20T16:56:26.767 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.6 metric 100 2024-05-20T16:56:26.767 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.6 metric 100 2024-05-20T16:56:26.770 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-20T16:56:26.770 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-05-20T16:56:26.770 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-05-20T16:56:26.772 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-20T16:56:26.772 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-20T16:56:26.772 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-20T16:56:26.773 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-05-20T16:56:26.773 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15e4/64 scope link noprefixroute 2024-05-20T16:56:26.773 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-20T16:56:26.773 INFO:teuthology.orchestra.run.smithi006.stdout:Mon IP `172.21.15.6` is in CIDR network `172.21.0.0/20` 2024-05-20T16:56:26.773 INFO:teuthology.orchestra.run.smithi006.stdout:Mon IP `172.21.15.6` is in CIDR network `172.21.0.0/20` 2024-05-20T16:56:26.773 INFO:teuthology.orchestra.run.smithi006.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-20T16:56:26.774 INFO:teuthology.orchestra.run.smithi006.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-20T16:56:26.775 INFO:teuthology.orchestra.run.smithi006.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d... 2024-05-20T16:56:27.401 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stdout cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 2024-05-20T16:56:27.401 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d... 2024-05-20T16:56:27.401 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Getting image source signatures 2024-05-20T16:56:27.401 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Copying blob sha256:506d33f63dccdaac2c87f708e3d3ef98b8f2fc00666d50b72896243431ca9bae 2024-05-20T16:56:27.401 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Copying blob sha256:d0e808cd455827ca3108db1b0125dcee9ffc148daa1d7dde963f550bc831d501 2024-05-20T16:56:27.401 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Copying config sha256:cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 2024-05-20T16:56:27.401 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-20T16:56:28.363 INFO:teuthology.orchestra.run.smithi006.stdout:ceph: stdout ceph version 19.0.0-2744-gd2b507c7 (d2b507c724ef6c8295ee0a35d185cdab167fd61d) squid (dev) 2024-05-20T16:56:28.364 INFO:teuthology.orchestra.run.smithi006.stdout:Ceph version: ceph version 19.0.0-2744-gd2b507c7 (d2b507c724ef6c8295ee0a35d185cdab167fd61d) squid (dev) 2024-05-20T16:56:28.364 INFO:teuthology.orchestra.run.smithi006.stdout:Extracting ceph user uid/gid from container image... 2024-05-20T16:56:29.321 INFO:teuthology.orchestra.run.smithi006.stdout:stat: stdout 167 167 2024-05-20T16:56:29.321 INFO:teuthology.orchestra.run.smithi006.stdout:Creating initial keys... 2024-05-20T16:56:30.245 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph-authtool: stdout AQC9gEtmOsHiKRAAoo/zFt+m2Aa9ap8y5ARVZA== 2024-05-20T16:56:39.641 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph-authtool: stdout AQDBgEtmZeQYGhAAEwPrzE5zS5lUGq890FX0bQ== 2024-05-20T16:56:41.827 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph-authtool: stdout AQDJgEtmJHYyERAAdCvOkPdLKGYmw7VsxuehyQ== 2024-05-20T16:56:41.828 INFO:teuthology.orchestra.run.smithi006.stdout:Creating initial monmap... 2024-05-20T16:56:42.724 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-20T16:56:42.725 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-05-20T16:56:42.725 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:56:42.725 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-20T16:56:42.725 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool for a [v2:172.21.15.6:3300,v1:172.21.15.6:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-20T16:56:42.725 INFO:teuthology.orchestra.run.smithi006.stdout:setting min_mon_release = quincy 2024-05-20T16:56:42.725 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: set fsid to c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:56:42.725 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-20T16:56:42.725 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:56:42.725 INFO:teuthology.orchestra.run.smithi006.stdout:Creating mon... 2024-05-20T16:56:43.588 INFO:teuthology.orchestra.run.smithi006.stdout:create mon.a on 2024-05-20T16:56:43.810 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-20T16:56:43.962 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-20T16:56:44.243 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c726c954-16c9-11ef-bc9a-c7b262605968.target → /etc/systemd/system/ceph-c726c954-16c9-11ef-bc9a-c7b262605968.target. 2024-05-20T16:56:44.243 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-c726c954-16c9-11ef-bc9a-c7b262605968.target → /etc/systemd/system/ceph-c726c954-16c9-11ef-bc9a-c7b262605968.target. 2024-05-20T16:56:44.474 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mon.a 2024-05-20T16:56:44.474 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mon.a.service: Unit ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mon.a.service not loaded. 2024-05-20T16:56:44.639 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c726c954-16c9-11ef-bc9a-c7b262605968.target.wants/ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mon.a.service → /etc/systemd/system/ceph-c726c954-16c9-11ef-bc9a-c7b262605968@.service. 2024-05-20T16:56:45.141 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-20T16:56:45.142 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout disabled 2024-05-20T16:56:45.149 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-20T16:56:45.149 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2024-05-20T16:56:45.149 INFO:teuthology.orchestra.run.smithi006.stdout:firewalld.service is not enabled 2024-05-20T16:56:45.149 INFO:teuthology.orchestra.run.smithi006.stdout:Not possible to enable service . firewalld.service is not available 2024-05-20T16:56:45.150 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mon to start... 2024-05-20T16:56:45.150 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mon... 2024-05-20T16:56:46.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:46 smithi006 ceph-mon[32103]: from='client.? 172.21.15.6:0/341920830' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-20T16:56:46.491 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout cluster: 2024-05-20T16:56:46.497 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout id: c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:56:46.497 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-20T16:56:46.497 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-05-20T16:56:46.497 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout services: 2024-05-20T16:56:46.497 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.585329s) 2024-05-20T16:56:46.497 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-20T16:56:46.497 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-20T16:56:46.497 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-05-20T16:56:46.498 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout data: 2024-05-20T16:56:46.498 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-20T16:56:46.498 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-20T16:56:46.498 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-20T16:56:46.498 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout pgs: 2024-05-20T16:56:46.498 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-05-20T16:56:46.498 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.609+0000 7fe16a9e9700 1 Processor -- start 2024-05-20T16:56:46.498 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.609+0000 7fe16a9e9700 1 -- start start 2024-05-20T16:56:46.498 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.609+0000 7fe16a9e9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe16407bca0 0x7fe16410b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:56:46.498 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.609+0000 7fe16a9e9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe16410b9f0 con 0x7fe16407bca0 2024-05-20T16:56:46.498 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.610+0000 7fe163fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe16407bca0 0x7fe16410b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:56:46.498 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.610+0000 7fe163fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe16407bca0 0x7fe16410b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43894/0 (socket says 172.21.15.6:43894) 2024-05-20T16:56:46.499 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.610+0000 7fe163fff700 1 -- 172.21.15.6:0/2474428767 learned_addr learned my addr 172.21.15.6:0/2474428767 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:56:46.499 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.610+0000 7fe163fff700 1 -- 172.21.15.6:0/2474428767 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16410bb70 con 0x7fe16407bca0 2024-05-20T16:56:46.499 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.610+0000 7fe163fff700 1 --2- 172.21.15.6:0/2474428767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe16407bca0 0x7fe16410b3e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0098a0 tx=0x7fe14c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c32e2091061465c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:56:46.499 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.610+0000 7fe162ffd700 1 -- 172.21.15.6:0/2474428767 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe14c004160 con 0x7fe16407bca0 2024-05-20T16:56:46.499 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.611+0000 7fe162ffd700 1 -- 172.21.15.6:0/2474428767 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe14c004300 con 0x7fe16407bca0 2024-05-20T16:56:46.499 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.611+0000 7fe162ffd700 1 -- 172.21.15.6:0/2474428767 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe14c0036a0 con 0x7fe16407bca0 2024-05-20T16:56:46.499 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.611+0000 7fe16a9e9700 1 -- 172.21.15.6:0/2474428767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe16407bca0 msgr2=0x7fe16410b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:56:46.499 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.611+0000 7fe16a9e9700 1 --2- 172.21.15.6:0/2474428767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe16407bca0 0x7fe16410b3e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0098a0 tx=0x7fe14c009bb0 comp rx=0 tx=0).stop 2024-05-20T16:56:46.500 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.611+0000 7fe16a9e9700 1 -- 172.21.15.6:0/2474428767 shutdown_connections 2024-05-20T16:56:46.500 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.611+0000 7fe16a9e9700 1 --2- 172.21.15.6:0/2474428767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe16407bca0 0x7fe16410b3e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:56:46.500 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.611+0000 7fe16a9e9700 1 -- 172.21.15.6:0/2474428767 >> 172.21.15.6:0/2474428767 conn(0x7fe164102df0 msgr2=0x7fe1641052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:56:46.500 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.611+0000 7fe16a9e9700 1 -- 172.21.15.6:0/2474428767 shutdown_connections 2024-05-20T16:56:46.500 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.611+0000 7fe16a9e9700 1 -- 172.21.15.6:0/2474428767 wait complete. 2024-05-20T16:56:46.500 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.612+0000 7fe16a9e9700 1 Processor -- start 2024-05-20T16:56:46.500 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.612+0000 7fe16a9e9700 1 -- start start 2024-05-20T16:56:46.500 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.613+0000 7fe16a9e9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe16407bca0 0x7fe16419c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:56:46.500 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.613+0000 7fe16a9e9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe16410c0a0 con 0x7fe16407bca0 2024-05-20T16:56:46.500 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.613+0000 7fe163fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe16407bca0 0x7fe16419c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:56:46.500 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.613+0000 7fe163fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe16407bca0 0x7fe16419c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43906/0 (socket says 172.21.15.6:43906) 2024-05-20T16:56:46.500 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.613+0000 7fe163fff700 1 -- 172.21.15.6:0/341920830 learned_addr learned my addr 172.21.15.6:0/341920830 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:56:46.500 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.613+0000 7fe163fff700 1 -- 172.21.15.6:0/341920830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16419c8c0 con 0x7fe16407bca0 2024-05-20T16:56:46.501 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.613+0000 7fe163fff700 1 --2- 172.21.15.6:0/341920830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe16407bca0 0x7fe16419c380 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe14c000c00 tx=0x7fe14c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:56:46.501 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.613+0000 7fe1617fa700 1 -- 172.21.15.6:0/341920830 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe14c003db0 con 0x7fe16407bca0 2024-05-20T16:56:46.501 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.614+0000 7fe1617fa700 1 -- 172.21.15.6:0/341920830 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe14c011630 con 0x7fe16407bca0 2024-05-20T16:56:46.501 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.614+0000 7fe16a9e9700 1 -- 172.21.15.6:0/341920830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe16419cb50 con 0x7fe16407bca0 2024-05-20T16:56:46.501 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.614+0000 7fe1617fa700 1 -- 172.21.15.6:0/341920830 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe14c011950 con 0x7fe16407bca0 2024-05-20T16:56:46.501 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.614+0000 7fe16a9e9700 1 -- 172.21.15.6:0/341920830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe16419f760 con 0x7fe16407bca0 2024-05-20T16:56:46.501 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.614+0000 7fe1617fa700 1 -- 172.21.15.6:0/341920830 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe14c011af0 con 0x7fe16407bca0 2024-05-20T16:56:46.501 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.614+0000 7fe1617fa700 1 -- 172.21.15.6:0/341920830 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe14c01c450 con 0x7fe16407bca0 2024-05-20T16:56:46.501 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.615+0000 7fe16a9e9700 1 -- 172.21.15.6:0/341920830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe164063ca0 con 0x7fe16407bca0 2024-05-20T16:56:46.501 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.618+0000 7fe1617fa700 1 -- 172.21.15.6:0/341920830 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe14c032020 con 0x7fe16407bca0 2024-05-20T16:56:46.501 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.692+0000 7fe16a9e9700 1 -- 172.21.15.6:0/341920830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fe16402df60 con 0x7fe16407bca0 2024-05-20T16:56:46.501 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.692+0000 7fe1617fa700 1 -- 172.21.15.6:0/341920830 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fe14c004260 con 0x7fe16407bca0 2024-05-20T16:56:46.501 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.694+0000 7fe16a9e9700 1 -- 172.21.15.6:0/341920830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe16407bca0 msgr2=0x7fe16419c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:56:46.501 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.694+0000 7fe16a9e9700 1 --2- 172.21.15.6:0/341920830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe16407bca0 0x7fe16419c380 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe14c000c00 tx=0x7fe14c004750 comp rx=0 tx=0).stop 2024-05-20T16:56:46.502 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.694+0000 7fe16a9e9700 1 -- 172.21.15.6:0/341920830 shutdown_connections 2024-05-20T16:56:46.502 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.694+0000 7fe16a9e9700 1 --2- 172.21.15.6:0/341920830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe16407bca0 0x7fe16419c380 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:56:46.502 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.694+0000 7fe16a9e9700 1 -- 172.21.15.6:0/341920830 >> 172.21.15.6:0/341920830 conn(0x7fe164102df0 msgr2=0x7fe164104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:56:46.502 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.694+0000 7fe16a9e9700 1 -- 172.21.15.6:0/341920830 shutdown_connections 2024-05-20T16:56:46.502 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:45.694+0000 7fe16a9e9700 1 -- 172.21.15.6:0/341920830 wait complete. 2024-05-20T16:56:46.502 INFO:teuthology.orchestra.run.smithi006.stdout:mon is available 2024-05-20T16:56:46.502 INFO:teuthology.orchestra.run.smithi006.stdout:Assimilating anything we can from ceph.conf... 2024-05-20T16:56:48.817 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:48 smithi006 ceph-mon[32103]: from='client.? 172.21.15.6:0/3858485906' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-20T16:56:48.817 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:48 smithi006 ceph-mon[32103]: from='client.? 172.21.15.6:0/3858485906' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-20T16:56:49.101 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-05-20T16:56:49.101 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [global] 2024-05-20T16:56:49.102 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout fsid = c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:56:49.102 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.6:3300,v1:172.21.15.6:6789] 2024-05-20T16:56:49.102 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-20T16:56:49.102 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-20T16:56:49.102 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-20T16:56:49.102 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-20T16:56:49.102 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-05-20T16:56:49.102 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-20T16:56:49.102 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-20T16:56:49.102 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-05-20T16:56:49.102 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [osd] 2024-05-20T16:56:49.102 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-20T16:56:49.103 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-20T16:56:49.103 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-20T16:56:49.103 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-20T16:56:49.103 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-20T16:56:49.103 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.436+0000 7f8376e9d700 1 Processor -- start 2024-05-20T16:56:49.103 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.437+0000 7f8376e9d700 1 -- start start 2024-05-20T16:56:49.103 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.437+0000 7f8376e9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8370109390 0x7f837010b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:56:49.103 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.437+0000 7f8376e9d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f837007c7e0 con 0x7f8370109390 2024-05-20T16:56:49.103 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.437+0000 7f8374c39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8370109390 0x7f837010b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:56:49.103 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.437+0000 7f8374c39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8370109390 0x7f837010b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43916/0 (socket says 172.21.15.6:43916) 2024-05-20T16:56:49.103 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.437+0000 7f8374c39700 1 -- 172.21.15.6:0/3212676398 learned_addr learned my addr 172.21.15.6:0/3212676398 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:56:49.103 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.437+0000 7f8374c39700 1 -- 172.21.15.6:0/3212676398 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837010bcf0 con 0x7f8370109390 2024-05-20T16:56:49.103 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.438+0000 7f8374c39700 1 --2- 172.21.15.6:0/3212676398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8370109390 0x7f837010b7b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f83640098a0 tx=0x7f8364009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed6dbce9c9947c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:56:49.104 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.438+0000 7f836f7fe700 1 -- 172.21.15.6:0/3212676398 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8364004160 con 0x7f8370109390 2024-05-20T16:56:49.104 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.438+0000 7f836f7fe700 1 -- 172.21.15.6:0/3212676398 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8364004300 con 0x7f8370109390 2024-05-20T16:56:49.104 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.438+0000 7f836f7fe700 1 -- 172.21.15.6:0/3212676398 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83640036a0 con 0x7f8370109390 2024-05-20T16:56:49.104 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.439+0000 7f8376e9d700 1 -- 172.21.15.6:0/3212676398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8370109390 msgr2=0x7f837010b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:56:49.104 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.439+0000 7f8376e9d700 1 --2- 172.21.15.6:0/3212676398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8370109390 0x7f837010b7b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f83640098a0 tx=0x7f8364009bb0 comp rx=0 tx=0).stop 2024-05-20T16:56:49.104 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.439+0000 7f8376e9d700 1 -- 172.21.15.6:0/3212676398 shutdown_connections 2024-05-20T16:56:49.104 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.439+0000 7f8376e9d700 1 --2- 172.21.15.6:0/3212676398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8370109390 0x7f837010b7b0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:56:49.104 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.439+0000 7f8376e9d700 1 -- 172.21.15.6:0/3212676398 >> 172.21.15.6:0/3212676398 conn(0x7f8370102e30 msgr2=0x7f83701052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:56:49.104 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.439+0000 7f8376e9d700 1 -- 172.21.15.6:0/3212676398 shutdown_connections 2024-05-20T16:56:49.104 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.439+0000 7f8376e9d700 1 -- 172.21.15.6:0/3212676398 wait complete. 2024-05-20T16:56:49.104 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.439+0000 7f8376e9d700 1 Processor -- start 2024-05-20T16:56:49.104 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.440+0000 7f8376e9d700 1 -- start start 2024-05-20T16:56:49.105 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.440+0000 7f8376e9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8370109390 0x7f837019c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:56:49.105 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.440+0000 7f8376e9d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f837010c0a0 con 0x7f8370109390 2024-05-20T16:56:49.105 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.440+0000 7f8374c39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8370109390 0x7f837019c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:56:49.105 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.440+0000 7f8374c39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8370109390 0x7f837019c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43930/0 (socket says 172.21.15.6:43930) 2024-05-20T16:56:49.105 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.440+0000 7f8374c39700 1 -- 172.21.15.6:0/3858485906 learned_addr learned my addr 172.21.15.6:0/3858485906 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:56:49.105 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.440+0000 7f8374c39700 1 -- 172.21.15.6:0/3858485906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837019c8d0 con 0x7f8370109390 2024-05-20T16:56:49.105 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.440+0000 7f8374c39700 1 --2- 172.21.15.6:0/3858485906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8370109390 0x7f837019c390 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8364000c00 tx=0x7f8364004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:56:49.105 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.441+0000 7f836dffb700 1 -- 172.21.15.6:0/3858485906 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8364003db0 con 0x7f8370109390 2024-05-20T16:56:49.105 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.441+0000 7f836dffb700 1 -- 172.21.15.6:0/3858485906 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8364011630 con 0x7f8370109390 2024-05-20T16:56:49.105 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.441+0000 7f836dffb700 1 -- 172.21.15.6:0/3858485906 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8364011950 con 0x7f8370109390 2024-05-20T16:56:49.105 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.441+0000 7f8376e9d700 1 -- 172.21.15.6:0/3858485906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f837019cb60 con 0x7f8370109390 2024-05-20T16:56:49.105 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.441+0000 7f8376e9d700 1 -- 172.21.15.6:0/3858485906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f837019f770 con 0x7f8370109390 2024-05-20T16:56:49.105 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.441+0000 7f836dffb700 1 -- 172.21.15.6:0/3858485906 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f836401a460 con 0x7f8370109390 2024-05-20T16:56:49.106 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.441+0000 7f836dffb700 1 -- 172.21.15.6:0/3858485906 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f836401b780 con 0x7f8370109390 2024-05-20T16:56:49.106 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.442+0000 7f8376e9d700 1 -- 172.21.15.6:0/3858485906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8370063ca0 con 0x7f8370109390 2024-05-20T16:56:49.106 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.444+0000 7f836dffb700 1 -- 172.21.15.6:0/3858485906 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8364031020 con 0x7f8370109390 2024-05-20T16:56:49.106 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.515+0000 7f8376e9d700 1 -- 172.21.15.6:0/3858485906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f837002df30 con 0x7f8370109390 2024-05-20T16:56:49.106 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.519+0000 7f836dffb700 1 -- 172.21.15.6:0/3858485906 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+427 (secure 0 0 0) 0x7f836401bad0 con 0x7f8370109390 2024-05-20T16:56:49.106 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.520+0000 7f8376e9d700 1 -- 172.21.15.6:0/3858485906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8370109390 msgr2=0x7f837019c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:56:49.106 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.520+0000 7f8376e9d700 1 --2- 172.21.15.6:0/3858485906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8370109390 0x7f837019c390 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8364000c00 tx=0x7f8364004750 comp rx=0 tx=0).stop 2024-05-20T16:56:49.106 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.520+0000 7f8376e9d700 1 -- 172.21.15.6:0/3858485906 shutdown_connections 2024-05-20T16:56:49.106 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.520+0000 7f8376e9d700 1 --2- 172.21.15.6:0/3858485906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8370109390 0x7f837019c390 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:56:49.106 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.520+0000 7f8376e9d700 1 -- 172.21.15.6:0/3858485906 >> 172.21.15.6:0/3858485906 conn(0x7f8370102e30 msgr2=0x7f8370104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:56:49.106 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.520+0000 7f8376e9d700 1 -- 172.21.15.6:0/3858485906 shutdown_connections 2024-05-20T16:56:49.106 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:48.520+0000 7f8376e9d700 1 -- 172.21.15.6:0/3858485906 wait complete. 2024-05-20T16:56:49.107 INFO:teuthology.orchestra.run.smithi006.stdout:Generating new minimal ceph.conf... 2024-05-20T16:56:49.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:49 smithi006 ceph-mon[32103]: from='client.? 172.21.15.6:0/2639879926' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:56:50.258 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.519+0000 7f53cfc7e700 1 Processor -- start 2024-05-20T16:56:50.258 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.519+0000 7f53cfc7e700 1 -- start start 2024-05-20T16:56:50.258 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.520+0000 7f53cfc7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53c8109390 0x7f53c810b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:56:50.258 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.520+0000 7f53cfc7e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f53c807bdb0 con 0x7f53c8109390 2024-05-20T16:56:50.258 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.520+0000 7f53cda1a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53c8109390 0x7f53c810b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:56:50.258 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.520+0000 7f53cda1a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53c8109390 0x7f53c810b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43944/0 (socket says 172.21.15.6:43944) 2024-05-20T16:56:50.258 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.520+0000 7f53cda1a700 1 -- 172.21.15.6:0/787145918 learned_addr learned my addr 172.21.15.6:0/787145918 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:56:50.258 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.520+0000 7f53cda1a700 1 -- 172.21.15.6:0/787145918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c810bcf0 con 0x7f53c8109390 2024-05-20T16:56:50.258 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.520+0000 7f53cda1a700 1 --2- 172.21.15.6:0/787145918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53c8109390 0x7f53c810b7b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f53c40098a0 tx=0x7f53c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516985e38805785e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:56:50.259 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.521+0000 7f53cca18700 1 -- 172.21.15.6:0/787145918 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c4004160 con 0x7f53c8109390 2024-05-20T16:56:50.259 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.521+0000 7f53cca18700 1 -- 172.21.15.6:0/787145918 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f53c4004300 con 0x7f53c8109390 2024-05-20T16:56:50.259 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.521+0000 7f53cca18700 1 -- 172.21.15.6:0/787145918 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c4011a80 con 0x7f53c8109390 2024-05-20T16:56:50.259 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.521+0000 7f53cfc7e700 1 -- 172.21.15.6:0/787145918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53c8109390 msgr2=0x7f53c810b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:56:50.259 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.521+0000 7f53cfc7e700 1 --2- 172.21.15.6:0/787145918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53c8109390 0x7f53c810b7b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f53c40098a0 tx=0x7f53c4009bb0 comp rx=0 tx=0).stop 2024-05-20T16:56:50.259 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.521+0000 7f53cfc7e700 1 -- 172.21.15.6:0/787145918 shutdown_connections 2024-05-20T16:56:50.259 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.521+0000 7f53cfc7e700 1 --2- 172.21.15.6:0/787145918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53c8109390 0x7f53c810b7b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:56:50.260 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.521+0000 7f53cfc7e700 1 -- 172.21.15.6:0/787145918 >> 172.21.15.6:0/787145918 conn(0x7f53c8102df0 msgr2=0x7f53c81052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:56:50.260 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.521+0000 7f53cfc7e700 1 -- 172.21.15.6:0/787145918 shutdown_connections 2024-05-20T16:56:50.260 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.522+0000 7f53cfc7e700 1 -- 172.21.15.6:0/787145918 wait complete. 2024-05-20T16:56:50.260 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.522+0000 7f53cfc7e700 1 Processor -- start 2024-05-20T16:56:50.260 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.522+0000 7f53cfc7e700 1 -- start start 2024-05-20T16:56:50.261 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.522+0000 7f53cfc7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53c8109390 0x7f53c8108b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:56:50.261 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.522+0000 7f53cfc7e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f53c810cbf0 con 0x7f53c8109390 2024-05-20T16:56:50.261 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.523+0000 7f53cda1a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53c8109390 0x7f53c8108b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:56:50.261 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.523+0000 7f53cda1a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53c8109390 0x7f53c8108b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43948/0 (socket says 172.21.15.6:43948) 2024-05-20T16:56:50.261 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.523+0000 7f53cda1a700 1 -- 172.21.15.6:0/2639879926 learned_addr learned my addr 172.21.15.6:0/2639879926 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:56:50.261 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.523+0000 7f53cda1a700 1 -- 172.21.15.6:0/2639879926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c8109050 con 0x7f53c8109390 2024-05-20T16:56:50.261 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.523+0000 7f53cda1a700 1 --2- 172.21.15.6:0/2639879926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53c8109390 0x7f53c8108b10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f53c40116a0 tx=0x7f53c4011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:56:50.262 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.523+0000 7f53beffd700 1 -- 172.21.15.6:0/2639879926 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c40039f0 con 0x7f53c8109390 2024-05-20T16:56:50.262 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.523+0000 7f53beffd700 1 -- 172.21.15.6:0/2639879926 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f53c4003b90 con 0x7f53c8109390 2024-05-20T16:56:50.262 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.523+0000 7f53cfc7e700 1 -- 172.21.15.6:0/2639879926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c81072a0 con 0x7f53c8109390 2024-05-20T16:56:50.262 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.523+0000 7f53beffd700 1 -- 172.21.15.6:0/2639879926 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c4019740 con 0x7f53c8109390 2024-05-20T16:56:50.262 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.523+0000 7f53cfc7e700 1 -- 172.21.15.6:0/2639879926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c8107780 con 0x7f53c8109390 2024-05-20T16:56:50.262 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.523+0000 7f53beffd700 1 -- 172.21.15.6:0/2639879926 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f53c402d430 con 0x7f53c8109390 2024-05-20T16:56:50.263 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.523+0000 7f53beffd700 1 -- 172.21.15.6:0/2639879926 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f53c40247c0 con 0x7f53c8109390 2024-05-20T16:56:50.263 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.524+0000 7f53cfc7e700 1 -- 172.21.15.6:0/2639879926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c8063ca0 con 0x7f53c8109390 2024-05-20T16:56:50.263 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.527+0000 7f53beffd700 1 -- 172.21.15.6:0/2639879926 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f53c401abe0 con 0x7f53c8109390 2024-05-20T16:56:50.263 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.597+0000 7f53cfc7e700 1 -- 172.21.15.6:0/2639879926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f53c8107a00 con 0x7f53c8109390 2024-05-20T16:56:50.263 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.597+0000 7f53beffd700 1 -- 172.21.15.6:0/2639879926 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+173 (secure 0 0 0) 0x7f53c4024a60 con 0x7f53c8109390 2024-05-20T16:56:50.263 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.598+0000 7f53cfc7e700 1 -- 172.21.15.6:0/2639879926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53c8109390 msgr2=0x7f53c8108b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:56:50.263 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.598+0000 7f53cfc7e700 1 --2- 172.21.15.6:0/2639879926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53c8109390 0x7f53c8108b10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f53c40116a0 tx=0x7f53c4011b70 comp rx=0 tx=0).stop 2024-05-20T16:56:50.263 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.598+0000 7f53cfc7e700 1 -- 172.21.15.6:0/2639879926 shutdown_connections 2024-05-20T16:56:50.263 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.598+0000 7f53cfc7e700 1 --2- 172.21.15.6:0/2639879926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53c8109390 0x7f53c8108b10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:56:50.264 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.598+0000 7f53cfc7e700 1 -- 172.21.15.6:0/2639879926 >> 172.21.15.6:0/2639879926 conn(0x7f53c8102df0 msgr2=0x7f53c81036d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:56:50.264 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.598+0000 7f53cfc7e700 1 -- 172.21.15.6:0/2639879926 shutdown_connections 2024-05-20T16:56:50.264 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:49.598+0000 7f53cfc7e700 1 -- 172.21.15.6:0/2639879926 wait complete. 2024-05-20T16:56:50.264 INFO:teuthology.orchestra.run.smithi006.stdout:Restarting the monitor... 2024-05-20T16:56:50.537 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:50 smithi006 systemd[1]: Stopping Ceph mon.a for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T16:56:50.837 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:50 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-a[32099]: 2024-05-20T16:56:50.536+0000 7f82d97bf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T16:56:50.837 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:50 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-a[32099]: 2024-05-20T16:56:50.536+0000 7f82d97bf700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-20T16:56:50.837 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:50 smithi006 podman[32362]: 2024-05-20 16:56:50.588830555 +0000 UTC m=+0.163847664 container died 1f417f007b85c3855058fbda4a4c33282cfb3055427406af128e1d91133cc7e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-a, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-20T16:56:51.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:50 smithi006 podman[32362]: 2024-05-20 16:56:50.928574499 +0000 UTC m=+0.503591599 container cleanup 1f417f007b85c3855058fbda4a4c33282cfb3055427406af128e1d91133cc7e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS) 2024-05-20T16:56:51.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:50 smithi006 bash[32362]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-a 2024-05-20T16:56:51.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 podman[32375]: 2024-05-20 16:56:51.071020319 +0000 UTC m=+0.471820065 container remove 1f417f007b85c3855058fbda4a4c33282cfb3055427406af128e1d91133cc7e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-a, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T16:56:51.530 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 systemd[1]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-20T16:56:51.530 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 systemd[1]: Stopped Ceph mon.a for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T16:56:51.530 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 systemd[1]: Starting Ceph mon.a for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T16:56:51.530 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 podman[32467]: 2024-05-20 16:56:51.401970324 +0000 UTC m=+0.018100460 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T16:56:51.530 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 podman[32467]: 2024-05-20 16:56:51.530794991 +0000 UTC m=+0.146925137 container create e83671806ab5bb8ea965bef154627552b536b5607941f87ffefd6624c4a90c35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-05-20T16:56:51.803 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 podman[32467]: 2024-05-20 16:56:51.766835229 +0000 UTC m=+0.382965365 container init e83671806ab5bb8ea965bef154627552b536b5607941f87ffefd6624c4a90c35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T16:56:51.803 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 podman[32467]: 2024-05-20 16:56:51.770345867 +0000 UTC m=+0.386475994 container start e83671806ab5bb8ea965bef154627552b536b5607941f87ffefd6624c4a90c35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-a, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-05-20T16:56:51.845 INFO:teuthology.orchestra.run.smithi006.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-20T16:56:52.061 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: set uid:gid to 167:167 (ceph:ceph) 2024-05-20T16:56:52.061 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: ceph version 19.0.0-2744-gd2b507c7 (d2b507c724ef6c8295ee0a35d185cdab167fd61d) squid (dev), process ceph-mon, pid 2 2024-05-20T16:56:52.061 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: pidfile_write: ignore empty --pid-file 2024-05-20T16:56:52.061 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: load: jerasure load: lrc 2024-05-20T16:56:52.061 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: RocksDB version: 7.9.2 2024-05-20T16:56:52.061 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Git sha 0 2024-05-20T16:56:52.061 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Compile date 2024-05-17 21:21:31 2024-05-20T16:56:52.061 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: DB SUMMARY 2024-05-20T16:56:52.061 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: DB Session ID: R2H5F7S7WFLIGUPOM6CY 2024-05-20T16:56:52.061 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: CURRENT file: CURRENT 2024-05-20T16:56:52.062 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: IDENTITY file: IDENTITY 2024-05-20T16:56:52.062 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-20T16:56:52.062 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-20T16:56:52.062 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 103722 ; 2024-05-20T16:56:52.062 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.error_if_exists: 0 2024-05-20T16:56:52.062 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.create_if_missing: 0 2024-05-20T16:56:52.062 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.paranoid_checks: 1 2024-05-20T16:56:52.062 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-20T16:56:52.062 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-20T16:56:52.062 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-20T16:56:52.062 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.env: 0x561f413f24a0 2024-05-20T16:56:52.063 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.fs: PosixFileSystem 2024-05-20T16:56:52.063 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.info_log: 0x561f41c81d40 2024-05-20T16:56:52.063 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_file_opening_threads: 16 2024-05-20T16:56:52.063 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.statistics: (nil) 2024-05-20T16:56:52.063 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.use_fsync: 0 2024-05-20T16:56:52.063 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_log_file_size: 0 2024-05-20T16:56:52.063 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-20T16:56:52.063 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-20T16:56:52.063 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.keep_log_file_num: 1000 2024-05-20T16:56:52.063 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.recycle_log_file_num: 0 2024-05-20T16:56:52.063 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.allow_fallocate: 1 2024-05-20T16:56:52.063 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.allow_mmap_reads: 0 2024-05-20T16:56:52.063 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.allow_mmap_writes: 0 2024-05-20T16:56:52.064 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.use_direct_reads: 0 2024-05-20T16:56:52.064 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-20T16:56:52.064 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.create_missing_column_families: 0 2024-05-20T16:56:52.064 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.db_log_dir: 2024-05-20T16:56:52.064 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.wal_dir: 2024-05-20T16:56:52.064 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-20T16:56:52.065 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-20T16:56:52.065 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-20T16:56:52.065 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-20T16:56:52.065 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-20T16:56:52.065 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-20T16:56:52.066 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.advise_random_on_open: 1 2024-05-20T16:56:52.066 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.db_write_buffer_size: 0 2024-05-20T16:56:52.066 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.write_buffer_manager: 0x561f41c552c0 2024-05-20T16:56:52.066 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-20T16:56:52.066 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-20T16:56:52.066 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-20T16:56:52.066 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.rate_limiter: (nil) 2024-05-20T16:56:52.066 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-20T16:56:52.066 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.wal_recovery_mode: 2 2024-05-20T16:56:52.066 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.enable_thread_tracking: 0 2024-05-20T16:56:52.066 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.enable_pipelined_write: 0 2024-05-20T16:56:52.066 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.unordered_write: 0 2024-05-20T16:56:52.066 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-20T16:56:52.067 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-20T16:56:52.067 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-20T16:56:52.067 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-20T16:56:52.067 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.row_cache: None 2024-05-20T16:56:52.067 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.wal_filter: None 2024-05-20T16:56:52.067 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-20T16:56:52.067 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.allow_ingest_behind: 0 2024-05-20T16:56:52.067 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.two_write_queues: 0 2024-05-20T16:56:52.067 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.manual_wal_flush: 0 2024-05-20T16:56:52.067 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.wal_compression: 0 2024-05-20T16:56:52.067 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.atomic_flush: 0 2024-05-20T16:56:52.067 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-20T16:56:52.067 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-20T16:56:52.068 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-20T16:56:52.068 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.log_readahead_size: 0 2024-05-20T16:56:52.068 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-20T16:56:52.068 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.best_efforts_recovery: 0 2024-05-20T16:56:52.068 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-20T16:56:52.068 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-20T16:56:52.068 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.allow_data_in_errors: 0 2024-05-20T16:56:52.068 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.db_host_id: __hostname__ 2024-05-20T16:56:52.068 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-20T16:56:52.068 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_background_jobs: 2 2024-05-20T16:56:52.068 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_background_compactions: -1 2024-05-20T16:56:52.068 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_subcompactions: 1 2024-05-20T16:56:52.068 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-20T16:56:52.068 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-20T16:56:52.068 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-20T16:56:52.069 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_total_wal_size: 0 2024-05-20T16:56:52.069 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-20T16:56:52.069 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-20T16:56:52.069 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-20T16:56:52.069 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-20T16:56:52.069 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_open_files: -1 2024-05-20T16:56:52.069 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.bytes_per_sync: 0 2024-05-20T16:56:52.069 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-20T16:56:52.069 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-20T16:56:52.069 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compaction_readahead_size: 0 2024-05-20T16:56:52.069 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_background_flushes: -1 2024-05-20T16:56:52.069 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Compression algorithms supported: 2024-05-20T16:56:52.069 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-20T16:56:52.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: kZSTD supported: 0 2024-05-20T16:56:52.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: kXpressCompression supported: 0 2024-05-20T16:56:52.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: kLZ4HCCompression supported: 1 2024-05-20T16:56:52.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: kZlibCompression supported: 1 2024-05-20T16:56:52.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: kSnappyCompression supported: 1 2024-05-20T16:56:52.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: kLZ4Compression supported: 1 2024-05-20T16:56:52.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: kBZip2Compression supported: 0 2024-05-20T16:56:52.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-20T16:56:52.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-20T16:56:52.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-20T16:56:52.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-20T16:56:52.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-20T16:56:52.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.merge_operator: 2024-05-20T16:56:52.071 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compaction_filter: None 2024-05-20T16:56:52.071 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compaction_filter_factory: None 2024-05-20T16:56:52.071 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.sst_partitioner_factory: None 2024-05-20T16:56:52.071 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-20T16:56:52.071 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-20T16:56:52.071 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561f41c81e40) 2024-05-20T16:56:52.071 INFO:journalctl@ceph.mon.a.smithi006.stdout: cache_index_and_filter_blocks: 1 2024-05-20T16:56:52.071 INFO:journalctl@ceph.mon.a.smithi006.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-20T16:56:52.071 INFO:journalctl@ceph.mon.a.smithi006.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-20T16:56:52.071 INFO:journalctl@ceph.mon.a.smithi006.stdout: pin_top_level_index_and_filter: 1 2024-05-20T16:56:52.071 INFO:journalctl@ceph.mon.a.smithi006.stdout: index_type: 0 2024-05-20T16:56:52.071 INFO:journalctl@ceph.mon.a.smithi006.stdout: data_block_index_type: 0 2024-05-20T16:56:52.071 INFO:journalctl@ceph.mon.a.smithi006.stdout: index_shortening: 1 2024-05-20T16:56:52.071 INFO:journalctl@ceph.mon.a.smithi006.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-20T16:56:52.072 INFO:journalctl@ceph.mon.a.smithi006.stdout: checksum: 4 2024-05-20T16:56:52.072 INFO:journalctl@ceph.mon.a.smithi006.stdout: no_block_cache: 0 2024-05-20T16:56:52.072 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_cache: 0x561f41c85090 2024-05-20T16:56:52.072 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_cache_name: BinnedLRUCache 2024-05-20T16:56:52.072 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_cache_options: 2024-05-20T16:56:52.072 INFO:journalctl@ceph.mon.a.smithi006.stdout: capacity : 536870912 2024-05-20T16:56:52.072 INFO:journalctl@ceph.mon.a.smithi006.stdout: num_shard_bits : 4 2024-05-20T16:56:52.072 INFO:journalctl@ceph.mon.a.smithi006.stdout: strict_capacity_limit : 0 2024-05-20T16:56:52.072 INFO:journalctl@ceph.mon.a.smithi006.stdout: high_pri_pool_ratio: 0.000 2024-05-20T16:56:52.072 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_cache_compressed: (nil) 2024-05-20T16:56:52.072 INFO:journalctl@ceph.mon.a.smithi006.stdout: persistent_cache: (nil) 2024-05-20T16:56:52.072 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_size: 4096 2024-05-20T16:56:52.072 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_size_deviation: 10 2024-05-20T16:56:52.073 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_restart_interval: 16 2024-05-20T16:56:52.073 INFO:journalctl@ceph.mon.a.smithi006.stdout: index_block_restart_interval: 1 2024-05-20T16:56:52.073 INFO:journalctl@ceph.mon.a.smithi006.stdout: metadata_block_size: 4096 2024-05-20T16:56:52.073 INFO:journalctl@ceph.mon.a.smithi006.stdout: partition_filters: 0 2024-05-20T16:56:52.073 INFO:journalctl@ceph.mon.a.smithi006.stdout: use_delta_encoding: 1 2024-05-20T16:56:52.073 INFO:journalctl@ceph.mon.a.smithi006.stdout: filter_policy: bloomfilter 2024-05-20T16:56:52.073 INFO:journalctl@ceph.mon.a.smithi006.stdout: whole_key_filtering: 1 2024-05-20T16:56:52.073 INFO:journalctl@ceph.mon.a.smithi006.stdout: verify_compression: 0 2024-05-20T16:56:52.073 INFO:journalctl@ceph.mon.a.smithi006.stdout: read_amp_bytes_per_bit: 0 2024-05-20T16:56:52.073 INFO:journalctl@ceph.mon.a.smithi006.stdout: format_version: 5 2024-05-20T16:56:52.073 INFO:journalctl@ceph.mon.a.smithi006.stdout: enable_index_compression: 1 2024-05-20T16:56:52.073 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_align: 0 2024-05-20T16:56:52.073 INFO:journalctl@ceph.mon.a.smithi006.stdout: max_auto_readahead_size: 262144 2024-05-20T16:56:52.074 INFO:journalctl@ceph.mon.a.smithi006.stdout: prepopulate_block_cache: 0 2024-05-20T16:56:52.074 INFO:journalctl@ceph.mon.a.smithi006.stdout: initial_auto_readahead_size: 8192 2024-05-20T16:56:52.074 INFO:journalctl@ceph.mon.a.smithi006.stdout: num_file_reads_for_auto_readahead: 2 2024-05-20T16:56:52.074 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.write_buffer_size: 33554432 2024-05-20T16:56:52.074 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_write_buffer_number: 2 2024-05-20T16:56:52.074 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compression: NoCompression 2024-05-20T16:56:52.074 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.bottommost_compression: Disabled 2024-05-20T16:56:52.074 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.prefix_extractor: nullptr 2024-05-20T16:56:52.074 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-20T16:56:52.074 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.num_levels: 7 2024-05-20T16:56:52.074 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-20T16:56:52.074 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-20T16:56:52.074 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-20T16:56:52.075 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-20T16:56:52.075 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-20T16:56:52.075 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-20T16:56:52.075 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-20T16:56:52.075 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-20T16:56:52.075 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-20T16:56:52.075 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-20T16:56:52.075 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-20T16:56:52.075 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-20T16:56:52.075 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-20T16:56:52.075 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compression_opts.level: 32767 2024-05-20T16:56:52.075 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compression_opts.strategy: 0 2024-05-20T16:56:52.075 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-20T16:56:52.076 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-20T16:56:52.076 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-20T16:56:52.076 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-20T16:56:52.076 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compression_opts.enabled: false 2024-05-20T16:56:52.076 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-20T16:56:52.076 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-20T16:56:52.076 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-20T16:56:52.076 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-20T16:56:52.076 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.target_file_size_base: 67108864 2024-05-20T16:56:52.076 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-20T16:56:52.076 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-20T16:56:52.076 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-20T16:56:52.076 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-20T16:56:52.076 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-20T16:56:52.077 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-20T16:56:52.077 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-20T16:56:52.077 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-20T16:56:52.077 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-20T16:56:52.077 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-20T16:56:52.077 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-20T16:56:52.077 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-20T16:56:52.077 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-20T16:56:52.077 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-20T16:56:52.077 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.arena_block_size: 1048576 2024-05-20T16:56:52.077 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-20T16:56:52.077 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-20T16:56:52.077 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.disable_auto_compactions: 0 2024-05-20T16:56:52.078 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-20T16:56:52.078 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-20T16:56:52.078 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-20T16:56:52.078 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-20T16:56:52.078 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-20T16:56:52.078 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-20T16:56:52.078 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-20T16:56:52.078 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-20T16:56:52.078 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-20T16:56:52.078 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-20T16:56:52.078 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.table_properties_collectors: 2024-05-20T16:56:52.078 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.inplace_update_support: 0 2024-05-20T16:56:52.078 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-20T16:56:52.079 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-20T16:56:52.079 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-20T16:56:52.079 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-20T16:56:52.079 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.bloom_locality: 0 2024-05-20T16:56:52.079 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.max_successive_merges: 0 2024-05-20T16:56:52.079 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-20T16:56:52.079 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.paranoid_file_checks: 0 2024-05-20T16:56:52.079 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.force_consistency_checks: 1 2024-05-20T16:56:52.079 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.report_bg_io_stats: 0 2024-05-20T16:56:52.079 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.ttl: 2592000 2024-05-20T16:56:52.079 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-20T16:56:52.079 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-20T16:56:52.079 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-20T16:56:52.079 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.enable_blob_files: false 2024-05-20T16:56:52.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.min_blob_size: 0 2024-05-20T16:56:52.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.blob_file_size: 268435456 2024-05-20T16:56:52.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-20T16:56:52.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-20T16:56:52.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-20T16:56:52.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-20T16:56:52.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-20T16:56:52.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.blob_file_starting_level: 0 2024-05-20T16:56:52.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-20T16:56:52.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-20T16:56:52.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-20T16:56:52.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fe338379-2df8-4b0d-871d-4833422efd6f 2024-05-20T16:56:52.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716224211811145, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-20T16:56:52.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-20T16:56:52.081 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716224211812362, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 98908, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 322, "table_properties": {"data_size": 96905, "index_size": 285, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13921, "raw_average_key_size": 49, "raw_value_size": 89286, "raw_average_value_size": 317, "num_data_blocks": 12, "num_entries": 281, "num_filter_entries": 281, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1716224211, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fe338379-2df8-4b0d-871d-4833422efd6f", "db_session_id": "R2H5F7S7WFLIGUPOM6CY", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-20T16:56:52.081 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716224211812448, "job": 1, "event": "recovery_finished"} 2024-05-20T16:56:52.081 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-20T16:56:52.081 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-20T16:56:52.081 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561f41c6bc00 2024-05-20T16:56:52.081 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: DB pointer 0x561f46a58000 2024-05-20T16:56:52.081 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-20T16:56:52.081 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-20T16:56:52.081 INFO:journalctl@ceph.mon.a.smithi006.stdout: ** DB Stats ** 2024-05-20T16:56:52.081 INFO:journalctl@ceph.mon.a.smithi006.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-20T16:56:52.081 INFO:journalctl@ceph.mon.a.smithi006.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-20T16:56:52.081 INFO:journalctl@ceph.mon.a.smithi006.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-20T16:56:52.081 INFO:journalctl@ceph.mon.a.smithi006.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-20T16:56:52.082 INFO:journalctl@ceph.mon.a.smithi006.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-20T16:56:52.082 INFO:journalctl@ceph.mon.a.smithi006.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-20T16:56:52.082 INFO:journalctl@ceph.mon.a.smithi006.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-20T16:56:52.082 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2024-05-20T16:56:52.082 INFO:journalctl@ceph.mon.a.smithi006.stdout: ** Compaction Stats [default] ** 2024-05-20T16:56:52.082 INFO:journalctl@ceph.mon.a.smithi006.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-20T16:56:52.082 INFO:journalctl@ceph.mon.a.smithi006.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-20T16:56:52.082 INFO:journalctl@ceph.mon.a.smithi006.stdout: L0 2/0 98.42 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 134.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-20T16:56:52.082 INFO:journalctl@ceph.mon.a.smithi006.stdout: Sum 2/0 98.42 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 134.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-20T16:56:52.082 INFO:journalctl@ceph.mon.a.smithi006.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 134.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-20T16:56:52.082 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2024-05-20T16:56:52.082 INFO:journalctl@ceph.mon.a.smithi006.stdout: ** Compaction Stats [default] ** 2024-05-20T16:56:52.082 INFO:journalctl@ceph.mon.a.smithi006.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-20T16:56:52.083 INFO:journalctl@ceph.mon.a.smithi006.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-20T16:56:52.083 INFO:journalctl@ceph.mon.a.smithi006.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 134.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-20T16:56:52.083 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2024-05-20T16:56:52.083 INFO:journalctl@ceph.mon.a.smithi006.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-20T16:56:52.083 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2024-05-20T16:56:52.083 INFO:journalctl@ceph.mon.a.smithi006.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-20T16:56:52.083 INFO:journalctl@ceph.mon.a.smithi006.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-20T16:56:52.083 INFO:journalctl@ceph.mon.a.smithi006.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-20T16:56:52.083 INFO:journalctl@ceph.mon.a.smithi006.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-20T16:56:52.083 INFO:journalctl@ceph.mon.a.smithi006.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-20T16:56:52.083 INFO:journalctl@ceph.mon.a.smithi006.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-20T16:56:52.083 INFO:journalctl@ceph.mon.a.smithi006.stdout: Cumulative compaction: 0.00 GB write, 28.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-20T16:56:52.083 INFO:journalctl@ceph.mon.a.smithi006.stdout: Interval compaction: 0.00 GB write, 28.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-20T16:56:52.083 INFO:journalctl@ceph.mon.a.smithi006.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-20T16:56:52.084 INFO:journalctl@ceph.mon.a.smithi006.stdout: Block cache BinnedLRUCache@0x561f41c85090#2 capacity: 512.00 MB usage: 1.38 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-05-20T16:56:52.084 INFO:journalctl@ceph.mon.a.smithi006.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.91 KB,0.000172853%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-05-20T16:56:52.084 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2024-05-20T16:56:52.084 INFO:journalctl@ceph.mon.a.smithi006.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-20T16:56:52.084 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: starting mon.a rank 0 at public addrs [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] at bind addrs [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:56:52.084 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: mon.a@-1(???) e1 preinit fsid c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:56:52.084 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: mon.a@-1(???).mds e1 new map 2024-05-20T16:56:52.084 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: mon.a@-1(???).mds e1 print_map 2024-05-20T16:56:52.084 INFO:journalctl@ceph.mon.a.smithi006.stdout: e1 2024-05-20T16:56:52.084 INFO:journalctl@ceph.mon.a.smithi006.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-20T16:56:52.084 INFO:journalctl@ceph.mon.a.smithi006.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-20T16:56:52.084 INFO:journalctl@ceph.mon.a.smithi006.stdout: legacy client fscid: -1 2024-05-20T16:56:52.084 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2024-05-20T16:56:52.084 INFO:journalctl@ceph.mon.a.smithi006.stdout: No filesystems configured 2024-05-20T16:56:52.085 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-20T16:56:52.085 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-20T16:56:52.085 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-20T16:56:52.085 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-20T16:56:52.085 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-20T16:56:52.085 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 bash[32467]: e83671806ab5bb8ea965bef154627552b536b5607941f87ffefd6624c4a90c35 2024-05-20T16:56:52.085 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 systemd[1]: Started Ceph mon.a for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T16:56:52.085 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-20T16:56:52.085 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: monmap epoch 1 2024-05-20T16:56:52.085 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: fsid c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:56:52.085 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: last_changed 2024-05-20T16:56:42.205459+0000 2024-05-20T16:56:52.085 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: created 2024-05-20T16:56:42.205459+0000 2024-05-20T16:56:52.085 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: min_mon_release 19 (squid) 2024-05-20T16:56:52.085 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: election_strategy: 1 2024-05-20T16:56:52.086 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-05-20T16:56:52.086 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: fsmap 2024-05-20T16:56:52.086 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: osdmap e1: 0 total, 0 up, 0 in 2024-05-20T16:56:52.086 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:51 smithi006 ceph-mon[32486]: mgrmap e1: no daemons active 2024-05-20T16:56:52.904 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.280+0000 7fdca4605700 1 Processor -- start 2024-05-20T16:56:52.904 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.280+0000 7fdca4605700 1 -- start start 2024-05-20T16:56:52.905 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.280+0000 7fdca4605700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c1093b0 0x7fdc9c10b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:56:52.905 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.280+0000 7fdca4605700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c07c640 con 0x7fdc9c1093b0 2024-05-20T16:56:52.905 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.281+0000 7fdca23a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c1093b0 0x7fdc9c10b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:56:52.905 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.281+0000 7fdca23a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c1093b0 0x7fdc9c10b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57516/0 (socket says 172.21.15.6:57516) 2024-05-20T16:56:52.905 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.281+0000 7fdca23a1700 1 -- 172.21.15.6:0/3186626214 learned_addr learned my addr 172.21.15.6:0/3186626214 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:56:52.905 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.281+0000 7fdca23a1700 1 -- 172.21.15.6:0/3186626214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9c10bd10 con 0x7fdc9c1093b0 2024-05-20T16:56:52.905 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.281+0000 7fdca23a1700 1 --2- 172.21.15.6:0/3186626214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c1093b0 0x7fdc9c10b7d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fdc980098a0 tx=0x7fdc98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dfe02222685ac7c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:56:52.905 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.281+0000 7fdca139f700 1 -- 172.21.15.6:0/3186626214 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc98004160 con 0x7fdc9c1093b0 2024-05-20T16:56:52.905 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.282+0000 7fdca139f700 1 -- 172.21.15.6:0/3186626214 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fdc98004300 con 0x7fdc9c1093b0 2024-05-20T16:56:52.905 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.282+0000 7fdca139f700 1 -- 172.21.15.6:0/3186626214 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc98011a80 con 0x7fdc9c1093b0 2024-05-20T16:56:52.905 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.282+0000 7fdca4605700 1 -- 172.21.15.6:0/3186626214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c1093b0 msgr2=0x7fdc9c10b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:56:52.905 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.282+0000 7fdca4605700 1 --2- 172.21.15.6:0/3186626214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c1093b0 0x7fdc9c10b7d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fdc980098a0 tx=0x7fdc98009bb0 comp rx=0 tx=0).stop 2024-05-20T16:56:52.905 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.282+0000 7fdca4605700 1 -- 172.21.15.6:0/3186626214 shutdown_connections 2024-05-20T16:56:52.906 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.282+0000 7fdca4605700 1 --2- 172.21.15.6:0/3186626214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c1093b0 0x7fdc9c10b7d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:56:52.906 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.282+0000 7fdca4605700 1 -- 172.21.15.6:0/3186626214 >> 172.21.15.6:0/3186626214 conn(0x7fdc9c102e70 msgr2=0x7fdc9c1052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:56:52.906 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.282+0000 7fdca4605700 1 -- 172.21.15.6:0/3186626214 shutdown_connections 2024-05-20T16:56:52.906 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.282+0000 7fdca4605700 1 -- 172.21.15.6:0/3186626214 wait complete. 2024-05-20T16:56:52.906 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.283+0000 7fdca4605700 1 Processor -- start 2024-05-20T16:56:52.906 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.283+0000 7fdca4605700 1 -- start start 2024-05-20T16:56:52.906 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.283+0000 7fdca4605700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c1093b0 0x7fdc9c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:56:52.906 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.283+0000 7fdca4605700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c10cc10 con 0x7fdc9c1093b0 2024-05-20T16:56:52.906 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.284+0000 7fdca23a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c1093b0 0x7fdc9c19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:56:52.906 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.284+0000 7fdca23a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c1093b0 0x7fdc9c19cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57520/0 (socket says 172.21.15.6:57520) 2024-05-20T16:56:52.906 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.284+0000 7fdca23a1700 1 -- 172.21.15.6:0/2313580862 learned_addr learned my addr 172.21.15.6:0/2313580862 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:56:52.906 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.284+0000 7fdca23a1700 1 -- 172.21.15.6:0/2313580862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9c19d170 con 0x7fdc9c1093b0 2024-05-20T16:56:52.906 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.284+0000 7fdca23a1700 1 --2- 172.21.15.6:0/2313580862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c1093b0 0x7fdc9c19cc30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fdc98006af0 tx=0x7fdc98011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:56:52.907 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.284+0000 7fdc937fe700 1 -- 172.21.15.6:0/2313580862 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc98003a60 con 0x7fdc9c1093b0 2024-05-20T16:56:52.907 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.284+0000 7fdc937fe700 1 -- 172.21.15.6:0/2313580862 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fdc98003c00 con 0x7fdc9c1093b0 2024-05-20T16:56:52.907 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.284+0000 7fdc937fe700 1 -- 172.21.15.6:0/2313580862 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc98019750 con 0x7fdc9c1093b0 2024-05-20T16:56:52.907 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.284+0000 7fdca4605700 1 -- 172.21.15.6:0/2313580862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc9c19d400 con 0x7fdc9c1093b0 2024-05-20T16:56:52.907 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.284+0000 7fdca4605700 1 -- 172.21.15.6:0/2313580862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc9c1a0010 con 0x7fdc9c1093b0 2024-05-20T16:56:52.907 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.284+0000 7fdc937fe700 1 -- 172.21.15.6:0/2313580862 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdc98022020 con 0x7fdc9c1093b0 2024-05-20T16:56:52.907 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.284+0000 7fdc937fe700 1 -- 172.21.15.6:0/2313580862 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdc98024df0 con 0x7fdc9c1093b0 2024-05-20T16:56:52.907 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.285+0000 7fdca4605700 1 -- 172.21.15.6:0/2313580862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc9c063ca0 con 0x7fdc9c1093b0 2024-05-20T16:56:52.907 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.288+0000 7fdc937fe700 1 -- 172.21.15.6:0/2313580862 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fdc9801ac30 con 0x7fdc9c1093b0 2024-05-20T16:56:52.907 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.358+0000 7fdca4605700 1 -- 172.21.15.6:0/2313580862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fdc9c1a01e0 con 0x7fdc9c1093b0 2024-05-20T16:56:52.907 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.362+0000 7fdc937fe700 1 -- 172.21.15.6:0/2313580862 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fdc98024410 con 0x7fdc9c1093b0 2024-05-20T16:56:52.907 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.363+0000 7fdca4605700 1 -- 172.21.15.6:0/2313580862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c1093b0 msgr2=0x7fdc9c19cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:56:52.907 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.363+0000 7fdca4605700 1 --2- 172.21.15.6:0/2313580862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c1093b0 0x7fdc9c19cc30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fdc98006af0 tx=0x7fdc98011ae0 comp rx=0 tx=0).stop 2024-05-20T16:56:52.908 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.363+0000 7fdca4605700 1 -- 172.21.15.6:0/2313580862 shutdown_connections 2024-05-20T16:56:52.908 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.363+0000 7fdca4605700 1 --2- 172.21.15.6:0/2313580862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c1093b0 0x7fdc9c19cc30 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:56:52.908 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.363+0000 7fdca4605700 1 -- 172.21.15.6:0/2313580862 >> 172.21.15.6:0/2313580862 conn(0x7fdc9c102e70 msgr2=0x7fdc9c103780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:56:52.908 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.363+0000 7fdca4605700 1 -- 172.21.15.6:0/2313580862 shutdown_connections 2024-05-20T16:56:52.908 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:52.363+0000 7fdca4605700 1 -- 172.21.15.6:0/2313580862 wait complete. 2024-05-20T16:56:52.908 INFO:teuthology.orchestra.run.smithi006.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-20T16:56:52.930 INFO:teuthology.orchestra.run.smithi006.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-20T16:56:52.930 INFO:teuthology.orchestra.run.smithi006.stdout:Creating mgr... 2024-05-20T16:56:52.930 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-20T16:56:52.931 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-20T16:56:53.219 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mgr.x 2024-05-20T16:56:53.219 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mgr.x.service: Unit ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mgr.x.service not loaded. 2024-05-20T16:56:53.405 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c726c954-16c9-11ef-bc9a-c7b262605968.target.wants/ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-c726c954-16c9-11ef-bc9a-c7b262605968@.service. 2024-05-20T16:56:53.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:53 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2313580862' entity='client.admin' 2024-05-20T16:56:53.630 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:53 smithi006 systemd[1]: Starting Ceph mgr.x for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T16:56:53.934 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:53 smithi006 podman[32702]: 2024-05-20 16:56:53.550991478 +0000 UTC m=+0.018034493 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T16:56:53.934 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:53 smithi006 podman[32702]: 2024-05-20 16:56:53.658183539 +0000 UTC m=+0.125226531 container create b111cb13d067acf250aa52a529675a04bf84bc58af78ddbe3e3841f28b2244d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS) 2024-05-20T16:56:53.934 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:53 smithi006 podman[32702]: 2024-05-20 16:56:53.877107884 +0000 UTC m=+0.344150898 container init b111cb13d067acf250aa52a529675a04bf84bc58af78ddbe3e3841f28b2244d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-20T16:56:53.935 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:53 smithi006 podman[32702]: 2024-05-20 16:56:53.87982858 +0000 UTC m=+0.346871589 container start b111cb13d067acf250aa52a529675a04bf84bc58af78ddbe3e3841f28b2244d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-05-20T16:56:53.935 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:53 smithi006 bash[32702]: b111cb13d067acf250aa52a529675a04bf84bc58af78ddbe3e3841f28b2244d9 2024-05-20T16:56:53.948 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-20T16:56:53.948 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout disabled 2024-05-20T16:56:53.956 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-20T16:56:53.956 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2024-05-20T16:56:53.956 INFO:teuthology.orchestra.run.smithi006.stdout:firewalld.service is not enabled 2024-05-20T16:56:53.956 INFO:teuthology.orchestra.run.smithi006.stdout:Not possible to enable service . firewalld.service is not available 2024-05-20T16:56:53.965 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-20T16:56:53.965 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout disabled 2024-05-20T16:56:53.973 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-20T16:56:53.973 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2024-05-20T16:56:53.973 INFO:teuthology.orchestra.run.smithi006.stdout:firewalld.service is not enabled 2024-05-20T16:56:53.973 INFO:teuthology.orchestra.run.smithi006.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-20T16:56:53.973 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mgr to start... 2024-05-20T16:56:53.973 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mgr... 2024-05-20T16:56:54.184 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:53 smithi006 systemd[1]: Started Ceph mgr.x for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T16:56:54.184 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:54 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:54.051+0000 7f841f1b2200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T16:56:54.468 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:54 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:54.245+0000 7f841f1b2200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T16:56:54.468 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:54 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:54.354+0000 7f841f1b2200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T16:56:54.774 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:54 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3481055578' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-20T16:56:54.775 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:54 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:54.685+0000 7f841f1b2200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T16:56:54.775 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:54 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:54.775+0000 7f841f1b2200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T16:56:55.063 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-05-20T16:56:55.063 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-05-20T16:56:55.064 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsid": "c726c954-16c9-11ef-bc9a-c7b262605968", 2024-05-20T16:56:55.064 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "health": { 2024-05-20T16:56:55.064 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-20T16:56:55.064 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-20T16:56:55.064 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-20T16:56:55.064 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:56:55.064 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-20T16:56:55.064 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-20T16:56:55.064 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 0 2024-05-20T16:56:55.064 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-05-20T16:56:55.064 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-20T16:56:55.065 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "a" 2024-05-20T16:56:55.065 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-05-20T16:56:55.065 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-05-20T16:56:55.065 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-20T16:56:55.065 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T16:56:55.065 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-20T16:56:55.065 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-20T16:56:55.065 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:56:55.065 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-20T16:56:55.065 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T16:56:55.065 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-20T16:56:55.066 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-20T16:56:55.066 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-20T16:56:55.074 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-20T16:56:55.074 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-20T16:56:55.074 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-20T16:56:55.074 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:56:55.075 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-20T16:56:55.075 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-20T16:56:55.075 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-20T16:56:55.075 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-20T16:56:55.075 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-20T16:56:55.075 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-20T16:56:55.075 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-20T16:56:55.075 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-20T16:56:55.075 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-20T16:56:55.075 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:56:55.075 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-20T16:56:55.076 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T16:56:55.076 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-20T16:56:55.076 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-20T16:56:55.076 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:56:55.076 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-20T16:56:55.076 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-20T16:56:55.076 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-20T16:56:55.076 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-20T16:56:55.076 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-20T16:56:55.076 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-20T16:56:55.076 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "restful" 2024-05-20T16:56:55.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-05-20T16:56:55.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T16:56:55.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:56:55.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-20T16:56:55.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T16:56:55.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modified": "2024-05-20T16:56:45.112082+0000", 2024-05-20T16:56:55.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T16:56:55.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:56:55.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-20T16:56:55.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-05-20T16:56:55.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.387+0000 7fb91ef5d700 1 Processor -- start 2024-05-20T16:56:55.077 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.387+0000 7fb91ef5d700 1 -- start start 2024-05-20T16:56:55.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.387+0000 7fb91ef5d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181077b0 0x7fb918107bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:56:55.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.387+0000 7fb91ef5d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb9181081b0 con 0x7fb9181077b0 2024-05-20T16:56:55.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.387+0000 7fb91ccf9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181077b0 0x7fb918107bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:56:55.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.387+0000 7fb91ccf9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181077b0 0x7fb918107bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57556/0 (socket says 172.21.15.6:57556) 2024-05-20T16:56:55.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.387+0000 7fb91ccf9700 1 -- 172.21.15.6:0/1877267361 learned_addr learned my addr 172.21.15.6:0/1877267361 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:56:55.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.388+0000 7fb91ccf9700 1 -- 172.21.15.6:0/1877267361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9181088e0 con 0x7fb9181077b0 2024-05-20T16:56:55.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.388+0000 7fb91ccf9700 1 --2- 172.21.15.6:0/1877267361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181077b0 0x7fb918107bc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0098a0 tx=0x7fb90c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6b0a8e115b6d54 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:56:55.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.388+0000 7fb9177fe700 1 -- 172.21.15.6:0/1877267361 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb90c004160 con 0x7fb9181077b0 2024-05-20T16:56:55.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.388+0000 7fb9177fe700 1 -- 172.21.15.6:0/1877267361 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb90c004300 con 0x7fb9181077b0 2024-05-20T16:56:55.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.388+0000 7fb9177fe700 1 -- 172.21.15.6:0/1877267361 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb90c011a80 con 0x7fb9181077b0 2024-05-20T16:56:55.078 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.389+0000 7fb91ef5d700 1 -- 172.21.15.6:0/1877267361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181077b0 msgr2=0x7fb918107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:56:55.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.389+0000 7fb91ef5d700 1 --2- 172.21.15.6:0/1877267361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181077b0 0x7fb918107bc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0098a0 tx=0x7fb90c009bb0 comp rx=0 tx=0).stop 2024-05-20T16:56:55.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.389+0000 7fb91ef5d700 1 -- 172.21.15.6:0/1877267361 shutdown_connections 2024-05-20T16:56:55.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.389+0000 7fb91ef5d700 1 --2- 172.21.15.6:0/1877267361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181077b0 0x7fb918107bc0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:56:55.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.389+0000 7fb91ef5d700 1 -- 172.21.15.6:0/1877267361 >> 172.21.15.6:0/1877267361 conn(0x7fb918102df0 msgr2=0x7fb9181052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:56:55.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.389+0000 7fb91ef5d700 1 -- 172.21.15.6:0/1877267361 shutdown_connections 2024-05-20T16:56:55.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.389+0000 7fb91ef5d700 1 -- 172.21.15.6:0/1877267361 wait complete. 2024-05-20T16:56:55.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.390+0000 7fb91ef5d700 1 Processor -- start 2024-05-20T16:56:55.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.390+0000 7fb91ef5d700 1 -- start start 2024-05-20T16:56:55.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.390+0000 7fb91ef5d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181077b0 0x7fb918104f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:56:55.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.390+0000 7fb91ef5d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb91810bc90 con 0x7fb9181077b0 2024-05-20T16:56:55.079 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.390+0000 7fb91ccf9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181077b0 0x7fb918104f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:56:55.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.390+0000 7fb91ccf9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181077b0 0x7fb918104f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57560/0 (socket says 172.21.15.6:57560) 2024-05-20T16:56:55.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.390+0000 7fb91ccf9700 1 -- 172.21.15.6:0/3481055578 learned_addr learned my addr 172.21.15.6:0/3481055578 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:56:55.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.391+0000 7fb91ccf9700 1 -- 172.21.15.6:0/3481055578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb918105470 con 0x7fb9181077b0 2024-05-20T16:56:55.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.391+0000 7fb91ccf9700 1 --2- 172.21.15.6:0/3481055578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181077b0 0x7fb918104f30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb90c011a50 tx=0x7fb90c011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:56:55.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.391+0000 7fb915ffb700 1 -- 172.21.15.6:0/3481055578 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb90c003970 con 0x7fb9181077b0 2024-05-20T16:56:55.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.391+0000 7fb915ffb700 1 -- 172.21.15.6:0/3481055578 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb90c003b10 con 0x7fb9181077b0 2024-05-20T16:56:55.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.391+0000 7fb91ef5d700 1 -- 172.21.15.6:0/3481055578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9181036c0 con 0x7fb9181077b0 2024-05-20T16:56:55.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.391+0000 7fb915ffb700 1 -- 172.21.15.6:0/3481055578 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb90c024580 con 0x7fb9181077b0 2024-05-20T16:56:55.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.391+0000 7fb91ef5d700 1 -- 172.21.15.6:0/3481055578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb918103ba0 con 0x7fb9181077b0 2024-05-20T16:56:55.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.391+0000 7fb915ffb700 1 -- 172.21.15.6:0/3481055578 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb90c024b40 con 0x7fb9181077b0 2024-05-20T16:56:55.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.391+0000 7fb915ffb700 1 -- 172.21.15.6:0/3481055578 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb90c019700 con 0x7fb9181077b0 2024-05-20T16:56:55.081 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.392+0000 7fb91ef5d700 1 -- 172.21.15.6:0/3481055578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb918063ca0 con 0x7fb9181077b0 2024-05-20T16:56:55.081 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.395+0000 7fb915ffb700 1 -- 172.21.15.6:0/3481055578 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb90c042dd0 con 0x7fb9181077b0 2024-05-20T16:56:55.081 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.469+0000 7fb91ef5d700 1 -- 172.21.15.6:0/3481055578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb918195d70 con 0x7fb9181077b0 2024-05-20T16:56:55.081 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.469+0000 7fb915ffb700 1 -- 172.21.15.6:0/3481055578 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fb90c031070 con 0x7fb9181077b0 2024-05-20T16:56:55.081 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.470+0000 7fb91ef5d700 1 -- 172.21.15.6:0/3481055578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181077b0 msgr2=0x7fb918104f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:56:55.081 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.470+0000 7fb91ef5d700 1 --2- 172.21.15.6:0/3481055578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181077b0 0x7fb918104f30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb90c011a50 tx=0x7fb90c011b30 comp rx=0 tx=0).stop 2024-05-20T16:56:55.081 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.470+0000 7fb91ef5d700 1 -- 172.21.15.6:0/3481055578 shutdown_connections 2024-05-20T16:56:55.081 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.470+0000 7fb91ef5d700 1 --2- 172.21.15.6:0/3481055578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9181077b0 0x7fb918104f30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:56:55.081 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.470+0000 7fb91ef5d700 1 -- 172.21.15.6:0/3481055578 >> 172.21.15.6:0/3481055578 conn(0x7fb918102df0 msgr2=0x7fb9181931e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:56:55.081 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.471+0000 7fb91ef5d700 1 -- 172.21.15.6:0/3481055578 shutdown_connections 2024-05-20T16:56:55.081 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:54.471+0000 7fb91ef5d700 1 -- 172.21.15.6:0/3481055578 wait complete. 2024-05-20T16:56:55.082 INFO:teuthology.orchestra.run.smithi006.stdout:mgr not available, waiting (1/15)... 2024-05-20T16:56:56.215 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:56 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:56.039+0000 7f841f1b2200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T16:56:56.215 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:56 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:56.215+0000 7f841f1b2200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T16:56:56.630 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:56 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:56.394+0000 7f841f1b2200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T16:56:57.004 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:56 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:56.698+0000 7f841f1b2200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T16:56:57.004 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:56 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:56.794+0000 7f841f1b2200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T16:56:57.005 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:57 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:57.005+0000 7f841f1b2200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T16:56:57.308 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:57 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:57.212+0000 7f841f1b2200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T16:56:57.865 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:56:57 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3575172078' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-20T16:56:58.130 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:57 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:57.865+0000 7f841f1b2200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T16:56:58.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-05-20T16:56:58.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-05-20T16:56:58.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsid": "c726c954-16c9-11ef-bc9a-c7b262605968", 2024-05-20T16:56:58.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "health": { 2024-05-20T16:56:58.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-20T16:56:58.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-20T16:56:58.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-20T16:56:58.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:56:58.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-20T16:56:58.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-20T16:56:58.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 0 2024-05-20T16:56:58.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-05-20T16:56:58.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-20T16:56:58.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "a" 2024-05-20T16:56:58.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-05-20T16:56:58.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-05-20T16:56:58.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-20T16:56:58.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T16:56:58.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-20T16:56:58.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-20T16:56:58.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:56:58.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-20T16:56:58.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T16:56:58.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-20T16:56:58.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-20T16:56:58.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-20T16:56:58.188 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-20T16:56:58.188 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-20T16:56:58.188 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-20T16:56:58.188 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:56:58.188 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-20T16:56:58.188 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-20T16:56:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-20T16:56:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-20T16:56:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-20T16:56:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-20T16:56:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-20T16:56:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-20T16:56:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-20T16:56:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:56:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-20T16:56:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T16:56:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-20T16:56:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-20T16:56:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:56:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-20T16:56:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-20T16:56:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-20T16:56:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-20T16:56:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-20T16:56:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-20T16:56:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "restful" 2024-05-20T16:56:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-05-20T16:56:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T16:56:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:56:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-20T16:56:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T16:56:58.191 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modified": "2024-05-20T16:56:45.112082+0000", 2024-05-20T16:56:58.191 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T16:56:58.191 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:56:58.191 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-20T16:56:58.191 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-05-20T16:56:58.191 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.526+0000 7fe1c2796700 1 Processor -- start 2024-05-20T16:56:58.191 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.526+0000 7fe1c2796700 1 -- start start 2024-05-20T16:56:58.191 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.526+0000 7fe1c2796700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1bc109390 0x7fe1bc10b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:56:58.191 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.526+0000 7fe1c2796700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc07bdb0 con 0x7fe1bc109390 2024-05-20T16:56:58.191 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.526+0000 7fe1bbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1bc109390 0x7fe1bc10b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:56:58.191 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.526+0000 7fe1bbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1bc109390 0x7fe1bc10b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57568/0 (socket says 172.21.15.6:57568) 2024-05-20T16:56:58.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.526+0000 7fe1bbfff700 1 -- 172.21.15.6:0/396733393 learned_addr learned my addr 172.21.15.6:0/396733393 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:56:58.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.526+0000 7fe1bbfff700 1 -- 172.21.15.6:0/396733393 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1bc10bcf0 con 0x7fe1bc109390 2024-05-20T16:56:58.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.527+0000 7fe1bbfff700 1 --2- 172.21.15.6:0/396733393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1bc109390 0x7fe1bc10b7b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac0098a0 tx=0x7fe1ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eea040a6fb854f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:56:58.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.527+0000 7fe1baffd700 1 -- 172.21.15.6:0/396733393 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1ac004160 con 0x7fe1bc109390 2024-05-20T16:56:58.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.527+0000 7fe1baffd700 1 -- 172.21.15.6:0/396733393 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe1ac004300 con 0x7fe1bc109390 2024-05-20T16:56:58.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.527+0000 7fe1baffd700 1 -- 172.21.15.6:0/396733393 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1ac011a80 con 0x7fe1bc109390 2024-05-20T16:56:58.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.528+0000 7fe1c2796700 1 -- 172.21.15.6:0/396733393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1bc109390 msgr2=0x7fe1bc10b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:56:58.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.528+0000 7fe1c2796700 1 --2- 172.21.15.6:0/396733393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1bc109390 0x7fe1bc10b7b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac0098a0 tx=0x7fe1ac009bb0 comp rx=0 tx=0).stop 2024-05-20T16:56:58.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.528+0000 7fe1c2796700 1 -- 172.21.15.6:0/396733393 shutdown_connections 2024-05-20T16:56:58.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.528+0000 7fe1c2796700 1 --2- 172.21.15.6:0/396733393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1bc109390 0x7fe1bc10b7b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:56:58.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.528+0000 7fe1c2796700 1 -- 172.21.15.6:0/396733393 >> 172.21.15.6:0/396733393 conn(0x7fe1bc102df0 msgr2=0x7fe1bc1052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:56:58.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.528+0000 7fe1c2796700 1 -- 172.21.15.6:0/396733393 shutdown_connections 2024-05-20T16:56:58.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.528+0000 7fe1c2796700 1 -- 172.21.15.6:0/396733393 wait complete. 2024-05-20T16:56:58.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.528+0000 7fe1c2796700 1 Processor -- start 2024-05-20T16:56:58.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.529+0000 7fe1c2796700 1 -- start start 2024-05-20T16:56:58.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.529+0000 7fe1c2796700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1bc109390 0x7fe1bc19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:56:58.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.529+0000 7fe1c2796700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc10cbf0 con 0x7fe1bc109390 2024-05-20T16:56:58.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.529+0000 7fe1bbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1bc109390 0x7fe1bc19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:56:58.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.529+0000 7fe1bbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1bc109390 0x7fe1bc19cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57582/0 (socket says 172.21.15.6:57582) 2024-05-20T16:56:58.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.529+0000 7fe1bbfff700 1 -- 172.21.15.6:0/3575172078 learned_addr learned my addr 172.21.15.6:0/3575172078 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:56:58.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.529+0000 7fe1bbfff700 1 -- 172.21.15.6:0/3575172078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1bc19d1b0 con 0x7fe1bc109390 2024-05-20T16:56:58.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.530+0000 7fe1bbfff700 1 --2- 172.21.15.6:0/3575172078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1bc109390 0x7fe1bc19cc70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac0116a0 tx=0x7fe1ac011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:56:58.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.530+0000 7fe1b97fa700 1 -- 172.21.15.6:0/3575172078 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1ac0039f0 con 0x7fe1bc109390 2024-05-20T16:56:58.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.530+0000 7fe1b97fa700 1 -- 172.21.15.6:0/3575172078 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe1ac003b90 con 0x7fe1bc109390 2024-05-20T16:56:58.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.530+0000 7fe1c2796700 1 -- 172.21.15.6:0/3575172078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1bc19d440 con 0x7fe1bc109390 2024-05-20T16:56:58.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.530+0000 7fe1b97fa700 1 -- 172.21.15.6:0/3575172078 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1ac019740 con 0x7fe1bc109390 2024-05-20T16:56:58.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.530+0000 7fe1c2796700 1 -- 172.21.15.6:0/3575172078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1bc1a0050 con 0x7fe1bc109390 2024-05-20T16:56:58.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.530+0000 7fe1b97fa700 1 -- 172.21.15.6:0/3575172078 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe1ac02d430 con 0x7fe1bc109390 2024-05-20T16:56:58.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.530+0000 7fe1b97fa700 1 -- 172.21.15.6:0/3575172078 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe1ac0247c0 con 0x7fe1bc109390 2024-05-20T16:56:58.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.531+0000 7fe1c2796700 1 -- 172.21.15.6:0/3575172078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1bc063ca0 con 0x7fe1bc109390 2024-05-20T16:56:58.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.533+0000 7fe1b97fa700 1 -- 172.21.15.6:0/3575172078 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe1ac01abe0 con 0x7fe1bc109390 2024-05-20T16:56:58.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.607+0000 7fe1c2796700 1 -- 172.21.15.6:0/3575172078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fe1bc1a0220 con 0x7fe1bc109390 2024-05-20T16:56:58.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.608+0000 7fe1b97fa700 1 -- 172.21.15.6:0/3575172078 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fe1ac024a60 con 0x7fe1bc109390 2024-05-20T16:56:58.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.609+0000 7fe1c2796700 1 -- 172.21.15.6:0/3575172078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1bc109390 msgr2=0x7fe1bc19cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:56:58.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.609+0000 7fe1c2796700 1 --2- 172.21.15.6:0/3575172078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1bc109390 0x7fe1bc19cc70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac0116a0 tx=0x7fe1ac011b70 comp rx=0 tx=0).stop 2024-05-20T16:56:58.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.609+0000 7fe1c2796700 1 -- 172.21.15.6:0/3575172078 shutdown_connections 2024-05-20T16:56:58.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.609+0000 7fe1c2796700 1 --2- 172.21.15.6:0/3575172078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1bc109390 0x7fe1bc19cc70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:56:58.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.609+0000 7fe1c2796700 1 -- 172.21.15.6:0/3575172078 >> 172.21.15.6:0/3575172078 conn(0x7fe1bc102df0 msgr2=0x7fe1bc1036d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:56:58.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.609+0000 7fe1c2796700 1 -- 172.21.15.6:0/3575172078 shutdown_connections 2024-05-20T16:56:58.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:56:57.609+0000 7fe1c2796700 1 -- 172.21.15.6:0/3575172078 wait complete. 2024-05-20T16:56:58.195 INFO:teuthology.orchestra.run.smithi006.stdout:mgr not available, waiting (2/15)... 2024-05-20T16:56:58.613 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:58 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:58.304+0000 7f841f1b2200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T16:56:58.613 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:58 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:58.404+0000 7f841f1b2200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T16:56:58.613 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:58 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:58.613+0000 7f841f1b2200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T16:56:59.518 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:59 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:59.172+0000 7f841f1b2200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T16:56:59.518 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:59 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:59.267+0000 7f841f1b2200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T16:56:59.873 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:59 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:59.518+0000 7f841f1b2200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T16:56:59.873 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:59 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:59.656+0000 7f841f1b2200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T16:56:59.873 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:59 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:59.754+0000 7f841f1b2200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T16:56:59.873 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:56:59 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:56:59.874+0000 7f841f1b2200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T16:57:00.437 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:00 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:00.184+0000 7f841f1b2200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T16:57:01.028 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:00 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3996161133' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-20T16:57:01.029 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:00 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:00.832+0000 7f841f1b2200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T16:57:01.312 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:01 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:01.057+0000 7f841f1b2200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T16:57:01.317 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-05-20T16:57:01.317 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-05-20T16:57:01.317 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsid": "c726c954-16c9-11ef-bc9a-c7b262605968", 2024-05-20T16:57:01.317 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "health": { 2024-05-20T16:57:01.317 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-20T16:57:01.317 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-20T16:57:01.317 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-20T16:57:01.317 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:57:01.318 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-20T16:57:01.318 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-20T16:57:01.318 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 0 2024-05-20T16:57:01.318 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-05-20T16:57:01.318 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-20T16:57:01.318 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "a" 2024-05-20T16:57:01.318 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-05-20T16:57:01.318 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-05-20T16:57:01.318 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-20T16:57:01.318 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T16:57:01.318 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-20T16:57:01.318 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-20T16:57:01.318 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:57:01.319 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-20T16:57:01.319 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T16:57:01.319 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-20T16:57:01.319 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-20T16:57:01.319 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-20T16:57:01.329 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-20T16:57:01.330 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-20T16:57:01.330 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-20T16:57:01.330 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:57:01.330 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-20T16:57:01.330 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-20T16:57:01.330 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-20T16:57:01.330 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-20T16:57:01.330 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-20T16:57:01.330 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-20T16:57:01.330 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-20T16:57:01.330 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-20T16:57:01.331 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-20T16:57:01.331 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:57:01.331 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-20T16:57:01.331 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T16:57:01.331 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-20T16:57:01.331 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-20T16:57:01.331 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:57:01.331 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-20T16:57:01.331 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-20T16:57:01.331 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-20T16:57:01.331 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-20T16:57:01.331 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-20T16:57:01.331 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-20T16:57:01.332 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "restful" 2024-05-20T16:57:01.332 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-05-20T16:57:01.332 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T16:57:01.332 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:57:01.332 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-20T16:57:01.332 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T16:57:01.332 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modified": "2024-05-20T16:56:45.112082+0000", 2024-05-20T16:57:01.332 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T16:57:01.332 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:57:01.332 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-20T16:57:01.332 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-05-20T16:57:01.332 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.638+0000 7f4e24e22700 1 Processor -- start 2024-05-20T16:57:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.638+0000 7f4e24e22700 1 -- start start 2024-05-20T16:57:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.638+0000 7f4e24e22700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e20108920 0x7f4e20108d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.639+0000 7f4e24e22700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4e20109320 con 0x7f4e20108920 2024-05-20T16:57:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.639+0000 7f4e1e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e20108920 0x7f4e20108d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.639+0000 7f4e1e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e20108920 0x7f4e20108d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33444/0 (socket says 172.21.15.6:33444) 2024-05-20T16:57:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.639+0000 7f4e1e59c700 1 -- 172.21.15.6:0/61558749 learned_addr learned my addr 172.21.15.6:0/61558749 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.639+0000 7f4e1e59c700 1 -- 172.21.15.6:0/61558749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e20109a50 con 0x7f4e20108920 2024-05-20T16:57:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.639+0000 7f4e1e59c700 1 --2- 172.21.15.6:0/61558749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e20108920 0x7f4e20108d30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009e80 tx=0x7f4e1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce1ed06359cace9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.639+0000 7f4e1d59a700 1 -- 172.21.15.6:0/61558749 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e10017070 con 0x7f4e20108920 2024-05-20T16:57:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.639+0000 7f4e1d59a700 1 -- 172.21.15.6:0/61558749 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f4e1000b8c0 con 0x7f4e20108920 2024-05-20T16:57:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.639+0000 7f4e1d59a700 1 -- 172.21.15.6:0/61558749 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e10004520 con 0x7f4e20108920 2024-05-20T16:57:01.334 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.640+0000 7f4e24e22700 1 -- 172.21.15.6:0/61558749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e20108920 msgr2=0x7f4e20108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:01.334 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.640+0000 7f4e24e22700 1 --2- 172.21.15.6:0/61558749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e20108920 0x7f4e20108d30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009e80 tx=0x7f4e1000b330 comp rx=0 tx=0).stop 2024-05-20T16:57:01.334 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.640+0000 7f4e24e22700 1 -- 172.21.15.6:0/61558749 shutdown_connections 2024-05-20T16:57:01.334 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.640+0000 7f4e24e22700 1 --2- 172.21.15.6:0/61558749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e20108920 0x7f4e20108d30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:01.334 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.640+0000 7f4e24e22700 1 -- 172.21.15.6:0/61558749 >> 172.21.15.6:0/61558749 conn(0x7f4e20103fc0 msgr2=0x7f4e20106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:01.334 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.641+0000 7f4e24e22700 1 -- 172.21.15.6:0/61558749 shutdown_connections 2024-05-20T16:57:01.334 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.641+0000 7f4e24e22700 1 -- 172.21.15.6:0/61558749 wait complete. 2024-05-20T16:57:01.334 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.641+0000 7f4e24e22700 1 Processor -- start 2024-05-20T16:57:01.334 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.642+0000 7f4e24e22700 1 -- start start 2024-05-20T16:57:01.334 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.642+0000 7f4e24e22700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e20108920 0x7f4e2019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:01.335 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.642+0000 7f4e24e22700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2010cc80 con 0x7f4e20108920 2024-05-20T16:57:01.335 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.642+0000 7f4e1e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e20108920 0x7f4e2019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:01.335 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.642+0000 7f4e1e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e20108920 0x7f4e2019cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33454/0 (socket says 172.21.15.6:33454) 2024-05-20T16:57:01.335 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.642+0000 7f4e1e59c700 1 -- 172.21.15.6:0/3996161133 learned_addr learned my addr 172.21.15.6:0/3996161133 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:01.335 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.642+0000 7f4e1e59c700 1 -- 172.21.15.6:0/3996161133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2019d170 con 0x7f4e20108920 2024-05-20T16:57:01.335 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.642+0000 7f4e1e59c700 1 --2- 172.21.15.6:0/3996161133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e20108920 0x7f4e2019cc30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009fd0 tx=0x7f4e10004670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:01.335 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.643+0000 7f4e177fe700 1 -- 172.21.15.6:0/3996161133 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e10020020 con 0x7f4e20108920 2024-05-20T16:57:01.335 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.643+0000 7f4e177fe700 1 -- 172.21.15.6:0/3996161133 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f4e10012430 con 0x7f4e20108920 2024-05-20T16:57:01.335 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.643+0000 7f4e177fe700 1 -- 172.21.15.6:0/3996161133 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e10017040 con 0x7f4e20108920 2024-05-20T16:57:01.335 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.643+0000 7f4e24e22700 1 -- 172.21.15.6:0/3996161133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e2019d400 con 0x7f4e20108920 2024-05-20T16:57:01.335 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.643+0000 7f4e24e22700 1 -- 172.21.15.6:0/3996161133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e201a0010 con 0x7f4e20108920 2024-05-20T16:57:01.336 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.643+0000 7f4e177fe700 1 -- 172.21.15.6:0/3996161133 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4e10023020 con 0x7f4e20108920 2024-05-20T16:57:01.336 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.643+0000 7f4e177fe700 1 -- 172.21.15.6:0/3996161133 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4e1000f050 con 0x7f4e20108920 2024-05-20T16:57:01.336 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.644+0000 7f4e24e22700 1 -- 172.21.15.6:0/3996161133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e20063ca0 con 0x7f4e20108920 2024-05-20T16:57:01.336 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.646+0000 7f4e177fe700 1 -- 172.21.15.6:0/3996161133 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4e1002a020 con 0x7f4e20108920 2024-05-20T16:57:01.336 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.721+0000 7f4e24e22700 1 -- 172.21.15.6:0/3996161133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4e201a01e0 con 0x7f4e20108920 2024-05-20T16:57:01.336 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.721+0000 7f4e177fe700 1 -- 172.21.15.6:0/3996161133 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f4e10025400 con 0x7f4e20108920 2024-05-20T16:57:01.336 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.722+0000 7f4e24e22700 1 -- 172.21.15.6:0/3996161133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e20108920 msgr2=0x7f4e2019cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:01.336 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.722+0000 7f4e24e22700 1 --2- 172.21.15.6:0/3996161133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e20108920 0x7f4e2019cc30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009fd0 tx=0x7f4e10004670 comp rx=0 tx=0).stop 2024-05-20T16:57:01.336 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.722+0000 7f4e24e22700 1 -- 172.21.15.6:0/3996161133 shutdown_connections 2024-05-20T16:57:01.336 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.722+0000 7f4e24e22700 1 --2- 172.21.15.6:0/3996161133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e20108920 0x7f4e2019cc30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:01.336 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.722+0000 7f4e24e22700 1 -- 172.21.15.6:0/3996161133 >> 172.21.15.6:0/3996161133 conn(0x7f4e20103fc0 msgr2=0x7f4e20104840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:01.336 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.722+0000 7f4e24e22700 1 -- 172.21.15.6:0/3996161133 shutdown_connections 2024-05-20T16:57:01.337 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:00.722+0000 7f4e24e22700 1 -- 172.21.15.6:0/3996161133 wait complete. 2024-05-20T16:57:01.337 INFO:teuthology.orchestra.run.smithi006.stdout:mgr not available, waiting (3/15)... 2024-05-20T16:57:02.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:01 smithi006 ceph-mon[32486]: Activating manager daemon x 2024-05-20T16:57:02.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:01 smithi006 ceph-mon[32486]: mgrmap e2: x(active, starting, since 0.00352522s) 2024-05-20T16:57:02.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:01 smithi006 ceph-mon[32486]: from='mgr.14100 172.21.15.6:0/2896015772' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-20T16:57:02.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:01 smithi006 ceph-mon[32486]: from='mgr.14100 172.21.15.6:0/2896015772' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-20T16:57:02.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:01 smithi006 ceph-mon[32486]: from='mgr.14100 172.21.15.6:0/2896015772' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-20T16:57:02.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:01 smithi006 ceph-mon[32486]: from='mgr.14100 172.21.15.6:0/2896015772' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T16:57:02.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:01 smithi006 ceph-mon[32486]: from='mgr.14100 172.21.15.6:0/2896015772' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-20T16:57:02.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:01 smithi006 ceph-mon[32486]: Manager daemon x is now available 2024-05-20T16:57:02.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:01 smithi006 ceph-mon[32486]: from='mgr.14100 172.21.15.6:0/2896015772' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-20T16:57:02.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:01 smithi006 ceph-mon[32486]: from='mgr.14100 172.21.15.6:0/2896015772' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-20T16:57:02.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:01 smithi006 ceph-mon[32486]: from='mgr.14100 172.21.15.6:0/2896015772' entity='mgr.x' 2024-05-20T16:57:02.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:01 smithi006 ceph-mon[32486]: from='mgr.14100 172.21.15.6:0/2896015772' entity='mgr.x' 2024-05-20T16:57:02.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:01 smithi006 ceph-mon[32486]: from='mgr.14100 172.21.15.6:0/2896015772' entity='mgr.x' 2024-05-20T16:57:03.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:03 smithi006 ceph-mon[32486]: mgrmap e3: x(active, since 1.00837s) 2024-05-20T16:57:04.376 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:04 smithi006 ceph-mon[32486]: mgrmap e4: x(active, since 2s) 2024-05-20T16:57:04.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-05-20T16:57:04.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-05-20T16:57:04.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsid": "c726c954-16c9-11ef-bc9a-c7b262605968", 2024-05-20T16:57:04.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "health": { 2024-05-20T16:57:04.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-20T16:57:04.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-20T16:57:04.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-20T16:57:04.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:57:04.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-20T16:57:04.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-20T16:57:04.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 0 2024-05-20T16:57:04.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-05-20T16:57:04.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-20T16:57:04.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "a" 2024-05-20T16:57:04.667 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-05-20T16:57:04.667 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-05-20T16:57:04.667 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-20T16:57:04.667 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T16:57:04.667 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-20T16:57:04.667 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-20T16:57:04.667 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:57:04.667 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-20T16:57:04.667 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T16:57:04.667 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-20T16:57:04.667 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-20T16:57:04.667 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-20T16:57:04.675 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-20T16:57:04.676 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-20T16:57:04.676 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-20T16:57:04.676 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:57:04.676 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-20T16:57:04.676 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-20T16:57:04.676 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-20T16:57:04.676 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-20T16:57:04.676 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-20T16:57:04.676 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-20T16:57:04.676 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-20T16:57:04.676 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-20T16:57:04.676 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-20T16:57:04.677 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:57:04.677 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-20T16:57:04.677 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T16:57:04.677 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-20T16:57:04.677 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-20T16:57:04.677 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:57:04.677 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-20T16:57:04.677 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-20T16:57:04.677 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-20T16:57:04.677 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-20T16:57:04.677 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-20T16:57:04.677 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-20T16:57:04.677 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "restful" 2024-05-20T16:57:04.677 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2024-05-20T16:57:04.678 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T16:57:04.678 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:57:04.678 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-20T16:57:04.678 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-20T16:57:04.678 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modified": "2024-05-20T16:56:45.112082+0000", 2024-05-20T16:57:04.678 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-20T16:57:04.678 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2024-05-20T16:57:04.678 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-20T16:57:04.678 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-05-20T16:57:04.678 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.766+0000 7f91271da700 1 Processor -- start 2024-05-20T16:57:04.678 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.766+0000 7f91271da700 1 -- start start 2024-05-20T16:57:04.678 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.767+0000 7f91271da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912007dd60 0x7f912007c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:04.678 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.767+0000 7f91271da700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f912007c770 con 0x7f912007dd60 2024-05-20T16:57:04.679 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.767+0000 7f9124f76700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912007dd60 0x7f912007c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:04.679 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.767+0000 7f9124f76700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912007dd60 0x7f912007c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33526/0 (socket says 172.21.15.6:33526) 2024-05-20T16:57:04.679 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.767+0000 7f9124f76700 1 -- 172.21.15.6:0/2384386243 learned_addr learned my addr 172.21.15.6:0/2384386243 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:04.679 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.767+0000 7f9124f76700 1 -- 172.21.15.6:0/2384386243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f912007c8f0 con 0x7f912007dd60 2024-05-20T16:57:04.679 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.768+0000 7f9124f76700 1 --2- 172.21.15.6:0/2384386243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912007dd60 0x7f912007c230 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f91140098a0 tx=0x7f9114009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b238075e301de60 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:04.679 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.768+0000 7f911f7fe700 1 -- 172.21.15.6:0/2384386243 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9114004160 con 0x7f912007dd60 2024-05-20T16:57:04.679 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.768+0000 7f911f7fe700 1 -- 172.21.15.6:0/2384386243 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9114004300 con 0x7f912007dd60 2024-05-20T16:57:04.679 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.768+0000 7f911f7fe700 1 -- 172.21.15.6:0/2384386243 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9114011a80 con 0x7f912007dd60 2024-05-20T16:57:04.679 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.769+0000 7f91271da700 1 -- 172.21.15.6:0/2384386243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912007dd60 msgr2=0x7f912007c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:04.679 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.769+0000 7f91271da700 1 --2- 172.21.15.6:0/2384386243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912007dd60 0x7f912007c230 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f91140098a0 tx=0x7f9114009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:04.679 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.769+0000 7f91271da700 1 -- 172.21.15.6:0/2384386243 shutdown_connections 2024-05-20T16:57:04.679 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.769+0000 7f91271da700 1 --2- 172.21.15.6:0/2384386243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912007dd60 0x7f912007c230 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:04.679 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.769+0000 7f91271da700 1 -- 172.21.15.6:0/2384386243 >> 172.21.15.6:0/2384386243 conn(0x7f9120104080 msgr2=0x7f91201064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:04.679 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.769+0000 7f91271da700 1 -- 172.21.15.6:0/2384386243 shutdown_connections 2024-05-20T16:57:04.680 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.769+0000 7f91271da700 1 -- 172.21.15.6:0/2384386243 wait complete. 2024-05-20T16:57:04.680 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.769+0000 7f91271da700 1 Processor -- start 2024-05-20T16:57:04.680 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.770+0000 7f91271da700 1 -- start start 2024-05-20T16:57:04.680 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.770+0000 7f91271da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912007dd60 0x7f912019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:04.680 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.770+0000 7f91271da700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f912010eed0 con 0x7f912007dd60 2024-05-20T16:57:04.680 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.770+0000 7f9124f76700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912007dd60 0x7f912019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:04.680 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.770+0000 7f9124f76700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912007dd60 0x7f912019ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33538/0 (socket says 172.21.15.6:33538) 2024-05-20T16:57:04.680 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.770+0000 7f9124f76700 1 -- 172.21.15.6:0/1219559429 learned_addr learned my addr 172.21.15.6:0/1219559429 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:04.680 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.770+0000 7f9124f76700 1 -- 172.21.15.6:0/1219559429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f912019f440 con 0x7f912007dd60 2024-05-20T16:57:04.680 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.770+0000 7f9124f76700 1 --2- 172.21.15.6:0/1219559429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912007dd60 0x7f912019ef00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f91140116a0 tx=0x7f9114011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:04.680 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.771+0000 7f911dffb700 1 -- 172.21.15.6:0/1219559429 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91140039f0 con 0x7f912007dd60 2024-05-20T16:57:04.680 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.771+0000 7f911dffb700 1 -- 172.21.15.6:0/1219559429 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9114003b90 con 0x7f912007dd60 2024-05-20T16:57:04.680 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.771+0000 7f91271da700 1 -- 172.21.15.6:0/1219559429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f912019f6d0 con 0x7f912007dd60 2024-05-20T16:57:04.681 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.771+0000 7f911dffb700 1 -- 172.21.15.6:0/1219559429 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9114019740 con 0x7f912007dd60 2024-05-20T16:57:04.681 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.771+0000 7f91271da700 1 -- 172.21.15.6:0/1219559429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91201a22e0 con 0x7f912007dd60 2024-05-20T16:57:04.681 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.772+0000 7f911dffb700 1 -- 172.21.15.6:0/1219559429 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f9114019a40 con 0x7f912007dd60 2024-05-20T16:57:04.681 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.772+0000 7f91271da700 1 -- 172.21.15.6:0/1219559429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9120063ca0 con 0x7f912007dd60 2024-05-20T16:57:04.681 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.772+0000 7f911dffb700 1 --2- 172.21.15.6:0/1219559429 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f9110038fb0 0x7f911003b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:04.681 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.772+0000 7f911dffb700 1 -- 172.21.15.6:0/1219559429 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f911404d670 con 0x7f912007dd60 2024-05-20T16:57:04.681 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.772+0000 7f911ffff700 1 --2- 172.21.15.6:0/1219559429 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f9110038fb0 0x7f911003b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:04.681 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.773+0000 7f911ffff700 1 --2- 172.21.15.6:0/1219559429 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f9110038fb0 0x7f911003b4c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f910c006fd0 tx=0x7f910c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:04.681 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:03.778+0000 7f911dffb700 1 -- 172.21.15.6:0/1219559429 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9114016260 con 0x7f912007dd60 2024-05-20T16:57:04.681 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:04.070+0000 7f91271da700 1 -- 172.21.15.6:0/1219559429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f91201a2960 con 0x7f912007dd60 2024-05-20T16:57:04.681 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:04.071+0000 7f911dffb700 1 -- 172.21.15.6:0/1219559429 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f911400fdd0 con 0x7f912007dd60 2024-05-20T16:57:04.681 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:04.073+0000 7f91271da700 1 -- 172.21.15.6:0/1219559429 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f9110038fb0 msgr2=0x7f911003b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:04.681 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:04.073+0000 7f91271da700 1 --2- 172.21.15.6:0/1219559429 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f9110038fb0 0x7f911003b4c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f910c006fd0 tx=0x7f910c006e40 comp rx=0 tx=0).stop 2024-05-20T16:57:04.681 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:04.073+0000 7f91271da700 1 -- 172.21.15.6:0/1219559429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912007dd60 msgr2=0x7f912019ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:04.682 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:04.073+0000 7f91271da700 1 --2- 172.21.15.6:0/1219559429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912007dd60 0x7f912019ef00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f91140116a0 tx=0x7f9114011b70 comp rx=0 tx=0).stop 2024-05-20T16:57:04.682 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:04.073+0000 7f91271da700 1 -- 172.21.15.6:0/1219559429 shutdown_connections 2024-05-20T16:57:04.682 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:04.073+0000 7f91271da700 1 --2- 172.21.15.6:0/1219559429 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f9110038fb0 0x7f911003b4c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:04.682 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:04.073+0000 7f91271da700 1 --2- 172.21.15.6:0/1219559429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912007dd60 0x7f912019ef00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:04.682 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:04.073+0000 7f91271da700 1 -- 172.21.15.6:0/1219559429 >> 172.21.15.6:0/1219559429 conn(0x7f9120104080 msgr2=0x7f91201049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:04.682 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:04.073+0000 7f91271da700 1 -- 172.21.15.6:0/1219559429 shutdown_connections 2024-05-20T16:57:04.682 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:04.073+0000 7f91271da700 1 -- 172.21.15.6:0/1219559429 wait complete. 2024-05-20T16:57:04.682 INFO:teuthology.orchestra.run.smithi006.stdout:mgr is available 2024-05-20T16:57:05.310 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:05 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1219559429' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-20T16:57:05.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-05-20T16:57:05.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [global] 2024-05-20T16:57:05.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout fsid = c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:57:05.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-20T16:57:05.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-20T16:57:05.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-20T16:57:05.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-20T16:57:05.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-05-20T16:57:05.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-20T16:57:05.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-20T16:57:05.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2024-05-20T16:57:05.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [osd] 2024-05-20T16:57:05.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-20T16:57:05.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-20T16:57:05.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-20T16:57:05.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-20T16:57:05.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-20T16:57:05.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.093+0000 7fe8947c9700 1 Processor -- start 2024-05-20T16:57:05.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.093+0000 7fe8947c9700 1 -- start start 2024-05-20T16:57:05.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.094+0000 7fe8947c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c109390 0x7fe88c10b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:05.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.094+0000 7fe8947c9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe88c07c7e0 con 0x7fe88c109390 2024-05-20T16:57:05.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.094+0000 7fe892565700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c109390 0x7fe88c10b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:05.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.094+0000 7fe892565700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c109390 0x7fe88c10b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33540/0 (socket says 172.21.15.6:33540) 2024-05-20T16:57:05.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.094+0000 7fe892565700 1 -- 172.21.15.6:0/2472805629 learned_addr learned my addr 172.21.15.6:0/2472805629 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:05.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.094+0000 7fe892565700 1 -- 172.21.15.6:0/2472805629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88c10bcf0 con 0x7fe88c109390 2024-05-20T16:57:05.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.094+0000 7fe892565700 1 --2- 172.21.15.6:0/2472805629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c109390 0x7fe88c10b7b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe8880098a0 tx=0x7fe888009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a1d6bd0faae7009 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:05.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.095+0000 7fe891563700 1 -- 172.21.15.6:0/2472805629 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe888004160 con 0x7fe88c109390 2024-05-20T16:57:05.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.095+0000 7fe891563700 1 -- 172.21.15.6:0/2472805629 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe888004300 con 0x7fe88c109390 2024-05-20T16:57:05.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.095+0000 7fe891563700 1 -- 172.21.15.6:0/2472805629 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe888011a80 con 0x7fe88c109390 2024-05-20T16:57:05.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.095+0000 7fe8947c9700 1 -- 172.21.15.6:0/2472805629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c109390 msgr2=0x7fe88c10b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:05.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.095+0000 7fe8947c9700 1 --2- 172.21.15.6:0/2472805629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c109390 0x7fe88c10b7b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe8880098a0 tx=0x7fe888009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:05.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.096+0000 7fe8947c9700 1 -- 172.21.15.6:0/2472805629 shutdown_connections 2024-05-20T16:57:05.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.096+0000 7fe8947c9700 1 --2- 172.21.15.6:0/2472805629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c109390 0x7fe88c10b7b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:05.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.096+0000 7fe8947c9700 1 -- 172.21.15.6:0/2472805629 >> 172.21.15.6:0/2472805629 conn(0x7fe88c102e50 msgr2=0x7fe88c1052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:05.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.096+0000 7fe8947c9700 1 -- 172.21.15.6:0/2472805629 shutdown_connections 2024-05-20T16:57:05.929 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.096+0000 7fe8947c9700 1 -- 172.21.15.6:0/2472805629 wait complete. 2024-05-20T16:57:05.929 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.096+0000 7fe8947c9700 1 Processor -- start 2024-05-20T16:57:05.929 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.096+0000 7fe8947c9700 1 -- start start 2024-05-20T16:57:05.929 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.097+0000 7fe8947c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c109390 0x7fe88c19cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:05.929 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.097+0000 7fe8947c9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe88c10cbf0 con 0x7fe88c109390 2024-05-20T16:57:05.929 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.097+0000 7fe892565700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c109390 0x7fe88c19cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:05.929 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.097+0000 7fe892565700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c109390 0x7fe88c19cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33542/0 (socket says 172.21.15.6:33542) 2024-05-20T16:57:05.929 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.097+0000 7fe892565700 1 -- 172.21.15.6:0/1486395779 learned_addr learned my addr 172.21.15.6:0/1486395779 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:05.929 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.097+0000 7fe892565700 1 -- 172.21.15.6:0/1486395779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88c19d130 con 0x7fe88c109390 2024-05-20T16:57:05.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.097+0000 7fe892565700 1 --2- 172.21.15.6:0/1486395779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c109390 0x7fe88c19cbf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe888006af0 tx=0x7fe888011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:05.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.097+0000 7fe8837fe700 1 -- 172.21.15.6:0/1486395779 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe888003a60 con 0x7fe88c109390 2024-05-20T16:57:05.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.097+0000 7fe8837fe700 1 -- 172.21.15.6:0/1486395779 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe888003c00 con 0x7fe88c109390 2024-05-20T16:57:05.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.097+0000 7fe8947c9700 1 -- 172.21.15.6:0/1486395779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe88c19d3c0 con 0x7fe88c109390 2024-05-20T16:57:05.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.097+0000 7fe8837fe700 1 -- 172.21.15.6:0/1486395779 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe888019750 con 0x7fe88c109390 2024-05-20T16:57:05.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.097+0000 7fe8947c9700 1 -- 172.21.15.6:0/1486395779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe88c19ffd0 con 0x7fe88c109390 2024-05-20T16:57:05.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.098+0000 7fe8837fe700 1 -- 172.21.15.6:0/1486395779 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fe888022020 con 0x7fe88c109390 2024-05-20T16:57:05.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.098+0000 7fe8947c9700 1 -- 172.21.15.6:0/1486395779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe88c063ca0 con 0x7fe88c109390 2024-05-20T16:57:05.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.099+0000 7fe8837fe700 1 --2- 172.21.15.6:0/1486395779 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7fe878039050 0x7fe87803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:05.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.099+0000 7fe8837fe700 1 -- 172.21.15.6:0/1486395779 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe88804d140 con 0x7fe88c109390 2024-05-20T16:57:05.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.099+0000 7fe891d64700 1 --2- 172.21.15.6:0/1486395779 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7fe878039050 0x7fe87803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:05.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.099+0000 7fe891d64700 1 --2- 172.21.15.6:0/1486395779 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7fe878039050 0x7fe87803b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe87c006fd0 tx=0x7fe87c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:05.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.104+0000 7fe8837fe700 1 -- 172.21.15.6:0/1486395779 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe88804cea0 con 0x7fe88c109390 2024-05-20T16:57:05.931 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.311+0000 7fe8947c9700 1 -- 172.21.15.6:0/1486395779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fe88c1a01a0 con 0x7fe88c109390 2024-05-20T16:57:05.931 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.313+0000 7fe8837fe700 1 -- 172.21.15.6:0/1486395779 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+373 (secure 0 0 0) 0x7fe88802bbe0 con 0x7fe88c109390 2024-05-20T16:57:05.931 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.316+0000 7fe8947c9700 1 -- 172.21.15.6:0/1486395779 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7fe878039050 msgr2=0x7fe87803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:05.931 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.316+0000 7fe8947c9700 1 --2- 172.21.15.6:0/1486395779 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7fe878039050 0x7fe87803b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe87c006fd0 tx=0x7fe87c006e40 comp rx=0 tx=0).stop 2024-05-20T16:57:05.931 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.316+0000 7fe8947c9700 1 -- 172.21.15.6:0/1486395779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c109390 msgr2=0x7fe88c19cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:05.931 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.316+0000 7fe8947c9700 1 --2- 172.21.15.6:0/1486395779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c109390 0x7fe88c19cbf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe888006af0 tx=0x7fe888011ae0 comp rx=0 tx=0).stop 2024-05-20T16:57:05.931 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.316+0000 7fe8947c9700 1 -- 172.21.15.6:0/1486395779 shutdown_connections 2024-05-20T16:57:05.931 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.316+0000 7fe8947c9700 1 --2- 172.21.15.6:0/1486395779 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7fe878039050 0x7fe87803b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:05.931 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.316+0000 7fe8947c9700 1 --2- 172.21.15.6:0/1486395779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c109390 0x7fe88c19cbf0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:05.931 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.316+0000 7fe8947c9700 1 -- 172.21.15.6:0/1486395779 >> 172.21.15.6:0/1486395779 conn(0x7fe88c102e50 msgr2=0x7fe88c1036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:05.931 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.316+0000 7fe8947c9700 1 -- 172.21.15.6:0/1486395779 shutdown_connections 2024-05-20T16:57:05.932 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:05.316+0000 7fe8947c9700 1 -- 172.21.15.6:0/1486395779 wait complete. 2024-05-20T16:57:05.932 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling cephadm module... 2024-05-20T16:57:06.344 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:06 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1486395779' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-20T16:57:07.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:07 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2619663624' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-20T16:57:07.380 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:07 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: ignoring --setuser ceph since I am not root 2024-05-20T16:57:07.380 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:07 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: ignoring --setgroup ceph since I am not root 2024-05-20T16:57:07.380 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:07 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:07.284+0000 7fa777ea5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T16:57:07.734 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:07 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:07.480+0000 7fa777ea5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T16:57:07.734 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:07 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:07.588+0000 7fa777ea5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T16:57:07.736 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.382+0000 7f3591827700 1 Processor -- start 2024-05-20T16:57:07.746 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.382+0000 7f3591827700 1 -- start start 2024-05-20T16:57:07.746 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.383+0000 7f3591827700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f358c109390 0x7f358c10b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:07.746 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.383+0000 7f3591827700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f358c07c7e0 con 0x7f358c109390 2024-05-20T16:57:07.746 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.383+0000 7f358affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f358c109390 0x7f358c10b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:07.746 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.383+0000 7f358affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f358c109390 0x7f358c10b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33552/0 (socket says 172.21.15.6:33552) 2024-05-20T16:57:07.746 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.383+0000 7f358affd700 1 -- 172.21.15.6:0/1816847577 learned_addr learned my addr 172.21.15.6:0/1816847577 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:07.746 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.383+0000 7f358affd700 1 -- 172.21.15.6:0/1816847577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f358c10bcf0 con 0x7f358c109390 2024-05-20T16:57:07.746 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.383+0000 7f358affd700 1 --2- 172.21.15.6:0/1816847577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f358c109390 0x7f358c10b7b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f357c0098a0 tx=0x7f357c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d9e4bd3d0a73e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:07.746 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.384+0000 7f3589ffb700 1 -- 172.21.15.6:0/1816847577 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f357c004160 con 0x7f358c109390 2024-05-20T16:57:07.747 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.384+0000 7f3589ffb700 1 -- 172.21.15.6:0/1816847577 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f357c004300 con 0x7f358c109390 2024-05-20T16:57:07.747 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.384+0000 7f3589ffb700 1 -- 172.21.15.6:0/1816847577 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f357c011a80 con 0x7f358c109390 2024-05-20T16:57:07.747 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.384+0000 7f3591827700 1 -- 172.21.15.6:0/1816847577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f358c109390 msgr2=0x7f358c10b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:07.747 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.384+0000 7f3591827700 1 --2- 172.21.15.6:0/1816847577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f358c109390 0x7f358c10b7b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f357c0098a0 tx=0x7f357c009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:07.747 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.384+0000 7f3591827700 1 -- 172.21.15.6:0/1816847577 shutdown_connections 2024-05-20T16:57:07.747 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.384+0000 7f3591827700 1 --2- 172.21.15.6:0/1816847577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f358c109390 0x7f358c10b7b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:07.747 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.384+0000 7f3591827700 1 -- 172.21.15.6:0/1816847577 >> 172.21.15.6:0/1816847577 conn(0x7f358c102e50 msgr2=0x7f358c1052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:07.747 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.384+0000 7f3591827700 1 -- 172.21.15.6:0/1816847577 shutdown_connections 2024-05-20T16:57:07.747 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.384+0000 7f3591827700 1 -- 172.21.15.6:0/1816847577 wait complete. 2024-05-20T16:57:07.747 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.385+0000 7f3591827700 1 Processor -- start 2024-05-20T16:57:07.747 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.385+0000 7f3591827700 1 -- start start 2024-05-20T16:57:07.747 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.386+0000 7f3591827700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f358c109390 0x7f358c19ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:07.747 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.386+0000 7f3591827700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f358c10cbf0 con 0x7f358c109390 2024-05-20T16:57:07.747 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.386+0000 7f358affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f358c109390 0x7f358c19ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:07.748 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.386+0000 7f358affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f358c109390 0x7f358c19ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33556/0 (socket says 172.21.15.6:33556) 2024-05-20T16:57:07.748 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.386+0000 7f358affd700 1 -- 172.21.15.6:0/2619663624 learned_addr learned my addr 172.21.15.6:0/2619663624 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:07.748 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.386+0000 7f358affd700 1 -- 172.21.15.6:0/2619663624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f358c19f390 con 0x7f358c109390 2024-05-20T16:57:07.748 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.386+0000 7f358affd700 1 --2- 172.21.15.6:0/2619663624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f358c109390 0x7f358c19ee50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f357c0116a0 tx=0x7f357c011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:07.748 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.386+0000 7f3590825700 1 -- 172.21.15.6:0/2619663624 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f357c0039f0 con 0x7f358c109390 2024-05-20T16:57:07.748 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.386+0000 7f3591827700 1 -- 172.21.15.6:0/2619663624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f358c19f620 con 0x7f358c109390 2024-05-20T16:57:07.748 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.386+0000 7f3590825700 1 -- 172.21.15.6:0/2619663624 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f357c003b90 con 0x7f358c109390 2024-05-20T16:57:07.748 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.387+0000 7f3590825700 1 -- 172.21.15.6:0/2619663624 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f357c019740 con 0x7f358c109390 2024-05-20T16:57:07.748 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.387+0000 7f3591827700 1 -- 172.21.15.6:0/2619663624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f358c1a2230 con 0x7f358c109390 2024-05-20T16:57:07.748 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.387+0000 7f3590825700 1 -- 172.21.15.6:0/2619663624 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f357c019a40 con 0x7f358c109390 2024-05-20T16:57:07.748 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.387+0000 7f3591827700 1 -- 172.21.15.6:0/2619663624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f358c063ca0 con 0x7f358c109390 2024-05-20T16:57:07.748 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.388+0000 7f3590825700 1 --2- 172.21.15.6:0/2619663624 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f3574038fb0 0x7f357403b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:07.749 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.388+0000 7f3590825700 1 -- 172.21.15.6:0/2619663624 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f357c04d690 con 0x7f358c109390 2024-05-20T16:57:07.749 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.388+0000 7f358a7fc700 1 --2- 172.21.15.6:0/2619663624 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f3574038fb0 0x7f357403b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:07.749 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.388+0000 7f358a7fc700 1 --2- 172.21.15.6:0/2619663624 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f3574038fb0 0x7f357403b4c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3580006fd0 tx=0x7f3580006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:07.749 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.393+0000 7f3590825700 1 -- 172.21.15.6:0/2619663624 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f357c016260 con 0x7f358c109390 2024-05-20T16:57:07.749 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:06.662+0000 7f3591827700 1 -- 172.21.15.6:0/2619663624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f358c02df60 con 0x7f358c109390 2024-05-20T16:57:07.749 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:07.072+0000 7f3590825700 1 -- 172.21.15.6:0/2619663624 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f357c004300 con 0x7f358c109390 2024-05-20T16:57:07.749 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:07.074+0000 7f3590825700 1 -- 172.21.15.6:0/2619663624 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f357c01abe0 con 0x7f358c109390 2024-05-20T16:57:07.749 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:07.076+0000 7f3591827700 1 -- 172.21.15.6:0/2619663624 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f3574038fb0 msgr2=0x7f357403b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:07.749 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:07.076+0000 7f3591827700 1 --2- 172.21.15.6:0/2619663624 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f3574038fb0 0x7f357403b4c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3580006fd0 tx=0x7f3580006e40 comp rx=0 tx=0).stop 2024-05-20T16:57:07.749 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:07.076+0000 7f3591827700 1 -- 172.21.15.6:0/2619663624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f358c109390 msgr2=0x7f358c19ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:07.750 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:07.076+0000 7f3591827700 1 --2- 172.21.15.6:0/2619663624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f358c109390 0x7f358c19ee50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f357c0116a0 tx=0x7f357c011b70 comp rx=0 tx=0).stop 2024-05-20T16:57:07.750 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:07.076+0000 7f3591827700 1 -- 172.21.15.6:0/2619663624 shutdown_connections 2024-05-20T16:57:07.750 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:07.076+0000 7f3591827700 1 --2- 172.21.15.6:0/2619663624 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f3574038fb0 0x7f357403b4c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:07.750 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:07.076+0000 7f3591827700 1 --2- 172.21.15.6:0/2619663624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f358c109390 0x7f358c19ee50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:07.750 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:07.076+0000 7f3591827700 1 -- 172.21.15.6:0/2619663624 >> 172.21.15.6:0/2619663624 conn(0x7f358c102e50 msgr2=0x7f358c107390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:07.750 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:07.077+0000 7f3591827700 1 -- 172.21.15.6:0/2619663624 shutdown_connections 2024-05-20T16:57:07.750 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:07.077+0000 7f3591827700 1 -- 172.21.15.6:0/2619663624 wait complete. 2024-05-20T16:57:07.990 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:07 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:07.925+0000 7fa777ea5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T16:57:08.380 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:08 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:08.018+0000 7fa777ea5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T16:57:08.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:08 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2619663624' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-20T16:57:08.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:08 smithi006 ceph-mon[32486]: mgrmap e5: x(active, since 6s) 2024-05-20T16:57:09.173 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:09 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1132336401' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-20T16:57:09.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-05-20T16:57:09.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-20T16:57:09.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-20T16:57:09.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-20T16:57:09.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-20T16:57:09.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-05-20T16:57:09.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.226+0000 7f2a4aee7700 1 Processor -- start 2024-05-20T16:57:09.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.226+0000 7f2a4aee7700 1 -- start start 2024-05-20T16:57:09.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.226+0000 7f2a4aee7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a441093d0 0x7f2a4410b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:09.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.226+0000 7f2a4aee7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4407c640 con 0x7f2a441093d0 2024-05-20T16:57:09.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.227+0000 7f2a48c83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a441093d0 0x7f2a4410b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:09.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.227+0000 7f2a48c83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a441093d0 0x7f2a4410b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33592/0 (socket says 172.21.15.6:33592) 2024-05-20T16:57:09.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.227+0000 7f2a48c83700 1 -- 172.21.15.6:0/1550960321 learned_addr learned my addr 172.21.15.6:0/1550960321 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:09.183 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.227+0000 7f2a48c83700 1 -- 172.21.15.6:0/1550960321 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4410bd30 con 0x7f2a441093d0 2024-05-20T16:57:09.183 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.227+0000 7f2a48c83700 1 --2- 172.21.15.6:0/1550960321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a441093d0 0x7f2a4410b7f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2a380098a0 tx=0x7f2a38009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55ee48c9c65510e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:09.183 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.227+0000 7f2a437fe700 1 -- 172.21.15.6:0/1550960321 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a38004160 con 0x7f2a441093d0 2024-05-20T16:57:09.183 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.227+0000 7f2a437fe700 1 -- 172.21.15.6:0/1550960321 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f2a38004300 con 0x7f2a441093d0 2024-05-20T16:57:09.183 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.227+0000 7f2a437fe700 1 -- 172.21.15.6:0/1550960321 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a38011a80 con 0x7f2a441093d0 2024-05-20T16:57:09.183 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.228+0000 7f2a4aee7700 1 -- 172.21.15.6:0/1550960321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a441093d0 msgr2=0x7f2a4410b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:09.183 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.228+0000 7f2a4aee7700 1 --2- 172.21.15.6:0/1550960321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a441093d0 0x7f2a4410b7f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2a380098a0 tx=0x7f2a38009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:09.183 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.228+0000 7f2a4aee7700 1 -- 172.21.15.6:0/1550960321 shutdown_connections 2024-05-20T16:57:09.183 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.228+0000 7f2a4aee7700 1 --2- 172.21.15.6:0/1550960321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a441093d0 0x7f2a4410b7f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:09.183 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.228+0000 7f2a4aee7700 1 -- 172.21.15.6:0/1550960321 >> 172.21.15.6:0/1550960321 conn(0x7f2a44102ef0 msgr2=0x7f2a44105340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:09.183 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.228+0000 7f2a4aee7700 1 -- 172.21.15.6:0/1550960321 shutdown_connections 2024-05-20T16:57:09.183 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.228+0000 7f2a4aee7700 1 -- 172.21.15.6:0/1550960321 wait complete. 2024-05-20T16:57:09.183 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.229+0000 7f2a4aee7700 1 Processor -- start 2024-05-20T16:57:09.184 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.229+0000 7f2a4aee7700 1 -- start start 2024-05-20T16:57:09.184 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.229+0000 7f2a4aee7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a441093d0 0x7f2a44108b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:09.184 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.229+0000 7f2a4aee7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4410cc30 con 0x7f2a441093d0 2024-05-20T16:57:09.184 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.229+0000 7f2a48c83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a441093d0 0x7f2a44108b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:09.184 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.229+0000 7f2a48c83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a441093d0 0x7f2a44108b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33602/0 (socket says 172.21.15.6:33602) 2024-05-20T16:57:09.184 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.229+0000 7f2a48c83700 1 -- 172.21.15.6:0/1132336401 learned_addr learned my addr 172.21.15.6:0/1132336401 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:09.184 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.230+0000 7f2a48c83700 1 -- 172.21.15.6:0/1132336401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a44109090 con 0x7f2a441093d0 2024-05-20T16:57:09.184 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.230+0000 7f2a48c83700 1 --2- 172.21.15.6:0/1132336401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a441093d0 0x7f2a44108b50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2a380116a0 tx=0x7f2a38011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:09.184 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.230+0000 7f2a41ffb700 1 -- 172.21.15.6:0/1132336401 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a380039f0 con 0x7f2a441093d0 2024-05-20T16:57:09.184 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.230+0000 7f2a41ffb700 1 -- 172.21.15.6:0/1132336401 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f2a38003b90 con 0x7f2a441093d0 2024-05-20T16:57:09.184 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.230+0000 7f2a4aee7700 1 -- 172.21.15.6:0/1132336401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a441072e0 con 0x7f2a441093d0 2024-05-20T16:57:09.184 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.230+0000 7f2a41ffb700 1 -- 172.21.15.6:0/1132336401 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a38019740 con 0x7f2a441093d0 2024-05-20T16:57:09.184 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.230+0000 7f2a4aee7700 1 -- 172.21.15.6:0/1132336401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a441077c0 con 0x7f2a441093d0 2024-05-20T16:57:09.185 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.231+0000 7f2a41ffb700 1 -- 172.21.15.6:0/1132336401 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f2a380199f0 con 0x7f2a441093d0 2024-05-20T16:57:09.185 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.231+0000 7f2a4aee7700 1 -- 172.21.15.6:0/1132336401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a44063ca0 con 0x7f2a441093d0 2024-05-20T16:57:09.185 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.231+0000 7f2a41ffb700 1 --2- 172.21.15.6:0/1132336401 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f2a34039050 0x7f2a3403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:09.185 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.232+0000 7f2a41ffb700 1 -- 172.21.15.6:0/1132336401 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2a3804d650 con 0x7f2a441093d0 2024-05-20T16:57:09.185 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.232+0000 7f2a43fff700 1 -- 172.21.15.6:0/1132336401 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f2a34039050 msgr2=0x7f2a3403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/741681069 2024-05-20T16:57:09.185 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.232+0000 7f2a43fff700 1 --2- 172.21.15.6:0/1132336401 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f2a34039050 0x7f2a3403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T16:57:09.185 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.237+0000 7f2a41ffb700 1 -- 172.21.15.6:0/1132336401 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2a38016260 con 0x7f2a441093d0 2024-05-20T16:57:09.185 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.433+0000 7f2a43fff700 1 -- 172.21.15.6:0/1132336401 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f2a34039050 msgr2=0x7f2a3403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/741681069 2024-05-20T16:57:09.185 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.433+0000 7f2a43fff700 1 --2- 172.21.15.6:0/1132336401 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f2a34039050 0x7f2a3403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-20T16:57:09.185 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.561+0000 7f2a4aee7700 1 -- 172.21.15.6:0/1132336401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f2a44107f00 con 0x7f2a441093d0 2024-05-20T16:57:09.185 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.561+0000 7f2a41ffb700 1 -- 172.21.15.6:0/1132336401 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f2a3800fdd0 con 0x7f2a441093d0 2024-05-20T16:57:09.185 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.564+0000 7f2a4aee7700 1 -- 172.21.15.6:0/1132336401 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f2a34039050 msgr2=0x7f2a3403b560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T16:57:09.185 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.564+0000 7f2a4aee7700 1 --2- 172.21.15.6:0/1132336401 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f2a34039050 0x7f2a3403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:09.186 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.564+0000 7f2a4aee7700 1 -- 172.21.15.6:0/1132336401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a441093d0 msgr2=0x7f2a44108b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:09.186 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.564+0000 7f2a4aee7700 1 --2- 172.21.15.6:0/1132336401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a441093d0 0x7f2a44108b50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2a380116a0 tx=0x7f2a38011b70 comp rx=0 tx=0).stop 2024-05-20T16:57:09.186 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.564+0000 7f2a4aee7700 1 -- 172.21.15.6:0/1132336401 shutdown_connections 2024-05-20T16:57:09.186 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.564+0000 7f2a4aee7700 1 --2- 172.21.15.6:0/1132336401 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f2a34039050 0x7f2a3403b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:09.186 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.564+0000 7f2a4aee7700 1 --2- 172.21.15.6:0/1132336401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a441093d0 0x7f2a44108b50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:09.186 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.564+0000 7f2a4aee7700 1 -- 172.21.15.6:0/1132336401 >> 172.21.15.6:0/1132336401 conn(0x7f2a44102ef0 msgr2=0x7f2a44104860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:09.186 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.564+0000 7f2a4aee7700 1 -- 172.21.15.6:0/1132336401 shutdown_connections 2024-05-20T16:57:09.186 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:08.564+0000 7f2a4aee7700 1 -- 172.21.15.6:0/1132336401 wait complete. 2024-05-20T16:57:09.186 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for the mgr to restart... 2024-05-20T16:57:09.186 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mgr epoch 5... 2024-05-20T16:57:09.424 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:09 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:09.318+0000 7fa777ea5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T16:57:09.850 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:09 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:09.502+0000 7fa777ea5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T16:57:09.850 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:09 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:09.685+0000 7fa777ea5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T16:57:10.130 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:09 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:09.990+0000 7fa777ea5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T16:57:10.130 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:10 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:10.087+0000 7fa777ea5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T16:57:10.504 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:10 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:10.299+0000 7fa777ea5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T16:57:10.880 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:10 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:10.504+0000 7fa777ea5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T16:57:11.380 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:11 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:11.138+0000 7fa777ea5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T16:57:11.880 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:11 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:11.587+0000 7fa777ea5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T16:57:11.880 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:11 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:11.690+0000 7fa777ea5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T16:57:12.382 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:11 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:11.904+0000 7fa777ea5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T16:57:12.810 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:12 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:12.454+0000 7fa777ea5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T16:57:12.810 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:12 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:12.551+0000 7fa777ea5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T16:57:13.130 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:12 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:12.809+0000 7fa777ea5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T16:57:13.130 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:12 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:12.951+0000 7fa777ea5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T16:57:13.130 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:13 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:13.052+0000 7fa777ea5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T16:57:13.489 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:13 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:13.175+0000 7fa777ea5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T16:57:13.489 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:13 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:13.489+0000 7fa777ea5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T16:57:14.380 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:14 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:14.122+0000 7fa777ea5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T16:57:14.380 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:14 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:14.353+0000 7fa777ea5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T16:57:14.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:14 smithi006 ceph-mon[32486]: Active manager daemon x restarted 2024-05-20T16:57:14.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:14 smithi006 ceph-mon[32486]: Activating manager daemon x 2024-05-20T16:57:14.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:14 smithi006 ceph-mon[32486]: osdmap e2: 0 total, 0 up, 0 in 2024-05-20T16:57:14.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:14 smithi006 ceph-mon[32486]: mgrmap e6: x(active, starting, since 0.00400103s) 2024-05-20T16:57:14.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:14 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T16:57:14.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:14 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-20T16:57:14.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:14 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-20T16:57:14.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:14 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-20T16:57:14.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:14 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-20T16:57:14.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:14 smithi006 ceph-mon[32486]: Manager daemon x is now available 2024-05-20T16:57:14.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:14 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' 2024-05-20T16:57:14.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:14 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' 2024-05-20T16:57:14.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:14 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:57:14.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:14 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:57:15.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:15 smithi006 ceph-mon[32486]: Found migration_current of "None". Setting to last migration. 2024-05-20T16:57:15.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:15 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-20T16:57:15.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:15 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-20T16:57:15.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:15 smithi006 ceph-mon[32486]: mgrmap e7: x(active, since 1.00622s) 2024-05-20T16:57:15.914 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-05-20T16:57:15.914 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-20T16:57:15.914 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-20T16:57:15.914 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-05-20T16:57:15.914 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.644+0000 7f13a1215700 1 Processor -- start 2024-05-20T16:57:15.914 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.644+0000 7f13a1215700 1 -- start start 2024-05-20T16:57:15.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.645+0000 7f13a1215700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c07bc80 0x7f139c10b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:15.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.645+0000 7f13a1215700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f139c10b9e0 con 0x7f139c07bc80 2024-05-20T16:57:15.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.645+0000 7f139ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c07bc80 0x7f139c10b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:15.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.645+0000 7f139ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c07bc80 0x7f139c10b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33608/0 (socket says 172.21.15.6:33608) 2024-05-20T16:57:15.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.645+0000 7f139ad9d700 1 -- 172.21.15.6:0/3373406681 learned_addr learned my addr 172.21.15.6:0/3373406681 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:15.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.645+0000 7f139ad9d700 1 -- 172.21.15.6:0/3373406681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139c10bb60 con 0x7f139c07bc80 2024-05-20T16:57:15.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.645+0000 7f139ad9d700 1 --2- 172.21.15.6:0/3373406681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c07bc80 0x7f139c10b3f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f138c0098a0 tx=0x7f138c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdba252238d28557 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:15.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.646+0000 7f1399d9b700 1 -- 172.21.15.6:0/3373406681 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f138c004160 con 0x7f139c07bc80 2024-05-20T16:57:15.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.646+0000 7f1399d9b700 1 -- 172.21.15.6:0/3373406681 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f138c004300 con 0x7f139c07bc80 2024-05-20T16:57:15.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.646+0000 7f1399d9b700 1 -- 172.21.15.6:0/3373406681 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f138c011a80 con 0x7f139c07bc80 2024-05-20T16:57:15.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.646+0000 7f13a1215700 1 -- 172.21.15.6:0/3373406681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c07bc80 msgr2=0x7f139c10b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:15.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.646+0000 7f13a1215700 1 --2- 172.21.15.6:0/3373406681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c07bc80 0x7f139c10b3f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f138c0098a0 tx=0x7f138c009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:15.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.646+0000 7f13a1215700 1 -- 172.21.15.6:0/3373406681 shutdown_connections 2024-05-20T16:57:15.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.646+0000 7f13a1215700 1 --2- 172.21.15.6:0/3373406681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c07bc80 0x7f139c10b3f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:15.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.646+0000 7f13a1215700 1 -- 172.21.15.6:0/3373406681 >> 172.21.15.6:0/3373406681 conn(0x7f139c102e00 msgr2=0x7f139c105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:15.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.646+0000 7f13a1215700 1 -- 172.21.15.6:0/3373406681 shutdown_connections 2024-05-20T16:57:15.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.646+0000 7f13a1215700 1 -- 172.21.15.6:0/3373406681 wait complete. 2024-05-20T16:57:15.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.647+0000 7f13a1215700 1 Processor -- start 2024-05-20T16:57:15.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.648+0000 7f13a1215700 1 -- start start 2024-05-20T16:57:15.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.648+0000 7f13a1215700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c07bc80 0x7f139c19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:15.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.648+0000 7f13a1215700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f139c10cbe0 con 0x7f139c07bc80 2024-05-20T16:57:15.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.648+0000 7f139ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c07bc80 0x7f139c19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:15.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.648+0000 7f139ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c07bc80 0x7f139c19cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33614/0 (socket says 172.21.15.6:33614) 2024-05-20T16:57:15.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.648+0000 7f139ad9d700 1 -- 172.21.15.6:0/2248501491 learned_addr learned my addr 172.21.15.6:0/2248501491 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:15.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.648+0000 7f139ad9d700 1 -- 172.21.15.6:0/2248501491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139c19d190 con 0x7f139c07bc80 2024-05-20T16:57:15.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.648+0000 7f139ad9d700 1 --2- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c07bc80 0x7f139c19cc50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f138c0116a0 tx=0x7f138c011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:15.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.649+0000 7f1383fff700 1 -- 172.21.15.6:0/2248501491 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f138c0039f0 con 0x7f139c07bc80 2024-05-20T16:57:15.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.649+0000 7f13a1215700 1 -- 172.21.15.6:0/2248501491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f139c19d420 con 0x7f139c07bc80 2024-05-20T16:57:15.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.649+0000 7f1383fff700 1 -- 172.21.15.6:0/2248501491 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f138c003b90 con 0x7f139c07bc80 2024-05-20T16:57:15.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.649+0000 7f1383fff700 1 -- 172.21.15.6:0/2248501491 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f138c019740 con 0x7f139c07bc80 2024-05-20T16:57:15.918 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.649+0000 7f13a1215700 1 -- 172.21.15.6:0/2248501491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f139c1a0030 con 0x7f139c07bc80 2024-05-20T16:57:15.918 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.650+0000 7f1383fff700 1 -- 172.21.15.6:0/2248501491 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f138c019a40 con 0x7f139c07bc80 2024-05-20T16:57:15.918 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.650+0000 7f1383fff700 1 --2- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f1384039000 0x7f138403b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:15.918 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.650+0000 7f1383fff700 1 -- 172.21.15.6:0/2248501491 --> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f138403bc20 con 0x7f1384039000 2024-05-20T16:57:15.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.650+0000 7f1383fff700 1 -- 172.21.15.6:0/2248501491 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f138c01a970 con 0x7f139c07bc80 2024-05-20T16:57:15.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.650+0000 7f139a59c700 1 -- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f1384039000 msgr2=0x7f138403b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/741681069 2024-05-20T16:57:15.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.650+0000 7f139a59c700 1 --2- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f1384039000 0x7f138403b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T16:57:15.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.851+0000 7f139a59c700 1 -- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f1384039000 msgr2=0x7f138403b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/741681069 2024-05-20T16:57:15.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:09.851+0000 7f139a59c700 1 --2- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f1384039000 0x7f138403b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-20T16:57:15.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:10.251+0000 7f139a59c700 1 -- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f1384039000 msgr2=0x7f138403b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/741681069 2024-05-20T16:57:15.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:10.251+0000 7f139a59c700 1 --2- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f1384039000 0x7f138403b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-20T16:57:15.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:11.052+0000 7f139a59c700 1 -- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f1384039000 msgr2=0x7f138403b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/741681069 2024-05-20T16:57:15.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:11.052+0000 7f139a59c700 1 --2- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f1384039000 0x7f138403b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-20T16:57:15.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:12.653+0000 7f139a59c700 1 -- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f1384039000 msgr2=0x7f138403b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/741681069 2024-05-20T16:57:15.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:12.653+0000 7f139a59c700 1 --2- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f1384039000 0x7f138403b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-20T16:57:15.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:14.357+0000 7f1383fff700 1 -- 172.21.15.6:0/2248501491 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f138c01abe0 con 0x7f139c07bc80 2024-05-20T16:57:15.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:14.357+0000 7f1383fff700 1 -- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f1384039000 msgr2=0x7f138403b510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T16:57:15.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:14.357+0000 7f1383fff700 1 --2- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f1384039000 0x7f138403b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:15.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:15.358+0000 7f1383fff700 1 -- 172.21.15.6:0/2248501491 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f138c023390 con 0x7f139c07bc80 2024-05-20T16:57:15.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:15.358+0000 7f1383fff700 1 --2- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f138403c980 0x7f138403eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:15.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:15.358+0000 7f1383fff700 1 -- 172.21.15.6:0/2248501491 --> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f138403bc20 con 0x7f138403c980 2024-05-20T16:57:15.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:15.359+0000 7f139a59c700 1 --2- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f138403c980 0x7f138403eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:15.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:15.359+0000 7f139a59c700 1 --2- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f138403c980 0x7f138403eda0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1390003a10 tx=0x7f1390009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:15.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:15.360+0000 7f1383fff700 1 -- 172.21.15.6:0/2248501491 <== mgr.14120 v2:172.21.15.6:6800/3509827796 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f138403bc20 con 0x7f138403c980 2024-05-20T16:57:15.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:15.367+0000 7f13a1215700 1 -- 172.21.15.6:0/2248501491 --> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f139c063ca0 con 0x7f138403c980 2024-05-20T16:57:15.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:15.368+0000 7f1383fff700 1 -- 172.21.15.6:0/2248501491 <== mgr.14120 v2:172.21.15.6:6800/3509827796 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f139c063ca0 con 0x7f138403c980 2024-05-20T16:57:15.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:15.368+0000 7f13a1215700 1 -- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f138403c980 msgr2=0x7f138403eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:15.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:15.368+0000 7f13a1215700 1 --2- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f138403c980 0x7f138403eda0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1390003a10 tx=0x7f1390009290 comp rx=0 tx=0).stop 2024-05-20T16:57:15.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:15.368+0000 7f13a1215700 1 -- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c07bc80 msgr2=0x7f139c19cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:15.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:15.368+0000 7f13a1215700 1 --2- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c07bc80 0x7f139c19cc50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f138c0116a0 tx=0x7f138c011b70 comp rx=0 tx=0).stop 2024-05-20T16:57:15.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:15.368+0000 7f13a1215700 1 -- 172.21.15.6:0/2248501491 shutdown_connections 2024-05-20T16:57:15.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:15.368+0000 7f13a1215700 1 --2- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f138403c980 0x7f138403eda0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:15.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:15.368+0000 7f13a1215700 1 --2- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c07bc80 0x7f139c19cc50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:15.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:15.368+0000 7f13a1215700 1 --2- 172.21.15.6:0/2248501491 >> [v2:172.21.15.6:6800/741681069,v1:172.21.15.6:6801/741681069] conn(0x7f1384039000 0x7f138403b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:15.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:15.368+0000 7f13a1215700 1 -- 172.21.15.6:0/2248501491 >> 172.21.15.6:0/2248501491 conn(0x7f139c102e00 msgr2=0x7f139c103770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:15.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:15.368+0000 7f13a1215700 1 -- 172.21.15.6:0/2248501491 shutdown_connections 2024-05-20T16:57:15.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:15.368+0000 7f13a1215700 1 -- 172.21.15.6:0/2248501491 wait complete. 2024-05-20T16:57:15.921 INFO:teuthology.orchestra.run.smithi006.stdout:mgr epoch 5 is available 2024-05-20T16:57:15.921 INFO:teuthology.orchestra.run.smithi006.stdout:Setting orchestrator backend to cephadm... 2024-05-20T16:57:16.576 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:16 smithi006 ceph-mon[32486]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-20T16:57:16.576 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:16 smithi006 ceph-mon[32486]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-20T16:57:16.576 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:16 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' 2024-05-20T16:57:16.576 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:16 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' 2024-05-20T16:57:16.576 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:16 smithi006 ceph-mon[32486]: [20/May/2024:16:57:16] ENGINE Bus STARTING 2024-05-20T16:57:17.153 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.339+0000 7f4571830700 1 Processor -- start 2024-05-20T16:57:17.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.339+0000 7f4571830700 1 -- start start 2024-05-20T16:57:17.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.339+0000 7f4571830700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f456c1077b0 0x7f456c107bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:17.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.339+0000 7f4571830700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f456c1081b0 con 0x7f456c1077b0 2024-05-20T16:57:17.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.340+0000 7f456affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f456c1077b0 0x7f456c107bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:17.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.340+0000 7f456affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f456c1077b0 0x7f456c107bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56244/0 (socket says 172.21.15.6:56244) 2024-05-20T16:57:17.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.340+0000 7f456affd700 1 -- 172.21.15.6:0/3025998836 learned_addr learned my addr 172.21.15.6:0/3025998836 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:17.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.340+0000 7f456affd700 1 -- 172.21.15.6:0/3025998836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456c1088e0 con 0x7f456c1077b0 2024-05-20T16:57:17.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.340+0000 7f456affd700 1 --2- 172.21.15.6:0/3025998836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f456c1077b0 0x7f456c107bc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f455c0098a0 tx=0x7f455c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3fbe1666b64df6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:17.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.340+0000 7f4569ffb700 1 -- 172.21.15.6:0/3025998836 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f455c004160 con 0x7f456c1077b0 2024-05-20T16:57:17.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.340+0000 7f4569ffb700 1 -- 172.21.15.6:0/3025998836 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f455c004300 con 0x7f456c1077b0 2024-05-20T16:57:17.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.340+0000 7f4569ffb700 1 -- 172.21.15.6:0/3025998836 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f455c011a80 con 0x7f456c1077b0 2024-05-20T16:57:17.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.341+0000 7f4571830700 1 -- 172.21.15.6:0/3025998836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f456c1077b0 msgr2=0x7f456c107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:17.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.341+0000 7f4571830700 1 --2- 172.21.15.6:0/3025998836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f456c1077b0 0x7f456c107bc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f455c0098a0 tx=0x7f455c009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:17.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.341+0000 7f4571830700 1 -- 172.21.15.6:0/3025998836 shutdown_connections 2024-05-20T16:57:17.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.341+0000 7f4571830700 1 --2- 172.21.15.6:0/3025998836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f456c1077b0 0x7f456c107bc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:17.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.341+0000 7f4571830700 1 -- 172.21.15.6:0/3025998836 >> 172.21.15.6:0/3025998836 conn(0x7f456c102df0 msgr2=0x7f456c1052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:17.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.341+0000 7f4571830700 1 -- 172.21.15.6:0/3025998836 shutdown_connections 2024-05-20T16:57:17.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.341+0000 7f4571830700 1 -- 172.21.15.6:0/3025998836 wait complete. 2024-05-20T16:57:17.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.342+0000 7f4571830700 1 Processor -- start 2024-05-20T16:57:17.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.342+0000 7f4571830700 1 -- start start 2024-05-20T16:57:17.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.342+0000 7f4571830700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f456c1077b0 0x7f456c104f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:17.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.342+0000 7f4571830700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f456c10bc90 con 0x7f456c1077b0 2024-05-20T16:57:17.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.342+0000 7f456affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f456c1077b0 0x7f456c104f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:17.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.342+0000 7f456affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f456c1077b0 0x7f456c104f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56250/0 (socket says 172.21.15.6:56250) 2024-05-20T16:57:17.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.342+0000 7f456affd700 1 -- 172.21.15.6:0/1941204064 learned_addr learned my addr 172.21.15.6:0/1941204064 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:17.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.343+0000 7f456affd700 1 -- 172.21.15.6:0/1941204064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456c1054b0 con 0x7f456c1077b0 2024-05-20T16:57:17.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.343+0000 7f456affd700 1 --2- 172.21.15.6:0/1941204064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f456c1077b0 0x7f456c104f70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f455c011a50 tx=0x7f455c011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:17.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.343+0000 7f457082e700 1 -- 172.21.15.6:0/1941204064 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f455c003970 con 0x7f456c1077b0 2024-05-20T16:57:17.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.343+0000 7f457082e700 1 -- 172.21.15.6:0/1941204064 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f455c003b10 con 0x7f456c1077b0 2024-05-20T16:57:17.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.343+0000 7f4571830700 1 -- 172.21.15.6:0/1941204064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f456c103700 con 0x7f456c1077b0 2024-05-20T16:57:17.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.343+0000 7f457082e700 1 -- 172.21.15.6:0/1941204064 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f455c024580 con 0x7f456c1077b0 2024-05-20T16:57:17.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.343+0000 7f4571830700 1 -- 172.21.15.6:0/1941204064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f456c103be0 con 0x7f456c1077b0 2024-05-20T16:57:17.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.344+0000 7f4571830700 1 -- 172.21.15.6:0/1941204064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f456c063ca0 con 0x7f456c1077b0 2024-05-20T16:57:17.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.344+0000 7f457082e700 1 -- 172.21.15.6:0/1941204064 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f455c02d3f0 con 0x7f456c1077b0 2024-05-20T16:57:17.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.344+0000 7f457082e700 1 --2- 172.21.15.6:0/1941204064 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f4558038f30 0x7f455803b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:17.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.344+0000 7f457082e700 1 -- 172.21.15.6:0/1941204064 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f455c04d180 con 0x7f456c1077b0 2024-05-20T16:57:17.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.345+0000 7f456a7fc700 1 --2- 172.21.15.6:0/1941204064 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f4558038f30 0x7f455803b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:17.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.345+0000 7f456a7fc700 1 --2- 172.21.15.6:0/1941204064 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f4558038f30 0x7f455803b440 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4554006fd0 tx=0x7f4554006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:17.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.350+0000 7f457082e700 1 -- 172.21.15.6:0/1941204064 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f455c00e260 con 0x7f456c1077b0 2024-05-20T16:57:17.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.421+0000 7f457082e700 1 -- 172.21.15.6:0/1941204064 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f455c0193c0 con 0x7f456c1077b0 2024-05-20T16:57:17.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.575+0000 7f4571830700 1 -- 172.21.15.6:0/1941204064 --> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f456c195de0 con 0x7f4558038f30 2024-05-20T16:57:17.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.583+0000 7f457082e700 1 -- 172.21.15.6:0/1941204064 <== mgr.14120 v2:172.21.15.6:6800/3509827796 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f456c195de0 con 0x7f4558038f30 2024-05-20T16:57:17.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.585+0000 7f4571830700 1 -- 172.21.15.6:0/1941204064 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f4558038f30 msgr2=0x7f455803b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:17.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.585+0000 7f4571830700 1 --2- 172.21.15.6:0/1941204064 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f4558038f30 0x7f455803b440 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4554006fd0 tx=0x7f4554006e40 comp rx=0 tx=0).stop 2024-05-20T16:57:17.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.585+0000 7f4571830700 1 -- 172.21.15.6:0/1941204064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f456c1077b0 msgr2=0x7f456c104f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:17.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.585+0000 7f4571830700 1 --2- 172.21.15.6:0/1941204064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f456c1077b0 0x7f456c104f70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f455c011a50 tx=0x7f455c011b30 comp rx=0 tx=0).stop 2024-05-20T16:57:17.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.586+0000 7f4571830700 1 -- 172.21.15.6:0/1941204064 shutdown_connections 2024-05-20T16:57:17.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.586+0000 7f4571830700 1 --2- 172.21.15.6:0/1941204064 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f4558038f30 0x7f455803b440 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:17.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.586+0000 7f4571830700 1 --2- 172.21.15.6:0/1941204064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f456c1077b0 0x7f456c104f70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:17.158 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.586+0000 7f4571830700 1 -- 172.21.15.6:0/1941204064 >> 172.21.15.6:0/1941204064 conn(0x7f456c102df0 msgr2=0x7f456c1931e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:17.158 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.586+0000 7f4571830700 1 -- 172.21.15.6:0/1941204064 shutdown_connections 2024-05-20T16:57:17.158 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:16.586+0000 7f4571830700 1 -- 172.21.15.6:0/1941204064 wait complete. 2024-05-20T16:57:17.574 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:17 smithi006 ceph-mon[32486]: [20/May/2024:16:57:16] ENGINE Serving on https://172.21.15.6:7150 2024-05-20T16:57:17.574 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:17 smithi006 ceph-mon[32486]: [20/May/2024:16:57:16] ENGINE Serving on http://172.21.15.6:8765 2024-05-20T16:57:17.574 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:17 smithi006 ceph-mon[32486]: [20/May/2024:16:57:16] ENGINE Bus STARTED 2024-05-20T16:57:17.574 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:17 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:57:17.575 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:17 smithi006 ceph-mon[32486]: mgrmap e8: x(active, since 2s) 2024-05-20T16:57:17.575 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:17 smithi006 ceph-mon[32486]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:57:17.575 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:17 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' 2024-05-20T16:57:17.575 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:17 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:57:18.505 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:18 smithi006 ceph-mon[32486]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:57:18.514 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-20T16:57:18.514 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.617+0000 7f5e8193d700 1 Processor -- start 2024-05-20T16:57:18.514 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.617+0000 7f5e8193d700 1 -- start start 2024-05-20T16:57:18.514 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.617+0000 7f5e8193d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e7c1088d0 0x7f5e7c108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:18.514 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.617+0000 7f5e8193d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c1092d0 con 0x7f5e7c1088d0 2024-05-20T16:57:18.514 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.617+0000 7f5e7affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e7c1088d0 0x7f5e7c108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:18.514 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.618+0000 7f5e7affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e7c1088d0 0x7f5e7c108ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56258/0 (socket says 172.21.15.6:56258) 2024-05-20T16:57:18.514 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.618+0000 7f5e7affd700 1 -- 172.21.15.6:0/2977060226 learned_addr learned my addr 172.21.15.6:0/2977060226 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:18.514 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.618+0000 7f5e7affd700 1 -- 172.21.15.6:0/2977060226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7c109a00 con 0x7f5e7c1088d0 2024-05-20T16:57:18.514 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.618+0000 7f5e7affd700 1 --2- 172.21.15.6:0/2977060226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e7c1088d0 0x7f5e7c108ce0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009e80 tx=0x7f5e6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c25931e7d4b43a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:18.515 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.618+0000 7f5e79ffb700 1 -- 172.21.15.6:0/2977060226 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e6c017070 con 0x7f5e7c1088d0 2024-05-20T16:57:18.515 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.618+0000 7f5e79ffb700 1 -- 172.21.15.6:0/2977060226 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f5e6c00b8c0 con 0x7f5e7c1088d0 2024-05-20T16:57:18.515 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.618+0000 7f5e79ffb700 1 -- 172.21.15.6:0/2977060226 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e6c004520 con 0x7f5e7c1088d0 2024-05-20T16:57:18.515 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.619+0000 7f5e8193d700 1 -- 172.21.15.6:0/2977060226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e7c1088d0 msgr2=0x7f5e7c108ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:18.515 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.619+0000 7f5e8193d700 1 --2- 172.21.15.6:0/2977060226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e7c1088d0 0x7f5e7c108ce0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009e80 tx=0x7f5e6c00b330 comp rx=0 tx=0).stop 2024-05-20T16:57:18.515 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.619+0000 7f5e8193d700 1 -- 172.21.15.6:0/2977060226 shutdown_connections 2024-05-20T16:57:18.515 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.619+0000 7f5e8193d700 1 --2- 172.21.15.6:0/2977060226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e7c1088d0 0x7f5e7c108ce0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:18.515 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.619+0000 7f5e8193d700 1 -- 172.21.15.6:0/2977060226 >> 172.21.15.6:0/2977060226 conn(0x7f5e7c103ff0 msgr2=0x7f5e7c106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:18.515 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.619+0000 7f5e8193d700 1 -- 172.21.15.6:0/2977060226 shutdown_connections 2024-05-20T16:57:18.515 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.619+0000 7f5e8193d700 1 -- 172.21.15.6:0/2977060226 wait complete. 2024-05-20T16:57:18.515 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.620+0000 7f5e8193d700 1 Processor -- start 2024-05-20T16:57:18.515 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.620+0000 7f5e8193d700 1 -- start start 2024-05-20T16:57:18.515 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.620+0000 7f5e8193d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e7c1088d0 0x7f5e7c19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:18.515 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.620+0000 7f5e8193d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c10cdb0 con 0x7f5e7c1088d0 2024-05-20T16:57:18.516 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.620+0000 7f5e7affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e7c1088d0 0x7f5e7c19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:18.516 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.620+0000 7f5e7affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e7c1088d0 0x7f5e7c19cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56260/0 (socket says 172.21.15.6:56260) 2024-05-20T16:57:18.516 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.620+0000 7f5e7affd700 1 -- 172.21.15.6:0/3473267999 learned_addr learned my addr 172.21.15.6:0/3473267999 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:18.516 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.621+0000 7f5e7affd700 1 -- 172.21.15.6:0/3473267999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7c19d180 con 0x7f5e7c1088d0 2024-05-20T16:57:18.516 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.621+0000 7f5e7affd700 1 --2- 172.21.15.6:0/3473267999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e7c1088d0 0x7f5e7c19cc40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009fd0 tx=0x7f5e6c004670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:18.516 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.621+0000 7f5e8093b700 1 -- 172.21.15.6:0/3473267999 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e6c020020 con 0x7f5e7c1088d0 2024-05-20T16:57:18.516 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.621+0000 7f5e8093b700 1 -- 172.21.15.6:0/3473267999 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f5e6c012430 con 0x7f5e7c1088d0 2024-05-20T16:57:18.516 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.621+0000 7f5e8193d700 1 -- 172.21.15.6:0/3473267999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e7c19d410 con 0x7f5e7c1088d0 2024-05-20T16:57:18.516 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.621+0000 7f5e8093b700 1 -- 172.21.15.6:0/3473267999 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e6c017040 con 0x7f5e7c1088d0 2024-05-20T16:57:18.516 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.621+0000 7f5e8193d700 1 -- 172.21.15.6:0/3473267999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e7c1a0020 con 0x7f5e7c1088d0 2024-05-20T16:57:18.516 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.622+0000 7f5e8093b700 1 -- 172.21.15.6:0/3473267999 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f5e6c023020 con 0x7f5e7c1088d0 2024-05-20T16:57:18.516 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.622+0000 7f5e8193d700 1 -- 172.21.15.6:0/3473267999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e7c063ca0 con 0x7f5e7c1088d0 2024-05-20T16:57:18.516 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.622+0000 7f5e8093b700 1 --2- 172.21.15.6:0/3473267999 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f5e68039050 0x7f5e6803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:18.517 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.622+0000 7f5e8093b700 1 -- 172.21.15.6:0/3473267999 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5e6c00f050 con 0x7f5e7c1088d0 2024-05-20T16:57:18.517 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.622+0000 7f5e7a7fc700 1 --2- 172.21.15.6:0/3473267999 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f5e68039050 0x7f5e6803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:18.517 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.623+0000 7f5e7a7fc700 1 --2- 172.21.15.6:0/3473267999 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f5e68039050 0x7f5e6803b560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5e64006fd0 tx=0x7f5e64006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:18.517 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.628+0000 7f5e8093b700 1 -- 172.21.15.6:0/3473267999 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5e6c02a020 con 0x7f5e7c1088d0 2024-05-20T16:57:18.517 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.834+0000 7f5e8193d700 1 -- 172.21.15.6:0/3473267999 --> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f5e7c105fc0 con 0x7f5e68039050 2024-05-20T16:57:18.517 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.835+0000 7f5e8093b700 1 -- 172.21.15.6:0/3473267999 <== mgr.14120 v2:172.21.15.6:6800/3509827796 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f5e7c105fc0 con 0x7f5e68039050 2024-05-20T16:57:18.517 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.837+0000 7f5e8193d700 1 -- 172.21.15.6:0/3473267999 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f5e68039050 msgr2=0x7f5e6803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:18.517 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.837+0000 7f5e8193d700 1 --2- 172.21.15.6:0/3473267999 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f5e68039050 0x7f5e6803b560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5e64006fd0 tx=0x7f5e64006e40 comp rx=0 tx=0).stop 2024-05-20T16:57:18.517 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.837+0000 7f5e8193d700 1 -- 172.21.15.6:0/3473267999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e7c1088d0 msgr2=0x7f5e7c19cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:18.517 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.837+0000 7f5e8193d700 1 --2- 172.21.15.6:0/3473267999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e7c1088d0 0x7f5e7c19cc40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009fd0 tx=0x7f5e6c004670 comp rx=0 tx=0).stop 2024-05-20T16:57:18.517 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.837+0000 7f5e8193d700 1 -- 172.21.15.6:0/3473267999 shutdown_connections 2024-05-20T16:57:18.517 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.837+0000 7f5e8193d700 1 --2- 172.21.15.6:0/3473267999 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f5e68039050 0x7f5e6803b560 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:18.517 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.837+0000 7f5e8193d700 1 --2- 172.21.15.6:0/3473267999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e7c1088d0 0x7f5e7c19cc40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:18.518 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.837+0000 7f5e8193d700 1 -- 172.21.15.6:0/3473267999 >> 172.21.15.6:0/3473267999 conn(0x7f5e7c103ff0 msgr2=0x7f5e7c1058b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:18.518 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.837+0000 7f5e8193d700 1 -- 172.21.15.6:0/3473267999 shutdown_connections 2024-05-20T16:57:18.518 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:17.837+0000 7f5e8193d700 1 -- 172.21.15.6:0/3473267999 wait complete. 2024-05-20T16:57:18.518 INFO:teuthology.orchestra.run.smithi006.stdout:Generating ssh key... 2024-05-20T16:57:19.630 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: Generating public/private rsa key pair. 2024-05-20T16:57:19.630 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: Your identification has been saved in /tmp/tmp32dow136/key. 2024-05-20T16:57:19.631 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: Your public key has been saved in /tmp/tmp32dow136/key.pub. 2024-05-20T16:57:19.631 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: The key fingerprint is: 2024-05-20T16:57:19.631 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: SHA256:XOZ4naxOH8Hi+zz+vf+87EYrho0JwBYW8bejGP6pjzc ceph-c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:57:19.631 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: The key's randomart image is: 2024-05-20T16:57:19.631 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: +---[RSA 3072]----+ 2024-05-20T16:57:19.631 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: | oo | 2024-05-20T16:57:19.631 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: | o. | 2024-05-20T16:57:19.631 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: | o ..o. | 2024-05-20T16:57:19.631 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: | = =.+.. | 2024-05-20T16:57:19.631 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: | ..S +o* | 2024-05-20T16:57:19.631 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: | . o+.o.. . | 2024-05-20T16:57:19.631 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: | o .= * . .| 2024-05-20T16:57:19.631 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: | oE.B.=.= | 2024-05-20T16:57:19.631 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: | o+++o*o==X| 2024-05-20T16:57:19.632 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: +----[SHA256]-----+ 2024-05-20T16:57:19.941 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.944+0000 7f3fcf69a700 1 Processor -- start 2024-05-20T16:57:19.941 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.944+0000 7f3fcf69a700 1 -- start start 2024-05-20T16:57:19.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.944+0000 7f3fcf69a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc81093d0 0x7f3fc810b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:19.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.944+0000 7f3fcf69a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc807c640 con 0x7f3fc81093d0 2024-05-20T16:57:19.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.944+0000 7f3fcd436700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc81093d0 0x7f3fc810b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:19.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.944+0000 7f3fcd436700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc81093d0 0x7f3fc810b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56272/0 (socket says 172.21.15.6:56272) 2024-05-20T16:57:19.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.944+0000 7f3fcd436700 1 -- 172.21.15.6:0/2440314457 learned_addr learned my addr 172.21.15.6:0/2440314457 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:19.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.945+0000 7f3fcd436700 1 -- 172.21.15.6:0/2440314457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc810bd30 con 0x7f3fc81093d0 2024-05-20T16:57:19.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.945+0000 7f3fcd436700 1 --2- 172.21.15.6:0/2440314457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc81093d0 0x7f3fc810b7f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40098a0 tx=0x7f3fc4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33636002b50f4ba server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:19.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.945+0000 7f3fbffff700 1 -- 172.21.15.6:0/2440314457 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc4004160 con 0x7f3fc81093d0 2024-05-20T16:57:19.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.945+0000 7f3fbffff700 1 -- 172.21.15.6:0/2440314457 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f3fc4004300 con 0x7f3fc81093d0 2024-05-20T16:57:19.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.945+0000 7f3fbffff700 1 -- 172.21.15.6:0/2440314457 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc4011a80 con 0x7f3fc81093d0 2024-05-20T16:57:19.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.946+0000 7f3fcf69a700 1 -- 172.21.15.6:0/2440314457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc81093d0 msgr2=0x7f3fc810b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:19.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.946+0000 7f3fcf69a700 1 --2- 172.21.15.6:0/2440314457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc81093d0 0x7f3fc810b7f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40098a0 tx=0x7f3fc4009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:19.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.946+0000 7f3fcf69a700 1 -- 172.21.15.6:0/2440314457 shutdown_connections 2024-05-20T16:57:19.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.946+0000 7f3fcf69a700 1 --2- 172.21.15.6:0/2440314457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc81093d0 0x7f3fc810b7f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:19.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.946+0000 7f3fcf69a700 1 -- 172.21.15.6:0/2440314457 >> 172.21.15.6:0/2440314457 conn(0x7f3fc8102ef0 msgr2=0x7f3fc8105340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:19.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.946+0000 7f3fcf69a700 1 -- 172.21.15.6:0/2440314457 shutdown_connections 2024-05-20T16:57:19.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.946+0000 7f3fcf69a700 1 -- 172.21.15.6:0/2440314457 wait complete. 2024-05-20T16:57:19.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.947+0000 7f3fcf69a700 1 Processor -- start 2024-05-20T16:57:19.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.947+0000 7f3fcf69a700 1 -- start start 2024-05-20T16:57:19.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.947+0000 7f3fcf69a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc81093d0 0x7f3fc819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:19.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.947+0000 7f3fcf69a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc810cc30 con 0x7f3fc81093d0 2024-05-20T16:57:19.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.947+0000 7f3fcd436700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc81093d0 0x7f3fc819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:19.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.947+0000 7f3fcd436700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc81093d0 0x7f3fc819cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56276/0 (socket says 172.21.15.6:56276) 2024-05-20T16:57:19.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.947+0000 7f3fcd436700 1 -- 172.21.15.6:0/2586864655 learned_addr learned my addr 172.21.15.6:0/2586864655 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:19.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.947+0000 7f3fcd436700 1 -- 172.21.15.6:0/2586864655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc819d190 con 0x7f3fc81093d0 2024-05-20T16:57:19.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.948+0000 7f3fcd436700 1 --2- 172.21.15.6:0/2586864655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc81093d0 0x7f3fc819cc50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40116a0 tx=0x7f3fc4011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:19.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.948+0000 7f3fbe7fc700 1 -- 172.21.15.6:0/2586864655 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc40039f0 con 0x7f3fc81093d0 2024-05-20T16:57:19.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.948+0000 7f3fbe7fc700 1 -- 172.21.15.6:0/2586864655 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f3fc4003b90 con 0x7f3fc81093d0 2024-05-20T16:57:19.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.948+0000 7f3fcf69a700 1 -- 172.21.15.6:0/2586864655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc819d420 con 0x7f3fc81093d0 2024-05-20T16:57:19.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.948+0000 7f3fbe7fc700 1 -- 172.21.15.6:0/2586864655 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc4019740 con 0x7f3fc81093d0 2024-05-20T16:57:19.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.948+0000 7f3fcf69a700 1 -- 172.21.15.6:0/2586864655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc81a0030 con 0x7f3fc81093d0 2024-05-20T16:57:19.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.949+0000 7f3fbe7fc700 1 -- 172.21.15.6:0/2586864655 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f3fc40199f0 con 0x7f3fc81093d0 2024-05-20T16:57:19.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.949+0000 7f3fbe7fc700 1 --2- 172.21.15.6:0/2586864655 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f3fb4039050 0x7f3fb403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:19.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.949+0000 7f3fcf69a700 1 -- 172.21.15.6:0/2586864655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fc8063ca0 con 0x7f3fc81093d0 2024-05-20T16:57:19.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.949+0000 7f3fbe7fc700 1 -- 172.21.15.6:0/2586864655 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3fc404d5d0 con 0x7f3fc81093d0 2024-05-20T16:57:19.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.949+0000 7f3fccc35700 1 --2- 172.21.15.6:0/2586864655 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f3fb4039050 0x7f3fb403b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:19.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.950+0000 7f3fccc35700 1 --2- 172.21.15.6:0/2586864655 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f3fb4039050 0x7f3fb403b560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8006fd0 tx=0x7f3fb8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:19.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:18.955+0000 7f3fbe7fc700 1 -- 172.21.15.6:0/2586864655 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3fc4020240 con 0x7f3fc81093d0 2024-05-20T16:57:19.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:19.163+0000 7f3fcf69a700 1 -- 172.21.15.6:0/2586864655 --> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f3fc8104fb0 con 0x7f3fb4039050 2024-05-20T16:57:19.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:19.288+0000 7f3fbe7fc700 1 -- 172.21.15.6:0/2586864655 <== mgr.14120 v2:172.21.15.6:6800/3509827796 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3fc8104fb0 con 0x7f3fb4039050 2024-05-20T16:57:19.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:19.290+0000 7f3fcf69a700 1 -- 172.21.15.6:0/2586864655 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f3fb4039050 msgr2=0x7f3fb403b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:19.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:19.290+0000 7f3fcf69a700 1 --2- 172.21.15.6:0/2586864655 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f3fb4039050 0x7f3fb403b560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8006fd0 tx=0x7f3fb8006e40 comp rx=0 tx=0).stop 2024-05-20T16:57:19.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:19.290+0000 7f3fcf69a700 1 -- 172.21.15.6:0/2586864655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc81093d0 msgr2=0x7f3fc819cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:19.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:19.290+0000 7f3fcf69a700 1 --2- 172.21.15.6:0/2586864655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc81093d0 0x7f3fc819cc50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40116a0 tx=0x7f3fc4011b70 comp rx=0 tx=0).stop 2024-05-20T16:57:19.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:19.290+0000 7f3fcf69a700 1 -- 172.21.15.6:0/2586864655 shutdown_connections 2024-05-20T16:57:19.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:19.290+0000 7f3fcf69a700 1 --2- 172.21.15.6:0/2586864655 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f3fb4039050 0x7f3fb403b560 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:19.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:19.290+0000 7f3fcf69a700 1 --2- 172.21.15.6:0/2586864655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc81093d0 0x7f3fc819cc50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:19.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:19.290+0000 7f3fcf69a700 1 -- 172.21.15.6:0/2586864655 >> 172.21.15.6:0/2586864655 conn(0x7f3fc8102ef0 msgr2=0x7f3fc8104860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:19.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:19.290+0000 7f3fcf69a700 1 -- 172.21.15.6:0/2586864655 shutdown_connections 2024-05-20T16:57:19.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:19.290+0000 7f3fcf69a700 1 -- 172.21.15.6:0/2586864655 wait complete. 2024-05-20T16:57:20.587 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:20 smithi006 ceph-mon[32486]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:57:20.587 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:20 smithi006 ceph-mon[32486]: Generating ssh key... 2024-05-20T16:57:20.587 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:20 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' 2024-05-20T16:57:20.587 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:20 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' 2024-05-20T16:57:21.173 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC38NkjrdOvxcl9qXYFu3Qytou3HhC+K39Wo4gnz001UZySSXab2nnIzLQiGOR5kShYSScmcTal43b6NA8N3G5RQNm0nG/fWC3dfPnPDc7Wz1wQD3zjpDtiPfZlI/xt1NVpZOuWJxwKwaTIpm+KKMcUI5KdT+eOj/xxSY3c4z5+87nJohKvT9byIgp+Mp3j1f/EkAxtf86PRjJYvhbLzeof3oBQg8olsodj0KQam9zFX5cz+xgHKlymlJ4JmUQ0IzNDh0vs/NkiwiiBEXUnVsKU/GLZJ313IM4uloupAWGjJhp0cgUOaknHua28fE64xPZ4Gi9GiLvfLJCi6AIMIFKdSyoaIsy5OyK7vLfDNHCNJx8T4db+hHiiTOTDZoP4/9G+9wJCFEPAyvEdQI4pHcQKfODvIjqksbGWpoy8TXPpP3cfB5ei6ArGOr2iy6msPbwv3CLZyagRadVOJqReW7DlDAnz9V898nawohZpiOVxakBb0gnS+7VQRGkf5l6g/4c= ceph-c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:57:21.173 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.368+0000 7fc4e3359700 1 Processor -- start 2024-05-20T16:57:21.173 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.368+0000 7fc4e3359700 1 -- start start 2024-05-20T16:57:21.173 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.368+0000 7fc4e3359700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4dc1077f0 0x7fc4dc107c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:21.173 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.368+0000 7fc4e3359700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc4dc1081f0 con 0x7fc4dc1077f0 2024-05-20T16:57:21.173 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.369+0000 7fc4e10f5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4dc1077f0 0x7fc4dc107c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:21.174 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.369+0000 7fc4e10f5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4dc1077f0 0x7fc4dc107c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56284/0 (socket says 172.21.15.6:56284) 2024-05-20T16:57:21.174 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.369+0000 7fc4e10f5700 1 -- 172.21.15.6:0/2084420570 learned_addr learned my addr 172.21.15.6:0/2084420570 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:21.174 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.369+0000 7fc4e10f5700 1 -- 172.21.15.6:0/2084420570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4dc108920 con 0x7fc4dc1077f0 2024-05-20T16:57:21.174 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.369+0000 7fc4e10f5700 1 --2- 172.21.15.6:0/2084420570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4dc1077f0 0x7fc4dc107c00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80098a0 tx=0x7fc4d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bdf76dcc888bb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:21.174 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.369+0000 7fc4cffff700 1 -- 172.21.15.6:0/2084420570 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4d8004160 con 0x7fc4dc1077f0 2024-05-20T16:57:21.174 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.369+0000 7fc4cffff700 1 -- 172.21.15.6:0/2084420570 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fc4d8004300 con 0x7fc4dc1077f0 2024-05-20T16:57:21.174 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.369+0000 7fc4cffff700 1 -- 172.21.15.6:0/2084420570 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4d8011a80 con 0x7fc4dc1077f0 2024-05-20T16:57:21.174 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.370+0000 7fc4e3359700 1 -- 172.21.15.6:0/2084420570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4dc1077f0 msgr2=0x7fc4dc107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:21.174 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.370+0000 7fc4e3359700 1 --2- 172.21.15.6:0/2084420570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4dc1077f0 0x7fc4dc107c00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80098a0 tx=0x7fc4d8009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:21.174 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.370+0000 7fc4e3359700 1 -- 172.21.15.6:0/2084420570 shutdown_connections 2024-05-20T16:57:21.175 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.370+0000 7fc4e3359700 1 --2- 172.21.15.6:0/2084420570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4dc1077f0 0x7fc4dc107c00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:21.175 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.370+0000 7fc4e3359700 1 -- 172.21.15.6:0/2084420570 >> 172.21.15.6:0/2084420570 conn(0x7fc4dc102ef0 msgr2=0x7fc4dc105340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:21.175 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.370+0000 7fc4e3359700 1 -- 172.21.15.6:0/2084420570 shutdown_connections 2024-05-20T16:57:21.175 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.370+0000 7fc4e3359700 1 -- 172.21.15.6:0/2084420570 wait complete. 2024-05-20T16:57:21.175 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.371+0000 7fc4e3359700 1 Processor -- start 2024-05-20T16:57:21.175 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.371+0000 7fc4e3359700 1 -- start start 2024-05-20T16:57:21.175 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.371+0000 7fc4e3359700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4dc1077f0 0x7fc4dc106050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:21.175 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.371+0000 7fc4e3359700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc4dc10bcd0 con 0x7fc4dc1077f0 2024-05-20T16:57:21.175 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.371+0000 7fc4e10f5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4dc1077f0 0x7fc4dc106050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:21.175 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.371+0000 7fc4e10f5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4dc1077f0 0x7fc4dc106050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56298/0 (socket says 172.21.15.6:56298) 2024-05-20T16:57:21.175 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.371+0000 7fc4e10f5700 1 -- 172.21.15.6:0/3879064792 learned_addr learned my addr 172.21.15.6:0/3879064792 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:21.175 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.372+0000 7fc4e10f5700 1 -- 172.21.15.6:0/3879064792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4dc106590 con 0x7fc4dc1077f0 2024-05-20T16:57:21.175 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.372+0000 7fc4e10f5700 1 --2- 172.21.15.6:0/3879064792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4dc1077f0 0x7fc4dc106050 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8011a50 tx=0x7fc4d8011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:21.176 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.372+0000 7fc4ce7fc700 1 -- 172.21.15.6:0/3879064792 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4d8003970 con 0x7fc4dc1077f0 2024-05-20T16:57:21.176 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.372+0000 7fc4ce7fc700 1 -- 172.21.15.6:0/3879064792 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fc4d8003b10 con 0x7fc4dc1077f0 2024-05-20T16:57:21.176 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.372+0000 7fc4e3359700 1 -- 172.21.15.6:0/3879064792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4dc1047e0 con 0x7fc4dc1077f0 2024-05-20T16:57:21.176 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.372+0000 7fc4ce7fc700 1 -- 172.21.15.6:0/3879064792 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4d8024580 con 0x7fc4dc1077f0 2024-05-20T16:57:21.176 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.372+0000 7fc4e3359700 1 -- 172.21.15.6:0/3879064792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4dc104cc0 con 0x7fc4dc1077f0 2024-05-20T16:57:21.176 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.373+0000 7fc4ce7fc700 1 -- 172.21.15.6:0/3879064792 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fc4d802d3f0 con 0x7fc4dc1077f0 2024-05-20T16:57:21.176 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.373+0000 7fc4e3359700 1 -- 172.21.15.6:0/3879064792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4dc063ca0 con 0x7fc4dc1077f0 2024-05-20T16:57:21.176 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.373+0000 7fc4ce7fc700 1 --2- 172.21.15.6:0/3879064792 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fc4c80390a0 0x7fc4c803b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:21.176 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.373+0000 7fc4ce7fc700 1 -- 172.21.15.6:0/3879064792 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc4d804d2b0 con 0x7fc4dc1077f0 2024-05-20T16:57:21.176 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.373+0000 7fc4e08f4700 1 --2- 172.21.15.6:0/3879064792 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fc4c80390a0 0x7fc4c803b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:21.176 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.374+0000 7fc4e08f4700 1 --2- 172.21.15.6:0/3879064792 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fc4c80390a0 0x7fc4c803b5b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0006fd0 tx=0x7fc4d0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:21.176 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.379+0000 7fc4ce7fc700 1 -- 172.21.15.6:0/3879064792 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc4d800e260 con 0x7fc4dc1077f0 2024-05-20T16:57:21.176 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.587+0000 7fc4e3359700 1 -- 172.21.15.6:0/3879064792 --> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fc4dc195ee0 con 0x7fc4c80390a0 2024-05-20T16:57:21.176 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.587+0000 7fc4ce7fc700 1 -- 172.21.15.6:0/3879064792 <== mgr.14120 v2:172.21.15.6:6800/3509827796 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fc4dc195ee0 con 0x7fc4c80390a0 2024-05-20T16:57:21.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.591+0000 7fc4e3359700 1 -- 172.21.15.6:0/3879064792 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fc4c80390a0 msgr2=0x7fc4c803b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:21.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.591+0000 7fc4e3359700 1 --2- 172.21.15.6:0/3879064792 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fc4c80390a0 0x7fc4c803b5b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0006fd0 tx=0x7fc4d0006e40 comp rx=0 tx=0).stop 2024-05-20T16:57:21.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.591+0000 7fc4e3359700 1 -- 172.21.15.6:0/3879064792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4dc1077f0 msgr2=0x7fc4dc106050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:21.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.591+0000 7fc4e3359700 1 --2- 172.21.15.6:0/3879064792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4dc1077f0 0x7fc4dc106050 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8011a50 tx=0x7fc4d8011b30 comp rx=0 tx=0).stop 2024-05-20T16:57:21.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.591+0000 7fc4e3359700 1 -- 172.21.15.6:0/3879064792 shutdown_connections 2024-05-20T16:57:21.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.591+0000 7fc4e3359700 1 --2- 172.21.15.6:0/3879064792 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fc4c80390a0 0x7fc4c803b5b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:21.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.591+0000 7fc4e3359700 1 --2- 172.21.15.6:0/3879064792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4dc1077f0 0x7fc4dc106050 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:21.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.591+0000 7fc4e3359700 1 -- 172.21.15.6:0/3879064792 >> 172.21.15.6:0/3879064792 conn(0x7fc4dc102ef0 msgr2=0x7fc4dc193250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:21.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.591+0000 7fc4e3359700 1 -- 172.21.15.6:0/3879064792 shutdown_connections 2024-05-20T16:57:21.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:20.591+0000 7fc4e3359700 1 -- 172.21.15.6:0/3879064792 wait complete. 2024-05-20T16:57:21.177 INFO:teuthology.orchestra.run.smithi006.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-20T16:57:21.177 INFO:teuthology.orchestra.run.smithi006.stdout:Adding key to root@localhost authorized_keys... 2024-05-20T16:57:21.177 INFO:teuthology.orchestra.run.smithi006.stdout:Adding host smithi006... 2024-05-20T16:57:21.476 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:21 smithi006 ceph-mon[32486]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:57:22.458 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:22 smithi006 ceph-mon[32486]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi006", "addr": "172.21.15.6", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:57:23.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:23 smithi006 ceph-mon[32486]: Deploying cephadm binary to smithi006 2024-05-20T16:57:26.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout Added host 'smithi006' with addr '172.21.15.6' 2024-05-20T16:57:26.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.602+0000 7f2d1540d700 1 Processor -- start 2024-05-20T16:57:26.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.602+0000 7f2d1540d700 1 -- start start 2024-05-20T16:57:26.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.602+0000 7f2d1540d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d1007bc60 0x7f2d1010b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:26.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.602+0000 7f2d1540d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1010b9f0 con 0x7f2d1007bc60 2024-05-20T16:57:26.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.603+0000 7f2d0effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d1007bc60 0x7f2d1010b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:26.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.603+0000 7f2d0effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d1007bc60 0x7f2d1010b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56746/0 (socket says 172.21.15.6:56746) 2024-05-20T16:57:26.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.603+0000 7f2d0effd700 1 -- 172.21.15.6:0/1410905694 learned_addr learned my addr 172.21.15.6:0/1410905694 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:26.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.603+0000 7f2d0effd700 1 -- 172.21.15.6:0/1410905694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d1010bb70 con 0x7f2d1007bc60 2024-05-20T16:57:26.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.603+0000 7f2d0effd700 1 --2- 172.21.15.6:0/1410905694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d1007bc60 0x7f2d1010b420 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2d000098a0 tx=0x7f2d00009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdace615cdba941c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:26.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.603+0000 7f2d0dffb700 1 -- 172.21.15.6:0/1410905694 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d00004160 con 0x7f2d1007bc60 2024-05-20T16:57:26.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.603+0000 7f2d0dffb700 1 -- 172.21.15.6:0/1410905694 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f2d00004300 con 0x7f2d1007bc60 2024-05-20T16:57:26.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.603+0000 7f2d0dffb700 1 -- 172.21.15.6:0/1410905694 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d00011a80 con 0x7f2d1007bc60 2024-05-20T16:57:26.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.604+0000 7f2d1540d700 1 -- 172.21.15.6:0/1410905694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d1007bc60 msgr2=0x7f2d1010b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:26.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.604+0000 7f2d1540d700 1 --2- 172.21.15.6:0/1410905694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d1007bc60 0x7f2d1010b420 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2d000098a0 tx=0x7f2d00009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:26.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.604+0000 7f2d1540d700 1 -- 172.21.15.6:0/1410905694 shutdown_connections 2024-05-20T16:57:26.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.604+0000 7f2d1540d700 1 --2- 172.21.15.6:0/1410905694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d1007bc60 0x7f2d1010b420 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:26.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.604+0000 7f2d1540d700 1 -- 172.21.15.6:0/1410905694 >> 172.21.15.6:0/1410905694 conn(0x7f2d10102df0 msgr2=0x7f2d101052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:26.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.604+0000 7f2d1540d700 1 -- 172.21.15.6:0/1410905694 shutdown_connections 2024-05-20T16:57:26.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.604+0000 7f2d1540d700 1 -- 172.21.15.6:0/1410905694 wait complete. 2024-05-20T16:57:26.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.605+0000 7f2d1540d700 1 Processor -- start 2024-05-20T16:57:26.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.605+0000 7f2d1540d700 1 -- start start 2024-05-20T16:57:26.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.605+0000 7f2d1540d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d1007bc60 0x7f2d1019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:26.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.605+0000 7f2d1540d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1010cbf0 con 0x7f2d1007bc60 2024-05-20T16:57:26.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.605+0000 7f2d0effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d1007bc60 0x7f2d1019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:26.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.605+0000 7f2d0effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d1007bc60 0x7f2d1019cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56748/0 (socket says 172.21.15.6:56748) 2024-05-20T16:57:26.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.605+0000 7f2d0effd700 1 -- 172.21.15.6:0/2030711518 learned_addr learned my addr 172.21.15.6:0/2030711518 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:26.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.606+0000 7f2d0effd700 1 -- 172.21.15.6:0/2030711518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d1019d180 con 0x7f2d1007bc60 2024-05-20T16:57:26.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.606+0000 7f2d0effd700 1 --2- 172.21.15.6:0/2030711518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d1007bc60 0x7f2d1019cc40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d000116a0 tx=0x7f2d00011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:26.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.606+0000 7f2cf7fff700 1 -- 172.21.15.6:0/2030711518 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d000039f0 con 0x7f2d1007bc60 2024-05-20T16:57:26.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.606+0000 7f2cf7fff700 1 -- 172.21.15.6:0/2030711518 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f2d00003b90 con 0x7f2d1007bc60 2024-05-20T16:57:26.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.606+0000 7f2cf7fff700 1 -- 172.21.15.6:0/2030711518 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d00019760 con 0x7f2d1007bc60 2024-05-20T16:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.606+0000 7f2d1540d700 1 -- 172.21.15.6:0/2030711518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d1019d410 con 0x7f2d1007bc60 2024-05-20T16:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.606+0000 7f2d1540d700 1 -- 172.21.15.6:0/2030711518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d101a0020 con 0x7f2d1007bc60 2024-05-20T16:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.607+0000 7f2cf7fff700 1 -- 172.21.15.6:0/2030711518 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f2d00019a60 con 0x7f2d1007bc60 2024-05-20T16:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.607+0000 7f2d1540d700 1 -- 172.21.15.6:0/2030711518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d10063ca0 con 0x7f2d1007bc60 2024-05-20T16:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.607+0000 7f2cf7fff700 1 --2- 172.21.15.6:0/2030711518 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f2cf8039000 0x7f2cf803b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.607+0000 7f2cf7fff700 1 -- 172.21.15.6:0/2030711518 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2d0004d580 con 0x7f2d1007bc60 2024-05-20T16:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.607+0000 7f2d0e7fc700 1 --2- 172.21.15.6:0/2030711518 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f2cf8039000 0x7f2cf803b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.608+0000 7f2d0e7fc700 1 --2- 172.21.15.6:0/2030711518 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f2cf8039000 0x7f2cf803b510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2d04006fd0 tx=0x7f2d04006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.613+0000 7f2cf7fff700 1 -- 172.21.15.6:0/2030711518 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2d0000fda0 con 0x7f2d1007bc60 2024-05-20T16:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:21.822+0000 7f2d1540d700 1 -- 172.21.15.6:0/2030711518 --> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi006", "addr": "172.21.15.6", "target": ["mon-mgr", ""]}) -- 0x7f2d101a01f0 con 0x7f2cf8039000 2024-05-20T16:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:26.064+0000 7f2cf7fff700 1 -- 172.21.15.6:0/2030711518 <== mgr.14120 v2:172.21.15.6:6800/3509827796 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f2d101a01f0 con 0x7f2cf8039000 2024-05-20T16:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:26.066+0000 7f2d1540d700 1 -- 172.21.15.6:0/2030711518 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f2cf8039000 msgr2=0x7f2cf803b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:26.066+0000 7f2d1540d700 1 --2- 172.21.15.6:0/2030711518 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f2cf8039000 0x7f2cf803b510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2d04006fd0 tx=0x7f2d04006e40 comp rx=0 tx=0).stop 2024-05-20T16:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:26.066+0000 7f2d1540d700 1 -- 172.21.15.6:0/2030711518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d1007bc60 msgr2=0x7f2d1019cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:26.066+0000 7f2d1540d700 1 --2- 172.21.15.6:0/2030711518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d1007bc60 0x7f2d1019cc40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d000116a0 tx=0x7f2d00011b70 comp rx=0 tx=0).stop 2024-05-20T16:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:26.066+0000 7f2d1540d700 1 -- 172.21.15.6:0/2030711518 shutdown_connections 2024-05-20T16:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:26.067+0000 7f2d1540d700 1 --2- 172.21.15.6:0/2030711518 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f2cf8039000 0x7f2cf803b510 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:26.067+0000 7f2d1540d700 1 --2- 172.21.15.6:0/2030711518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d1007bc60 0x7f2d1019cc40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:26.067+0000 7f2d1540d700 1 -- 172.21.15.6:0/2030711518 >> 172.21.15.6:0/2030711518 conn(0x7f2d10102df0 msgr2=0x7f2d10103730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:26.067+0000 7f2d1540d700 1 -- 172.21.15.6:0/2030711518 shutdown_connections 2024-05-20T16:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:26.067+0000 7f2d1540d700 1 -- 172.21.15.6:0/2030711518 wait complete. 2024-05-20T16:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout:Deploying unmanaged mon service... 2024-05-20T16:57:27.254 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:27 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' 2024-05-20T16:57:27.254 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:27 smithi006 ceph-mon[32486]: Added host smithi006 2024-05-20T16:57:27.254 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:27 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:57:28.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-20T16:57:28.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.253+0000 7fabae5cb700 1 Processor -- start 2024-05-20T16:57:28.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.254+0000 7fabae5cb700 1 -- start start 2024-05-20T16:57:28.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.254+0000 7fabae5cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba807bc80 0x7faba810b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:28.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.254+0000 7fabae5cb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faba810b9f0 con 0x7faba807bc80 2024-05-20T16:57:28.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.254+0000 7faba7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba807bc80 0x7faba810b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:28.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.254+0000 7faba7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba807bc80 0x7faba810b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56762/0 (socket says 172.21.15.6:56762) 2024-05-20T16:57:28.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.254+0000 7faba7fff700 1 -- 172.21.15.6:0/462797714 learned_addr learned my addr 172.21.15.6:0/462797714 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:28.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.254+0000 7faba7fff700 1 -- 172.21.15.6:0/462797714 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba810bb70 con 0x7faba807bc80 2024-05-20T16:57:28.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.255+0000 7faba7fff700 1 --2- 172.21.15.6:0/462797714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba807bc80 0x7faba810b400 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fab980098a0 tx=0x7fab98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77514482138e1636 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:28.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.255+0000 7faba77fe700 1 -- 172.21.15.6:0/462797714 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab98004160 con 0x7faba807bc80 2024-05-20T16:57:28.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.255+0000 7faba77fe700 1 -- 172.21.15.6:0/462797714 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fab98004300 con 0x7faba807bc80 2024-05-20T16:57:28.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.255+0000 7faba77fe700 1 -- 172.21.15.6:0/462797714 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab98011a80 con 0x7faba807bc80 2024-05-20T16:57:28.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.255+0000 7fabae5cb700 1 -- 172.21.15.6:0/462797714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba807bc80 msgr2=0x7faba810b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:28.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.255+0000 7fabae5cb700 1 --2- 172.21.15.6:0/462797714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba807bc80 0x7faba810b400 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fab980098a0 tx=0x7fab98009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:28.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.256+0000 7fabae5cb700 1 -- 172.21.15.6:0/462797714 shutdown_connections 2024-05-20T16:57:28.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.256+0000 7fabae5cb700 1 --2- 172.21.15.6:0/462797714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba807bc80 0x7faba810b400 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:28.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.256+0000 7fabae5cb700 1 -- 172.21.15.6:0/462797714 >> 172.21.15.6:0/462797714 conn(0x7faba8102df0 msgr2=0x7faba81052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:28.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.256+0000 7fabae5cb700 1 -- 172.21.15.6:0/462797714 shutdown_connections 2024-05-20T16:57:28.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.256+0000 7fabae5cb700 1 -- 172.21.15.6:0/462797714 wait complete. 2024-05-20T16:57:28.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.256+0000 7fabae5cb700 1 Processor -- start 2024-05-20T16:57:28.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.256+0000 7fabae5cb700 1 -- start start 2024-05-20T16:57:28.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.257+0000 7fabae5cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba807bc80 0x7faba819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:28.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.257+0000 7fabae5cb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faba810cbf0 con 0x7faba807bc80 2024-05-20T16:57:28.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.257+0000 7faba7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba807bc80 0x7faba819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:28.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.257+0000 7faba7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba807bc80 0x7faba819cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56774/0 (socket says 172.21.15.6:56774) 2024-05-20T16:57:28.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.257+0000 7faba7fff700 1 -- 172.21.15.6:0/2142430499 learned_addr learned my addr 172.21.15.6:0/2142430499 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:28.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.257+0000 7faba7fff700 1 -- 172.21.15.6:0/2142430499 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba819d150 con 0x7faba807bc80 2024-05-20T16:57:28.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.257+0000 7faba7fff700 1 --2- 172.21.15.6:0/2142430499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba807bc80 0x7faba819cc10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fab98006af0 tx=0x7fab98011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:28.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.257+0000 7faba5ffb700 1 -- 172.21.15.6:0/2142430499 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab98003a60 con 0x7faba807bc80 2024-05-20T16:57:28.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.257+0000 7faba5ffb700 1 -- 172.21.15.6:0/2142430499 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fab98003c00 con 0x7faba807bc80 2024-05-20T16:57:28.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.257+0000 7fabae5cb700 1 -- 172.21.15.6:0/2142430499 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba819d3e0 con 0x7faba807bc80 2024-05-20T16:57:28.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.257+0000 7faba5ffb700 1 -- 172.21.15.6:0/2142430499 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab98019750 con 0x7faba807bc80 2024-05-20T16:57:28.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.258+0000 7fabae5cb700 1 -- 172.21.15.6:0/2142430499 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faba819fff0 con 0x7faba807bc80 2024-05-20T16:57:28.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.258+0000 7fabae5cb700 1 -- 172.21.15.6:0/2142430499 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faba8063ca0 con 0x7faba807bc80 2024-05-20T16:57:28.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.258+0000 7faba5ffb700 1 -- 172.21.15.6:0/2142430499 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fab98022020 con 0x7faba807bc80 2024-05-20T16:57:28.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.259+0000 7faba5ffb700 1 --2- 172.21.15.6:0/2142430499 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fab94039050 0x7fab9403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:28.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.259+0000 7faba5ffb700 1 -- 172.21.15.6:0/2142430499 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fab9804d330 con 0x7faba807bc80 2024-05-20T16:57:28.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.259+0000 7fab9ffff700 1 --2- 172.21.15.6:0/2142430499 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fab94039050 0x7fab9403b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:28.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.259+0000 7fab9ffff700 1 --2- 172.21.15.6:0/2142430499 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fab94039050 0x7fab9403b560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fab90006fd0 tx=0x7fab90006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:28.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.264+0000 7faba5ffb700 1 -- 172.21.15.6:0/2142430499 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fab98020e80 con 0x7faba807bc80 2024-05-20T16:57:28.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.491+0000 7fabae5cb700 1 -- 172.21.15.6:0/2142430499 --> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7faba8103e70 con 0x7fab94039050 2024-05-20T16:57:28.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.499+0000 7faba5ffb700 1 -- 172.21.15.6:0/2142430499 <== mgr.14120 v2:172.21.15.6:6800/3509827796 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7faba8103e70 con 0x7fab94039050 2024-05-20T16:57:28.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.501+0000 7fabae5cb700 1 -- 172.21.15.6:0/2142430499 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fab94039050 msgr2=0x7fab9403b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:28.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.501+0000 7fabae5cb700 1 --2- 172.21.15.6:0/2142430499 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fab94039050 0x7fab9403b560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fab90006fd0 tx=0x7fab90006e40 comp rx=0 tx=0).stop 2024-05-20T16:57:28.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.501+0000 7fabae5cb700 1 -- 172.21.15.6:0/2142430499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba807bc80 msgr2=0x7faba819cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:28.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.501+0000 7fabae5cb700 1 --2- 172.21.15.6:0/2142430499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba807bc80 0x7faba819cc10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fab98006af0 tx=0x7fab98011ae0 comp rx=0 tx=0).stop 2024-05-20T16:57:28.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.501+0000 7fabae5cb700 1 -- 172.21.15.6:0/2142430499 shutdown_connections 2024-05-20T16:57:28.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.501+0000 7fabae5cb700 1 --2- 172.21.15.6:0/2142430499 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fab94039050 0x7fab9403b560 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:28.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.501+0000 7fabae5cb700 1 --2- 172.21.15.6:0/2142430499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba807bc80 0x7faba819cc10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:28.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.501+0000 7fabae5cb700 1 -- 172.21.15.6:0/2142430499 >> 172.21.15.6:0/2142430499 conn(0x7faba8102df0 msgr2=0x7faba8103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:28.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.501+0000 7fabae5cb700 1 -- 172.21.15.6:0/2142430499 shutdown_connections 2024-05-20T16:57:28.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:27.501+0000 7fabae5cb700 1 -- 172.21.15.6:0/2142430499 wait complete. 2024-05-20T16:57:28.180 INFO:teuthology.orchestra.run.smithi006.stdout:Deploying unmanaged mgr service... 2024-05-20T16:57:28.853 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:28 smithi006 ceph-mon[32486]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:57:28.853 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:28 smithi006 ceph-mon[32486]: Saving service mon spec with placement count:5 2024-05-20T16:57:28.853 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:28 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' 2024-05-20T16:57:30.514 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:30 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' 2024-05-20T16:57:30.514 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:30 smithi006 ceph-mon[32486]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:57:30.514 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:30 smithi006 ceph-mon[32486]: Saving service mgr spec with placement count:2 2024-05-20T16:57:30.514 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:30 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' 2024-05-20T16:57:30.514 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:30 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' 2024-05-20T16:57:30.521 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-20T16:57:30.521 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.488+0000 7f027bca7700 1 Processor -- start 2024-05-20T16:57:30.521 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.488+0000 7f027bca7700 1 -- start start 2024-05-20T16:57:30.521 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.488+0000 7f027bca7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02741089e0 0x7f0274108df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:30.522 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.488+0000 7f027bca7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f02741093e0 con 0x7f02741089e0 2024-05-20T16:57:30.522 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.489+0000 7f0279a43700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02741089e0 0x7f0274108df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:30.522 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.489+0000 7f0279a43700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02741089e0 0x7f0274108df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56790/0 (socket says 172.21.15.6:56790) 2024-05-20T16:57:30.522 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.489+0000 7f0279a43700 1 -- 172.21.15.6:0/745123354 learned_addr learned my addr 172.21.15.6:0/745123354 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:30.522 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.489+0000 7f0279a43700 1 -- 172.21.15.6:0/745123354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0274109b10 con 0x7f02741089e0 2024-05-20T16:57:30.522 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.489+0000 7f0279a43700 1 --2- 172.21.15.6:0/745123354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02741089e0 0x7f0274108df0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f02700098a0 tx=0x7f0270009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e6a18367514d80 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:30.522 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.490+0000 7f0278a41700 1 -- 172.21.15.6:0/745123354 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0270004160 con 0x7f02741089e0 2024-05-20T16:57:30.522 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.490+0000 7f0278a41700 1 -- 172.21.15.6:0/745123354 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0270004300 con 0x7f02741089e0 2024-05-20T16:57:30.522 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.490+0000 7f0278a41700 1 -- 172.21.15.6:0/745123354 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0270011a50 con 0x7f02741089e0 2024-05-20T16:57:30.522 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.491+0000 7f027bca7700 1 -- 172.21.15.6:0/745123354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02741089e0 msgr2=0x7f0274108df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:30.522 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.491+0000 7f027bca7700 1 --2- 172.21.15.6:0/745123354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02741089e0 0x7f0274108df0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f02700098a0 tx=0x7f0270009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:30.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.491+0000 7f027bca7700 1 -- 172.21.15.6:0/745123354 shutdown_connections 2024-05-20T16:57:30.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.491+0000 7f027bca7700 1 --2- 172.21.15.6:0/745123354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02741089e0 0x7f0274108df0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:30.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.491+0000 7f027bca7700 1 -- 172.21.15.6:0/745123354 >> 172.21.15.6:0/745123354 conn(0x7f0274104080 msgr2=0x7f02741064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:30.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.491+0000 7f027bca7700 1 -- 172.21.15.6:0/745123354 shutdown_connections 2024-05-20T16:57:30.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.491+0000 7f027bca7700 1 -- 172.21.15.6:0/745123354 wait complete. 2024-05-20T16:57:30.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.492+0000 7f027bca7700 1 Processor -- start 2024-05-20T16:57:30.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.492+0000 7f027bca7700 1 -- start start 2024-05-20T16:57:30.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.492+0000 7f027bca7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02741089e0 0x7f027419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:30.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.492+0000 7f027bca7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f027410cec0 con 0x7f02741089e0 2024-05-20T16:57:30.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.493+0000 7f0279a43700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02741089e0 0x7f027419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:30.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.493+0000 7f0279a43700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02741089e0 0x7f027419cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56806/0 (socket says 172.21.15.6:56806) 2024-05-20T16:57:30.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.493+0000 7f0279a43700 1 -- 172.21.15.6:0/1104230591 learned_addr learned my addr 172.21.15.6:0/1104230591 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:30.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.493+0000 7f0279a43700 1 -- 172.21.15.6:0/1104230591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027419d250 con 0x7f02741089e0 2024-05-20T16:57:30.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.493+0000 7f0279a43700 1 --2- 172.21.15.6:0/1104230591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02741089e0 0x7f027419cd10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0270011a20 tx=0x7f0270011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:30.524 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.493+0000 7f026affd700 1 -- 172.21.15.6:0/1104230591 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02700038b0 con 0x7f02741089e0 2024-05-20T16:57:30.524 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.493+0000 7f026affd700 1 -- 172.21.15.6:0/1104230591 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0270003a50 con 0x7f02741089e0 2024-05-20T16:57:30.524 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.493+0000 7f027bca7700 1 -- 172.21.15.6:0/1104230591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f027419d4e0 con 0x7f02741089e0 2024-05-20T16:57:30.524 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.494+0000 7f026affd700 1 -- 172.21.15.6:0/1104230591 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0270024610 con 0x7f02741089e0 2024-05-20T16:57:30.524 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.494+0000 7f027bca7700 1 -- 172.21.15.6:0/1104230591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f027419d900 con 0x7f02741089e0 2024-05-20T16:57:30.524 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.494+0000 7f026affd700 1 -- 172.21.15.6:0/1104230591 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f02700193c0 con 0x7f02741089e0 2024-05-20T16:57:30.524 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.495+0000 7f026affd700 1 --2- 172.21.15.6:0/1104230591 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f02600390a0 0x7f026003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:30.524 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.495+0000 7f026affd700 1 -- 172.21.15.6:0/1104230591 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f027001a840 con 0x7f02741089e0 2024-05-20T16:57:30.524 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.495+0000 7f0279242700 1 --2- 172.21.15.6:0/1104230591 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f02600390a0 0x7f026003b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:30.524 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.495+0000 7f027bca7700 1 -- 172.21.15.6:0/1104230591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0274063ca0 con 0x7f02741089e0 2024-05-20T16:57:30.524 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.495+0000 7f0279242700 1 --2- 172.21.15.6:0/1104230591 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f02600390a0 0x7f026003b5b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0264006fd0 tx=0x7f0264006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:30.524 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.501+0000 7f026affd700 1 -- 172.21.15.6:0/1104230591 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0270010380 con 0x7f02741089e0 2024-05-20T16:57:30.524 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.743+0000 7f027bca7700 1 -- 172.21.15.6:0/1104230591 --> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f02741a01a0 con 0x7f02600390a0 2024-05-20T16:57:30.524 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.751+0000 7f026affd700 1 -- 172.21.15.6:0/1104230591 <== mgr.14120 v2:172.21.15.6:6800/3509827796 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f02741a01a0 con 0x7f02600390a0 2024-05-20T16:57:30.525 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.753+0000 7f027bca7700 1 -- 172.21.15.6:0/1104230591 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f02600390a0 msgr2=0x7f026003b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:30.525 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.753+0000 7f027bca7700 1 --2- 172.21.15.6:0/1104230591 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f02600390a0 0x7f026003b5b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0264006fd0 tx=0x7f0264006e40 comp rx=0 tx=0).stop 2024-05-20T16:57:30.525 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.753+0000 7f027bca7700 1 -- 172.21.15.6:0/1104230591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02741089e0 msgr2=0x7f027419cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:30.525 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.753+0000 7f027bca7700 1 --2- 172.21.15.6:0/1104230591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02741089e0 0x7f027419cd10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0270011a20 tx=0x7f0270011b00 comp rx=0 tx=0).stop 2024-05-20T16:57:30.525 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.753+0000 7f027bca7700 1 -- 172.21.15.6:0/1104230591 shutdown_connections 2024-05-20T16:57:30.525 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.753+0000 7f027bca7700 1 --2- 172.21.15.6:0/1104230591 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f02600390a0 0x7f026003b5b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:30.525 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.753+0000 7f027bca7700 1 --2- 172.21.15.6:0/1104230591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02741089e0 0x7f027419cd10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:30.525 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.753+0000 7f027bca7700 1 -- 172.21.15.6:0/1104230591 >> 172.21.15.6:0/1104230591 conn(0x7f0274104080 msgr2=0x7f0274104860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:30.525 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.754+0000 7f027bca7700 1 -- 172.21.15.6:0/1104230591 shutdown_connections 2024-05-20T16:57:30.525 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:29.754+0000 7f027bca7700 1 -- 172.21.15.6:0/1104230591 wait complete. 2024-05-20T16:57:31.988 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.945+0000 7f0c31a0a700 1 Processor -- start 2024-05-20T16:57:31.989 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.945+0000 7f0c31a0a700 1 -- start start 2024-05-20T16:57:31.989 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.946+0000 7f0c31a0a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2c1077b0 0x7f0c2c107bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:31.989 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.946+0000 7f0c31a0a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c1081b0 con 0x7f0c2c1077b0 2024-05-20T16:57:31.989 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.946+0000 7f0c2affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2c1077b0 0x7f0c2c107bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:31.989 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.946+0000 7f0c2affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2c1077b0 0x7f0c2c107bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54196/0 (socket says 172.21.15.6:54196) 2024-05-20T16:57:31.989 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.946+0000 7f0c2affd700 1 -- 172.21.15.6:0/3759381921 learned_addr learned my addr 172.21.15.6:0/3759381921 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:31.989 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.946+0000 7f0c2affd700 1 -- 172.21.15.6:0/3759381921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c1088e0 con 0x7f0c2c1077b0 2024-05-20T16:57:31.989 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.946+0000 7f0c2affd700 1 --2- 172.21.15.6:0/3759381921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2c1077b0 0x7f0c2c107bc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c0098a0 tx=0x7f0c1c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c613ed11742d2d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:31.989 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.946+0000 7f0c29ffb700 1 -- 172.21.15.6:0/3759381921 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c1c004160 con 0x7f0c2c1077b0 2024-05-20T16:57:31.989 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.947+0000 7f0c29ffb700 1 -- 172.21.15.6:0/3759381921 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c1c004300 con 0x7f0c2c1077b0 2024-05-20T16:57:31.990 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.947+0000 7f0c29ffb700 1 -- 172.21.15.6:0/3759381921 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c1c011a50 con 0x7f0c2c1077b0 2024-05-20T16:57:31.990 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.947+0000 7f0c31a0a700 1 -- 172.21.15.6:0/3759381921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2c1077b0 msgr2=0x7f0c2c107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:31.990 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.947+0000 7f0c31a0a700 1 --2- 172.21.15.6:0/3759381921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2c1077b0 0x7f0c2c107bc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c0098a0 tx=0x7f0c1c009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:31.990 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.947+0000 7f0c31a0a700 1 -- 172.21.15.6:0/3759381921 shutdown_connections 2024-05-20T16:57:31.990 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.947+0000 7f0c31a0a700 1 --2- 172.21.15.6:0/3759381921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2c1077b0 0x7f0c2c107bc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:31.990 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.947+0000 7f0c31a0a700 1 -- 172.21.15.6:0/3759381921 >> 172.21.15.6:0/3759381921 conn(0x7f0c2c102df0 msgr2=0x7f0c2c1052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:31.990 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.947+0000 7f0c31a0a700 1 -- 172.21.15.6:0/3759381921 shutdown_connections 2024-05-20T16:57:31.990 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.947+0000 7f0c31a0a700 1 -- 172.21.15.6:0/3759381921 wait complete. 2024-05-20T16:57:31.990 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.948+0000 7f0c31a0a700 1 Processor -- start 2024-05-20T16:57:31.990 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.948+0000 7f0c31a0a700 1 -- start start 2024-05-20T16:57:31.990 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.948+0000 7f0c31a0a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2c1077b0 0x7f0c2c104f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:31.990 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.948+0000 7f0c31a0a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c10bc90 con 0x7f0c2c1077b0 2024-05-20T16:57:31.990 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.948+0000 7f0c2affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2c1077b0 0x7f0c2c104f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:31.991 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.949+0000 7f0c2affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2c1077b0 0x7f0c2c104f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54204/0 (socket says 172.21.15.6:54204) 2024-05-20T16:57:31.991 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.949+0000 7f0c2affd700 1 -- 172.21.15.6:0/1219736756 learned_addr learned my addr 172.21.15.6:0/1219736756 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:31.991 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.949+0000 7f0c2affd700 1 -- 172.21.15.6:0/1219736756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c105480 con 0x7f0c2c1077b0 2024-05-20T16:57:31.991 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.949+0000 7f0c2affd700 1 --2- 172.21.15.6:0/1219736756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2c1077b0 0x7f0c2c104f40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c011a20 tx=0x7f0c1c011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:31.991 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.949+0000 7f0c30a08700 1 -- 172.21.15.6:0/1219736756 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c1c0038b0 con 0x7f0c2c1077b0 2024-05-20T16:57:31.991 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.949+0000 7f0c30a08700 1 -- 172.21.15.6:0/1219736756 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c1c003a50 con 0x7f0c2c1077b0 2024-05-20T16:57:31.991 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.949+0000 7f0c31a0a700 1 -- 172.21.15.6:0/1219736756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2c1036d0 con 0x7f0c2c1077b0 2024-05-20T16:57:31.991 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.949+0000 7f0c30a08700 1 -- 172.21.15.6:0/1219736756 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c1c024610 con 0x7f0c2c1077b0 2024-05-20T16:57:31.991 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.949+0000 7f0c31a0a700 1 -- 172.21.15.6:0/1219736756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2c103bb0 con 0x7f0c2c1077b0 2024-05-20T16:57:31.991 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.950+0000 7f0c31a0a700 1 -- 172.21.15.6:0/1219736756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c2c063ca0 con 0x7f0c2c1077b0 2024-05-20T16:57:31.991 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.950+0000 7f0c30a08700 1 -- 172.21.15.6:0/1219736756 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f0c1c02d3f0 con 0x7f0c2c1077b0 2024-05-20T16:57:31.991 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.951+0000 7f0c30a08700 1 --2- 172.21.15.6:0/1219736756 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f0c14039050 0x7f0c1403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:31.991 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.951+0000 7f0c30a08700 1 -- 172.21.15.6:0/1219736756 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0c1c04d3f0 con 0x7f0c2c1077b0 2024-05-20T16:57:31.992 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.951+0000 7f0c2a7fc700 1 --2- 172.21.15.6:0/1219736756 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f0c14039050 0x7f0c1403b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:31.992 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.951+0000 7f0c2a7fc700 1 --2- 172.21.15.6:0/1219736756 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f0c14039050 0x7f0c1403b560 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0c20006fd0 tx=0x7f0c20006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:31.992 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:30.956+0000 7f0c30a08700 1 -- 172.21.15.6:0/1219736756 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0c1c00e260 con 0x7f0c2c1077b0 2024-05-20T16:57:31.992 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:31.173+0000 7f0c31a0a700 1 -- 172.21.15.6:0/1219736756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f0c2c195d20 con 0x7f0c2c1077b0 2024-05-20T16:57:31.992 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:31.176+0000 7f0c30a08700 1 -- 172.21.15.6:0/1219736756 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f0c1c00b5a0 con 0x7f0c2c1077b0 2024-05-20T16:57:31.992 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:31.178+0000 7f0c31a0a700 1 -- 172.21.15.6:0/1219736756 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f0c14039050 msgr2=0x7f0c1403b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:31.992 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:31.178+0000 7f0c31a0a700 1 --2- 172.21.15.6:0/1219736756 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f0c14039050 0x7f0c1403b560 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0c20006fd0 tx=0x7f0c20006e40 comp rx=0 tx=0).stop 2024-05-20T16:57:31.992 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:31.178+0000 7f0c31a0a700 1 -- 172.21.15.6:0/1219736756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2c1077b0 msgr2=0x7f0c2c104f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:31.992 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:31.178+0000 7f0c31a0a700 1 --2- 172.21.15.6:0/1219736756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2c1077b0 0x7f0c2c104f40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c011a20 tx=0x7f0c1c011b00 comp rx=0 tx=0).stop 2024-05-20T16:57:31.992 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:31.178+0000 7f0c31a0a700 1 -- 172.21.15.6:0/1219736756 shutdown_connections 2024-05-20T16:57:31.992 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:31.178+0000 7f0c31a0a700 1 --2- 172.21.15.6:0/1219736756 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f0c14039050 0x7f0c1403b560 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:31.992 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:31.178+0000 7f0c31a0a700 1 --2- 172.21.15.6:0/1219736756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2c1077b0 0x7f0c2c104f40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:31.992 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:31.178+0000 7f0c31a0a700 1 -- 172.21.15.6:0/1219736756 >> 172.21.15.6:0/1219736756 conn(0x7f0c2c102df0 msgr2=0x7f0c2c193190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:31.993 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:31.178+0000 7f0c31a0a700 1 -- 172.21.15.6:0/1219736756 shutdown_connections 2024-05-20T16:57:31.993 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:31.178+0000 7f0c31a0a700 1 -- 172.21.15.6:0/1219736756 wait complete. 2024-05-20T16:57:32.300 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:32 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1219736756' entity='client.admin' 2024-05-20T16:57:33.373 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.422+0000 7fcdfff80700 1 Processor -- start 2024-05-20T16:57:33.373 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.422+0000 7fcdfff80700 1 -- start start 2024-05-20T16:57:33.373 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.422+0000 7fcdfff80700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf8107800 0x7fcdf8107c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:33.373 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.422+0000 7fcdfff80700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf8108200 con 0x7fcdf8107800 2024-05-20T16:57:33.373 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.422+0000 7fcdfdd1c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf8107800 0x7fcdf8107c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:33.374 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.422+0000 7fcdfdd1c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf8107800 0x7fcdf8107c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54206/0 (socket says 172.21.15.6:54206) 2024-05-20T16:57:33.374 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.422+0000 7fcdfdd1c700 1 -- 172.21.15.6:0/3072951995 learned_addr learned my addr 172.21.15.6:0/3072951995 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:33.374 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.423+0000 7fcdfdd1c700 1 -- 172.21.15.6:0/3072951995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf8108930 con 0x7fcdf8107800 2024-05-20T16:57:33.374 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.423+0000 7fcdfdd1c700 1 --2- 172.21.15.6:0/3072951995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf8107800 0x7fcdf8107c10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcdec0098a0 tx=0x7fcdec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468b43fa280be339 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:33.374 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.423+0000 7fcdfcd1a700 1 -- 172.21.15.6:0/3072951995 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdec004160 con 0x7fcdf8107800 2024-05-20T16:57:33.374 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.423+0000 7fcdfcd1a700 1 -- 172.21.15.6:0/3072951995 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcdec004300 con 0x7fcdf8107800 2024-05-20T16:57:33.374 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.423+0000 7fcdfcd1a700 1 -- 172.21.15.6:0/3072951995 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdec011a50 con 0x7fcdf8107800 2024-05-20T16:57:33.374 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.424+0000 7fcdfff80700 1 -- 172.21.15.6:0/3072951995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf8107800 msgr2=0x7fcdf8107c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:33.374 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.424+0000 7fcdfff80700 1 --2- 172.21.15.6:0/3072951995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf8107800 0x7fcdf8107c10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcdec0098a0 tx=0x7fcdec009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:33.374 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.424+0000 7fcdfff80700 1 -- 172.21.15.6:0/3072951995 shutdown_connections 2024-05-20T16:57:33.374 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.424+0000 7fcdfff80700 1 --2- 172.21.15.6:0/3072951995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf8107800 0x7fcdf8107c10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:33.375 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.424+0000 7fcdfff80700 1 -- 172.21.15.6:0/3072951995 >> 172.21.15.6:0/3072951995 conn(0x7fcdf8102e40 msgr2=0x7fcdf81052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:33.375 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.424+0000 7fcdfff80700 1 -- 172.21.15.6:0/3072951995 shutdown_connections 2024-05-20T16:57:33.375 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.424+0000 7fcdfff80700 1 -- 172.21.15.6:0/3072951995 wait complete. 2024-05-20T16:57:33.375 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.425+0000 7fcdfff80700 1 Processor -- start 2024-05-20T16:57:33.375 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.425+0000 7fcdfff80700 1 -- start start 2024-05-20T16:57:33.376 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.425+0000 7fcdfff80700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf8107800 0x7fcdf819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:33.376 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.425+0000 7fcdfff80700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf810bce0 con 0x7fcdf8107800 2024-05-20T16:57:33.376 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.425+0000 7fcdfdd1c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf8107800 0x7fcdf819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:33.376 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.425+0000 7fcdfdd1c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf8107800 0x7fcdf819cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54216/0 (socket says 172.21.15.6:54216) 2024-05-20T16:57:33.376 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.425+0000 7fcdfdd1c700 1 -- 172.21.15.6:0/2110134358 learned_addr learned my addr 172.21.15.6:0/2110134358 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:33.376 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.425+0000 7fcdfdd1c700 1 -- 172.21.15.6:0/2110134358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf819d1a0 con 0x7fcdf8107800 2024-05-20T16:57:33.376 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.426+0000 7fcdfdd1c700 1 --2- 172.21.15.6:0/2110134358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf8107800 0x7fcdf819cc60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcdec009fb0 tx=0x7fcdec011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:33.376 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.426+0000 7fcdeaffd700 1 -- 172.21.15.6:0/2110134358 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdec0038b0 con 0x7fcdf8107800 2024-05-20T16:57:33.376 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.426+0000 7fcdfff80700 1 -- 172.21.15.6:0/2110134358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdf819d430 con 0x7fcdf8107800 2024-05-20T16:57:33.376 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.426+0000 7fcdeaffd700 1 -- 172.21.15.6:0/2110134358 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcdec003a50 con 0x7fcdf8107800 2024-05-20T16:57:33.376 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.426+0000 7fcdeaffd700 1 -- 172.21.15.6:0/2110134358 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdec019590 con 0x7fcdf8107800 2024-05-20T16:57:33.376 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.426+0000 7fcdfff80700 1 -- 172.21.15.6:0/2110134358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdf81a0040 con 0x7fcdf8107800 2024-05-20T16:57:33.377 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.427+0000 7fcdfff80700 1 -- 172.21.15.6:0/2110134358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdf8063ca0 con 0x7fcdf8107800 2024-05-20T16:57:33.377 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.427+0000 7fcdeaffd700 1 -- 172.21.15.6:0/2110134358 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fcdec0198b0 con 0x7fcdf8107800 2024-05-20T16:57:33.377 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.427+0000 7fcdeaffd700 1 --2- 172.21.15.6:0/2110134358 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fcde4039000 0x7fcde403b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:33.377 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.427+0000 7fcdeaffd700 1 -- 172.21.15.6:0/2110134358 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcdec04d540 con 0x7fcdf8107800 2024-05-20T16:57:33.377 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.427+0000 7fcdfd51b700 1 --2- 172.21.15.6:0/2110134358 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fcde4039000 0x7fcde403b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:33.377 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.428+0000 7fcdfd51b700 1 --2- 172.21.15.6:0/2110134358 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fcde4039000 0x7fcde403b510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4006fd0 tx=0x7fcdf4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:33.377 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.433+0000 7fcdeaffd700 1 -- 172.21.15.6:0/2110134358 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcdec00fda0 con 0x7fcdf8107800 2024-05-20T16:57:33.377 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.640+0000 7fcdfff80700 1 -- 172.21.15.6:0/2110134358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fcdf81a0350 con 0x7fcdf8107800 2024-05-20T16:57:33.377 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.643+0000 7fcdeaffd700 1 -- 172.21.15.6:0/2110134358 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fcdec02d960 con 0x7fcdf8107800 2024-05-20T16:57:33.377 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.645+0000 7fcdfff80700 1 -- 172.21.15.6:0/2110134358 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fcde4039000 msgr2=0x7fcde403b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:33.377 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.645+0000 7fcdfff80700 1 --2- 172.21.15.6:0/2110134358 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fcde4039000 0x7fcde403b510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4006fd0 tx=0x7fcdf4006e40 comp rx=0 tx=0).stop 2024-05-20T16:57:33.377 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.645+0000 7fcdfff80700 1 -- 172.21.15.6:0/2110134358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf8107800 msgr2=0x7fcdf819cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:33.377 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.645+0000 7fcdfff80700 1 --2- 172.21.15.6:0/2110134358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf8107800 0x7fcdf819cc60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcdec009fb0 tx=0x7fcdec011ab0 comp rx=0 tx=0).stop 2024-05-20T16:57:33.378 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.645+0000 7fcdfff80700 1 -- 172.21.15.6:0/2110134358 shutdown_connections 2024-05-20T16:57:33.378 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.645+0000 7fcdfff80700 1 --2- 172.21.15.6:0/2110134358 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fcde4039000 0x7fcde403b510 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:33.378 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.645+0000 7fcdfff80700 1 --2- 172.21.15.6:0/2110134358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf8107800 0x7fcdf819cc60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:33.378 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.645+0000 7fcdfff80700 1 -- 172.21.15.6:0/2110134358 >> 172.21.15.6:0/2110134358 conn(0x7fcdf8102e40 msgr2=0x7fcdf81036e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:33.378 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.645+0000 7fcdfff80700 1 -- 172.21.15.6:0/2110134358 shutdown_connections 2024-05-20T16:57:33.378 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:32.645+0000 7fcdfff80700 1 -- 172.21.15.6:0/2110134358 wait complete. 2024-05-20T16:57:33.378 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling the dashboard module... 2024-05-20T16:57:33.767 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:33 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2110134358' entity='client.admin' 2024-05-20T16:57:33.768 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:33 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' 2024-05-20T16:57:34.980 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:34 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3104667428' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-20T16:57:34.980 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:34 smithi006 ceph-mon[32486]: from='mgr.14120 172.21.15.6:0/1941757882' entity='mgr.x' 2024-05-20T16:57:34.980 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:34 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: ignoring --setuser ceph since I am not root 2024-05-20T16:57:34.980 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:34 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: ignoring --setgroup ceph since I am not root 2024-05-20T16:57:34.980 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:34 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:34.884+0000 7f920681d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T16:57:35.297 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:35 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:35.079+0000 7f920681d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T16:57:35.297 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:35 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:35.188+0000 7f920681d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T16:57:35.306 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.804+0000 7effe2ab5700 1 Processor -- start 2024-05-20T16:57:35.307 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.804+0000 7effe2ab5700 1 -- start start 2024-05-20T16:57:35.307 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.804+0000 7effe2ab5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effdc1088d0 0x7effdc108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:35.307 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.804+0000 7effe2ab5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7effdc1092d0 con 0x7effdc1088d0 2024-05-20T16:57:35.307 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.805+0000 7effe0851700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effdc1088d0 0x7effdc108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:35.307 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.805+0000 7effe0851700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effdc1088d0 0x7effdc108ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54222/0 (socket says 172.21.15.6:54222) 2024-05-20T16:57:35.307 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.805+0000 7effe0851700 1 -- 172.21.15.6:0/1258134232 learned_addr learned my addr 172.21.15.6:0/1258134232 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:35.307 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.805+0000 7effe0851700 1 -- 172.21.15.6:0/1258134232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc109a00 con 0x7effdc1088d0 2024-05-20T16:57:35.307 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.805+0000 7effe0851700 1 --2- 172.21.15.6:0/1258134232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effdc1088d0 0x7effdc108ce0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7effd00098a0 tx=0x7effd0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d56c620e29d341 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:35.308 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.806+0000 7effdb7fe700 1 -- 172.21.15.6:0/1258134232 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd0004160 con 0x7effdc1088d0 2024-05-20T16:57:35.308 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.806+0000 7effdb7fe700 1 -- 172.21.15.6:0/1258134232 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7effd0004300 con 0x7effdc1088d0 2024-05-20T16:57:35.308 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.806+0000 7effdb7fe700 1 -- 172.21.15.6:0/1258134232 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd0011a50 con 0x7effdc1088d0 2024-05-20T16:57:35.308 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.807+0000 7effe2ab5700 1 -- 172.21.15.6:0/1258134232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effdc1088d0 msgr2=0x7effdc108ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:35.308 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.807+0000 7effe2ab5700 1 --2- 172.21.15.6:0/1258134232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effdc1088d0 0x7effdc108ce0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7effd00098a0 tx=0x7effd0009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:35.308 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.807+0000 7effe2ab5700 1 -- 172.21.15.6:0/1258134232 shutdown_connections 2024-05-20T16:57:35.308 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.807+0000 7effe2ab5700 1 --2- 172.21.15.6:0/1258134232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effdc1088d0 0x7effdc108ce0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:35.308 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.807+0000 7effe2ab5700 1 -- 172.21.15.6:0/1258134232 >> 172.21.15.6:0/1258134232 conn(0x7effdc103ef0 msgr2=0x7effdc1063c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:35.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.807+0000 7effe2ab5700 1 -- 172.21.15.6:0/1258134232 shutdown_connections 2024-05-20T16:57:35.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.807+0000 7effe2ab5700 1 -- 172.21.15.6:0/1258134232 wait complete. 2024-05-20T16:57:35.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.808+0000 7effe2ab5700 1 Processor -- start 2024-05-20T16:57:35.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.808+0000 7effe2ab5700 1 -- start start 2024-05-20T16:57:35.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.808+0000 7effe2ab5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effdc1088d0 0x7effdc19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:35.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.808+0000 7effe2ab5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7effdc10cdb0 con 0x7effdc1088d0 2024-05-20T16:57:35.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.808+0000 7effe0851700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effdc1088d0 0x7effdc19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:35.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.808+0000 7effe0851700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effdc1088d0 0x7effdc19ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54224/0 (socket says 172.21.15.6:54224) 2024-05-20T16:57:35.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.808+0000 7effe0851700 1 -- 172.21.15.6:0/3104667428 learned_addr learned my addr 172.21.15.6:0/3104667428 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:35.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.808+0000 7effe0851700 1 -- 172.21.15.6:0/3104667428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc19d1f0 con 0x7effdc1088d0 2024-05-20T16:57:35.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.809+0000 7effe0851700 1 --2- 172.21.15.6:0/3104667428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effdc1088d0 0x7effdc19ccb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7effd0011a20 tx=0x7effd0011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:35.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.809+0000 7effd9ffb700 1 -- 172.21.15.6:0/3104667428 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd00038b0 con 0x7effdc1088d0 2024-05-20T16:57:35.310 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.809+0000 7effd9ffb700 1 -- 172.21.15.6:0/3104667428 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7effd0003a50 con 0x7effdc1088d0 2024-05-20T16:57:35.310 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.809+0000 7effd9ffb700 1 -- 172.21.15.6:0/3104667428 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd0024610 con 0x7effdc1088d0 2024-05-20T16:57:35.310 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.809+0000 7effe2ab5700 1 -- 172.21.15.6:0/3104667428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effdc19d480 con 0x7effdc1088d0 2024-05-20T16:57:35.310 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.809+0000 7effe2ab5700 1 -- 172.21.15.6:0/3104667428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effdc1a0090 con 0x7effdc1088d0 2024-05-20T16:57:35.310 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.810+0000 7effd9ffb700 1 -- 172.21.15.6:0/3104667428 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7effd002d3f0 con 0x7effdc1088d0 2024-05-20T16:57:35.310 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.810+0000 7effe2ab5700 1 -- 172.21.15.6:0/3104667428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effdc063ca0 con 0x7effdc1088d0 2024-05-20T16:57:35.310 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.810+0000 7effd9ffb700 1 --2- 172.21.15.6:0/3104667428 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7effcc0390a0 0x7effcc03b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:35.310 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.810+0000 7effd9ffb700 1 -- 172.21.15.6:0/3104667428 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7effd004d320 con 0x7effdc1088d0 2024-05-20T16:57:35.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.811+0000 7effdbfff700 1 --2- 172.21.15.6:0/3104667428 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7effcc0390a0 0x7effcc03b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:35.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.811+0000 7effdbfff700 1 --2- 172.21.15.6:0/3104667428 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7effcc0390a0 0x7effcc03b5b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7effc8006fd0 tx=0x7effc8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:35.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:33.816+0000 7effd9ffb700 1 -- 172.21.15.6:0/3104667428 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7effd000e260 con 0x7effdc1088d0 2024-05-20T16:57:35.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:34.090+0000 7effe2ab5700 1 -- 172.21.15.6:0/3104667428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7effdc1a0260 con 0x7effdc1088d0 2024-05-20T16:57:35.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:34.646+0000 7effd9ffb700 1 -- 172.21.15.6:0/3104667428 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7effd000b5a0 con 0x7effdc1088d0 2024-05-20T16:57:35.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:34.648+0000 7effd9ffb700 1 -- 172.21.15.6:0/3104667428 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7effd00193c0 con 0x7effdc1088d0 2024-05-20T16:57:35.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:34.649+0000 7effe2ab5700 1 -- 172.21.15.6:0/3104667428 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7effcc0390a0 msgr2=0x7effcc03b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:35.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:34.649+0000 7effe2ab5700 1 --2- 172.21.15.6:0/3104667428 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7effcc0390a0 0x7effcc03b5b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7effc8006fd0 tx=0x7effc8006e40 comp rx=0 tx=0).stop 2024-05-20T16:57:35.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:34.649+0000 7effe2ab5700 1 -- 172.21.15.6:0/3104667428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effdc1088d0 msgr2=0x7effdc19ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:35.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:34.649+0000 7effe2ab5700 1 --2- 172.21.15.6:0/3104667428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effdc1088d0 0x7effdc19ccb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7effd0011a20 tx=0x7effd0011b00 comp rx=0 tx=0).stop 2024-05-20T16:57:35.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:34.649+0000 7effe2ab5700 1 -- 172.21.15.6:0/3104667428 shutdown_connections 2024-05-20T16:57:35.312 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:34.649+0000 7effe2ab5700 1 --2- 172.21.15.6:0/3104667428 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7effcc0390a0 0x7effcc03b5b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:35.312 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:34.649+0000 7effe2ab5700 1 --2- 172.21.15.6:0/3104667428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effdc1088d0 0x7effdc19ccb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:35.312 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:34.649+0000 7effe2ab5700 1 -- 172.21.15.6:0/3104667428 >> 172.21.15.6:0/3104667428 conn(0x7effdc103ef0 msgr2=0x7effdc104740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:35.312 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:34.649+0000 7effe2ab5700 1 -- 172.21.15.6:0/3104667428 shutdown_connections 2024-05-20T16:57:35.312 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:34.650+0000 7effe2ab5700 1 -- 172.21.15.6:0/3104667428 wait complete. 2024-05-20T16:57:35.614 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:35 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:35.523+0000 7f920681d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T16:57:35.614 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:35 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:35.614+0000 7f920681d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T16:57:35.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:35 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3104667428' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-20T16:57:35.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:35 smithi006 ceph-mon[32486]: mgrmap e9: x(active, since 20s) 2024-05-20T16:57:36.934 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:36 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1344910553' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-20T16:57:36.934 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:36 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:36.896+0000 7f920681d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T16:57:37.257 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:37 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:37.078+0000 7f920681d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T16:57:37.447 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-05-20T16:57:37.453 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-20T16:57:37.453 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-20T16:57:37.453 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-20T16:57:37.453 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-20T16:57:37.453 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-05-20T16:57:37.453 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.744+0000 7fe27f0d7700 1 Processor -- start 2024-05-20T16:57:37.453 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.744+0000 7fe27f0d7700 1 -- start start 2024-05-20T16:57:37.453 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.744+0000 7fe27f0d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27807bc80 0x7fe27810b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:37.454 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.744+0000 7fe27f0d7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe27810b9f0 con 0x7fe27807bc80 2024-05-20T16:57:37.454 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.744+0000 7fe27ce73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27807bc80 0x7fe27810b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:37.454 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.744+0000 7fe27ce73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27807bc80 0x7fe27810b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54258/0 (socket says 172.21.15.6:54258) 2024-05-20T16:57:37.454 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.744+0000 7fe27ce73700 1 -- 172.21.15.6:0/1893983265 learned_addr learned my addr 172.21.15.6:0/1893983265 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:37.454 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.745+0000 7fe27ce73700 1 -- 172.21.15.6:0/1893983265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe27810bb70 con 0x7fe27807bc80 2024-05-20T16:57:37.454 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.745+0000 7fe27ce73700 1 --2- 172.21.15.6:0/1893983265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27807bc80 0x7fe27810b400 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0098a0 tx=0x7fe26c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94614fb8b022225 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:37.454 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.745+0000 7fe2777fe700 1 -- 172.21.15.6:0/1893983265 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe26c004160 con 0x7fe27807bc80 2024-05-20T16:57:37.454 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.745+0000 7fe2777fe700 1 -- 172.21.15.6:0/1893983265 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe26c004300 con 0x7fe27807bc80 2024-05-20T16:57:37.454 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.745+0000 7fe2777fe700 1 -- 172.21.15.6:0/1893983265 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe26c011a50 con 0x7fe27807bc80 2024-05-20T16:57:37.454 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.746+0000 7fe27f0d7700 1 -- 172.21.15.6:0/1893983265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27807bc80 msgr2=0x7fe27810b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:37.454 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.746+0000 7fe27f0d7700 1 --2- 172.21.15.6:0/1893983265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27807bc80 0x7fe27810b400 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0098a0 tx=0x7fe26c009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:37.455 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.746+0000 7fe27f0d7700 1 -- 172.21.15.6:0/1893983265 shutdown_connections 2024-05-20T16:57:37.455 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.746+0000 7fe27f0d7700 1 --2- 172.21.15.6:0/1893983265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27807bc80 0x7fe27810b400 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:37.455 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.746+0000 7fe27f0d7700 1 -- 172.21.15.6:0/1893983265 >> 172.21.15.6:0/1893983265 conn(0x7fe278102df0 msgr2=0x7fe2781052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:37.455 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.746+0000 7fe27f0d7700 1 -- 172.21.15.6:0/1893983265 shutdown_connections 2024-05-20T16:57:37.455 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.746+0000 7fe27f0d7700 1 -- 172.21.15.6:0/1893983265 wait complete. 2024-05-20T16:57:37.455 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.747+0000 7fe27f0d7700 1 Processor -- start 2024-05-20T16:57:37.455 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.747+0000 7fe27f0d7700 1 -- start start 2024-05-20T16:57:37.455 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.747+0000 7fe27f0d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27807bc80 0x7fe278108b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:37.455 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.747+0000 7fe27f0d7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe27810cc30 con 0x7fe27807bc80 2024-05-20T16:57:37.455 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.747+0000 7fe27ce73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27807bc80 0x7fe278108b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:37.455 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.747+0000 7fe27ce73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27807bc80 0x7fe278108b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54262/0 (socket says 172.21.15.6:54262) 2024-05-20T16:57:37.455 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.747+0000 7fe27ce73700 1 -- 172.21.15.6:0/1344910553 learned_addr learned my addr 172.21.15.6:0/1344910553 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:37.455 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.748+0000 7fe27ce73700 1 -- 172.21.15.6:0/1344910553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2781090b0 con 0x7fe27807bc80 2024-05-20T16:57:37.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.748+0000 7fe27ce73700 1 --2- 172.21.15.6:0/1344910553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27807bc80 0x7fe278108b70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe26c011710 tx=0x7fe26c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:37.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.748+0000 7fe275ffb700 1 -- 172.21.15.6:0/1344910553 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe26c0039c0 con 0x7fe27807bc80 2024-05-20T16:57:37.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.748+0000 7fe275ffb700 1 -- 172.21.15.6:0/1344910553 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe26c003b60 con 0x7fe27807bc80 2024-05-20T16:57:37.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.748+0000 7fe27f0d7700 1 -- 172.21.15.6:0/1344910553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe278107300 con 0x7fe27807bc80 2024-05-20T16:57:37.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.748+0000 7fe275ffb700 1 -- 172.21.15.6:0/1344910553 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe26c01a690 con 0x7fe27807bc80 2024-05-20T16:57:37.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.748+0000 7fe27f0d7700 1 -- 172.21.15.6:0/1344910553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2781077e0 con 0x7fe27807bc80 2024-05-20T16:57:37.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.749+0000 7fe27f0d7700 1 -- 172.21.15.6:0/1344910553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe278063ca0 con 0x7fe27807bc80 2024-05-20T16:57:37.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.749+0000 7fe275ffb700 1 -- 172.21.15.6:0/1344910553 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fe26c01a960 con 0x7fe27807bc80 2024-05-20T16:57:37.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.750+0000 7fe275ffb700 1 --2- 172.21.15.6:0/1344910553 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fe2680390b0 0x7fe26803b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:37.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.750+0000 7fe275ffb700 1 -- 172.21.15.6:0/1344910553 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe26c04d6c0 con 0x7fe27807bc80 2024-05-20T16:57:37.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.750+0000 7fe277fff700 1 -- 172.21.15.6:0/1344910553 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fe2680390b0 msgr2=0x7fe26803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/3509827796 2024-05-20T16:57:37.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.750+0000 7fe277fff700 1 --2- 172.21.15.6:0/1344910553 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fe2680390b0 0x7fe26803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T16:57:37.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.755+0000 7fe275ffb700 1 -- 172.21.15.6:0/1344910553 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe26c00fdd0 con 0x7fe27807bc80 2024-05-20T16:57:37.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.951+0000 7fe277fff700 1 -- 172.21.15.6:0/1344910553 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fe2680390b0 msgr2=0x7fe26803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/3509827796 2024-05-20T16:57:37.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:35.951+0000 7fe277fff700 1 --2- 172.21.15.6:0/1344910553 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fe2680390b0 0x7fe26803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-20T16:57:37.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:36.078+0000 7fe27f0d7700 1 -- 172.21.15.6:0/1344910553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fe278107ed0 con 0x7fe27807bc80 2024-05-20T16:57:37.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:36.085+0000 7fe275ffb700 1 -- 172.21.15.6:0/1344910553 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fe26c00bc70 con 0x7fe27807bc80 2024-05-20T16:57:37.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:36.089+0000 7fe27f0d7700 1 -- 172.21.15.6:0/1344910553 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fe2680390b0 msgr2=0x7fe26803b5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T16:57:37.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:36.089+0000 7fe27f0d7700 1 --2- 172.21.15.6:0/1344910553 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fe2680390b0 0x7fe26803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:37.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:36.090+0000 7fe27f0d7700 1 -- 172.21.15.6:0/1344910553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27807bc80 msgr2=0x7fe278108b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:37.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:36.090+0000 7fe27f0d7700 1 --2- 172.21.15.6:0/1344910553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27807bc80 0x7fe278108b70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe26c011710 tx=0x7fe26c011ad0 comp rx=0 tx=0).stop 2024-05-20T16:57:37.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:36.090+0000 7fe27f0d7700 1 -- 172.21.15.6:0/1344910553 shutdown_connections 2024-05-20T16:57:37.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:36.090+0000 7fe27f0d7700 1 --2- 172.21.15.6:0/1344910553 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7fe2680390b0 0x7fe26803b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:37.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:36.090+0000 7fe27f0d7700 1 --2- 172.21.15.6:0/1344910553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27807bc80 0x7fe278108b70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:37.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:36.090+0000 7fe27f0d7700 1 -- 172.21.15.6:0/1344910553 >> 172.21.15.6:0/1344910553 conn(0x7fe278102df0 msgr2=0x7fe278103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:37.458 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:36.090+0000 7fe27f0d7700 1 -- 172.21.15.6:0/1344910553 shutdown_connections 2024-05-20T16:57:37.458 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:36.090+0000 7fe27f0d7700 1 -- 172.21.15.6:0/1344910553 wait complete. 2024-05-20T16:57:37.458 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for the mgr to restart... 2024-05-20T16:57:37.458 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mgr epoch 9... 2024-05-20T16:57:37.572 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:37 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:37.257+0000 7f920681d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T16:57:37.572 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:37 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:37.572+0000 7f920681d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T16:57:37.880 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:37 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:37.671+0000 7f920681d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T16:57:38.380 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:37 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:37.890+0000 7f920681d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T16:57:38.380 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:38 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:38.097+0000 7f920681d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T16:57:38.880 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:38 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:38.729+0000 7f920681d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T16:57:39.518 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:39 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:39.198+0000 7f920681d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T16:57:39.518 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:39 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:39.302+0000 7f920681d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T16:57:39.518 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:39 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:39.518+0000 7f920681d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T16:57:40.380 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:40 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:40.074+0000 7f920681d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T16:57:40.380 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:40 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:40.174+0000 7f920681d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T16:57:40.804 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:40 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:40.433+0000 7f920681d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T16:57:40.804 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:40 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:40.576+0000 7f920681d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T16:57:40.804 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:40 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:40.679+0000 7f920681d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T16:57:40.804 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:40 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:40.803+0000 7f920681d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T16:57:41.380 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:41 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:41.116+0000 7f920681d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T16:57:42.037 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:41 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:41.753+0000 7f920681d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T16:57:42.037 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 16:57:41 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T16:57:41.983+0000 7f920681d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T16:57:42.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:42 smithi006 ceph-mon[32486]: Active manager daemon x restarted 2024-05-20T16:57:42.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:42 smithi006 ceph-mon[32486]: Activating manager daemon x 2024-05-20T16:57:42.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:42 smithi006 ceph-mon[32486]: osdmap e3: 0 total, 0 up, 0 in 2024-05-20T16:57:42.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:42 smithi006 ceph-mon[32486]: mgrmap e10: x(active, starting, since 0.00398008s) 2024-05-20T16:57:42.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T16:57:42.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-20T16:57:42.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-20T16:57:42.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-20T16:57:42.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-20T16:57:42.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:42 smithi006 ceph-mon[32486]: Manager daemon x is now available 2024-05-20T16:57:42.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:57:43.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-20T16:57:43.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-20T16:57:43.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:43 smithi006 ceph-mon[32486]: [20/May/2024:16:57:42] ENGINE Bus STARTING 2024-05-20T16:57:43.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:43 smithi006 ceph-mon[32486]: mgrmap e11: x(active, since 1.00684s) 2024-05-20T16:57:43.947 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2024-05-20T16:57:43.947 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-20T16:57:43.947 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-20T16:57:43.947 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2024-05-20T16:57:43.947 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.921+0000 7f2a5d2f1700 1 Processor -- start 2024-05-20T16:57:43.947 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.921+0000 7f2a5d2f1700 1 -- start start 2024-05-20T16:57:43.947 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.922+0000 7f2a5d2f1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a5807bca0 0x7f2a5810b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:43.947 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.922+0000 7f2a5d2f1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5810b9e0 con 0x7f2a5807bca0 2024-05-20T16:57:43.947 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.922+0000 7f2a56ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a5807bca0 0x7f2a5810b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:43.947 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.922+0000 7f2a56ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a5807bca0 0x7f2a5810b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54276/0 (socket says 172.21.15.6:54276) 2024-05-20T16:57:43.948 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.922+0000 7f2a56ffd700 1 -- 172.21.15.6:0/2111809877 learned_addr learned my addr 172.21.15.6:0/2111809877 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:43.948 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.922+0000 7f2a56ffd700 1 -- 172.21.15.6:0/2111809877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5810bb60 con 0x7f2a5807bca0 2024-05-20T16:57:43.948 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.922+0000 7f2a56ffd700 1 --2- 172.21.15.6:0/2111809877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a5807bca0 0x7f2a5810b3d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2a480098a0 tx=0x7f2a48009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f17fc0642ed39d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:43.948 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.922+0000 7f2a55ffb700 1 -- 172.21.15.6:0/2111809877 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a48004160 con 0x7f2a5807bca0 2024-05-20T16:57:43.948 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.922+0000 7f2a55ffb700 1 -- 172.21.15.6:0/2111809877 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a48004300 con 0x7f2a5807bca0 2024-05-20T16:57:43.948 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.923+0000 7f2a55ffb700 1 -- 172.21.15.6:0/2111809877 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a48011a50 con 0x7f2a5807bca0 2024-05-20T16:57:43.948 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.923+0000 7f2a5d2f1700 1 -- 172.21.15.6:0/2111809877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a5807bca0 msgr2=0x7f2a5810b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:43.948 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.923+0000 7f2a5d2f1700 1 --2- 172.21.15.6:0/2111809877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a5807bca0 0x7f2a5810b3d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2a480098a0 tx=0x7f2a48009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:43.948 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.923+0000 7f2a5d2f1700 1 -- 172.21.15.6:0/2111809877 shutdown_connections 2024-05-20T16:57:43.948 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.923+0000 7f2a5d2f1700 1 --2- 172.21.15.6:0/2111809877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a5807bca0 0x7f2a5810b3d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:43.948 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.923+0000 7f2a5d2f1700 1 -- 172.21.15.6:0/2111809877 >> 172.21.15.6:0/2111809877 conn(0x7f2a58102e00 msgr2=0x7f2a58105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:43.948 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.923+0000 7f2a5d2f1700 1 -- 172.21.15.6:0/2111809877 shutdown_connections 2024-05-20T16:57:43.948 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.923+0000 7f2a5d2f1700 1 -- 172.21.15.6:0/2111809877 wait complete. 2024-05-20T16:57:43.949 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.924+0000 7f2a5d2f1700 1 Processor -- start 2024-05-20T16:57:43.949 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.924+0000 7f2a5d2f1700 1 -- start start 2024-05-20T16:57:43.949 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.924+0000 7f2a5d2f1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a5807bca0 0x7f2a5819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:43.949 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.924+0000 7f2a5d2f1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5810cc20 con 0x7f2a5807bca0 2024-05-20T16:57:43.949 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.925+0000 7f2a56ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a5807bca0 0x7f2a5819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:43.949 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.925+0000 7f2a56ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a5807bca0 0x7f2a5819cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54290/0 (socket says 172.21.15.6:54290) 2024-05-20T16:57:43.949 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.925+0000 7f2a56ffd700 1 -- 172.21.15.6:0/554958148 learned_addr learned my addr 172.21.15.6:0/554958148 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:43.949 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.925+0000 7f2a56ffd700 1 -- 172.21.15.6:0/554958148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5819d120 con 0x7f2a5807bca0 2024-05-20T16:57:43.949 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.925+0000 7f2a56ffd700 1 --2- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a5807bca0 0x7f2a5819cbe0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2a48011710 tx=0x7f2a48011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:43.949 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.925+0000 7f2a4ffff700 1 -- 172.21.15.6:0/554958148 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a480039c0 con 0x7f2a5807bca0 2024-05-20T16:57:43.949 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.925+0000 7f2a4ffff700 1 -- 172.21.15.6:0/554958148 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a48003b60 con 0x7f2a5807bca0 2024-05-20T16:57:43.949 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.925+0000 7f2a4ffff700 1 -- 172.21.15.6:0/554958148 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a4801a690 con 0x7f2a5807bca0 2024-05-20T16:57:43.949 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.925+0000 7f2a5d2f1700 1 -- 172.21.15.6:0/554958148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a5819d3b0 con 0x7f2a5807bca0 2024-05-20T16:57:43.949 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.925+0000 7f2a5d2f1700 1 -- 172.21.15.6:0/554958148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a5819ffc0 con 0x7f2a5807bca0 2024-05-20T16:57:43.949 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.926+0000 7f2a4ffff700 1 -- 172.21.15.6:0/554958148 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f2a4801a940 con 0x7f2a5807bca0 2024-05-20T16:57:43.950 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.927+0000 7f2a4ffff700 1 --2- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f2a440390b0 0x7f2a4403b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:43.950 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.927+0000 7f2a4ffff700 1 -- 172.21.15.6:0/554958148 --> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2a4403bcd0 con 0x7f2a440390b0 2024-05-20T16:57:43.950 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.927+0000 7f2a4ffff700 1 -- 172.21.15.6:0/554958148 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2a4804d6e0 con 0x7f2a5807bca0 2024-05-20T16:57:43.950 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.927+0000 7f2a567fc700 1 -- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f2a440390b0 msgr2=0x7f2a4403b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/3509827796 2024-05-20T16:57:43.950 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:37.927+0000 7f2a567fc700 1 --2- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f2a440390b0 0x7f2a4403b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T16:57:43.950 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:38.128+0000 7f2a567fc700 1 -- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f2a440390b0 msgr2=0x7f2a4403b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/3509827796 2024-05-20T16:57:43.950 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:38.128+0000 7f2a567fc700 1 --2- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f2a440390b0 0x7f2a4403b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-20T16:57:43.950 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:38.529+0000 7f2a567fc700 1 -- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f2a440390b0 msgr2=0x7f2a4403b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/3509827796 2024-05-20T16:57:43.950 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:38.529+0000 7f2a567fc700 1 --2- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f2a440390b0 0x7f2a4403b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-20T16:57:43.950 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:39.330+0000 7f2a567fc700 1 -- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f2a440390b0 msgr2=0x7f2a4403b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/3509827796 2024-05-20T16:57:43.950 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:39.330+0000 7f2a567fc700 1 --2- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f2a440390b0 0x7f2a4403b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-20T16:57:43.950 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:40.931+0000 7f2a567fc700 1 -- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f2a440390b0 msgr2=0x7f2a4403b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/3509827796 2024-05-20T16:57:43.950 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:40.931+0000 7f2a567fc700 1 --2- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f2a440390b0 0x7f2a4403b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-20T16:57:43.951 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:41.987+0000 7f2a4ffff700 1 -- 172.21.15.6:0/554958148 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f2a4801ac80 con 0x7f2a5807bca0 2024-05-20T16:57:43.951 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:41.987+0000 7f2a4ffff700 1 -- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f2a440390b0 msgr2=0x7f2a4403b5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T16:57:43.951 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:41.987+0000 7f2a4ffff700 1 --2- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f2a440390b0 0x7f2a4403b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:43.951 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:42.988+0000 7f2a4ffff700 1 -- 172.21.15.6:0/554958148 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f2a4804f740 con 0x7f2a5807bca0 2024-05-20T16:57:43.951 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:42.988+0000 7f2a4ffff700 1 --2- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2a4804d270 0x7f2a4403ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:43.951 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:42.989+0000 7f2a4ffff700 1 -- 172.21.15.6:0/554958148 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2a4800fec0 con 0x7f2a4804d270 2024-05-20T16:57:43.951 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:42.989+0000 7f2a567fc700 1 --2- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2a4804d270 0x7f2a4403ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:43.951 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:42.990+0000 7f2a567fc700 1 --2- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2a4804d270 0x7f2a4403ebd0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2a40003a10 tx=0x7f2a400092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:43.951 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:42.991+0000 7f2a4ffff700 1 -- 172.21.15.6:0/554958148 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f2a4800fec0 con 0x7f2a4804d270 2024-05-20T16:57:43.951 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:42.998+0000 7f2a5d2f1700 1 -- 172.21.15.6:0/554958148 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f2a58063ca0 con 0x7f2a4804d270 2024-05-20T16:57:43.951 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:42.998+0000 7f2a4ffff700 1 -- 172.21.15.6:0/554958148 <== mgr.14152 v2:172.21.15.6:6800/3244338052 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f2a58063ca0 con 0x7f2a4804d270 2024-05-20T16:57:43.951 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:42.998+0000 7f2a5d2f1700 1 -- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2a4804d270 msgr2=0x7f2a4403ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:43.951 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:42.998+0000 7f2a5d2f1700 1 --2- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2a4804d270 0x7f2a4403ebd0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2a40003a10 tx=0x7f2a400092b0 comp rx=0 tx=0).stop 2024-05-20T16:57:43.951 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:42.998+0000 7f2a5d2f1700 1 -- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a5807bca0 msgr2=0x7f2a5819cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:43.952 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:42.998+0000 7f2a5d2f1700 1 --2- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a5807bca0 0x7f2a5819cbe0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2a48011710 tx=0x7f2a48011ad0 comp rx=0 tx=0).stop 2024-05-20T16:57:43.952 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:42.999+0000 7f2a5d2f1700 1 -- 172.21.15.6:0/554958148 shutdown_connections 2024-05-20T16:57:43.952 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:42.999+0000 7f2a5d2f1700 1 --2- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2a4804d270 0x7f2a4403ebd0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:43.952 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:42.999+0000 7f2a5d2f1700 1 --2- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a5807bca0 0x7f2a5819cbe0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:43.952 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:42.999+0000 7f2a5d2f1700 1 --2- 172.21.15.6:0/554958148 >> [v2:172.21.15.6:6800/3509827796,v1:172.21.15.6:6801/3509827796] conn(0x7f2a440390b0 0x7f2a4403b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:43.952 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:42.999+0000 7f2a5d2f1700 1 -- 172.21.15.6:0/554958148 >> 172.21.15.6:0/554958148 conn(0x7f2a58102e00 msgr2=0x7f2a581036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:43.952 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:42.999+0000 7f2a5d2f1700 1 -- 172.21.15.6:0/554958148 shutdown_connections 2024-05-20T16:57:43.952 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:42.999+0000 7f2a5d2f1700 1 -- 172.21.15.6:0/554958148 wait complete. 2024-05-20T16:57:43.952 INFO:teuthology.orchestra.run.smithi006.stdout:mgr epoch 9 is available 2024-05-20T16:57:43.952 INFO:teuthology.orchestra.run.smithi006.stdout:Generating a dashboard self-signed certificate... 2024-05-20T16:57:44.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:44 smithi006 ceph-mon[32486]: [20/May/2024:16:57:42] ENGINE Serving on https://172.21.15.6:7150 2024-05-20T16:57:44.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:44 smithi006 ceph-mon[32486]: [20/May/2024:16:57:42] ENGINE Serving on http://172.21.15.6:8765 2024-05-20T16:57:44.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:44 smithi006 ceph-mon[32486]: [20/May/2024:16:57:42] ENGINE Bus STARTED 2024-05-20T16:57:44.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:44 smithi006 ceph-mon[32486]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-20T16:57:44.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:44 smithi006 ceph-mon[32486]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-20T16:57:44.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:57:45.351 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-20T16:57:45.352 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.395+0000 7f43b6569700 1 Processor -- start 2024-05-20T16:57:45.352 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.395+0000 7f43b6569700 1 -- start start 2024-05-20T16:57:45.352 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.395+0000 7f43b6569700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b007bc80 0x7f43b010b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:45.352 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.395+0000 7f43b6569700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f43b010b9f0 con 0x7f43b007bc80 2024-05-20T16:57:45.352 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.396+0000 7f43affff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b007bc80 0x7f43b010b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:45.352 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.396+0000 7f43affff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b007bc80 0x7f43b010b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40740/0 (socket says 172.21.15.6:40740) 2024-05-20T16:57:45.352 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.396+0000 7f43affff700 1 -- 172.21.15.6:0/1121463516 learned_addr learned my addr 172.21.15.6:0/1121463516 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:45.352 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.396+0000 7f43affff700 1 -- 172.21.15.6:0/1121463516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b010bb70 con 0x7f43b007bc80 2024-05-20T16:57:45.352 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.396+0000 7f43affff700 1 --2- 172.21.15.6:0/1121463516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b007bc80 0x7f43b010b400 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f43a00098a0 tx=0x7f43a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def11af852826a81 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:45.352 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.396+0000 7f43aeffd700 1 -- 172.21.15.6:0/1121463516 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a0004160 con 0x7f43b007bc80 2024-05-20T16:57:45.353 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.396+0000 7f43aeffd700 1 -- 172.21.15.6:0/1121463516 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f43a0004300 con 0x7f43b007bc80 2024-05-20T16:57:45.353 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.396+0000 7f43aeffd700 1 -- 172.21.15.6:0/1121463516 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a0011a50 con 0x7f43b007bc80 2024-05-20T16:57:45.353 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.397+0000 7f43b6569700 1 -- 172.21.15.6:0/1121463516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b007bc80 msgr2=0x7f43b010b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:45.353 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.397+0000 7f43b6569700 1 --2- 172.21.15.6:0/1121463516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b007bc80 0x7f43b010b400 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f43a00098a0 tx=0x7f43a0009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:45.353 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.397+0000 7f43b6569700 1 -- 172.21.15.6:0/1121463516 shutdown_connections 2024-05-20T16:57:45.353 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.397+0000 7f43b6569700 1 --2- 172.21.15.6:0/1121463516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b007bc80 0x7f43b010b400 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:45.353 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.397+0000 7f43b6569700 1 -- 172.21.15.6:0/1121463516 >> 172.21.15.6:0/1121463516 conn(0x7f43b0102df0 msgr2=0x7f43b01052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:45.353 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.397+0000 7f43b6569700 1 -- 172.21.15.6:0/1121463516 shutdown_connections 2024-05-20T16:57:45.353 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.397+0000 7f43b6569700 1 -- 172.21.15.6:0/1121463516 wait complete. 2024-05-20T16:57:45.353 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.398+0000 7f43b6569700 1 Processor -- start 2024-05-20T16:57:45.353 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.398+0000 7f43b6569700 1 -- start start 2024-05-20T16:57:45.353 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.399+0000 7f43b6569700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b007bc80 0x7f43b019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:45.353 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.399+0000 7f43b6569700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f43b010cc30 con 0x7f43b007bc80 2024-05-20T16:57:45.354 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.399+0000 7f43affff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b007bc80 0x7f43b019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:45.354 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.399+0000 7f43affff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b007bc80 0x7f43b019cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40742/0 (socket says 172.21.15.6:40742) 2024-05-20T16:57:45.354 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.399+0000 7f43affff700 1 -- 172.21.15.6:0/1104419955 learned_addr learned my addr 172.21.15.6:0/1104419955 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:45.354 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.399+0000 7f43affff700 1 -- 172.21.15.6:0/1104419955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b019d110 con 0x7f43b007bc80 2024-05-20T16:57:45.354 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.399+0000 7f43affff700 1 --2- 172.21.15.6:0/1104419955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b007bc80 0x7f43b019cbd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f43a0011710 tx=0x7f43a0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:45.354 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.399+0000 7f43ad7fa700 1 -- 172.21.15.6:0/1104419955 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a00039c0 con 0x7f43b007bc80 2024-05-20T16:57:45.354 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.399+0000 7f43b6569700 1 -- 172.21.15.6:0/1104419955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b019d3a0 con 0x7f43b007bc80 2024-05-20T16:57:45.354 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.399+0000 7f43ad7fa700 1 -- 172.21.15.6:0/1104419955 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f43a0003b60 con 0x7f43b007bc80 2024-05-20T16:57:45.354 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.399+0000 7f43ad7fa700 1 -- 172.21.15.6:0/1104419955 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a001a690 con 0x7f43b007bc80 2024-05-20T16:57:45.354 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.400+0000 7f43b6569700 1 -- 172.21.15.6:0/1104419955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b019ffb0 con 0x7f43b007bc80 2024-05-20T16:57:45.354 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.400+0000 7f43ad7fa700 1 -- 172.21.15.6:0/1104419955 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f43a001a990 con 0x7f43b007bc80 2024-05-20T16:57:45.354 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.401+0000 7f43b6569700 1 -- 172.21.15.6:0/1104419955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b0063ca0 con 0x7f43b007bc80 2024-05-20T16:57:45.354 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.401+0000 7f43ad7fa700 1 --2- 172.21.15.6:0/1104419955 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f439c038f40 0x7f439c03b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:45.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.401+0000 7f43ad7fa700 1 -- 172.21.15.6:0/1104419955 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f43a004d630 con 0x7f43b007bc80 2024-05-20T16:57:45.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.401+0000 7f43af7fe700 1 --2- 172.21.15.6:0/1104419955 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f439c038f40 0x7f439c03b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:45.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.401+0000 7f43af7fe700 1 --2- 172.21.15.6:0/1104419955 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f439c038f40 0x7f439c03b450 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4398006fd0 tx=0x7f4398006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:45.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.407+0000 7f43ad7fa700 1 -- 172.21.15.6:0/1104419955 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f43a0019c70 con 0x7f43b007bc80 2024-05-20T16:57:45.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.607+0000 7f43ad7fa700 1 -- 172.21.15.6:0/1104419955 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f43a002d910 con 0x7f43b007bc80 2024-05-20T16:57:45.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.649+0000 7f43b6569700 1 -- 172.21.15.6:0/1104419955 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f43b0103d70 con 0x7f439c038f40 2024-05-20T16:57:45.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.748+0000 7f43ad7fa700 1 -- 172.21.15.6:0/1104419955 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f43b0103d70 con 0x7f439c038f40 2024-05-20T16:57:45.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.750+0000 7f43b6569700 1 -- 172.21.15.6:0/1104419955 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f439c038f40 msgr2=0x7f439c03b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:45.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.750+0000 7f43b6569700 1 --2- 172.21.15.6:0/1104419955 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f439c038f40 0x7f439c03b450 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4398006fd0 tx=0x7f4398006e40 comp rx=0 tx=0).stop 2024-05-20T16:57:45.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.750+0000 7f43b6569700 1 -- 172.21.15.6:0/1104419955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b007bc80 msgr2=0x7f43b019cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:45.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.750+0000 7f43b6569700 1 --2- 172.21.15.6:0/1104419955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b007bc80 0x7f43b019cbd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f43a0011710 tx=0x7f43a0011ad0 comp rx=0 tx=0).stop 2024-05-20T16:57:45.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.750+0000 7f43b6569700 1 -- 172.21.15.6:0/1104419955 shutdown_connections 2024-05-20T16:57:45.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.750+0000 7f43b6569700 1 --2- 172.21.15.6:0/1104419955 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f439c038f40 0x7f439c03b450 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:45.356 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.750+0000 7f43b6569700 1 --2- 172.21.15.6:0/1104419955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43b007bc80 0x7f43b019cbd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:45.356 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.750+0000 7f43b6569700 1 -- 172.21.15.6:0/1104419955 >> 172.21.15.6:0/1104419955 conn(0x7f43b0102df0 msgr2=0x7f43b0103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:45.356 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.750+0000 7f43b6569700 1 -- 172.21.15.6:0/1104419955 shutdown_connections 2024-05-20T16:57:45.356 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:44.750+0000 7f43b6569700 1 -- 172.21.15.6:0/1104419955 wait complete. 2024-05-20T16:57:45.356 INFO:teuthology.orchestra.run.smithi006.stdout:Creating initial admin user... 2024-05-20T16:57:45.789 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:45 smithi006 ceph-mon[32486]: mgrmap e12: x(active, since 2s) 2024-05-20T16:57:45.789 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:45 smithi006 ceph-mon[32486]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:57:45.789 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:57:45.789 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:57:45.790 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:57:46.996 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$0NsrIJ4p6CyPeSPr4WtD5uW2HcmOAHOkanrKN6RW7NluY2UdnJp8C", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1716224266, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-20T16:57:46.996 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.828+0000 7fb4b782e700 1 Processor -- start 2024-05-20T16:57:46.996 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.829+0000 7fb4b782e700 1 -- start start 2024-05-20T16:57:46.996 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.829+0000 7fb4b782e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4b0109e30 0x7fb4b010a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:46.997 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.829+0000 7fb4b782e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b010a810 con 0x7fb4b0109e30 2024-05-20T16:57:46.997 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.829+0000 7fb4b55ca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4b0109e30 0x7fb4b010a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:46.997 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.829+0000 7fb4b55ca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4b0109e30 0x7fb4b010a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40748/0 (socket says 172.21.15.6:40748) 2024-05-20T16:57:46.997 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.829+0000 7fb4b55ca700 1 -- 172.21.15.6:0/2271918516 learned_addr learned my addr 172.21.15.6:0/2271918516 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:46.997 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.829+0000 7fb4b55ca700 1 -- 172.21.15.6:0/2271918516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b010a990 con 0x7fb4b0109e30 2024-05-20T16:57:46.997 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.829+0000 7fb4b55ca700 1 --2- 172.21.15.6:0/2271918516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4b0109e30 0x7fb4b010a240 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb4a40098a0 tx=0x7fb4a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8885e0bff8e0d88 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:46.997 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.830+0000 7fb4a3fff700 1 -- 172.21.15.6:0/2271918516 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4a4004160 con 0x7fb4b0109e30 2024-05-20T16:57:46.997 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.830+0000 7fb4a3fff700 1 -- 172.21.15.6:0/2271918516 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb4a4004300 con 0x7fb4b0109e30 2024-05-20T16:57:46.997 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.830+0000 7fb4a3fff700 1 -- 172.21.15.6:0/2271918516 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4a4011a50 con 0x7fb4b0109e30 2024-05-20T16:57:46.997 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.830+0000 7fb4b782e700 1 -- 172.21.15.6:0/2271918516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4b0109e30 msgr2=0x7fb4b010a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:46.997 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.830+0000 7fb4b782e700 1 --2- 172.21.15.6:0/2271918516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4b0109e30 0x7fb4b010a240 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb4a40098a0 tx=0x7fb4a4009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:46.997 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.831+0000 7fb4b782e700 1 -- 172.21.15.6:0/2271918516 shutdown_connections 2024-05-20T16:57:46.997 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.831+0000 7fb4b782e700 1 --2- 172.21.15.6:0/2271918516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4b0109e30 0x7fb4b010a240 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:46.998 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.831+0000 7fb4b782e700 1 -- 172.21.15.6:0/2271918516 >> 172.21.15.6:0/2271918516 conn(0x7fb4b0102570 msgr2=0x7fb4b0104a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:46.998 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.831+0000 7fb4b782e700 1 -- 172.21.15.6:0/2271918516 shutdown_connections 2024-05-20T16:57:46.998 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.831+0000 7fb4b782e700 1 -- 172.21.15.6:0/2271918516 wait complete. 2024-05-20T16:57:46.998 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.831+0000 7fb4b782e700 1 Processor -- start 2024-05-20T16:57:46.998 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.831+0000 7fb4b782e700 1 -- start start 2024-05-20T16:57:46.998 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.832+0000 7fb4b782e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4b0109e30 0x7fb4b0109320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:46.998 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.832+0000 7fb4b782e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b010cdd0 con 0x7fb4b0109e30 2024-05-20T16:57:46.998 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.832+0000 7fb4b55ca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4b0109e30 0x7fb4b0109320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:46.998 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.832+0000 7fb4b55ca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4b0109e30 0x7fb4b0109320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40754/0 (socket says 172.21.15.6:40754) 2024-05-20T16:57:46.998 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.832+0000 7fb4b55ca700 1 -- 172.21.15.6:0/4281662556 learned_addr learned my addr 172.21.15.6:0/4281662556 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:46.998 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.832+0000 7fb4b55ca700 1 -- 172.21.15.6:0/4281662556 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b0109860 con 0x7fb4b0109e30 2024-05-20T16:57:46.998 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.832+0000 7fb4b55ca700 1 --2- 172.21.15.6:0/4281662556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4b0109e30 0x7fb4b0109320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4011a20 tx=0x7fb4a4011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:46.998 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.832+0000 7fb4a27fc700 1 -- 172.21.15.6:0/4281662556 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4a4003af0 con 0x7fb4b0109e30 2024-05-20T16:57:46.999 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.832+0000 7fb4a27fc700 1 -- 172.21.15.6:0/4281662556 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb4a401a8e0 con 0x7fb4b0109e30 2024-05-20T16:57:46.999 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.832+0000 7fb4b782e700 1 -- 172.21.15.6:0/4281662556 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4b0107ab0 con 0x7fb4b0109e30 2024-05-20T16:57:46.999 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.833+0000 7fb4a27fc700 1 -- 172.21.15.6:0/4281662556 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4a4024860 con 0x7fb4b0109e30 2024-05-20T16:57:46.999 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.833+0000 7fb4b782e700 1 -- 172.21.15.6:0/4281662556 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4b0107f90 con 0x7fb4b0109e30 2024-05-20T16:57:46.999 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.833+0000 7fb4a27fc700 1 -- 172.21.15.6:0/4281662556 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fb4a4022020 con 0x7fb4b0109e30 2024-05-20T16:57:46.999 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.833+0000 7fb4b782e700 1 -- 172.21.15.6:0/4281662556 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4b0063ca0 con 0x7fb4b0109e30 2024-05-20T16:57:46.999 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.834+0000 7fb4a27fc700 1 --2- 172.21.15.6:0/4281662556 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb49c039100 0x7fb49c03b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:46.999 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.834+0000 7fb4a27fc700 1 -- 172.21.15.6:0/4281662556 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb4a404d430 con 0x7fb4b0109e30 2024-05-20T16:57:46.999 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.834+0000 7fb4b4dc9700 1 --2- 172.21.15.6:0/4281662556 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb49c039100 0x7fb49c03b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:46.999 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.835+0000 7fb4b4dc9700 1 --2- 172.21.15.6:0/4281662556 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb49c039100 0x7fb49c03b610 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac006fd0 tx=0x7fb4ac006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:46.999 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:45.840+0000 7fb4a27fc700 1 -- 172.21.15.6:0/4281662556 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb4a400b3e0 con 0x7fb4b0109e30 2024-05-20T16:57:46.999 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:46.075+0000 7fb4b782e700 1 -- 172.21.15.6:0/4281662556 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fb4b0108650 con 0x7fb49c039100 2024-05-20T16:57:46.999 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:46.323+0000 7fb4a27fc700 1 -- 172.21.15.6:0/4281662556 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fb4b0108650 con 0x7fb49c039100 2024-05-20T16:57:47.000 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:46.325+0000 7fb4b782e700 1 -- 172.21.15.6:0/4281662556 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb49c039100 msgr2=0x7fb49c03b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:47.000 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:46.325+0000 7fb4b782e700 1 --2- 172.21.15.6:0/4281662556 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb49c039100 0x7fb49c03b610 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac006fd0 tx=0x7fb4ac006e40 comp rx=0 tx=0).stop 2024-05-20T16:57:47.000 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:46.325+0000 7fb4b782e700 1 -- 172.21.15.6:0/4281662556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4b0109e30 msgr2=0x7fb4b0109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:47.000 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:46.325+0000 7fb4b782e700 1 --2- 172.21.15.6:0/4281662556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4b0109e30 0x7fb4b0109320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4011a20 tx=0x7fb4a4011b00 comp rx=0 tx=0).stop 2024-05-20T16:57:47.000 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:46.325+0000 7fb4b782e700 1 -- 172.21.15.6:0/4281662556 shutdown_connections 2024-05-20T16:57:47.000 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:46.325+0000 7fb4b782e700 1 --2- 172.21.15.6:0/4281662556 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb49c039100 0x7fb49c03b610 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:47.000 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:46.325+0000 7fb4b782e700 1 --2- 172.21.15.6:0/4281662556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4b0109e30 0x7fb4b0109320 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:47.000 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:46.325+0000 7fb4b782e700 1 -- 172.21.15.6:0/4281662556 >> 172.21.15.6:0/4281662556 conn(0x7fb4b0102570 msgr2=0x7fb4b0102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:47.000 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:46.326+0000 7fb4b782e700 1 -- 172.21.15.6:0/4281662556 shutdown_connections 2024-05-20T16:57:47.000 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:46.326+0000 7fb4b782e700 1 -- 172.21.15.6:0/4281662556 wait complete. 2024-05-20T16:57:47.000 INFO:teuthology.orchestra.run.smithi006.stdout:Fetching dashboard port number... 2024-05-20T16:57:47.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:47 smithi006 ceph-mon[32486]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:57:47.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:47 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:57:48.448 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:48 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3631487254' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-20T16:57:48.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 8443 2024-05-20T16:57:48.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.464+0000 7fea82dfd700 1 Processor -- start 2024-05-20T16:57:48.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.464+0000 7fea82dfd700 1 -- start start 2024-05-20T16:57:48.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.464+0000 7fea82dfd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea7c1071d0 0x7fea7c1075e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:48.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.464+0000 7fea82dfd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c07c640 con 0x7fea7c1071d0 2024-05-20T16:57:48.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.464+0000 7fea80b99700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea7c1071d0 0x7fea7c1075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:48.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.464+0000 7fea80b99700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea7c1071d0 0x7fea7c1075e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40770/0 (socket says 172.21.15.6:40770) 2024-05-20T16:57:48.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.464+0000 7fea80b99700 1 -- 172.21.15.6:0/4055615135 learned_addr learned my addr 172.21.15.6:0/4055615135 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:48.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.465+0000 7fea80b99700 1 -- 172.21.15.6:0/4055615135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7c107b20 con 0x7fea7c1071d0 2024-05-20T16:57:48.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.465+0000 7fea80b99700 1 --2- 172.21.15.6:0/4055615135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea7c1071d0 0x7fea7c1075e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fea700098a0 tx=0x7fea70009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae6b84c97037a2a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:48.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.465+0000 7fea7b7fe700 1 -- 172.21.15.6:0/4055615135 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea70004160 con 0x7fea7c1071d0 2024-05-20T16:57:48.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.465+0000 7fea7b7fe700 1 -- 172.21.15.6:0/4055615135 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fea70004300 con 0x7fea7c1071d0 2024-05-20T16:57:48.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.465+0000 7fea7b7fe700 1 -- 172.21.15.6:0/4055615135 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea70011a50 con 0x7fea7c1071d0 2024-05-20T16:57:48.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.466+0000 7fea82dfd700 1 -- 172.21.15.6:0/4055615135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea7c1071d0 msgr2=0x7fea7c1075e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:48.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.466+0000 7fea82dfd700 1 --2- 172.21.15.6:0/4055615135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea7c1071d0 0x7fea7c1075e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fea700098a0 tx=0x7fea70009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:48.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.466+0000 7fea82dfd700 1 -- 172.21.15.6:0/4055615135 shutdown_connections 2024-05-20T16:57:48.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.466+0000 7fea82dfd700 1 --2- 172.21.15.6:0/4055615135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea7c1071d0 0x7fea7c1075e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:48.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.466+0000 7fea82dfd700 1 -- 172.21.15.6:0/4055615135 >> 172.21.15.6:0/4055615135 conn(0x7fea7c102e40 msgr2=0x7fea7c1052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:48.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.466+0000 7fea82dfd700 1 -- 172.21.15.6:0/4055615135 shutdown_connections 2024-05-20T16:57:48.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.466+0000 7fea82dfd700 1 -- 172.21.15.6:0/4055615135 wait complete. 2024-05-20T16:57:48.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.467+0000 7fea82dfd700 1 Processor -- start 2024-05-20T16:57:48.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.467+0000 7fea82dfd700 1 -- start start 2024-05-20T16:57:48.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.467+0000 7fea82dfd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea7c1071d0 0x7fea7c19ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:48.458 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.467+0000 7fea82dfd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c108a60 con 0x7fea7c1071d0 2024-05-20T16:57:48.458 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.468+0000 7fea80b99700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea7c1071d0 0x7fea7c19ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:48.458 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.468+0000 7fea80b99700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea7c1071d0 0x7fea7c19ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40772/0 (socket says 172.21.15.6:40772) 2024-05-20T16:57:48.458 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.468+0000 7fea80b99700 1 -- 172.21.15.6:0/3631487254 learned_addr learned my addr 172.21.15.6:0/3631487254 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:48.458 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.468+0000 7fea80b99700 1 -- 172.21.15.6:0/3631487254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7c19f340 con 0x7fea7c1071d0 2024-05-20T16:57:48.458 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.468+0000 7fea80b99700 1 --2- 172.21.15.6:0/3631487254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea7c1071d0 0x7fea7c19ee00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fea70011a20 tx=0x7fea70011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:48.458 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.468+0000 7fea79ffb700 1 -- 172.21.15.6:0/3631487254 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea70003af0 con 0x7fea7c1071d0 2024-05-20T16:57:48.458 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.468+0000 7fea79ffb700 1 -- 172.21.15.6:0/3631487254 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fea7001a8e0 con 0x7fea7c1071d0 2024-05-20T16:57:48.458 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.468+0000 7fea82dfd700 1 -- 172.21.15.6:0/3631487254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea7c19f5d0 con 0x7fea7c1071d0 2024-05-20T16:57:48.458 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.468+0000 7fea79ffb700 1 -- 172.21.15.6:0/3631487254 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea70024860 con 0x7fea7c1071d0 2024-05-20T16:57:48.458 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.468+0000 7fea82dfd700 1 -- 172.21.15.6:0/3631487254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea7c1a21e0 con 0x7fea7c1071d0 2024-05-20T16:57:48.458 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.469+0000 7fea79ffb700 1 -- 172.21.15.6:0/3631487254 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fea70022020 con 0x7fea7c1071d0 2024-05-20T16:57:48.459 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.469+0000 7fea82dfd700 1 -- 172.21.15.6:0/3631487254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea7c063ca0 con 0x7fea7c1071d0 2024-05-20T16:57:48.459 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.470+0000 7fea79ffb700 1 --2- 172.21.15.6:0/3631487254 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fea6c0390a0 0x7fea6c03b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:48.459 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.470+0000 7fea79ffb700 1 -- 172.21.15.6:0/3631487254 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fea7004e320 con 0x7fea7c1071d0 2024-05-20T16:57:48.459 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.470+0000 7fea7bfff700 1 --2- 172.21.15.6:0/3631487254 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fea6c0390a0 0x7fea6c03b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:48.459 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.470+0000 7fea7bfff700 1 --2- 172.21.15.6:0/3631487254 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fea6c0390a0 0x7fea6c03b5b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fea68006fd0 tx=0x7fea68006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:48.459 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.475+0000 7fea79ffb700 1 -- 172.21.15.6:0/3631487254 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fea7000b3e0 con 0x7fea7c1071d0 2024-05-20T16:57:48.459 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.681+0000 7fea82dfd700 1 -- 172.21.15.6:0/3631487254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fea7c02ded0 con 0x7fea7c1071d0 2024-05-20T16:57:48.459 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.681+0000 7fea79ffb700 1 -- 172.21.15.6:0/3631487254 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fea7002ce10 con 0x7fea7c1071d0 2024-05-20T16:57:48.459 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.683+0000 7fea82dfd700 1 -- 172.21.15.6:0/3631487254 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fea6c0390a0 msgr2=0x7fea6c03b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:48.459 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.683+0000 7fea82dfd700 1 --2- 172.21.15.6:0/3631487254 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fea6c0390a0 0x7fea6c03b5b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fea68006fd0 tx=0x7fea68006e40 comp rx=0 tx=0).stop 2024-05-20T16:57:48.459 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.683+0000 7fea82dfd700 1 -- 172.21.15.6:0/3631487254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea7c1071d0 msgr2=0x7fea7c19ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:48.459 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.683+0000 7fea82dfd700 1 --2- 172.21.15.6:0/3631487254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea7c1071d0 0x7fea7c19ee00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fea70011a20 tx=0x7fea70011b00 comp rx=0 tx=0).stop 2024-05-20T16:57:48.459 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.684+0000 7fea82dfd700 1 -- 172.21.15.6:0/3631487254 shutdown_connections 2024-05-20T16:57:48.460 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.684+0000 7fea82dfd700 1 --2- 172.21.15.6:0/3631487254 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fea6c0390a0 0x7fea6c03b5b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:48.460 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.684+0000 7fea82dfd700 1 --2- 172.21.15.6:0/3631487254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea7c1071d0 0x7fea7c19ee00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:48.460 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.684+0000 7fea82dfd700 1 -- 172.21.15.6:0/3631487254 >> 172.21.15.6:0/3631487254 conn(0x7fea7c102e40 msgr2=0x7fea7c192da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:48.460 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.684+0000 7fea82dfd700 1 -- 172.21.15.6:0/3631487254 shutdown_connections 2024-05-20T16:57:48.460 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:47.684+0000 7fea82dfd700 1 -- 172.21.15.6:0/3631487254 wait complete. 2024-05-20T16:57:48.465 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-20T16:57:48.465 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout disabled 2024-05-20T16:57:48.474 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-20T16:57:48.474 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2024-05-20T16:57:48.474 INFO:teuthology.orchestra.run.smithi006.stdout:firewalld.service is not enabled 2024-05-20T16:57:48.474 INFO:teuthology.orchestra.run.smithi006.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-20T16:57:48.476 INFO:teuthology.orchestra.run.smithi006.stdout:Ceph Dashboard is now available at: 2024-05-20T16:57:48.476 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:57:48.476 INFO:teuthology.orchestra.run.smithi006.stdout: URL: https://smithi006.front.sepia.ceph.com:8443/ 2024-05-20T16:57:48.476 INFO:teuthology.orchestra.run.smithi006.stdout: User: admin 2024-05-20T16:57:48.476 INFO:teuthology.orchestra.run.smithi006.stdout: Password: 15f298o8is 2024-05-20T16:57:48.476 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:57:48.477 INFO:teuthology.orchestra.run.smithi006.stdout:Saving cluster configuration to /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config directory 2024-05-20T16:57:48.477 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling autotune for osd_memory_target 2024-05-20T16:57:49.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:49 smithi006 ceph-mon[32486]: mgrmap e13: x(active, since 6s) 2024-05-20T16:57:49.662 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.890+0000 7ff9b4d49700 1 Processor -- start 2024-05-20T16:57:49.662 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.890+0000 7ff9b4d49700 1 -- start start 2024-05-20T16:57:49.662 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.890+0000 7ff9b4d49700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b007c510 0x7ff9b010b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:49.662 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.890+0000 7ff9b4d49700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b010ba30 con 0x7ff9b007c510 2024-05-20T16:57:49.662 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.890+0000 7ff9ae59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b007c510 0x7ff9b010b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:49.662 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.891+0000 7ff9ae59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b007c510 0x7ff9b010b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40776/0 (socket says 172.21.15.6:40776) 2024-05-20T16:57:49.662 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.891+0000 7ff9ae59c700 1 -- 172.21.15.6:0/2324684740 learned_addr learned my addr 172.21.15.6:0/2324684740 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:49.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.891+0000 7ff9ae59c700 1 -- 172.21.15.6:0/2324684740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b010bbb0 con 0x7ff9b007c510 2024-05-20T16:57:49.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.891+0000 7ff9ae59c700 1 --2- 172.21.15.6:0/2324684740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b007c510 0x7ff9b010b440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00098a0 tx=0x7ff9a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a4a08f8bc1866f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:49.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.891+0000 7ff9ad59a700 1 -- 172.21.15.6:0/2324684740 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9a0004160 con 0x7ff9b007c510 2024-05-20T16:57:49.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.891+0000 7ff9ad59a700 1 -- 172.21.15.6:0/2324684740 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9a0004300 con 0x7ff9b007c510 2024-05-20T16:57:49.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.891+0000 7ff9ad59a700 1 -- 172.21.15.6:0/2324684740 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9a0011a50 con 0x7ff9b007c510 2024-05-20T16:57:49.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.892+0000 7ff9b4d49700 1 -- 172.21.15.6:0/2324684740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b007c510 msgr2=0x7ff9b010b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:49.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.892+0000 7ff9b4d49700 1 --2- 172.21.15.6:0/2324684740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b007c510 0x7ff9b010b440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00098a0 tx=0x7ff9a0009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:49.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.892+0000 7ff9b4d49700 1 -- 172.21.15.6:0/2324684740 shutdown_connections 2024-05-20T16:57:49.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.892+0000 7ff9b4d49700 1 --2- 172.21.15.6:0/2324684740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b007c510 0x7ff9b010b440 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:49.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.892+0000 7ff9b4d49700 1 -- 172.21.15.6:0/2324684740 >> 172.21.15.6:0/2324684740 conn(0x7ff9b0102ef0 msgr2=0x7ff9b0105340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:49.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.892+0000 7ff9b4d49700 1 -- 172.21.15.6:0/2324684740 shutdown_connections 2024-05-20T16:57:49.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.892+0000 7ff9b4d49700 1 -- 172.21.15.6:0/2324684740 wait complete. 2024-05-20T16:57:49.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.893+0000 7ff9b4d49700 1 Processor -- start 2024-05-20T16:57:49.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.893+0000 7ff9b4d49700 1 -- start start 2024-05-20T16:57:49.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.893+0000 7ff9b4d49700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b007c510 0x7ff9b019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:49.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.893+0000 7ff9b4d49700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b010cc70 con 0x7ff9b007c510 2024-05-20T16:57:49.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.893+0000 7ff9ae59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b007c510 0x7ff9b019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:49.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.893+0000 7ff9ae59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b007c510 0x7ff9b019cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40786/0 (socket says 172.21.15.6:40786) 2024-05-20T16:57:49.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.893+0000 7ff9ae59c700 1 -- 172.21.15.6:0/2986763274 learned_addr learned my addr 172.21.15.6:0/2986763274 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:49.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.894+0000 7ff9ae59c700 1 -- 172.21.15.6:0/2986763274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b019d130 con 0x7ff9b007c510 2024-05-20T16:57:49.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.894+0000 7ff9ae59c700 1 --2- 172.21.15.6:0/2986763274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b007c510 0x7ff9b019cbf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0011710 tx=0x7ff9a0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:49.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.894+0000 7ff99f7fe700 1 -- 172.21.15.6:0/2986763274 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9a00039c0 con 0x7ff9b007c510 2024-05-20T16:57:49.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.894+0000 7ff9b4d49700 1 -- 172.21.15.6:0/2986763274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b019d3c0 con 0x7ff9b007c510 2024-05-20T16:57:49.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.894+0000 7ff99f7fe700 1 -- 172.21.15.6:0/2986763274 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9a0003b60 con 0x7ff9b007c510 2024-05-20T16:57:49.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.894+0000 7ff99f7fe700 1 -- 172.21.15.6:0/2986763274 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9a001a690 con 0x7ff9b007c510 2024-05-20T16:57:49.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.894+0000 7ff9b4d49700 1 -- 172.21.15.6:0/2986763274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b019ffd0 con 0x7ff9b007c510 2024-05-20T16:57:49.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.895+0000 7ff99f7fe700 1 -- 172.21.15.6:0/2986763274 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7ff9a001a990 con 0x7ff9b007c510 2024-05-20T16:57:49.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.895+0000 7ff9b4d49700 1 -- 172.21.15.6:0/2986763274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b0063ca0 con 0x7ff9b007c510 2024-05-20T16:57:49.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.895+0000 7ff99f7fe700 1 --2- 172.21.15.6:0/2986763274 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff9980390f0 0x7ff99803b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:49.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.895+0000 7ff99f7fe700 1 -- 172.21.15.6:0/2986763274 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff9a004d980 con 0x7ff9b007c510 2024-05-20T16:57:49.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.896+0000 7ff9add9b700 1 --2- 172.21.15.6:0/2986763274 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff9980390f0 0x7ff99803b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:49.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.896+0000 7ff9add9b700 1 --2- 172.21.15.6:0/2986763274 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff9980390f0 0x7ff99803b600 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4006fd0 tx=0x7ff9a4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:49.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:48.901+0000 7ff99f7fe700 1 -- 172.21.15.6:0/2986763274 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff9a002c350 con 0x7ff9b007c510 2024-05-20T16:57:49.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:49.108+0000 7ff9b4d49700 1 -- 172.21.15.6:0/2986763274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7ff9b01076a0 con 0x7ff9b007c510 2024-05-20T16:57:49.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:49.108+0000 7ff99f7fe700 1 -- 172.21.15.6:0/2986763274 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7ff9a000bc50 con 0x7ff9b007c510 2024-05-20T16:57:49.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:49.111+0000 7ff9b4d49700 1 -- 172.21.15.6:0/2986763274 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff9980390f0 msgr2=0x7ff99803b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:49.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:49.111+0000 7ff9b4d49700 1 --2- 172.21.15.6:0/2986763274 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff9980390f0 0x7ff99803b600 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4006fd0 tx=0x7ff9a4006e40 comp rx=0 tx=0).stop 2024-05-20T16:57:49.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:49.111+0000 7ff9b4d49700 1 -- 172.21.15.6:0/2986763274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b007c510 msgr2=0x7ff9b019cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:49.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:49.111+0000 7ff9b4d49700 1 --2- 172.21.15.6:0/2986763274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b007c510 0x7ff9b019cbf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0011710 tx=0x7ff9a0011ad0 comp rx=0 tx=0).stop 2024-05-20T16:57:49.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:49.111+0000 7ff9b4d49700 1 -- 172.21.15.6:0/2986763274 shutdown_connections 2024-05-20T16:57:49.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:49.111+0000 7ff9b4d49700 1 --2- 172.21.15.6:0/2986763274 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff9980390f0 0x7ff99803b600 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:49.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:49.111+0000 7ff9b4d49700 1 --2- 172.21.15.6:0/2986763274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b007c510 0x7ff9b019cbf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:49.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:49.111+0000 7ff9b4d49700 1 -- 172.21.15.6:0/2986763274 >> 172.21.15.6:0/2986763274 conn(0x7ff9b0102ef0 msgr2=0x7ff9b01047c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:49.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:49.111+0000 7ff9b4d49700 1 -- 172.21.15.6:0/2986763274 shutdown_connections 2024-05-20T16:57:49.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:49.111+0000 7ff9b4d49700 1 -- 172.21.15.6:0/2986763274 wait complete. 2024-05-20T16:57:51.044 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.107+0000 7f00745f0700 1 Processor -- start 2024-05-20T16:57:51.044 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.107+0000 7f00745f0700 1 -- start start 2024-05-20T16:57:51.044 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.108+0000 7f00745f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f006c07e5d0 0x7f006c07caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:51.044 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.108+0000 7f00745f0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f006c07cfe0 con 0x7f006c07e5d0 2024-05-20T16:57:51.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.108+0000 7f007238c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f006c07e5d0 0x7f006c07caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:51.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.108+0000 7f007238c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f006c07e5d0 0x7f006c07caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40788/0 (socket says 172.21.15.6:40788) 2024-05-20T16:57:51.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.108+0000 7f007238c700 1 -- 172.21.15.6:0/2529214927 learned_addr learned my addr 172.21.15.6:0/2529214927 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:51.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.108+0000 7f007238c700 1 -- 172.21.15.6:0/2529214927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006c07d160 con 0x7f006c07e5d0 2024-05-20T16:57:51.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.108+0000 7f007238c700 1 --2- 172.21.15.6:0/2529214927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f006c07e5d0 0x7f006c07caa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f00680098a0 tx=0x7f0068009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf36a4143bdb0c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:51.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.109+0000 7f007138a700 1 -- 172.21.15.6:0/2529214927 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0068004160 con 0x7f006c07e5d0 2024-05-20T16:57:51.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.109+0000 7f007138a700 1 -- 172.21.15.6:0/2529214927 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0068004300 con 0x7f006c07e5d0 2024-05-20T16:57:51.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.109+0000 7f00745f0700 1 -- 172.21.15.6:0/2529214927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f006c07e5d0 msgr2=0x7f006c07caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:51.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.109+0000 7f00745f0700 1 --2- 172.21.15.6:0/2529214927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f006c07e5d0 0x7f006c07caa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f00680098a0 tx=0x7f0068009bb0 comp rx=0 tx=0).stop 2024-05-20T16:57:51.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.109+0000 7f00745f0700 1 -- 172.21.15.6:0/2529214927 shutdown_connections 2024-05-20T16:57:51.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.109+0000 7f00745f0700 1 --2- 172.21.15.6:0/2529214927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f006c07e5d0 0x7f006c07caa0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:51.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.109+0000 7f00745f0700 1 -- 172.21.15.6:0/2529214927 >> 172.21.15.6:0/2529214927 conn(0x7f006c103f80 msgr2=0x7f006c1063d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:51.045 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.110+0000 7f00745f0700 1 -- 172.21.15.6:0/2529214927 shutdown_connections 2024-05-20T16:57:51.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.110+0000 7f00745f0700 1 -- 172.21.15.6:0/2529214927 wait complete. 2024-05-20T16:57:51.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.110+0000 7f00745f0700 1 Processor -- start 2024-05-20T16:57:51.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.110+0000 7f00745f0700 1 -- start start 2024-05-20T16:57:51.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.110+0000 7f00745f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f006c07e5d0 0x7f006c19ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:51.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.110+0000 7f00745f0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f006c10ee80 con 0x7f006c07e5d0 2024-05-20T16:57:51.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.111+0000 7f007238c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f006c07e5d0 0x7f006c19ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:51.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.111+0000 7f007238c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f006c07e5d0 0x7f006c19ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40800/0 (socket says 172.21.15.6:40800) 2024-05-20T16:57:51.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.111+0000 7f007238c700 1 -- 172.21.15.6:0/3327539827 learned_addr learned my addr 172.21.15.6:0/3327539827 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:51.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.111+0000 7f007238c700 1 -- 172.21.15.6:0/3327539827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006c19f320 con 0x7f006c07e5d0 2024-05-20T16:57:51.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.111+0000 7f007238c700 1 --2- 172.21.15.6:0/3327539827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f006c07e5d0 0x7f006c19ede0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0068011890 tx=0x7f0068003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:51.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.111+0000 7f00637fe700 1 -- 172.21.15.6:0/3327539827 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f006801a640 con 0x7f006c07e5d0 2024-05-20T16:57:51.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.111+0000 7f00637fe700 1 -- 172.21.15.6:0/3327539827 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f006801ac90 con 0x7f006c07e5d0 2024-05-20T16:57:51.046 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.111+0000 7f00745f0700 1 -- 172.21.15.6:0/3327539827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f006c19f5b0 con 0x7f006c07e5d0 2024-05-20T16:57:51.047 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.111+0000 7f00637fe700 1 -- 172.21.15.6:0/3327539827 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0068024980 con 0x7f006c07e5d0 2024-05-20T16:57:51.047 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.111+0000 7f00745f0700 1 -- 172.21.15.6:0/3327539827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f006c1a2180 con 0x7f006c07e5d0 2024-05-20T16:57:51.047 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.112+0000 7f00637fe700 1 -- 172.21.15.6:0/3327539827 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f0068022020 con 0x7f006c07e5d0 2024-05-20T16:57:51.047 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.112+0000 7f00745f0700 1 -- 172.21.15.6:0/3327539827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f006c19fa10 con 0x7f006c07e5d0 2024-05-20T16:57:51.047 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.112+0000 7f00637fe700 1 --2- 172.21.15.6:0/3327539827 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0058039180 0x7f005803b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:51.047 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.113+0000 7f00637fe700 1 -- 172.21.15.6:0/3327539827 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f006804d390 con 0x7f006c07e5d0 2024-05-20T16:57:51.047 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.113+0000 7f0071b8b700 1 --2- 172.21.15.6:0/3327539827 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0058039180 0x7f005803b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:51.047 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.113+0000 7f0071b8b700 1 --2- 172.21.15.6:0/3327539827 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0058039180 0x7f005803b690 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f005c006fd0 tx=0x7f005c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:51.047 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.118+0000 7f00637fe700 1 -- 172.21.15.6:0/3327539827 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0068010380 con 0x7f006c07e5d0 2024-05-20T16:57:51.047 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.440+0000 7f00745f0700 1 -- 172.21.15.6:0/3327539827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f006c1a2350 con 0x7f006c07e5d0 2024-05-20T16:57:51.047 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.443+0000 7f00637fe700 1 -- 172.21.15.6:0/3327539827 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f006802a2a0 con 0x7f006c07e5d0 2024-05-20T16:57:51.047 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.445+0000 7f00745f0700 1 -- 172.21.15.6:0/3327539827 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0058039180 msgr2=0x7f005803b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:51.047 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.445+0000 7f00745f0700 1 --2- 172.21.15.6:0/3327539827 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0058039180 0x7f005803b690 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f005c006fd0 tx=0x7f005c006e40 comp rx=0 tx=0).stop 2024-05-20T16:57:51.048 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.445+0000 7f00745f0700 1 -- 172.21.15.6:0/3327539827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f006c07e5d0 msgr2=0x7f006c19ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:51.048 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.445+0000 7f00745f0700 1 --2- 172.21.15.6:0/3327539827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f006c07e5d0 0x7f006c19ede0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0068011890 tx=0x7f0068003960 comp rx=0 tx=0).stop 2024-05-20T16:57:51.048 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.445+0000 7f00745f0700 1 -- 172.21.15.6:0/3327539827 shutdown_connections 2024-05-20T16:57:51.048 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.445+0000 7f00745f0700 1 --2- 172.21.15.6:0/3327539827 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0058039180 0x7f005803b690 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:51.048 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.445+0000 7f00745f0700 1 --2- 172.21.15.6:0/3327539827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f006c07e5d0 0x7f006c19ede0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:51.048 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.445+0000 7f00745f0700 1 -- 172.21.15.6:0/3327539827 >> 172.21.15.6:0/3327539827 conn(0x7f006c103f80 msgr2=0x7f006c105860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:51.048 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.445+0000 7f00745f0700 1 -- 172.21.15.6:0/3327539827 shutdown_connections 2024-05-20T16:57:51.048 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2024-05-20T16:57:50.446+0000 7f00745f0700 1 -- 172.21.15.6:0/3327539827 wait complete. 2024-05-20T16:57:51.048 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-20T16:57:51.048 INFO:teuthology.orchestra.run.smithi006.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-20T16:57:51.048 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:57:51.048 INFO:teuthology.orchestra.run.smithi006.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-20T16:57:51.048 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:57:51.048 INFO:teuthology.orchestra.run.smithi006.stdout:Or, if you are only running a single cluster on this host: 2024-05-20T16:57:51.049 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:57:51.049 INFO:teuthology.orchestra.run.smithi006.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-20T16:57:51.049 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:57:51.049 INFO:teuthology.orchestra.run.smithi006.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-20T16:57:51.049 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:57:51.049 INFO:teuthology.orchestra.run.smithi006.stdout: ceph telemetry on 2024-05-20T16:57:51.049 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:57:51.049 INFO:teuthology.orchestra.run.smithi006.stdout:For more information see: 2024-05-20T16:57:51.049 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:57:51.049 INFO:teuthology.orchestra.run.smithi006.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-20T16:57:51.050 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:57:51.050 INFO:teuthology.orchestra.run.smithi006.stdout:Bootstrap complete. 2024-05-20T16:57:51.083 INFO:tasks.cephadm:Fetching config... 2024-05-20T16:57:51.084 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T16:57:51.084 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-20T16:57:51.101 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-20T16:57:51.101 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T16:57:51.101 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-20T16:57:51.158 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-20T16:57:51.158 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T16:57:51.158 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-20T16:57:51.224 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-20T16:57:51.224 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T16:57:51.225 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-20T16:57:51.281 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-20T16:57:51.281 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC38NkjrdOvxcl9qXYFu3Qytou3HhC+K39Wo4gnz001UZySSXab2nnIzLQiGOR5kShYSScmcTal43b6NA8N3G5RQNm0nG/fWC3dfPnPDc7Wz1wQD3zjpDtiPfZlI/xt1NVpZOuWJxwKwaTIpm+KKMcUI5KdT+eOj/xxSY3c4z5+87nJohKvT9byIgp+Mp3j1f/EkAxtf86PRjJYvhbLzeof3oBQg8olsodj0KQam9zFX5cz+xgHKlymlJ4JmUQ0IzNDh0vs/NkiwiiBEXUnVsKU/GLZJ313IM4uloupAWGjJhp0cgUOaknHua28fE64xPZ4Gi9GiLvfLJCi6AIMIFKdSyoaIsy5OyK7vLfDNHCNJx8T4db+hHiiTOTDZoP4/9G+9wJCFEPAyvEdQI4pHcQKfODvIjqksbGWpoy8TXPpP3cfB5ei6ArGOr2iy6msPbwv3CLZyagRadVOJqReW7DlDAnz9V898nawohZpiOVxakBb0gnS+7VQRGkf5l6g/4c= ceph-c726c954-16c9-11ef-bc9a-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-20T16:57:51.358 INFO:teuthology.orchestra.run.smithi006.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC38NkjrdOvxcl9qXYFu3Qytou3HhC+K39Wo4gnz001UZySSXab2nnIzLQiGOR5kShYSScmcTal43b6NA8N3G5RQNm0nG/fWC3dfPnPDc7Wz1wQD3zjpDtiPfZlI/xt1NVpZOuWJxwKwaTIpm+KKMcUI5KdT+eOj/xxSY3c4z5+87nJohKvT9byIgp+Mp3j1f/EkAxtf86PRjJYvhbLzeof3oBQg8olsodj0KQam9zFX5cz+xgHKlymlJ4JmUQ0IzNDh0vs/NkiwiiBEXUnVsKU/GLZJ313IM4uloupAWGjJhp0cgUOaknHua28fE64xPZ4Gi9GiLvfLJCi6AIMIFKdSyoaIsy5OyK7vLfDNHCNJx8T4db+hHiiTOTDZoP4/9G+9wJCFEPAyvEdQI4pHcQKfODvIjqksbGWpoy8TXPpP3cfB5ei6ArGOr2iy6msPbwv3CLZyagRadVOJqReW7DlDAnz9V898nawohZpiOVxakBb0gnS+7VQRGkf5l6g/4c= ceph-c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:57:51.370 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC38NkjrdOvxcl9qXYFu3Qytou3HhC+K39Wo4gnz001UZySSXab2nnIzLQiGOR5kShYSScmcTal43b6NA8N3G5RQNm0nG/fWC3dfPnPDc7Wz1wQD3zjpDtiPfZlI/xt1NVpZOuWJxwKwaTIpm+KKMcUI5KdT+eOj/xxSY3c4z5+87nJohKvT9byIgp+Mp3j1f/EkAxtf86PRjJYvhbLzeof3oBQg8olsodj0KQam9zFX5cz+xgHKlymlJ4JmUQ0IzNDh0vs/NkiwiiBEXUnVsKU/GLZJ313IM4uloupAWGjJhp0cgUOaknHua28fE64xPZ4Gi9GiLvfLJCi6AIMIFKdSyoaIsy5OyK7vLfDNHCNJx8T4db+hHiiTOTDZoP4/9G+9wJCFEPAyvEdQI4pHcQKfODvIjqksbGWpoy8TXPpP3cfB5ei6ArGOr2iy6msPbwv3CLZyagRadVOJqReW7DlDAnz9V898nawohZpiOVxakBb0gnS+7VQRGkf5l6g/4c= ceph-c726c954-16c9-11ef-bc9a-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-20T16:57:51.413 INFO:teuthology.orchestra.run.smithi062.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC38NkjrdOvxcl9qXYFu3Qytou3HhC+K39Wo4gnz001UZySSXab2nnIzLQiGOR5kShYSScmcTal43b6NA8N3G5RQNm0nG/fWC3dfPnPDc7Wz1wQD3zjpDtiPfZlI/xt1NVpZOuWJxwKwaTIpm+KKMcUI5KdT+eOj/xxSY3c4z5+87nJohKvT9byIgp+Mp3j1f/EkAxtf86PRjJYvhbLzeof3oBQg8olsodj0KQam9zFX5cz+xgHKlymlJ4JmUQ0IzNDh0vs/NkiwiiBEXUnVsKU/GLZJ313IM4uloupAWGjJhp0cgUOaknHua28fE64xPZ4Gi9GiLvfLJCi6AIMIFKdSyoaIsy5OyK7vLfDNHCNJx8T4db+hHiiTOTDZoP4/9G+9wJCFEPAyvEdQI4pHcQKfODvIjqksbGWpoy8TXPpP3cfB5ei6ArGOr2iy6msPbwv3CLZyagRadVOJqReW7DlDAnz9V898nawohZpiOVxakBb0gnS+7VQRGkf5l6g/4c= ceph-c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:57:51.426 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC38NkjrdOvxcl9qXYFu3Qytou3HhC+K39Wo4gnz001UZySSXab2nnIzLQiGOR5kShYSScmcTal43b6NA8N3G5RQNm0nG/fWC3dfPnPDc7Wz1wQD3zjpDtiPfZlI/xt1NVpZOuWJxwKwaTIpm+KKMcUI5KdT+eOj/xxSY3c4z5+87nJohKvT9byIgp+Mp3j1f/EkAxtf86PRjJYvhbLzeof3oBQg8olsodj0KQam9zFX5cz+xgHKlymlJ4JmUQ0IzNDh0vs/NkiwiiBEXUnVsKU/GLZJ313IM4uloupAWGjJhp0cgUOaknHua28fE64xPZ4Gi9GiLvfLJCi6AIMIFKdSyoaIsy5OyK7vLfDNHCNJx8T4db+hHiiTOTDZoP4/9G+9wJCFEPAyvEdQI4pHcQKfODvIjqksbGWpoy8TXPpP3cfB5ei6ArGOr2iy6msPbwv3CLZyagRadVOJqReW7DlDAnz9V898nawohZpiOVxakBb0gnS+7VQRGkf5l6g/4c= ceph-c726c954-16c9-11ef-bc9a-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-20T16:57:51.468 INFO:teuthology.orchestra.run.smithi171.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC38NkjrdOvxcl9qXYFu3Qytou3HhC+K39Wo4gnz001UZySSXab2nnIzLQiGOR5kShYSScmcTal43b6NA8N3G5RQNm0nG/fWC3dfPnPDc7Wz1wQD3zjpDtiPfZlI/xt1NVpZOuWJxwKwaTIpm+KKMcUI5KdT+eOj/xxSY3c4z5+87nJohKvT9byIgp+Mp3j1f/EkAxtf86PRjJYvhbLzeof3oBQg8olsodj0KQam9zFX5cz+xgHKlymlJ4JmUQ0IzNDh0vs/NkiwiiBEXUnVsKU/GLZJ313IM4uloupAWGjJhp0cgUOaknHua28fE64xPZ4Gi9GiLvfLJCi6AIMIFKdSyoaIsy5OyK7vLfDNHCNJx8T4db+hHiiTOTDZoP4/9G+9wJCFEPAyvEdQI4pHcQKfODvIjqksbGWpoy8TXPpP3cfB5ei6ArGOr2iy6msPbwv3CLZyagRadVOJqReW7DlDAnz9V898nawohZpiOVxakBb0gnS+7VQRGkf5l6g/4c= ceph-c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:57:51.480 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-20T16:57:51.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:51 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3327539827' entity='client.admin' 2024-05-20T16:57:51.727 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T16:57:54.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:54 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:57:54.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:54 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:57:54.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:54 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi006", "name": "osd_memory_target"}]: dispatch 2024-05-20T16:57:54.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:54 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:57:54.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:54 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:57:54.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:54 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:57:54.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.352+0000 7f535f264700 1 -- 172.21.15.6:0/1364819039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5358102aa0 msgr2=0x7f5358102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:54.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.352+0000 7f535f264700 1 --2- 172.21.15.6:0/1364819039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5358102aa0 0x7f5358102eb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f534c009910 tx=0x7f534c009c20 comp rx=0 tx=0).stop 2024-05-20T16:57:54.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.352+0000 7f535f264700 1 -- 172.21.15.6:0/1364819039 shutdown_connections 2024-05-20T16:57:54.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.352+0000 7f535f264700 1 --2- 172.21.15.6:0/1364819039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5358102aa0 0x7f5358102eb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:54.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.352+0000 7f535f264700 1 -- 172.21.15.6:0/1364819039 >> 172.21.15.6:0/1364819039 conn(0x7f53580fe0e0 msgr2=0x7f5358100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:54.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.352+0000 7f535f264700 1 -- 172.21.15.6:0/1364819039 shutdown_connections 2024-05-20T16:57:54.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.352+0000 7f535f264700 1 -- 172.21.15.6:0/1364819039 wait complete. 2024-05-20T16:57:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.353+0000 7f535f264700 1 Processor -- start 2024-05-20T16:57:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.353+0000 7f535f264700 1 -- start start 2024-05-20T16:57:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.353+0000 7f535f264700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5358102aa0 0x7f5358198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.353+0000 7f535f264700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5358108a60 con 0x7f5358102aa0 2024-05-20T16:57:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.354+0000 7f535d000700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5358102aa0 0x7f5358198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.354+0000 7f535d000700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5358102aa0 0x7f5358198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57542/0 (socket says 172.21.15.6:57542) 2024-05-20T16:57:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.354+0000 7f535d000700 1 -- 172.21.15.6:0/408666094 learned_addr learned my addr 172.21.15.6:0/408666094 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.354+0000 7f535d000700 1 -- 172.21.15.6:0/408666094 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5358198ad0 con 0x7f5358102aa0 2024-05-20T16:57:54.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.354+0000 7f535d000700 1 --2- 172.21.15.6:0/408666094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5358102aa0 0x7f5358198590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f534c0057d0 tx=0x7f534c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:54.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.354+0000 7f5355ffb700 1 -- 172.21.15.6:0/408666094 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f534c027070 con 0x7f5358102aa0 2024-05-20T16:57:54.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.354+0000 7f5355ffb700 1 -- 172.21.15.6:0/408666094 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f534c00be10 con 0x7f5358102aa0 2024-05-20T16:57:54.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.354+0000 7f535f264700 1 -- 172.21.15.6:0/408666094 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5358198d60 con 0x7f5358102aa0 2024-05-20T16:57:54.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.354+0000 7f5355ffb700 1 -- 172.21.15.6:0/408666094 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f534c022dd0 con 0x7f5358102aa0 2024-05-20T16:57:54.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.355+0000 7f535f264700 1 -- 172.21.15.6:0/408666094 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f535819b970 con 0x7f5358102aa0 2024-05-20T16:57:54.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.355+0000 7f535f264700 1 -- 172.21.15.6:0/408666094 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53581091e0 con 0x7f5358102aa0 2024-05-20T16:57:54.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.356+0000 7f5355ffb700 1 -- 172.21.15.6:0/408666094 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f534c02a070 con 0x7f5358102aa0 2024-05-20T16:57:54.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.356+0000 7f5355ffb700 1 --2- 172.21.15.6:0/408666094 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f53480390f0 0x7f534803b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:54.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.356+0000 7f5355ffb700 1 -- 172.21.15.6:0/408666094 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f534c01e030 con 0x7f5358102aa0 2024-05-20T16:57:54.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.356+0000 7f5357fff700 1 --2- 172.21.15.6:0/408666094 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f53480390f0 0x7f534803b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:54.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.357+0000 7f5357fff700 1 --2- 172.21.15.6:0/408666094 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f53480390f0 0x7f534803b600 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5344006fd0 tx=0x7f5344006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:54.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.362+0000 7f5355ffb700 1 -- 172.21.15.6:0/408666094 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f534c013070 con 0x7f5358102aa0 2024-05-20T16:57:54.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.571+0000 7f535f264700 1 -- 172.21.15.6:0/408666094 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f535802dd70 con 0x7f5358102aa0 2024-05-20T16:57:54.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.574+0000 7f5355ffb700 1 -- 172.21.15.6:0/408666094 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f534c0310c0 con 0x7f5358102aa0 2024-05-20T16:57:54.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.576+0000 7f535f264700 1 -- 172.21.15.6:0/408666094 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f53480390f0 msgr2=0x7f534803b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:54.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.576+0000 7f535f264700 1 --2- 172.21.15.6:0/408666094 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f53480390f0 0x7f534803b600 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5344006fd0 tx=0x7f5344006e40 comp rx=0 tx=0).stop 2024-05-20T16:57:54.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.576+0000 7f535f264700 1 -- 172.21.15.6:0/408666094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5358102aa0 msgr2=0x7f5358198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:54.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.576+0000 7f535f264700 1 --2- 172.21.15.6:0/408666094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5358102aa0 0x7f5358198590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f534c0057d0 tx=0x7f534c005800 comp rx=0 tx=0).stop 2024-05-20T16:57:54.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.577+0000 7f535f264700 1 -- 172.21.15.6:0/408666094 shutdown_connections 2024-05-20T16:57:54.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.577+0000 7f535f264700 1 --2- 172.21.15.6:0/408666094 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f53480390f0 0x7f534803b600 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:54.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.577+0000 7f535f264700 1 --2- 172.21.15.6:0/408666094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5358102aa0 0x7f5358198590 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:54.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.577+0000 7f535f264700 1 -- 172.21.15.6:0/408666094 >> 172.21.15.6:0/408666094 conn(0x7f53580fe0e0 msgr2=0x7f53580fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:54.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.577+0000 7f535f264700 1 -- 172.21.15.6:0/408666094 shutdown_connections 2024-05-20T16:57:54.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:54.577+0000 7f535f264700 1 -- 172.21.15.6:0/408666094 wait complete. 2024-05-20T16:57:55.726 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-20T16:57:55.726 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-20T16:57:55.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:55 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/408666094' entity='client.admin' 2024-05-20T16:57:55.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:55 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:57:55.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:55 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:57:55.982 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T16:57:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.423+0000 7f6d4cd33700 1 -- 172.21.15.6:0/2196613569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d48103550 msgr2=0x7f6d48105970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.423+0000 7f6d4cd33700 1 --2- 172.21.15.6:0/2196613569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d48103550 0x7f6d48105970 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800b0a0 tx=0x7f6d3800b3b0 comp rx=0 tx=0).stop 2024-05-20T16:57:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.423+0000 7f6d4cd33700 1 -- 172.21.15.6:0/2196613569 shutdown_connections 2024-05-20T16:57:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.423+0000 7f6d4cd33700 1 --2- 172.21.15.6:0/2196613569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d48103550 0x7f6d48105970 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.423+0000 7f6d4cd33700 1 -- 172.21.15.6:0/2196613569 >> 172.21.15.6:0/2196613569 conn(0x7f6d480fcf90 msgr2=0x7f6d480ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.424+0000 7f6d4cd33700 1 -- 172.21.15.6:0/2196613569 shutdown_connections 2024-05-20T16:57:57.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.424+0000 7f6d4cd33700 1 -- 172.21.15.6:0/2196613569 wait complete. 2024-05-20T16:57:57.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.424+0000 7f6d4cd33700 1 Processor -- start 2024-05-20T16:57:57.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.424+0000 7f6d4cd33700 1 -- start start 2024-05-20T16:57:57.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.425+0000 7f6d4cd33700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d48103550 0x7f6d48102cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:57.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.425+0000 7f6d4cd33700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6d48108a10 con 0x7f6d48103550 2024-05-20T16:57:57.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.425+0000 7f6d4659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d48103550 0x7f6d48102cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:57.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.425+0000 7f6d4659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d48103550 0x7f6d48102cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57562/0 (socket says 172.21.15.6:57562) 2024-05-20T16:57:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.425+0000 7f6d4659c700 1 -- 172.21.15.6:0/66606798 learned_addr learned my addr 172.21.15.6:0/66606798 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:57:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.425+0000 7f6d4659c700 1 -- 172.21.15.6:0/66606798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d48103210 con 0x7f6d48103550 2024-05-20T16:57:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.425+0000 7f6d4659c700 1 --2- 172.21.15.6:0/66606798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d48103550 0x7f6d48102cd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6d38007760 tx=0x7f6d38003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.425+0000 7f6d377fe700 1 -- 172.21.15.6:0/66606798 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d38017040 con 0x7f6d48103550 2024-05-20T16:57:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.425+0000 7f6d377fe700 1 -- 172.21.15.6:0/66606798 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6d38022070 con 0x7f6d48103550 2024-05-20T16:57:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.425+0000 7f6d4cd33700 1 -- 172.21.15.6:0/66606798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d48101460 con 0x7f6d48103550 2024-05-20T16:57:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.426+0000 7f6d377fe700 1 -- 172.21.15.6:0/66606798 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d3801d5a0 con 0x7f6d48103550 2024-05-20T16:57:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.426+0000 7f6d4cd33700 1 -- 172.21.15.6:0/66606798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d48101940 con 0x7f6d48103550 2024-05-20T16:57:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.426+0000 7f6d4cd33700 1 -- 172.21.15.6:0/66606798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d48109190 con 0x7f6d48103550 2024-05-20T16:57:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.426+0000 7f6d377fe700 1 -- 172.21.15.6:0/66606798 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f6d3801d8a0 con 0x7f6d48103550 2024-05-20T16:57:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.427+0000 7f6d377fe700 1 --2- 172.21.15.6:0/66606798 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6d300390f0 0x7f6d3003b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:57:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.427+0000 7f6d377fe700 1 -- 172.21.15.6:0/66606798 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6d3800f050 con 0x7f6d48103550 2024-05-20T16:57:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.427+0000 7f6d45d9b700 1 --2- 172.21.15.6:0/66606798 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6d300390f0 0x7f6d3003b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:57:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.427+0000 7f6d45d9b700 1 --2- 172.21.15.6:0/66606798 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6d300390f0 0x7f6d3003b600 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c006fd0 tx=0x7f6d3c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:57:57.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.432+0000 7f6d377fe700 1 -- 172.21.15.6:0/66606798 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6d38025c00 con 0x7f6d48103550 2024-05-20T16:57:57.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.643+0000 7f6d4cd33700 1 -- 172.21.15.6:0/66606798 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f6d48191440 con 0x7f6d300390f0 2024-05-20T16:57:57.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.647+0000 7f6d377fe700 1 -- 172.21.15.6:0/66606798 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6d48191440 con 0x7f6d300390f0 2024-05-20T16:57:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.649+0000 7f6d4cd33700 1 -- 172.21.15.6:0/66606798 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6d300390f0 msgr2=0x7f6d3003b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.649+0000 7f6d4cd33700 1 --2- 172.21.15.6:0/66606798 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6d300390f0 0x7f6d3003b600 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c006fd0 tx=0x7f6d3c006e40 comp rx=0 tx=0).stop 2024-05-20T16:57:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.649+0000 7f6d4cd33700 1 -- 172.21.15.6:0/66606798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d48103550 msgr2=0x7f6d48102cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:57:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.649+0000 7f6d4cd33700 1 --2- 172.21.15.6:0/66606798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d48103550 0x7f6d48102cd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6d38007760 tx=0x7f6d38003ce0 comp rx=0 tx=0).stop 2024-05-20T16:57:57.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.649+0000 7f6d4cd33700 1 -- 172.21.15.6:0/66606798 shutdown_connections 2024-05-20T16:57:57.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.649+0000 7f6d4cd33700 1 --2- 172.21.15.6:0/66606798 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6d300390f0 0x7f6d3003b600 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:57.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.649+0000 7f6d4cd33700 1 --2- 172.21.15.6:0/66606798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d48103550 0x7f6d48102cd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:57:57.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.649+0000 7f6d4cd33700 1 -- 172.21.15.6:0/66606798 >> 172.21.15.6:0/66606798 conn(0x7f6d480fcf90 msgr2=0x7f6d480fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:57:57.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.649+0000 7f6d4cd33700 1 -- 172.21.15.6:0/66606798 shutdown_connections 2024-05-20T16:57:57.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:57:57.649+0000 7f6d4cd33700 1 -- 172.21.15.6:0/66606798 wait complete. 2024-05-20T16:57:58.379 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi062 2024-05-20T16:57:58.379 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-20T16:57:58.380 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/etc/ceph/ceph.conf 2024-05-20T16:57:58.400 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-20T16:57:58.400 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-20T16:57:58.459 INFO:tasks.cephadm:Adding host smithi062 to orchestrator... 2024-05-20T16:57:58.459 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph orch host add smithi062 2024-05-20T16:57:58.710 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T16:57:58.953 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:58 smithi006 ceph-mon[32486]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:57:58.953 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:58 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:57:58.953 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:58 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:57:58.953 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:58 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:57:58.953 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:58 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:57:58.953 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:58 smithi006 ceph-mon[32486]: Updating smithi006:/etc/ceph/ceph.conf 2024-05-20T16:57:59.773 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:59 smithi006 ceph-mon[32486]: Updating smithi006:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T16:57:59.773 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:59 smithi006 ceph-mon[32486]: Updating smithi006:/etc/ceph/ceph.client.admin.keyring 2024-05-20T16:57:59.773 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:59 smithi006 ceph-mon[32486]: Updating smithi006:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T16:57:59.773 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:57:59.773 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:57:59.774 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:57:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:00.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.287+0000 7f0c595b8700 1 -- 172.21.15.6:0/3523745246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c54107a20 msgr2=0x7f0c54107e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:00.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.287+0000 7f0c595b8700 1 --2- 172.21.15.6:0/3523745246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c54107a20 0x7f0c54107e30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009910 tx=0x7f0c44009c20 comp rx=0 tx=0).stop 2024-05-20T16:58:00.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.287+0000 7f0c595b8700 1 -- 172.21.15.6:0/3523745246 shutdown_connections 2024-05-20T16:58:00.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.287+0000 7f0c595b8700 1 --2- 172.21.15.6:0/3523745246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c54107a20 0x7f0c54107e30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:00.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.287+0000 7f0c595b8700 1 -- 172.21.15.6:0/3523745246 >> 172.21.15.6:0/3523745246 conn(0x7f0c540fccb0 msgr2=0x7f0c540ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:00.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.287+0000 7f0c595b8700 1 -- 172.21.15.6:0/3523745246 shutdown_connections 2024-05-20T16:58:00.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.287+0000 7f0c595b8700 1 -- 172.21.15.6:0/3523745246 wait complete. 2024-05-20T16:58:00.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.288+0000 7f0c595b8700 1 Processor -- start 2024-05-20T16:58:00.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.288+0000 7f0c595b8700 1 -- start start 2024-05-20T16:58:00.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.288+0000 7f0c595b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c54107a20 0x7f0c5419e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:00.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.288+0000 7f0c595b8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5410d0a0 con 0x7f0c54107a20 2024-05-20T16:58:00.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.288+0000 7f0c52ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c54107a20 0x7f0c5419e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:00.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.288+0000 7f0c52ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c54107a20 0x7f0c5419e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57578/0 (socket says 172.21.15.6:57578) 2024-05-20T16:58:00.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.288+0000 7f0c52ffd700 1 -- 172.21.15.6:0/3442344974 learned_addr learned my addr 172.21.15.6:0/3442344974 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:58:00.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.289+0000 7f0c52ffd700 1 -- 172.21.15.6:0/3442344974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5419ea80 con 0x7f0c54107a20 2024-05-20T16:58:00.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.289+0000 7f0c52ffd700 1 --2- 172.21.15.6:0/3442344974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c54107a20 0x7f0c5419e540 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400b5c0 tx=0x7f0c44005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:00.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.289+0000 7f0c3bfff700 1 -- 172.21.15.6:0/3442344974 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c44026070 con 0x7f0c54107a20 2024-05-20T16:58:00.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.289+0000 7f0c595b8700 1 -- 172.21.15.6:0/3442344974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c5419ed10 con 0x7f0c54107a20 2024-05-20T16:58:00.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.289+0000 7f0c3bfff700 1 -- 172.21.15.6:0/3442344974 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c4400b750 con 0x7f0c54107a20 2024-05-20T16:58:00.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.289+0000 7f0c3bfff700 1 -- 172.21.15.6:0/3442344974 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c44003810 con 0x7f0c54107a20 2024-05-20T16:58:00.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.289+0000 7f0c595b8700 1 -- 172.21.15.6:0/3442344974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c541986d0 con 0x7f0c54107a20 2024-05-20T16:58:00.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.290+0000 7f0c3bfff700 1 -- 172.21.15.6:0/3442344974 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f0c44029070 con 0x7f0c54107a20 2024-05-20T16:58:00.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.290+0000 7f0c595b8700 1 -- 172.21.15.6:0/3442344974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c54104130 con 0x7f0c54107a20 2024-05-20T16:58:00.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.290+0000 7f0c3bfff700 1 --2- 172.21.15.6:0/3442344974 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0c3c0390f0 0x7f0c3c03b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:00.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.290+0000 7f0c3bfff700 1 -- 172.21.15.6:0/3442344974 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0c4401e070 con 0x7f0c54107a20 2024-05-20T16:58:00.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.290+0000 7f0c527fc700 1 --2- 172.21.15.6:0/3442344974 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0c3c0390f0 0x7f0c3c03b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:00.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.291+0000 7f0c527fc700 1 --2- 172.21.15.6:0/3442344974 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0c3c0390f0 0x7f0c3c03b600 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0c48006fd0 tx=0x7f0c48006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:00.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.296+0000 7f0c3bfff700 1 -- 172.21.15.6:0/3442344974 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0c44013070 con 0x7f0c54107a20 2024-05-20T16:58:00.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:00.504+0000 7f0c595b8700 1 -- 172.21.15.6:0/3442344974 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi062", "target": ["mon-mgr", ""]}) -- 0x7f0c54199be0 con 0x7f0c3c0390f0 2024-05-20T16:58:01.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:00 smithi006 ceph-mon[32486]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi062", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:58:02.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:01 smithi006 ceph-mon[32486]: Deploying cephadm binary to smithi062 2024-05-20T16:58:03.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:02 smithi006 ceph-mon[32486]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:04.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:04.790+0000 7f0c3bfff700 1 -- 172.21.15.6:0/3442344974 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f0c54199be0 con 0x7f0c3c0390f0 2024-05-20T16:58:04.790 INFO:teuthology.orchestra.run.smithi006.stdout:Added host 'smithi062' with addr '172.21.15.62' 2024-05-20T16:58:04.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:04.792+0000 7f0c595b8700 1 -- 172.21.15.6:0/3442344974 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0c3c0390f0 msgr2=0x7f0c3c03b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:04.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:04.792+0000 7f0c595b8700 1 --2- 172.21.15.6:0/3442344974 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0c3c0390f0 0x7f0c3c03b600 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0c48006fd0 tx=0x7f0c48006e40 comp rx=0 tx=0).stop 2024-05-20T16:58:04.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:04.793+0000 7f0c595b8700 1 -- 172.21.15.6:0/3442344974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c54107a20 msgr2=0x7f0c5419e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:04.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:04.793+0000 7f0c595b8700 1 --2- 172.21.15.6:0/3442344974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c54107a20 0x7f0c5419e540 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400b5c0 tx=0x7f0c44005780 comp rx=0 tx=0).stop 2024-05-20T16:58:04.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:04.793+0000 7f0c595b8700 1 -- 172.21.15.6:0/3442344974 shutdown_connections 2024-05-20T16:58:04.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:04.793+0000 7f0c595b8700 1 --2- 172.21.15.6:0/3442344974 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0c3c0390f0 0x7f0c3c03b600 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:04.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:04.793+0000 7f0c595b8700 1 --2- 172.21.15.6:0/3442344974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c54107a20 0x7f0c5419e540 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:04.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:04.793+0000 7f0c595b8700 1 -- 172.21.15.6:0/3442344974 >> 172.21.15.6:0/3442344974 conn(0x7f0c540fccb0 msgr2=0x7f0c54104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:04.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:04.793+0000 7f0c595b8700 1 -- 172.21.15.6:0/3442344974 shutdown_connections 2024-05-20T16:58:04.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:04.793+0000 7f0c595b8700 1 -- 172.21.15.6:0/3442344974 wait complete. 2024-05-20T16:58:05.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:05 smithi006 ceph-mon[32486]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:05.362 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:05 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:05.362 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:05 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:58:05.396 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph orch host ls --format=json 2024-05-20T16:58:05.647 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T16:58:06.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:06 smithi006 ceph-mon[32486]: Added host smithi062 2024-05-20T16:58:06.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:06 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:06.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:06 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.288+0000 7f7aab518700 1 -- 172.21.15.6:0/3487250483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa41089f0 msgr2=0x7f7aa4108e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:07.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.288+0000 7f7aab518700 1 --2- 172.21.15.6:0/3487250483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa41089f0 0x7f7aa4108e00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009910 tx=0x7f7aa0009c20 comp rx=0 tx=0).stop 2024-05-20T16:58:07.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.288+0000 7f7aab518700 1 -- 172.21.15.6:0/3487250483 shutdown_connections 2024-05-20T16:58:07.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.288+0000 7f7aab518700 1 --2- 172.21.15.6:0/3487250483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa41089f0 0x7f7aa4108e00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:07.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.288+0000 7f7aab518700 1 -- 172.21.15.6:0/3487250483 >> 172.21.15.6:0/3487250483 conn(0x7f7aa40fe4e0 msgr2=0x7f7aa4100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:07.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.288+0000 7f7aab518700 1 -- 172.21.15.6:0/3487250483 shutdown_connections 2024-05-20T16:58:07.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.288+0000 7f7aab518700 1 -- 172.21.15.6:0/3487250483 wait complete. 2024-05-20T16:58:07.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.289+0000 7f7aab518700 1 Processor -- start 2024-05-20T16:58:07.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.289+0000 7f7aab518700 1 -- start start 2024-05-20T16:58:07.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.289+0000 7f7aab518700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa41089f0 0x7f7aa41a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:07.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.289+0000 7f7aab518700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa410cf40 con 0x7f7aa41089f0 2024-05-20T16:58:07.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.289+0000 7f7aa92b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa41089f0 0x7f7aa41a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:07.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.289+0000 7f7aa92b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa41089f0 0x7f7aa41a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40664/0 (socket says 172.21.15.6:40664) 2024-05-20T16:58:07.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.289+0000 7f7aa92b4700 1 -- 172.21.15.6:0/961901760 learned_addr learned my addr 172.21.15.6:0/961901760 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:58:07.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.289+0000 7f7aa92b4700 1 -- 172.21.15.6:0/961901760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa41a0af0 con 0x7f7aa41089f0 2024-05-20T16:58:07.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.290+0000 7f7aa92b4700 1 --2- 172.21.15.6:0/961901760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa41089f0 0x7f7aa41a05b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00056d0 tx=0x7f7aa00057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:07.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.290+0000 7f7a9a7fc700 1 -- 172.21.15.6:0/961901760 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aa0027070 con 0x7f7aa41089f0 2024-05-20T16:58:07.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.290+0000 7f7a9a7fc700 1 -- 172.21.15.6:0/961901760 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7aa000be10 con 0x7f7aa41089f0 2024-05-20T16:58:07.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.290+0000 7f7aab518700 1 -- 172.21.15.6:0/961901760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa41a0de0 con 0x7f7aa41089f0 2024-05-20T16:58:07.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.290+0000 7f7a9a7fc700 1 -- 172.21.15.6:0/961901760 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aa0022d20 con 0x7f7aa41089f0 2024-05-20T16:58:07.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.290+0000 7f7aab518700 1 -- 172.21.15.6:0/961901760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa419a7f0 con 0x7f7aa41089f0 2024-05-20T16:58:07.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.291+0000 7f7a9a7fc700 1 -- 172.21.15.6:0/961901760 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f7aa002a070 con 0x7f7aa41089f0 2024-05-20T16:58:07.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.291+0000 7f7aab518700 1 -- 172.21.15.6:0/961901760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aa4104100 con 0x7f7aa41089f0 2024-05-20T16:58:07.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.291+0000 7f7a9a7fc700 1 --2- 172.21.15.6:0/961901760 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7a900390f0 0x7f7a9003b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:07.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.291+0000 7f7a9a7fc700 1 -- 172.21.15.6:0/961901760 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7aa001e030 con 0x7f7aa41089f0 2024-05-20T16:58:07.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.292+0000 7f7aa8ab3700 1 --2- 172.21.15.6:0/961901760 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7a900390f0 0x7f7a9003b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:07.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.292+0000 7f7aa8ab3700 1 --2- 172.21.15.6:0/961901760 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7a900390f0 0x7f7a9003b600 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7a94006fd0 tx=0x7f7a94006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:07.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.297+0000 7f7a9a7fc700 1 -- 172.21.15.6:0/961901760 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7aa0013070 con 0x7f7aa41089f0 2024-05-20T16:58:07.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.510+0000 7f7aab518700 1 -- 172.21.15.6:0/961901760 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7aa419bd00 con 0x7f7a900390f0 2024-05-20T16:58:07.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.512+0000 7f7a9a7fc700 1 -- 172.21.15.6:0/961901760 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+158 (secure 0 0 0) 0x7f7aa419bd00 con 0x7f7a900390f0 2024-05-20T16:58:07.512 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:58:07.512 INFO:teuthology.orchestra.run.smithi006.stdout:[{"addr": "172.21.15.6", "hostname": "smithi006", "labels": [], "status": ""}, {"addr": "172.21.15.62", "hostname": "smithi062", "labels": [], "status": ""}] 2024-05-20T16:58:07.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.514+0000 7f7aab518700 1 -- 172.21.15.6:0/961901760 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7a900390f0 msgr2=0x7f7a9003b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:07.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.514+0000 7f7aab518700 1 --2- 172.21.15.6:0/961901760 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7a900390f0 0x7f7a9003b600 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7a94006fd0 tx=0x7f7a94006e40 comp rx=0 tx=0).stop 2024-05-20T16:58:07.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.514+0000 7f7aab518700 1 -- 172.21.15.6:0/961901760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa41089f0 msgr2=0x7f7aa41a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:07.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.514+0000 7f7aab518700 1 --2- 172.21.15.6:0/961901760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa41089f0 0x7f7aa41a05b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00056d0 tx=0x7f7aa00057b0 comp rx=0 tx=0).stop 2024-05-20T16:58:07.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.515+0000 7f7aab518700 1 -- 172.21.15.6:0/961901760 shutdown_connections 2024-05-20T16:58:07.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.515+0000 7f7aab518700 1 --2- 172.21.15.6:0/961901760 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7a900390f0 0x7f7a9003b600 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:07.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.515+0000 7f7aab518700 1 --2- 172.21.15.6:0/961901760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa41089f0 0x7f7aa41a05b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:07.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.515+0000 7f7aab518700 1 -- 172.21.15.6:0/961901760 >> 172.21.15.6:0/961901760 conn(0x7f7aa40fe4e0 msgr2=0x7f7aa40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:07.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.515+0000 7f7aab518700 1 -- 172.21.15.6:0/961901760 shutdown_connections 2024-05-20T16:58:07.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:07.515+0000 7f7aab518700 1 -- 172.21.15.6:0/961901760 wait complete. 2024-05-20T16:58:07.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:07 smithi006 ceph-mon[32486]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:08.091 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi171 2024-05-20T16:58:08.091 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T16:58:08.091 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/etc/ceph/ceph.conf 2024-05-20T16:58:08.110 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T16:58:08.110 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-20T16:58:08.168 INFO:tasks.cephadm:Adding host smithi171 to orchestrator... 2024-05-20T16:58:08.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph orch host add smithi171 2024-05-20T16:58:08.409 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T16:58:08.827 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:08 smithi006 ceph-mon[32486]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T16:58:08.827 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:09.708 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:09 smithi006 ceph-mon[32486]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:09.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.964+0000 7f3999bce700 1 -- 172.21.15.6:0/3790640515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39941089f0 msgr2=0x7f3994108e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:09.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.964+0000 7f3999bce700 1 --2- 172.21.15.6:0/3790640515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39941089f0 0x7f3994108e00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3988009910 tx=0x7f3988009c20 comp rx=0 tx=0).stop 2024-05-20T16:58:09.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.964+0000 7f3999bce700 1 -- 172.21.15.6:0/3790640515 shutdown_connections 2024-05-20T16:58:09.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.964+0000 7f3999bce700 1 --2- 172.21.15.6:0/3790640515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39941089f0 0x7f3994108e00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:09.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.964+0000 7f3999bce700 1 -- 172.21.15.6:0/3790640515 >> 172.21.15.6:0/3790640515 conn(0x7f39940fe4e0 msgr2=0x7f3994100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:09.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.964+0000 7f3999bce700 1 -- 172.21.15.6:0/3790640515 shutdown_connections 2024-05-20T16:58:09.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.964+0000 7f3999bce700 1 -- 172.21.15.6:0/3790640515 wait complete. 2024-05-20T16:58:09.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.965+0000 7f3999bce700 1 Processor -- start 2024-05-20T16:58:09.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.965+0000 7f3999bce700 1 -- start start 2024-05-20T16:58:09.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.965+0000 7f3999bce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39941089f0 0x7f39941987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:09.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.965+0000 7f3999bce700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f399410cf40 con 0x7f39941089f0 2024-05-20T16:58:09.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.965+0000 7f39937fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39941089f0 0x7f39941987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:09.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.965+0000 7f39937fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39941089f0 0x7f39941987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40692/0 (socket says 172.21.15.6:40692) 2024-05-20T16:58:09.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.965+0000 7f39937fe700 1 -- 172.21.15.6:0/752613862 learned_addr learned my addr 172.21.15.6:0/752613862 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:58:09.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.966+0000 7f39937fe700 1 -- 172.21.15.6:0/752613862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3994198d20 con 0x7f39941089f0 2024-05-20T16:58:09.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.966+0000 7f39937fe700 1 --2- 172.21.15.6:0/752613862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39941089f0 0x7f39941987e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f39880056d0 tx=0x7f39880057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:09.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.966+0000 7f3990ff9700 1 -- 172.21.15.6:0/752613862 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3988027070 con 0x7f39941089f0 2024-05-20T16:58:09.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.966+0000 7f3990ff9700 1 -- 172.21.15.6:0/752613862 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f398800be10 con 0x7f39941089f0 2024-05-20T16:58:09.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.966+0000 7f3999bce700 1 -- 172.21.15.6:0/752613862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3994199010 con 0x7f39941089f0 2024-05-20T16:58:09.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.966+0000 7f3990ff9700 1 -- 172.21.15.6:0/752613862 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3988022d20 con 0x7f39941089f0 2024-05-20T16:58:09.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.966+0000 7f3999bce700 1 -- 172.21.15.6:0/752613862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f399419d010 con 0x7f39941089f0 2024-05-20T16:58:09.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.967+0000 7f3990ff9700 1 -- 172.21.15.6:0/752613862 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f398802a070 con 0x7f39941089f0 2024-05-20T16:58:09.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.967+0000 7f3999bce700 1 -- 172.21.15.6:0/752613862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3994104100 con 0x7f39941089f0 2024-05-20T16:58:09.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.967+0000 7f3990ff9700 1 --2- 172.21.15.6:0/752613862 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f397c0390f0 0x7f397c03b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:09.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.968+0000 7f3990ff9700 1 -- 172.21.15.6:0/752613862 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f398801e030 con 0x7f39941089f0 2024-05-20T16:58:09.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.968+0000 7f3992ffd700 1 --2- 172.21.15.6:0/752613862 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f397c0390f0 0x7f397c03b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:09.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.968+0000 7f3992ffd700 1 --2- 172.21.15.6:0/752613862 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f397c0390f0 0x7f397c03b600 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3984006fd0 tx=0x7f3984006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:09.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:09.973+0000 7f3990ff9700 1 -- 172.21.15.6:0/752613862 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3988013070 con 0x7f39941089f0 2024-05-20T16:58:10.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:10.185+0000 7f3999bce700 1 -- 172.21.15.6:0/752613862 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi171", "target": ["mon-mgr", ""]}) -- 0x7f3994199b40 con 0x7f397c0390f0 2024-05-20T16:58:12.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:11 smithi006 ceph-mon[32486]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:12.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:11 smithi006 ceph-mon[32486]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi171", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:58:12.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:12.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:12.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:12.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:12.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi062", "name": "osd_memory_target"}]: dispatch 2024-05-20T16:58:12.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:12.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:58:12.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:11 smithi006 ceph-mon[32486]: Updating smithi062:/etc/ceph/ceph.conf 2024-05-20T16:58:13.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:12 smithi006 ceph-mon[32486]: Deploying cephadm binary to smithi171 2024-05-20T16:58:13.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:12 smithi006 ceph-mon[32486]: Updating smithi062:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T16:58:13.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:12 smithi006 ceph-mon[32486]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-05-20T16:58:13.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:12 smithi006 ceph-mon[32486]: Updating smithi062:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T16:58:14.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:13 smithi006 ceph-mon[32486]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:14.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:14.557+0000 7f3990ff9700 1 -- 172.21.15.6:0/752613862 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f3994199b40 con 0x7f397c0390f0 2024-05-20T16:58:14.557 INFO:teuthology.orchestra.run.smithi006.stdout:Added host 'smithi171' with addr '172.21.15.171' 2024-05-20T16:58:14.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:14.559+0000 7f3999bce700 1 -- 172.21.15.6:0/752613862 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f397c0390f0 msgr2=0x7f397c03b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:14.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:14.559+0000 7f3999bce700 1 --2- 172.21.15.6:0/752613862 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f397c0390f0 0x7f397c03b600 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3984006fd0 tx=0x7f3984006e40 comp rx=0 tx=0).stop 2024-05-20T16:58:14.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:14.560+0000 7f3999bce700 1 -- 172.21.15.6:0/752613862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39941089f0 msgr2=0x7f39941987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:14.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:14.560+0000 7f3999bce700 1 --2- 172.21.15.6:0/752613862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39941089f0 0x7f39941987e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f39880056d0 tx=0x7f39880057b0 comp rx=0 tx=0).stop 2024-05-20T16:58:14.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:14.560+0000 7f3999bce700 1 -- 172.21.15.6:0/752613862 shutdown_connections 2024-05-20T16:58:14.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:14.560+0000 7f3999bce700 1 --2- 172.21.15.6:0/752613862 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f397c0390f0 0x7f397c03b600 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:14.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:14.560+0000 7f3999bce700 1 --2- 172.21.15.6:0/752613862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39941089f0 0x7f39941987e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:14.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:14.560+0000 7f3999bce700 1 -- 172.21.15.6:0/752613862 >> 172.21.15.6:0/752613862 conn(0x7f39940fe4e0 msgr2=0x7f39940ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:14.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:14.560+0000 7f3999bce700 1 -- 172.21.15.6:0/752613862 shutdown_connections 2024-05-20T16:58:14.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:14.560+0000 7f3999bce700 1 -- 172.21.15.6:0/752613862 wait complete. 2024-05-20T16:58:15.271 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:15 smithi006 ceph-mon[32486]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:15.271 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:15 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:15.271 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:15 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:15.271 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:15 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:15.271 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:15 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:15.271 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:15 smithi006 ceph-mon[32486]: Added host smithi171 2024-05-20T16:58:15.271 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:15 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:58:15.302 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph orch host ls --format=json 2024-05-20T16:58:15.547 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T16:58:16.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:16 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:16.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:16 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:17.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.263+0000 7fcd6b0fb700 1 -- 172.21.15.6:0/2823541684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd64103b70 msgr2=0x7fcd64103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:17.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.263+0000 7fcd6b0fb700 1 --2- 172.21.15.6:0/2823541684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd64103b70 0x7fcd64103f80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009910 tx=0x7fcd54009c20 comp rx=0 tx=0).stop 2024-05-20T16:58:17.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.263+0000 7fcd6b0fb700 1 -- 172.21.15.6:0/2823541684 shutdown_connections 2024-05-20T16:58:17.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.263+0000 7fcd6b0fb700 1 --2- 172.21.15.6:0/2823541684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd64103b70 0x7fcd64103f80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:17.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.263+0000 7fcd6b0fb700 1 -- 172.21.15.6:0/2823541684 >> 172.21.15.6:0/2823541684 conn(0x7fcd64077430 msgr2=0x7fcd64077890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:17.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.263+0000 7fcd6b0fb700 1 -- 172.21.15.6:0/2823541684 shutdown_connections 2024-05-20T16:58:17.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.263+0000 7fcd6b0fb700 1 -- 172.21.15.6:0/2823541684 wait complete. 2024-05-20T16:58:17.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.264+0000 7fcd6b0fb700 1 Processor -- start 2024-05-20T16:58:17.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.264+0000 7fcd6b0fb700 1 -- start start 2024-05-20T16:58:17.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.264+0000 7fcd6b0fb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd64103b70 0x7fcd641987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:17.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.264+0000 7fcd6b0fb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6410cfd0 con 0x7fcd64103b70 2024-05-20T16:58:17.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.265+0000 7fcd68e97700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd64103b70 0x7fcd641987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:17.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.265+0000 7fcd68e97700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd64103b70 0x7fcd641987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51344/0 (socket says 172.21.15.6:51344) 2024-05-20T16:58:17.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.265+0000 7fcd68e97700 1 -- 172.21.15.6:0/2773372461 learned_addr learned my addr 172.21.15.6:0/2773372461 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:58:17.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.265+0000 7fcd68e97700 1 -- 172.21.15.6:0/2773372461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd64198d20 con 0x7fcd64103b70 2024-05-20T16:58:17.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.265+0000 7fcd68e97700 1 --2- 172.21.15.6:0/2773372461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd64103b70 0x7fcd641987e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcd54006010 tx=0x7fcd54005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:17.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.265+0000 7fcd61ffb700 1 -- 172.21.15.6:0/2773372461 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd54026070 con 0x7fcd64103b70 2024-05-20T16:58:17.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.265+0000 7fcd6b0fb700 1 -- 172.21.15.6:0/2773372461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd64198fb0 con 0x7fcd64103b70 2024-05-20T16:58:17.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.265+0000 7fcd61ffb700 1 -- 172.21.15.6:0/2773372461 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcd5400bc00 con 0x7fcd64103b70 2024-05-20T16:58:17.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.265+0000 7fcd61ffb700 1 -- 172.21.15.6:0/2773372461 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd54003910 con 0x7fcd64103b70 2024-05-20T16:58:17.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.266+0000 7fcd6b0fb700 1 -- 172.21.15.6:0/2773372461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd64199410 con 0x7fcd64103b70 2024-05-20T16:58:17.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.266+0000 7fcd61ffb700 1 -- 172.21.15.6:0/2773372461 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fcd54029070 con 0x7fcd64103b70 2024-05-20T16:58:17.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.267+0000 7fcd6b0fb700 1 -- 172.21.15.6:0/2773372461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd6406a4f0 con 0x7fcd64103b70 2024-05-20T16:58:17.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.267+0000 7fcd61ffb700 1 --2- 172.21.15.6:0/2773372461 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fcd4c0390f0 0x7fcd4c03b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:17.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.267+0000 7fcd61ffb700 1 -- 172.21.15.6:0/2773372461 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcd5401e070 con 0x7fcd64103b70 2024-05-20T16:58:17.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.267+0000 7fcd63fff700 1 --2- 172.21.15.6:0/2773372461 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fcd4c0390f0 0x7fcd4c03b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:17.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.267+0000 7fcd63fff700 1 --2- 172.21.15.6:0/2773372461 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fcd4c0390f0 0x7fcd4c03b600 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcd58006fd0 tx=0x7fcd58006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:17.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.274+0000 7fcd61ffb700 1 -- 172.21.15.6:0/2773372461 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcd54013070 con 0x7fcd64103b70 2024-05-20T16:58:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.482+0000 7fcd6b0fb700 1 -- 172.21.15.6:0/2773372461 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcd64199b40 con 0x7fcd4c0390f0 2024-05-20T16:58:17.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.483+0000 7fcd61ffb700 1 -- 172.21.15.6:0/2773372461 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+238 (secure 0 0 0) 0x7fcd64199b40 con 0x7fcd4c0390f0 2024-05-20T16:58:17.484 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T16:58:17.484 INFO:teuthology.orchestra.run.smithi006.stdout:[{"addr": "172.21.15.6", "hostname": "smithi006", "labels": [], "status": ""}, {"addr": "172.21.15.62", "hostname": "smithi062", "labels": [], "status": ""}, {"addr": "172.21.15.171", "hostname": "smithi171", "labels": [], "status": ""}] 2024-05-20T16:58:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.485+0000 7fcd6b0fb700 1 -- 172.21.15.6:0/2773372461 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fcd4c0390f0 msgr2=0x7fcd4c03b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.485+0000 7fcd6b0fb700 1 --2- 172.21.15.6:0/2773372461 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fcd4c0390f0 0x7fcd4c03b600 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcd58006fd0 tx=0x7fcd58006e40 comp rx=0 tx=0).stop 2024-05-20T16:58:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.485+0000 7fcd6b0fb700 1 -- 172.21.15.6:0/2773372461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd64103b70 msgr2=0x7fcd641987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.485+0000 7fcd6b0fb700 1 --2- 172.21.15.6:0/2773372461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd64103b70 0x7fcd641987e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcd54006010 tx=0x7fcd54005780 comp rx=0 tx=0).stop 2024-05-20T16:58:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.485+0000 7fcd6b0fb700 1 -- 172.21.15.6:0/2773372461 shutdown_connections 2024-05-20T16:58:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.485+0000 7fcd6b0fb700 1 --2- 172.21.15.6:0/2773372461 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fcd4c0390f0 0x7fcd4c03b600 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.485+0000 7fcd6b0fb700 1 --2- 172.21.15.6:0/2773372461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd64103b70 0x7fcd641987e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.485+0000 7fcd6b0fb700 1 -- 172.21.15.6:0/2773372461 >> 172.21.15.6:0/2773372461 conn(0x7fcd64077430 msgr2=0x7fcd641049b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:17.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.486+0000 7fcd6b0fb700 1 -- 172.21.15.6:0/2773372461 shutdown_connections 2024-05-20T16:58:17.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:17.486+0000 7fcd6b0fb700 1 -- 172.21.15.6:0/2773372461 wait complete. 2024-05-20T16:58:17.858 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:17 smithi006 ceph-mon[32486]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:17.859 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:17 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:18.156 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-20T16:58:18.156 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph osd crush tunables default 2024-05-20T16:58:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T16:58:18.812 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:18 smithi006 ceph-mon[32486]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T16:58:19.711 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:19 smithi006 ceph-mon[32486]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:19.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.961+0000 7feb4ec28700 1 -- 172.21.15.6:0/3315873182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb481089d0 msgr2=0x7feb48108de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:19.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.961+0000 7feb4ec28700 1 --2- 172.21.15.6:0/3315873182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb481089d0 0x7feb48108de0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feb3c009910 tx=0x7feb3c009c20 comp rx=0 tx=0).stop 2024-05-20T16:58:19.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.961+0000 7feb4ec28700 1 -- 172.21.15.6:0/3315873182 shutdown_connections 2024-05-20T16:58:19.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.961+0000 7feb4ec28700 1 --2- 172.21.15.6:0/3315873182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb481089d0 0x7feb48108de0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:19.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.961+0000 7feb4ec28700 1 -- 172.21.15.6:0/3315873182 >> 172.21.15.6:0/3315873182 conn(0x7feb480fe520 msgr2=0x7feb48100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:19.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.962+0000 7feb4ec28700 1 -- 172.21.15.6:0/3315873182 shutdown_connections 2024-05-20T16:58:19.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.962+0000 7feb4ec28700 1 -- 172.21.15.6:0/3315873182 wait complete. 2024-05-20T16:58:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.962+0000 7feb4ec28700 1 Processor -- start 2024-05-20T16:58:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.963+0000 7feb4ec28700 1 -- start start 2024-05-20T16:58:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.963+0000 7feb4ec28700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb481089d0 0x7feb48074940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.963+0000 7feb4ec28700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7feb4810cf20 con 0x7feb481089d0 2024-05-20T16:58:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.963+0000 7feb4c9c4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb481089d0 0x7feb48074940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.963+0000 7feb4c9c4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb481089d0 0x7feb48074940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51362/0 (socket says 172.21.15.6:51362) 2024-05-20T16:58:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.963+0000 7feb4c9c4700 1 -- 172.21.15.6:0/3717984637 learned_addr learned my addr 172.21.15.6:0/3717984637 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:58:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.963+0000 7feb4c9c4700 1 -- 172.21.15.6:0/3717984637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb48076790 con 0x7feb481089d0 2024-05-20T16:58:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.963+0000 7feb4c9c4700 1 --2- 172.21.15.6:0/3717984637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb481089d0 0x7feb48074940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0092e0 tx=0x7feb3c005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.964+0000 7feb45ffb700 1 -- 172.21.15.6:0/3717984637 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb3c026070 con 0x7feb481089d0 2024-05-20T16:58:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.964+0000 7feb45ffb700 1 -- 172.21.15.6:0/3717984637 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feb3c00b6f0 con 0x7feb481089d0 2024-05-20T16:58:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.964+0000 7feb45ffb700 1 -- 172.21.15.6:0/3717984637 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb3c0037f0 con 0x7feb481089d0 2024-05-20T16:58:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.964+0000 7feb4ec28700 1 -- 172.21.15.6:0/3717984637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb48074e80 con 0x7feb481089d0 2024-05-20T16:58:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.964+0000 7feb4ec28700 1 -- 172.21.15.6:0/3717984637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb48075340 con 0x7feb481089d0 2024-05-20T16:58:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.965+0000 7feb45ffb700 1 -- 172.21.15.6:0/3717984637 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7feb3c029070 con 0x7feb481089d0 2024-05-20T16:58:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.965+0000 7feb4ec28700 1 -- 172.21.15.6:0/3717984637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb481040e0 con 0x7feb481089d0 2024-05-20T16:58:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.965+0000 7feb45ffb700 1 --2- 172.21.15.6:0/3717984637 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7feb38039150 0x7feb3803b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.965+0000 7feb45ffb700 1 -- 172.21.15.6:0/3717984637 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7feb3c01e070 con 0x7feb481089d0 2024-05-20T16:58:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.965+0000 7feb47fff700 1 --2- 172.21.15.6:0/3717984637 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7feb38039150 0x7feb3803b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.966+0000 7feb47fff700 1 --2- 172.21.15.6:0/3717984637 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7feb38039150 0x7feb3803b660 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7feb34006fd0 tx=0x7feb34006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:19.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:19.971+0000 7feb45ffb700 1 -- 172.21.15.6:0/3717984637 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7feb3c013070 con 0x7feb481089d0 2024-05-20T16:58:20.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:20.182+0000 7feb4ec28700 1 -- 172.21.15.6:0/3717984637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7feb48075e70 con 0x7feb481089d0 2024-05-20T16:58:20.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:20.615+0000 7feb45ffb700 1 -- 172.21.15.6:0/3717984637 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7feb3c00de00 con 0x7feb481089d0 2024-05-20T16:58:20.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:20.617+0000 7feb4ec28700 1 -- 172.21.15.6:0/3717984637 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7feb38039150 msgr2=0x7feb3803b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:20.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:20.617+0000 7feb4ec28700 1 --2- 172.21.15.6:0/3717984637 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7feb38039150 0x7feb3803b660 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7feb34006fd0 tx=0x7feb34006e40 comp rx=0 tx=0).stop 2024-05-20T16:58:20.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:20.617+0000 7feb4ec28700 1 -- 172.21.15.6:0/3717984637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb481089d0 msgr2=0x7feb48074940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:20.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:20.617+0000 7feb4ec28700 1 --2- 172.21.15.6:0/3717984637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb481089d0 0x7feb48074940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0092e0 tx=0x7feb3c005780 comp rx=0 tx=0).stop 2024-05-20T16:58:20.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:20.617+0000 7feb4ec28700 1 -- 172.21.15.6:0/3717984637 shutdown_connections 2024-05-20T16:58:20.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:20.617+0000 7feb4ec28700 1 --2- 172.21.15.6:0/3717984637 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7feb38039150 0x7feb3803b660 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:20.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:20.617+0000 7feb4ec28700 1 --2- 172.21.15.6:0/3717984637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb481089d0 0x7feb48074940 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:20.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:20.617+0000 7feb4ec28700 1 -- 172.21.15.6:0/3717984637 >> 172.21.15.6:0/3717984637 conn(0x7feb480fe520 msgr2=0x7feb480ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:20.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:20.618+0000 7feb4ec28700 1 -- 172.21.15.6:0/3717984637 shutdown_connections 2024-05-20T16:58:20.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:20.618+0000 7feb4ec28700 1 -- 172.21.15.6:0/3717984637 wait complete. 2024-05-20T16:58:20.618 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2024-05-20T16:58:20.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:20 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3717984637' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-20T16:58:20.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:20 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:20.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:20 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:20.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:20 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:20.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:20 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:20.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:20 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi171", "name": "osd_memory_target"}]: dispatch 2024-05-20T16:58:20.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:20 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:20.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:20 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:58:21.332 INFO:tasks.cephadm:Adding mon.a on smithi006 2024-05-20T16:58:21.332 INFO:tasks.cephadm:Adding mon.b on smithi062 2024-05-20T16:58:21.332 INFO:tasks.cephadm:Adding mon.c on smithi171 2024-05-20T16:58:21.332 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph orch apply mon '3;smithi006:172.21.15.6=a;smithi062:172.21.15.62=b;smithi171:172.21.15.171=c' 2024-05-20T16:58:21.568 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T16:58:21.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:21 smithi006 ceph-mon[32486]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:21.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:21 smithi006 ceph-mon[32486]: Updating smithi171:/etc/ceph/ceph.conf 2024-05-20T16:58:21.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:21 smithi006 ceph-mon[32486]: Updating smithi171:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T16:58:21.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:21 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3717984637' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-20T16:58:21.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:21 smithi006 ceph-mon[32486]: osdmap e4: 0 total, 0 up, 0 in 2024-05-20T16:58:21.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:21 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:21.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:21 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:21.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:21 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:22.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:22 smithi006 ceph-mon[32486]: Updating smithi171:/etc/ceph/ceph.client.admin.keyring 2024-05-20T16:58:22.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:22 smithi006 ceph-mon[32486]: Updating smithi171:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T16:58:22.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.948+0000 7fdc6e6cf700 1 -- 172.21.15.171:0/1155743227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc68107910 msgr2=0x7fdc68107d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:22.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.948+0000 7fdc6e6cf700 1 --2- 172.21.15.171:0/1155743227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc68107910 0x7fdc68107d20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009910 tx=0x7fdc58009c20 comp rx=0 tx=0).stop 2024-05-20T16:58:22.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.948+0000 7fdc6e6cf700 1 -- 172.21.15.171:0/1155743227 shutdown_connections 2024-05-20T16:58:22.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.948+0000 7fdc6e6cf700 1 --2- 172.21.15.171:0/1155743227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc68107910 0x7fdc68107d20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:22.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.948+0000 7fdc6e6cf700 1 -- 172.21.15.171:0/1155743227 >> 172.21.15.171:0/1155743227 conn(0x7fdc68077430 msgr2=0x7fdc68077890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:22.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.948+0000 7fdc6e6cf700 1 -- 172.21.15.171:0/1155743227 shutdown_connections 2024-05-20T16:58:22.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.948+0000 7fdc6e6cf700 1 -- 172.21.15.171:0/1155743227 wait complete. 2024-05-20T16:58:22.951 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.949+0000 7fdc6e6cf700 1 Processor -- start 2024-05-20T16:58:22.951 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.949+0000 7fdc6e6cf700 1 -- start start 2024-05-20T16:58:22.951 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.949+0000 7fdc6e6cf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc68107910 0x7fdc68199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:22.951 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.949+0000 7fdc6e6cf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6810be60 con 0x7fdc68107910 2024-05-20T16:58:22.951 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.949+0000 7fdc67fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc68107910 0x7fdc68199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:22.951 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.949+0000 7fdc67fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc68107910 0x7fdc68199600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.171:59354/0 (socket says 172.21.15.171:59354) 2024-05-20T16:58:22.951 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.949+0000 7fdc67fff700 1 -- 172.21.15.171:0/1790116429 learned_addr learned my addr 172.21.15.171:0/1790116429 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T16:58:22.951 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.950+0000 7fdc67fff700 1 -- 172.21.15.171:0/1790116429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc6806aba0 con 0x7fdc68107910 2024-05-20T16:58:22.951 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.950+0000 7fdc67fff700 1 --2- 172.21.15.171:0/1790116429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc68107910 0x7fdc68199600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdc580056d0 tx=0x7fdc580057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:22.951 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.950+0000 7fdc65ffb700 1 -- 172.21.15.171:0/1790116429 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc58027070 con 0x7fdc68107910 2024-05-20T16:58:22.952 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.950+0000 7fdc6e6cf700 1 -- 172.21.15.171:0/1790116429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc68199c00 con 0x7fdc68107910 2024-05-20T16:58:22.952 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.950+0000 7fdc65ffb700 1 -- 172.21.15.171:0/1790116429 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdc5800be10 con 0x7fdc68107910 2024-05-20T16:58:22.952 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.950+0000 7fdc65ffb700 1 -- 172.21.15.171:0/1790116429 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc58022d20 con 0x7fdc68107910 2024-05-20T16:58:22.952 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.950+0000 7fdc6e6cf700 1 -- 172.21.15.171:0/1790116429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc6819a0c0 con 0x7fdc68107910 2024-05-20T16:58:22.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.951+0000 7fdc6e6cf700 1 -- 172.21.15.171:0/1790116429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc6819a400 con 0x7fdc68107910 2024-05-20T16:58:22.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.951+0000 7fdc65ffb700 1 -- 172.21.15.171:0/1790116429 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fdc5802a070 con 0x7fdc68107910 2024-05-20T16:58:22.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.951+0000 7fdc65ffb700 1 --2- 172.21.15.171:0/1790116429 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdc540390f0 0x7fdc5403b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:22.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.951+0000 7fdc65ffb700 1 -- 172.21.15.171:0/1790116429 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdc5801e030 con 0x7fdc68107910 2024-05-20T16:58:22.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.952+0000 7fdc5ffff700 1 --2- 172.21.15.171:0/1790116429 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdc540390f0 0x7fdc5403b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:22.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.952+0000 7fdc5ffff700 1 --2- 172.21.15.171:0/1790116429 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdc540390f0 0x7fdc5403b600 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdc50006fd0 tx=0x7fdc50006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:22.958 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:22.957+0000 7fdc65ffb700 1 -- 172.21.15.171:0/1790116429 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fdc6806aba0 con 0x7fdc68107910 2024-05-20T16:58:23.165 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:23.164+0000 7fdc6e6cf700 1 -- 172.21.15.171:0/1790116429 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi006:172.21.15.6=a;smithi062:172.21.15.62=b;smithi171:172.21.15.171=c", "target": ["mon-mgr", ""]}) -- 0x7fdc68063ca0 con 0x7fdc540390f0 2024-05-20T16:58:23.172 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:23.172+0000 7fdc65ffb700 1 -- 172.21.15.171:0/1790116429 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fdc68063ca0 con 0x7fdc540390f0 2024-05-20T16:58:23.172 INFO:teuthology.orchestra.run.smithi171.stdout:Scheduled mon update... 2024-05-20T16:58:23.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:23.173+0000 7fdc6e6cf700 1 -- 172.21.15.171:0/1790116429 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdc540390f0 msgr2=0x7fdc5403b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:23.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:23.173+0000 7fdc6e6cf700 1 --2- 172.21.15.171:0/1790116429 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdc540390f0 0x7fdc5403b600 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdc50006fd0 tx=0x7fdc50006e40 comp rx=0 tx=0).stop 2024-05-20T16:58:23.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:23.173+0000 7fdc6e6cf700 1 -- 172.21.15.171:0/1790116429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc68107910 msgr2=0x7fdc68199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:23.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:23.173+0000 7fdc6e6cf700 1 --2- 172.21.15.171:0/1790116429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc68107910 0x7fdc68199600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdc580056d0 tx=0x7fdc580057b0 comp rx=0 tx=0).stop 2024-05-20T16:58:23.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:23.173+0000 7fdc6e6cf700 1 -- 172.21.15.171:0/1790116429 shutdown_connections 2024-05-20T16:58:23.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:23.173+0000 7fdc6e6cf700 1 --2- 172.21.15.171:0/1790116429 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdc540390f0 0x7fdc5403b600 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:23.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:23.173+0000 7fdc6e6cf700 1 --2- 172.21.15.171:0/1790116429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc68107910 0x7fdc68199600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:23.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:23.173+0000 7fdc6e6cf700 1 -- 172.21.15.171:0/1790116429 >> 172.21.15.171:0/1790116429 conn(0x7fdc68077430 msgr2=0x7fdc680fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:23.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:23.173+0000 7fdc6e6cf700 1 -- 172.21.15.171:0/1790116429 shutdown_connections 2024-05-20T16:58:23.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:23.173+0000 7fdc6e6cf700 1 -- 172.21.15.171:0/1790116429 wait complete. 2024-05-20T16:58:23.737 DEBUG:teuthology.orchestra.run.smithi062:mon.b> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mon.b.service 2024-05-20T16:58:23.740 DEBUG:teuthology.orchestra.run.smithi171:mon.c> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mon.c.service 2024-05-20T16:58:23.743 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-20T16:58:23.743 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph mon dump -f json 2024-05-20T16:58:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:23 smithi006 ceph-mon[32486]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:23 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:23 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:58:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:23 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:23 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:58:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:23 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:23 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T16:58:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:23 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:25.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:24 smithi006 ceph-mon[32486]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi006:172.21.15.6=a;smithi062:172.21.15.62=b;smithi171:172.21.15.171=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:58:25.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:24 smithi006 ceph-mon[32486]: Saving service mon spec with placement smithi006:172.21.15.6=a;smithi062:172.21.15.62=b;smithi171:172.21.15.171=c;count:3 2024-05-20T16:58:25.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:24 smithi006 ceph-mon[32486]: Deploying daemon mon.c on smithi171 2024-05-20T16:58:25.272 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T16:58:26.031 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:25 smithi006 ceph-mon[32486]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:26.961 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:26 smithi171 systemd[1]: Starting Ceph mon.c for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T16:58:27.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.295+0000 7f988821c700 1 -- 172.21.15.171:0/3065073636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98801078e0 msgr2=0x7f9880107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:27.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.295+0000 7f988821c700 1 --2- 172.21.15.171:0/3065073636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98801078e0 0x7f9880107cf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f987000b0a0 tx=0x7f987000b3b0 comp rx=0 tx=0).stop 2024-05-20T16:58:27.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.295+0000 7f988821c700 1 -- 172.21.15.171:0/3065073636 shutdown_connections 2024-05-20T16:58:27.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.295+0000 7f988821c700 1 --2- 172.21.15.171:0/3065073636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98801078e0 0x7f9880107cf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:27.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.295+0000 7f988821c700 1 -- 172.21.15.171:0/3065073636 >> 172.21.15.171:0/3065073636 conn(0x7f98800fd3f0 msgr2=0x7f98800ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:27.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.295+0000 7f988821c700 1 -- 172.21.15.171:0/3065073636 shutdown_connections 2024-05-20T16:58:27.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.295+0000 7f988821c700 1 -- 172.21.15.171:0/3065073636 wait complete. 2024-05-20T16:58:27.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.296+0000 7f988821c700 1 Processor -- start 2024-05-20T16:58:27.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.296+0000 7f988821c700 1 -- start start 2024-05-20T16:58:27.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.296+0000 7f988821c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98801078e0 0x7f9880198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:27.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.296+0000 7f988821c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f988010be30 con 0x7f98801078e0 2024-05-20T16:58:27.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.296+0000 7f9885fb8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98801078e0 0x7f9880198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:27.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.296+0000 7f9885fb8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98801078e0 0x7f9880198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.171:59386/0 (socket says 172.21.15.171:59386) 2024-05-20T16:58:27.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.296+0000 7f9885fb8700 1 -- 172.21.15.171:0/4229734162 learned_addr learned my addr 172.21.15.171:0/4229734162 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T16:58:27.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.297+0000 7f9885fb8700 1 -- 172.21.15.171:0/4229734162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9880198c90 con 0x7f98801078e0 2024-05-20T16:58:27.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.297+0000 7f9885fb8700 1 --2- 172.21.15.171:0/4229734162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98801078e0 0x7f9880198750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f98700062a0 tx=0x7f9870003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:27.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.297+0000 7f987effd700 1 -- 172.21.15.171:0/4229734162 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9870017040 con 0x7f98801078e0 2024-05-20T16:58:27.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.297+0000 7f987effd700 1 -- 172.21.15.171:0/4229734162 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9870022070 con 0x7f98801078e0 2024-05-20T16:58:27.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.297+0000 7f988821c700 1 -- 172.21.15.171:0/4229734162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9880198f20 con 0x7f98801078e0 2024-05-20T16:58:27.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.297+0000 7f987effd700 1 -- 172.21.15.171:0/4229734162 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f987001d5e0 con 0x7f98801078e0 2024-05-20T16:58:27.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.297+0000 7f988821c700 1 -- 172.21.15.171:0/4229734162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f988019cf80 con 0x7f98801078e0 2024-05-20T16:58:27.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.298+0000 7f988821c700 1 -- 172.21.15.171:0/4229734162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9880102ff0 con 0x7f98801078e0 2024-05-20T16:58:27.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.298+0000 7f987effd700 1 -- 172.21.15.171:0/4229734162 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f987001d8e0 con 0x7f98801078e0 2024-05-20T16:58:27.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.298+0000 7f987effd700 1 --2- 172.21.15.171:0/4229734162 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f98680390f0 0x7f986803b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:27.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.298+0000 7f987effd700 1 -- 172.21.15.171:0/4229734162 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f987000f050 con 0x7f98801078e0 2024-05-20T16:58:27.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.298+0000 7f98857b7700 1 --2- 172.21.15.171:0/4229734162 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f98680390f0 0x7f986803b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:27.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.299+0000 7f98857b7700 1 --2- 172.21.15.171:0/4229734162 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f98680390f0 0x7f986803b600 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9874006fd0 tx=0x7f9874006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:27.304 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.304+0000 7f987effd700 1 -- 172.21.15.171:0/4229734162 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9870025bf0 con 0x7f98801078e0 2024-05-20T16:58:27.592 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.592+0000 7f988821c700 1 -- 172.21.15.171:0/4229734162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f9880199ab0 con 0x7f98801078e0 2024-05-20T16:58:27.593 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.593+0000 7f987effd700 1 -- 172.21.15.171:0/4229734162 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7f987001dd20 con 0x7f98801078e0 2024-05-20T16:58:27.593 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:58:27.593 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":1,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","modified":"2024-05-20T16:56:42.205459Z","created":"2024-05-20T16:56:42.205459Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-20T16:58:27.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.596+0000 7f988821c700 1 -- 172.21.15.171:0/4229734162 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f98680390f0 msgr2=0x7f986803b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:27.596 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.596+0000 7f988821c700 1 --2- 172.21.15.171:0/4229734162 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f98680390f0 0x7f986803b600 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9874006fd0 tx=0x7f9874006e40 comp rx=0 tx=0).stop 2024-05-20T16:58:27.596 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.596+0000 7f988821c700 1 -- 172.21.15.171:0/4229734162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98801078e0 msgr2=0x7f9880198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:27.596 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.596+0000 7f988821c700 1 --2- 172.21.15.171:0/4229734162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98801078e0 0x7f9880198750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f98700062a0 tx=0x7f9870003ce0 comp rx=0 tx=0).stop 2024-05-20T16:58:27.596 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.596+0000 7f988821c700 1 -- 172.21.15.171:0/4229734162 shutdown_connections 2024-05-20T16:58:27.596 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.596+0000 7f988821c700 1 --2- 172.21.15.171:0/4229734162 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f98680390f0 0x7f986803b600 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:27.596 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.596+0000 7f988821c700 1 --2- 172.21.15.171:0/4229734162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98801078e0 0x7f9880198750 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:27.596 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.596+0000 7f988821c700 1 -- 172.21.15.171:0/4229734162 >> 172.21.15.171:0/4229734162 conn(0x7f98800fd3f0 msgr2=0x7f98801053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:27.596 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.596+0000 7f988821c700 1 -- 172.21.15.171:0/4229734162 shutdown_connections 2024-05-20T16:58:27.596 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:27.596+0000 7f988821c700 1 -- 172.21.15.171:0/4229734162 wait complete. 2024-05-20T16:58:27.597 INFO:teuthology.orchestra.run.smithi171.stderr:dumped monmap epoch 1 2024-05-20T16:58:27.855 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 podman[35870]: 2024-05-20 16:58:27.543896311 +0000 UTC m=+0.108689009 container create 530c2ec498d058901ec2d39db85840f3f2f7b34c7975b88509484c8547237663 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-c, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514) 2024-05-20T16:58:27.855 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 podman[35870]: 2024-05-20 16:58:27.453211608 +0000 UTC m=+0.018004251 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T16:58:27.855 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 podman[35870]: 2024-05-20 16:58:27.85568907 +0000 UTC m=+0.420481720 container init 530c2ec498d058901ec2d39db85840f3f2f7b34c7975b88509484c8547237663 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T16:58:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 podman[35870]: 2024-05-20 16:58:27.860233297 +0000 UTC m=+0.425025937 container start 530c2ec498d058901ec2d39db85840f3f2f7b34c7975b88509484c8547237663 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-c, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-05-20T16:58:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: set uid:gid to 167:167 (ceph:ceph) 2024-05-20T16:58:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: ceph version 19.0.0-2744-gd2b507c7 (d2b507c724ef6c8295ee0a35d185cdab167fd61d) squid (dev), process ceph-mon, pid 2 2024-05-20T16:58:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: pidfile_write: ignore empty --pid-file 2024-05-20T16:58:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: load: jerasure load: lrc 2024-05-20T16:58:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: RocksDB version: 7.9.2 2024-05-20T16:58:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Git sha 0 2024-05-20T16:58:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Compile date 2024-05-17 21:21:31 2024-05-20T16:58:28.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: DB SUMMARY 2024-05-20T16:58:28.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: DB Session ID: F8TZKCM8B90MPVAJYRB2 2024-05-20T16:58:28.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: CURRENT file: CURRENT 2024-05-20T16:58:28.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: IDENTITY file: IDENTITY 2024-05-20T16:58:28.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-20T16:58:28.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-05-20T16:58:28.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-05-20T16:58:28.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.error_if_exists: 0 2024-05-20T16:58:28.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.create_if_missing: 0 2024-05-20T16:58:28.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.paranoid_checks: 1 2024-05-20T16:58:28.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-20T16:58:28.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-20T16:58:28.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-20T16:58:28.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.env: 0x564c7368c4a0 2024-05-20T16:58:28.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.fs: PosixFileSystem 2024-05-20T16:58:28.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.info_log: 0x564c74523d40 2024-05-20T16:58:28.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_file_opening_threads: 16 2024-05-20T16:58:28.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.statistics: (nil) 2024-05-20T16:58:28.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.use_fsync: 0 2024-05-20T16:58:28.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_log_file_size: 0 2024-05-20T16:58:28.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-20T16:58:28.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-20T16:58:28.120 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.keep_log_file_num: 1000 2024-05-20T16:58:28.120 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.recycle_log_file_num: 0 2024-05-20T16:58:28.120 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.allow_fallocate: 1 2024-05-20T16:58:28.120 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.allow_mmap_reads: 0 2024-05-20T16:58:28.120 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.allow_mmap_writes: 0 2024-05-20T16:58:28.120 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.use_direct_reads: 0 2024-05-20T16:58:28.120 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-20T16:58:28.120 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.create_missing_column_families: 0 2024-05-20T16:58:28.120 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.db_log_dir: 2024-05-20T16:58:28.120 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.wal_dir: 2024-05-20T16:58:28.120 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-20T16:58:28.120 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-20T16:58:28.120 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-20T16:58:28.120 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-20T16:58:28.120 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-20T16:58:28.121 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-20T16:58:28.121 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.advise_random_on_open: 1 2024-05-20T16:58:28.121 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.db_write_buffer_size: 0 2024-05-20T16:58:28.121 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.write_buffer_manager: 0x564c744f72c0 2024-05-20T16:58:28.121 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-20T16:58:28.121 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-20T16:58:28.121 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-20T16:58:28.121 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.rate_limiter: (nil) 2024-05-20T16:58:28.121 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-20T16:58:28.121 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.wal_recovery_mode: 2 2024-05-20T16:58:28.121 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.enable_thread_tracking: 0 2024-05-20T16:58:28.121 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.enable_pipelined_write: 0 2024-05-20T16:58:28.121 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.unordered_write: 0 2024-05-20T16:58:28.121 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-20T16:58:28.121 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-20T16:58:28.122 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-20T16:58:28.122 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-20T16:58:28.122 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.row_cache: None 2024-05-20T16:58:28.122 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.wal_filter: None 2024-05-20T16:58:28.122 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-20T16:58:28.122 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.allow_ingest_behind: 0 2024-05-20T16:58:28.122 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.two_write_queues: 0 2024-05-20T16:58:28.122 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.manual_wal_flush: 0 2024-05-20T16:58:28.122 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.wal_compression: 0 2024-05-20T16:58:28.122 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.atomic_flush: 0 2024-05-20T16:58:28.122 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-20T16:58:28.122 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-20T16:58:28.124 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-20T16:58:28.124 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.log_readahead_size: 0 2024-05-20T16:58:28.124 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-20T16:58:28.124 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.best_efforts_recovery: 0 2024-05-20T16:58:28.124 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-20T16:58:28.124 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-20T16:58:28.124 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.allow_data_in_errors: 0 2024-05-20T16:58:28.124 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.db_host_id: __hostname__ 2024-05-20T16:58:28.124 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-20T16:58:28.124 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_background_jobs: 2 2024-05-20T16:58:28.124 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_background_compactions: -1 2024-05-20T16:58:28.124 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_subcompactions: 1 2024-05-20T16:58:28.125 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-20T16:58:28.125 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-20T16:58:28.125 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-20T16:58:28.125 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_total_wal_size: 0 2024-05-20T16:58:28.125 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-20T16:58:28.125 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-20T16:58:28.125 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-20T16:58:28.125 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-20T16:58:28.125 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_open_files: -1 2024-05-20T16:58:28.125 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.bytes_per_sync: 0 2024-05-20T16:58:28.125 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-20T16:58:28.125 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-20T16:58:28.125 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compaction_readahead_size: 0 2024-05-20T16:58:28.125 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_background_flushes: -1 2024-05-20T16:58:28.125 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Compression algorithms supported: 2024-05-20T16:58:28.126 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-20T16:58:28.126 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: kZSTD supported: 0 2024-05-20T16:58:28.126 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: kXpressCompression supported: 0 2024-05-20T16:58:28.126 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: kLZ4HCCompression supported: 1 2024-05-20T16:58:28.126 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: kZlibCompression supported: 1 2024-05-20T16:58:28.126 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: kSnappyCompression supported: 1 2024-05-20T16:58:28.126 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: kLZ4Compression supported: 1 2024-05-20T16:58:28.126 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: kBZip2Compression supported: 0 2024-05-20T16:58:28.126 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-20T16:58:28.126 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-20T16:58:28.126 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-05-20T16:58:28.126 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-20T16:58:28.126 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-20T16:58:28.127 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.merge_operator: 2024-05-20T16:58:28.127 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compaction_filter: None 2024-05-20T16:58:28.127 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compaction_filter_factory: None 2024-05-20T16:58:28.127 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.sst_partitioner_factory: None 2024-05-20T16:58:28.127 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-20T16:58:28.127 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-20T16:58:28.127 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564c74523e40) 2024-05-20T16:58:28.127 INFO:journalctl@ceph.mon.c.smithi171.stdout: cache_index_and_filter_blocks: 1 2024-05-20T16:58:28.127 INFO:journalctl@ceph.mon.c.smithi171.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-20T16:58:28.127 INFO:journalctl@ceph.mon.c.smithi171.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-20T16:58:28.127 INFO:journalctl@ceph.mon.c.smithi171.stdout: pin_top_level_index_and_filter: 1 2024-05-20T16:58:28.127 INFO:journalctl@ceph.mon.c.smithi171.stdout: index_type: 0 2024-05-20T16:58:28.128 INFO:journalctl@ceph.mon.c.smithi171.stdout: data_block_index_type: 0 2024-05-20T16:58:28.128 INFO:journalctl@ceph.mon.c.smithi171.stdout: index_shortening: 1 2024-05-20T16:58:28.128 INFO:journalctl@ceph.mon.c.smithi171.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-20T16:58:28.128 INFO:journalctl@ceph.mon.c.smithi171.stdout: checksum: 4 2024-05-20T16:58:28.128 INFO:journalctl@ceph.mon.c.smithi171.stdout: no_block_cache: 0 2024-05-20T16:58:28.128 INFO:journalctl@ceph.mon.c.smithi171.stdout: block_cache: 0x564c74527090 2024-05-20T16:58:28.128 INFO:journalctl@ceph.mon.c.smithi171.stdout: block_cache_name: BinnedLRUCache 2024-05-20T16:58:28.128 INFO:journalctl@ceph.mon.c.smithi171.stdout: block_cache_options: 2024-05-20T16:58:28.128 INFO:journalctl@ceph.mon.c.smithi171.stdout: capacity : 536870912 2024-05-20T16:58:28.128 INFO:journalctl@ceph.mon.c.smithi171.stdout: num_shard_bits : 4 2024-05-20T16:58:28.128 INFO:journalctl@ceph.mon.c.smithi171.stdout: strict_capacity_limit : 0 2024-05-20T16:58:28.128 INFO:journalctl@ceph.mon.c.smithi171.stdout: high_pri_pool_ratio: 0.000 2024-05-20T16:58:28.128 INFO:journalctl@ceph.mon.c.smithi171.stdout: block_cache_compressed: (nil) 2024-05-20T16:58:28.128 INFO:journalctl@ceph.mon.c.smithi171.stdout: persistent_cache: (nil) 2024-05-20T16:58:28.129 INFO:journalctl@ceph.mon.c.smithi171.stdout: block_size: 4096 2024-05-20T16:58:28.129 INFO:journalctl@ceph.mon.c.smithi171.stdout: block_size_deviation: 10 2024-05-20T16:58:28.129 INFO:journalctl@ceph.mon.c.smithi171.stdout: block_restart_interval: 16 2024-05-20T16:58:28.129 INFO:journalctl@ceph.mon.c.smithi171.stdout: index_block_restart_interval: 1 2024-05-20T16:58:28.129 INFO:journalctl@ceph.mon.c.smithi171.stdout: metadata_block_size: 4096 2024-05-20T16:58:28.129 INFO:journalctl@ceph.mon.c.smithi171.stdout: partition_filters: 0 2024-05-20T16:58:28.129 INFO:journalctl@ceph.mon.c.smithi171.stdout: use_delta_encoding: 1 2024-05-20T16:58:28.129 INFO:journalctl@ceph.mon.c.smithi171.stdout: filter_policy: bloomfilter 2024-05-20T16:58:28.129 INFO:journalctl@ceph.mon.c.smithi171.stdout: whole_key_filtering: 1 2024-05-20T16:58:28.129 INFO:journalctl@ceph.mon.c.smithi171.stdout: verify_compression: 0 2024-05-20T16:58:28.129 INFO:journalctl@ceph.mon.c.smithi171.stdout: read_amp_bytes_per_bit: 0 2024-05-20T16:58:28.129 INFO:journalctl@ceph.mon.c.smithi171.stdout: format_version: 5 2024-05-20T16:58:28.129 INFO:journalctl@ceph.mon.c.smithi171.stdout: enable_index_compression: 1 2024-05-20T16:58:28.129 INFO:journalctl@ceph.mon.c.smithi171.stdout: block_align: 0 2024-05-20T16:58:28.129 INFO:journalctl@ceph.mon.c.smithi171.stdout: max_auto_readahead_size: 262144 2024-05-20T16:58:28.129 INFO:journalctl@ceph.mon.c.smithi171.stdout: prepopulate_block_cache: 0 2024-05-20T16:58:28.130 INFO:journalctl@ceph.mon.c.smithi171.stdout: initial_auto_readahead_size: 8192 2024-05-20T16:58:28.130 INFO:journalctl@ceph.mon.c.smithi171.stdout: num_file_reads_for_auto_readahead: 2 2024-05-20T16:58:28.130 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.write_buffer_size: 33554432 2024-05-20T16:58:28.130 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_write_buffer_number: 2 2024-05-20T16:58:28.130 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compression: NoCompression 2024-05-20T16:58:28.130 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.bottommost_compression: Disabled 2024-05-20T16:58:28.130 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.prefix_extractor: nullptr 2024-05-20T16:58:28.130 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-20T16:58:28.130 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.num_levels: 7 2024-05-20T16:58:28.130 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-20T16:58:28.130 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-20T16:58:28.131 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-20T16:58:28.131 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-20T16:58:28.131 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-20T16:58:28.131 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-20T16:58:28.131 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-20T16:58:28.131 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-20T16:58:28.131 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-20T16:58:28.131 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-20T16:58:28.131 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-20T16:58:28.131 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-20T16:58:28.131 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-20T16:58:28.131 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compression_opts.level: 32767 2024-05-20T16:58:28.131 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compression_opts.strategy: 0 2024-05-20T16:58:28.131 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-20T16:58:28.132 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-20T16:58:28.132 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-20T16:58:28.132 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-20T16:58:28.132 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compression_opts.enabled: false 2024-05-20T16:58:28.132 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-20T16:58:28.132 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-20T16:58:28.132 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-20T16:58:28.132 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-20T16:58:28.132 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.target_file_size_base: 67108864 2024-05-20T16:58:28.132 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-20T16:58:28.132 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-20T16:58:28.132 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-20T16:58:28.132 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-20T16:58:28.132 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-20T16:58:28.132 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-20T16:58:28.133 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-20T16:58:28.133 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-20T16:58:28.133 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-20T16:58:28.133 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-20T16:58:28.133 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-20T16:58:28.133 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-20T16:58:28.133 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-20T16:58:28.133 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-20T16:58:28.133 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.arena_block_size: 1048576 2024-05-20T16:58:28.133 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-20T16:58:28.133 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-20T16:58:28.133 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.disable_auto_compactions: 0 2024-05-20T16:58:28.133 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-20T16:58:28.133 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-20T16:58:28.134 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-20T16:58:28.134 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-20T16:58:28.134 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-20T16:58:28.134 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-20T16:58:28.134 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-20T16:58:28.134 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-20T16:58:28.134 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-20T16:58:28.134 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-20T16:58:28.134 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.table_properties_collectors: 2024-05-20T16:58:28.134 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.inplace_update_support: 0 2024-05-20T16:58:28.134 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-20T16:58:28.134 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-20T16:58:28.134 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-20T16:58:28.134 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-20T16:58:28.135 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.bloom_locality: 0 2024-05-20T16:58:28.135 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.max_successive_merges: 0 2024-05-20T16:58:28.135 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-20T16:58:28.135 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.paranoid_file_checks: 0 2024-05-20T16:58:28.135 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.force_consistency_checks: 1 2024-05-20T16:58:28.135 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.report_bg_io_stats: 0 2024-05-20T16:58:28.135 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.ttl: 2592000 2024-05-20T16:58:28.135 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-20T16:58:28.135 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-20T16:58:28.135 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-20T16:58:28.135 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.enable_blob_files: false 2024-05-20T16:58:28.135 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.min_blob_size: 0 2024-05-20T16:58:28.135 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.blob_file_size: 268435456 2024-05-20T16:58:28.135 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-20T16:58:28.135 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-20T16:58:28.136 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-20T16:58:28.136 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-20T16:58:28.136 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-20T16:58:28.136 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.blob_file_starting_level: 0 2024-05-20T16:58:28.136 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-20T16:58:28.136 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-20T16:58:28.136 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-20T16:58:28.136 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4f68a620-d9c8-4ef7-9d9a-abd3f2f65496 2024-05-20T16:58:28.136 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716224307900637, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-20T16:58:28.136 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-20T16:58:28.136 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716224307901083, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1716224307, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4f68a620-d9c8-4ef7-9d9a-abd3f2f65496", "db_session_id": "F8TZKCM8B90MPVAJYRB2", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-20T16:58:28.136 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716224307901163, "job": 1, "event": "recovery_finished"} 2024-05-20T16:58:28.136 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-20T16:58:28.136 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-20T16:58:28.137 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564c7450dc00 2024-05-20T16:58:28.137 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: DB pointer 0x564c792fa000 2024-05-20T16:58:28.137 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-20T16:58:28.137 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-20T16:58:28.137 INFO:journalctl@ceph.mon.c.smithi171.stdout: ** DB Stats ** 2024-05-20T16:58:28.137 INFO:journalctl@ceph.mon.c.smithi171.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-20T16:58:28.137 INFO:journalctl@ceph.mon.c.smithi171.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-20T16:58:28.137 INFO:journalctl@ceph.mon.c.smithi171.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-20T16:58:28.137 INFO:journalctl@ceph.mon.c.smithi171.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-20T16:58:28.137 INFO:journalctl@ceph.mon.c.smithi171.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-20T16:58:28.137 INFO:journalctl@ceph.mon.c.smithi171.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-20T16:58:28.137 INFO:journalctl@ceph.mon.c.smithi171.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-20T16:58:28.137 INFO:journalctl@ceph.mon.c.smithi171.stdout: 2024-05-20T16:58:28.137 INFO:journalctl@ceph.mon.c.smithi171.stdout: ** Compaction Stats [default] ** 2024-05-20T16:58:28.137 INFO:journalctl@ceph.mon.c.smithi171.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-20T16:58:28.138 INFO:journalctl@ceph.mon.c.smithi171.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-20T16:58:28.138 INFO:journalctl@ceph.mon.c.smithi171.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-20T16:58:28.138 INFO:journalctl@ceph.mon.c.smithi171.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-20T16:58:28.138 INFO:journalctl@ceph.mon.c.smithi171.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-20T16:58:28.138 INFO:journalctl@ceph.mon.c.smithi171.stdout: 2024-05-20T16:58:28.138 INFO:journalctl@ceph.mon.c.smithi171.stdout: ** Compaction Stats [default] ** 2024-05-20T16:58:28.138 INFO:journalctl@ceph.mon.c.smithi171.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-20T16:58:28.138 INFO:journalctl@ceph.mon.c.smithi171.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-20T16:58:28.138 INFO:journalctl@ceph.mon.c.smithi171.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-20T16:58:28.138 INFO:journalctl@ceph.mon.c.smithi171.stdout: 2024-05-20T16:58:28.138 INFO:journalctl@ceph.mon.c.smithi171.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-20T16:58:28.138 INFO:journalctl@ceph.mon.c.smithi171.stdout: 2024-05-20T16:58:28.138 INFO:journalctl@ceph.mon.c.smithi171.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-20T16:58:28.138 INFO:journalctl@ceph.mon.c.smithi171.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-20T16:58:28.139 INFO:journalctl@ceph.mon.c.smithi171.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-20T16:58:28.139 INFO:journalctl@ceph.mon.c.smithi171.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-20T16:58:28.139 INFO:journalctl@ceph.mon.c.smithi171.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-20T16:58:28.139 INFO:journalctl@ceph.mon.c.smithi171.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-20T16:58:28.139 INFO:journalctl@ceph.mon.c.smithi171.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-20T16:58:28.139 INFO:journalctl@ceph.mon.c.smithi171.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-20T16:58:28.139 INFO:journalctl@ceph.mon.c.smithi171.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-20T16:58:28.139 INFO:journalctl@ceph.mon.c.smithi171.stdout: Block cache BinnedLRUCache@0x564c74527090#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-05-20T16:58:28.139 INFO:journalctl@ceph.mon.c.smithi171.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-20T16:58:28.139 INFO:journalctl@ceph.mon.c.smithi171.stdout: 2024-05-20T16:58:28.139 INFO:journalctl@ceph.mon.c.smithi171.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-20T16:58:28.139 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-05-20T16:58:28.139 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: using public_addr v2:172.21.15.171:0/0 -> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-05-20T16:58:28.139 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: starting mon.c rank -1 at public addrs [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] at bind addrs [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:58:28.139 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: mon.c@-1(???) e0 preinit fsid c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:58:28.140 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: mon.c@-1(synchronizing).mds e1 new map 2024-05-20T16:58:28.140 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: mon.c@-1(synchronizing).mds e1 print_map 2024-05-20T16:58:28.140 INFO:journalctl@ceph.mon.c.smithi171.stdout: e1 2024-05-20T16:58:28.140 INFO:journalctl@ceph.mon.c.smithi171.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-20T16:58:28.140 INFO:journalctl@ceph.mon.c.smithi171.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-20T16:58:28.140 INFO:journalctl@ceph.mon.c.smithi171.stdout: legacy client fscid: -1 2024-05-20T16:58:28.140 INFO:journalctl@ceph.mon.c.smithi171.stdout: 2024-05-20T16:58:28.140 INFO:journalctl@ceph.mon.c.smithi171.stdout: No filesystems configured 2024-05-20T16:58:28.140 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-20T16:58:28.140 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-20T16:58:28.140 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-20T16:58:28.140 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-20T16:58:28.140 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-20T16:58:28.140 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-20T16:58:28.140 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-20T16:58:28.141 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-20T16:58:28.141 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-20T16:58:28.141 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-20T16:58:28.141 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: Added host smithi062 2024-05-20T16:58:28.141 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.141 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.141 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:28.141 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T16:58:28.141 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.141 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:28.141 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:28.141 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi171", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:58:28.141 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.142 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.142 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.142 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.142 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi062", "name": "osd_memory_target"}]: dispatch 2024-05-20T16:58:28.142 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:28.142 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:58:28.142 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: Updating smithi062:/etc/ceph/ceph.conf 2024-05-20T16:58:28.142 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: Deploying cephadm binary to smithi171 2024-05-20T16:58:28.142 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: Updating smithi062:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T16:58:28.142 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-05-20T16:58:28.142 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: Updating smithi062:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T16:58:28.142 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:28.142 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:28.143 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.143 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.143 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.143 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.143 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: Added host smithi171 2024-05-20T16:58:28.143 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:58:28.143 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.143 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.143 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:28.143 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.143 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T16:58:28.143 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:28.143 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3717984637' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-20T16:58:28.144 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.144 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.144 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.144 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.144 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi171", "name": "osd_memory_target"}]: dispatch 2024-05-20T16:58:28.144 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:28.144 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:58:28.144 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:28.144 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: Updating smithi171:/etc/ceph/ceph.conf 2024-05-20T16:58:28.144 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: Updating smithi171:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T16:58:28.144 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3717984637' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-20T16:58:28.144 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: osdmap e4: 0 total, 0 up, 0 in 2024-05-20T16:58:28.144 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.144 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.144 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.145 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: Updating smithi171:/etc/ceph/ceph.client.admin.keyring 2024-05-20T16:58:28.145 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: Updating smithi171:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.client.admin.keyring 2024-05-20T16:58:28.145 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:28.145 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.145 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:58:28.145 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:28.145 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:58:28.145 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:28.145 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T16:58:28.145 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:28.145 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi006:172.21.15.6=a;smithi062:172.21.15.62=b;smithi171:172.21.15.171=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:58:28.145 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: Saving service mon spec with placement smithi006:172.21.15.6=a;smithi062:172.21.15.62=b;smithi171:172.21.15.171=c;count:3 2024-05-20T16:58:28.145 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: Deploying daemon mon.c on smithi171 2024-05-20T16:58:28.145 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:28.145 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:28.146 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: from='client.? 172.21.15.171:0/4229734162' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-20T16:58:28.146 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 ceph-mon[35901]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-20T16:58:28.146 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 bash[35870]: 530c2ec498d058901ec2d39db85840f3f2f7b34c7975b88509484c8547237663 2024-05-20T16:58:28.146 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:27 smithi171 systemd[1]: Started Ceph mon.c for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T16:58:28.146 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:27 smithi006 ceph-mon[32486]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:28.146 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:27 smithi006 ceph-mon[32486]: from='client.? 172.21.15.171:0/4229734162' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-20T16:58:29.469 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-20T16:58:29.470 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph mon dump -f json 2024-05-20T16:58:29.714 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T16:58:33.279 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T16:58:33.279 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: mon.a calling monitor election 2024-05-20T16:58:33.279 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T16:58:33.279 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:33.279 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T16:58:33.279 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T16:58:33.279 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: mon.c calling monitor election 2024-05-20T16:58:33.280 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:33.280 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T16:58:33.280 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T16:58:33.280 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:33.280 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T16:58:33.280 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-20T16:58:33.280 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: monmap epoch 2 2024-05-20T16:58:33.280 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: fsid c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:58:33.280 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: last_changed 2024-05-20T16:58:27.930736+0000 2024-05-20T16:58:33.280 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: created 2024-05-20T16:56:42.205459+0000 2024-05-20T16:58:33.280 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: min_mon_release 19 (squid) 2024-05-20T16:58:33.280 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: election_strategy: 1 2024-05-20T16:58:33.281 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-05-20T16:58:33.281 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-05-20T16:58:33.281 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: fsmap 2024-05-20T16:58:33.281 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: osdmap e4: 0 total, 0 up, 0 in 2024-05-20T16:58:33.281 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: mgrmap e13: x(active, since 50s) 2024-05-20T16:58:33.281 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: overall HEALTH_OK 2024-05-20T16:58:33.281 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:33.281 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:33.281 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:33.281 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T16:58:33.281 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:33.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T16:58:33.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: mon.a calling monitor election 2024-05-20T16:58:33.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T16:58:33.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:33.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T16:58:33.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T16:58:33.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: mon.c calling monitor election 2024-05-20T16:58:33.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:33.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T16:58:33.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T16:58:33.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:33.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T16:58:33.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-20T16:58:33.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: monmap epoch 2 2024-05-20T16:58:33.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: fsid c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:58:33.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: last_changed 2024-05-20T16:58:27.930736+0000 2024-05-20T16:58:33.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: created 2024-05-20T16:56:42.205459+0000 2024-05-20T16:58:33.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: min_mon_release 19 (squid) 2024-05-20T16:58:33.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: election_strategy: 1 2024-05-20T16:58:33.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-05-20T16:58:33.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-05-20T16:58:33.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: fsmap 2024-05-20T16:58:33.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: osdmap e4: 0 total, 0 up, 0 in 2024-05-20T16:58:33.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: mgrmap e13: x(active, since 50s) 2024-05-20T16:58:33.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: overall HEALTH_OK 2024-05-20T16:58:33.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:33.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:33.383 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:33.383 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T16:58:33.383 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:34.164 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.163+0000 7ff539b33700 1 -- 172.21.15.171:0/418256741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5200035c0 msgr2=0x7ff520005aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:34.164 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.163+0000 7ff539b33700 1 --2- 172.21.15.171:0/418256741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5200035c0 0x7ff520005aa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff5341029f0 tx=0x7ff52400feb0 comp rx=0 tx=0).stop 2024-05-20T16:58:34.164 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.163+0000 7ff539b33700 1 -- 172.21.15.171:0/418256741 shutdown_connections 2024-05-20T16:58:34.164 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.163+0000 7ff539b33700 1 --2- 172.21.15.171:0/418256741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5200035c0 0x7ff520005aa0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:34.164 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.163+0000 7ff539b33700 1 -- 172.21.15.171:0/418256741 >> 172.21.15.171:0/418256741 conn(0x7ff5340fe620 msgr2=0x7ff534100a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:34.164 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.164+0000 7ff539b33700 1 -- 172.21.15.171:0/418256741 shutdown_connections 2024-05-20T16:58:34.164 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.164+0000 7ff539b33700 1 -- 172.21.15.171:0/418256741 wait complete. 2024-05-20T16:58:34.166 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.164+0000 7ff539b33700 1 Processor -- start 2024-05-20T16:58:34.166 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.165+0000 7ff539b33700 1 -- start start 2024-05-20T16:58:34.166 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.165+0000 7ff539b33700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5200035c0 0x7ff534074940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:34.167 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.165+0000 7ff539b33700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff534074e80 0x7ff534075290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:34.167 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.165+0000 7ff539b33700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff53410aaa0 con 0x7ff5200035c0 2024-05-20T16:58:34.167 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.165+0000 7ff539b33700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff53410a920 con 0x7ff534074e80 2024-05-20T16:58:34.167 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.165+0000 7ff52bfff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff534074e80 0x7ff534075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:34.167 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.165+0000 7ff52bfff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff534074e80 0x7ff534075290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:48288/0 (socket says 172.21.15.171:48288) 2024-05-20T16:58:34.167 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.165+0000 7ff52bfff700 1 -- 172.21.15.171:0/2216930951 learned_addr learned my addr 172.21.15.171:0/2216930951 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T16:58:34.167 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.165+0000 7ff5337fe700 1 --2- 172.21.15.171:0/2216930951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5200035c0 0x7ff534074940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:34.167 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.165+0000 7ff52bfff700 1 -- 172.21.15.171:0/2216930951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff534074e80 msgr2=0x7ff534075290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-20T16:58:34.167 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.165+0000 7ff52bfff700 1 -- 172.21.15.171:0/2216930951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff534074e80 msgr2=0x7ff534075290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-20T16:58:34.167 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.165+0000 7ff52bfff700 1 --2- 172.21.15.171:0/2216930951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff534074e80 0x7ff534075290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-20T16:58:34.167 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.165+0000 7ff52bfff700 1 --2- 172.21.15.171:0/2216930951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff534074e80 0x7ff534075290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T16:58:34.167 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.166+0000 7ff5337fe700 1 -- 172.21.15.171:0/2216930951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff534074e80 msgr2=0x7ff534075290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T16:58:34.168 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.166+0000 7ff5337fe700 1 --2- 172.21.15.171:0/2216930951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff534074e80 0x7ff534075290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:34.168 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.166+0000 7ff5337fe700 1 -- 172.21.15.171:0/2216930951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff534076870 con 0x7ff5200035c0 2024-05-20T16:58:34.168 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.166+0000 7ff5337fe700 1 --2- 172.21.15.171:0/2216930951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5200035c0 0x7ff534074940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff524010010 tx=0x7ff5240050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:34.168 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.166+0000 7ff5317fa700 1 -- 172.21.15.171:0/2216930951 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7ff524004aa0 con 0x7ff5200035c0 2024-05-20T16:58:34.168 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.166+0000 7ff5317fa700 1 -- 172.21.15.171:0/2216930951 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff524004030 con 0x7ff5200035c0 2024-05-20T16:58:34.168 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.166+0000 7ff539b33700 1 -- 172.21.15.171:0/2216930951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5341a4b70 con 0x7ff5200035c0 2024-05-20T16:58:34.168 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.166+0000 7ff5317fa700 1 -- 172.21.15.171:0/2216930951 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7ff524011b60 con 0x7ff5200035c0 2024-05-20T16:58:34.168 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.166+0000 7ff539b33700 1 -- 172.21.15.171:0/2216930951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5341a50d0 con 0x7ff5200035c0 2024-05-20T16:58:34.169 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.168+0000 7ff5317fa700 1 -- 172.21.15.171:0/2216930951 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7ff524023070 con 0x7ff5200035c0 2024-05-20T16:58:34.169 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.168+0000 7ff539b33700 1 -- 172.21.15.171:0/2216930951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff534104200 con 0x7ff5200035c0 2024-05-20T16:58:34.169 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.168+0000 7ff5317fa700 1 --2- 172.21.15.171:0/2216930951 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff514038e90 0x7ff51403b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:34.169 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.168+0000 7ff5317fa700 1 -- 172.21.15.171:0/2216930951 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff524020050 con 0x7ff5200035c0 2024-05-20T16:58:34.169 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.168+0000 7ff52bfff700 1 --2- 172.21.15.171:0/2216930951 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff514038e90 0x7ff51403b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:34.169 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.169+0000 7ff52bfff700 1 --2- 172.21.15.171:0/2216930951 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff514038e90 0x7ff51403b3a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff534102060 tx=0x7ff51c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:34.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.174+0000 7ff5317fa700 1 -- 172.21.15.171:0/2216930951 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff524028020 con 0x7ff5200035c0 2024-05-20T16:58:34.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:34 smithi171 ceph-mon[35901]: Deploying daemon mon.b on smithi062 2024-05-20T16:58:34.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:34 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T16:58:34.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:34 smithi006 ceph-mon[32486]: Deploying daemon mon.b on smithi062 2024-05-20T16:58:34.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:34 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T16:58:34.453 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.453+0000 7ff539b33700 1 -- 172.21.15.171:0/2216930951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff53402dc60 con 0x7ff5200035c0 2024-05-20T16:58:34.453 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.454+0000 7ff5317fa700 1 -- 172.21.15.171:0/2216930951 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7ff52401a390 con 0x7ff5200035c0 2024-05-20T16:58:34.454 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:58:34.454 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":2,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","modified":"2024-05-20T16:58:27.930736Z","created":"2024-05-20T16:56:42.205459Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:3300","nonce":0},{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-20T16:58:34.456 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.456+0000 7ff539b33700 1 -- 172.21.15.171:0/2216930951 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff514038e90 msgr2=0x7ff51403b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:34.456 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.456+0000 7ff539b33700 1 --2- 172.21.15.171:0/2216930951 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff514038e90 0x7ff51403b3a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff534102060 tx=0x7ff51c008040 comp rx=0 tx=0).stop 2024-05-20T16:58:34.456 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.456+0000 7ff539b33700 1 -- 172.21.15.171:0/2216930951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5200035c0 msgr2=0x7ff534074940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:34.456 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.456+0000 7ff539b33700 1 --2- 172.21.15.171:0/2216930951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5200035c0 0x7ff534074940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff524010010 tx=0x7ff5240050d0 comp rx=0 tx=0).stop 2024-05-20T16:58:34.456 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.456+0000 7ff539b33700 1 -- 172.21.15.171:0/2216930951 shutdown_connections 2024-05-20T16:58:34.456 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.456+0000 7ff539b33700 1 --2- 172.21.15.171:0/2216930951 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff514038e90 0x7ff51403b3a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:34.456 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.456+0000 7ff539b33700 1 --2- 172.21.15.171:0/2216930951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5200035c0 0x7ff534074940 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:34.456 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.456+0000 7ff539b33700 1 --2- 172.21.15.171:0/2216930951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff534074e80 0x7ff534075290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:34.456 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.456+0000 7ff539b33700 1 -- 172.21.15.171:0/2216930951 >> 172.21.15.171:0/2216930951 conn(0x7ff5340fe620 msgr2=0x7ff534106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:34.456 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.456+0000 7ff539b33700 1 -- 172.21.15.171:0/2216930951 shutdown_connections 2024-05-20T16:58:34.456 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:34.456+0000 7ff539b33700 1 -- 172.21.15.171:0/2216930951 wait complete. 2024-05-20T16:58:34.457 INFO:teuthology.orchestra.run.smithi171.stderr:dumped monmap epoch 2 2024-05-20T16:58:35.011 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:35 smithi171 ceph-mon[35901]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:35.011 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:35 smithi171 ceph-mon[35901]: from='client.? 172.21.15.171:0/2216930951' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-20T16:58:35.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:35 smithi006 ceph-mon[32486]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:35.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:35 smithi006 ceph-mon[32486]: from='client.? 172.21.15.171:0/2216930951' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-20T16:58:36.040 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-20T16:58:36.040 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph mon dump -f json 2024-05-20T16:58:36.286 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T16:58:37.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:37 smithi006 ceph-mon[32486]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:37.334 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:37 smithi171 ceph-mon[35901]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:42.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T16:58:42.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: mon.a calling monitor election 2024-05-20T16:58:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: mon.c calling monitor election 2024-05-20T16:58:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T16:58:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T16:58:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T16:58:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T16:58:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T16:58:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T16:58:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T16:58:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-20T16:58:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: monmap epoch 3 2024-05-20T16:58:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: fsid c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:58:42.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: last_changed 2024-05-20T16:58:37.379954+0000 2024-05-20T16:58:42.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: created 2024-05-20T16:56:42.205459+0000 2024-05-20T16:58:42.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: min_mon_release 19 (squid) 2024-05-20T16:58:42.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: election_strategy: 1 2024-05-20T16:58:42.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-05-20T16:58:42.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-05-20T16:58:42.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: 2: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.b 2024-05-20T16:58:42.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: fsmap 2024-05-20T16:58:42.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: osdmap e4: 0 total, 0 up, 0 in 2024-05-20T16:58:42.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: mgrmap e13: x(active, since 60s) 2024-05-20T16:58:42.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: overall HEALTH_OK 2024-05-20T16:58:42.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:42.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:42.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:42.869 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:42.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T16:58:42.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: mon.a calling monitor election 2024-05-20T16:58:42.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: mon.c calling monitor election 2024-05-20T16:58:42.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T16:58:42.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T16:58:42.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:42.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T16:58:42.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T16:58:42.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:42.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T16:58:42.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T16:58:42.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T16:58:42.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-20T16:58:42.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: monmap epoch 3 2024-05-20T16:58:42.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: fsid c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:58:42.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: last_changed 2024-05-20T16:58:37.379954+0000 2024-05-20T16:58:42.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: created 2024-05-20T16:56:42.205459+0000 2024-05-20T16:58:42.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: min_mon_release 19 (squid) 2024-05-20T16:58:42.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: election_strategy: 1 2024-05-20T16:58:42.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-05-20T16:58:42.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-05-20T16:58:42.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: 2: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.b 2024-05-20T16:58:42.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: fsmap 2024-05-20T16:58:42.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: osdmap e4: 0 total, 0 up, 0 in 2024-05-20T16:58:42.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: mgrmap e13: x(active, since 60s) 2024-05-20T16:58:42.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: overall HEALTH_OK 2024-05-20T16:58:42.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:42.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:42.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:42.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:43.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:43 smithi171 ceph-mon[35901]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:43.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:58:43.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T16:58:43.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.666+0000 7f5c6517b700 1 -- 172.21.15.171:0/2701027511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c48006280 msgr2=0x7f5c48008740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:43.666 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.666+0000 7f5c6517b700 1 --2- 172.21.15.171:0/2701027511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c48006280 0x7f5c48008740 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5c6006adc0 tx=0x7f5c500095d0 comp rx=0 tx=0).stop 2024-05-20T16:58:43.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.666+0000 7f5c6517b700 1 -- 172.21.15.171:0/2701027511 shutdown_connections 2024-05-20T16:58:43.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.666+0000 7f5c6517b700 1 --2- 172.21.15.171:0/2701027511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c48006280 0x7f5c48008740 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:43.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.666+0000 7f5c6517b700 1 -- 172.21.15.171:0/2701027511 >> 172.21.15.171:0/2701027511 conn(0x7f5c60078660 msgr2=0x7f5c60078aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:43.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.666+0000 7f5c6517b700 1 -- 172.21.15.171:0/2701027511 shutdown_connections 2024-05-20T16:58:43.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.666+0000 7f5c6517b700 1 -- 172.21.15.171:0/2701027511 wait complete. 2024-05-20T16:58:43.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.667+0000 7f5c6517b700 1 Processor -- start 2024-05-20T16:58:43.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.667+0000 7f5c6517b700 1 -- start start 2024-05-20T16:58:43.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.668+0000 7f5c6517b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c48006280 0x7f5c6019e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:43.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.668+0000 7f5c6517b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c6019ed40 0x7f5c60198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:43.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.668+0000 7f5c6517b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c60198f60 0x7f5c60199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:43.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.668+0000 7f5c6517b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6010aa40 con 0x7f5c6019ed40 2024-05-20T16:58:43.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.668+0000 7f5c6517b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6010a8c0 con 0x7f5c60198f60 2024-05-20T16:58:43.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.668+0000 7f5c6517b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6010abc0 con 0x7f5c48006280 2024-05-20T16:58:43.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.668+0000 7f5c5ed9d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c48006280 0x7f5c6019e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:43.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.668+0000 7f5c5ed9d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c48006280 0x7f5c6019e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47692/0 (socket says 172.21.15.171:47692) 2024-05-20T16:58:43.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.668+0000 7f5c5ed9d700 1 -- 172.21.15.171:0/3179063607 learned_addr learned my addr 172.21.15.171:0/3179063607 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T16:58:43.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.668+0000 7f5c5e59c700 1 --2- 172.21.15.171:0/3179063607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c6019ed40 0x7f5c60198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:43.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.668+0000 7f5c5ed9d700 1 -- 172.21.15.171:0/3179063607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c60198f60 msgr2=0x7f5c60199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:43.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.668+0000 7f5c5f59e700 1 --2- 172.21.15.171:0/3179063607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c60198f60 0x7f5c60199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:43.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.668+0000 7f5c5ed9d700 1 --2- 172.21.15.171:0/3179063607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c60198f60 0x7f5c60199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:43.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.668+0000 7f5c5ed9d700 1 -- 172.21.15.171:0/3179063607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c6019ed40 msgr2=0x7f5c60198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:43.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.668+0000 7f5c5ed9d700 1 --2- 172.21.15.171:0/3179063607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c6019ed40 0x7f5c60198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:43.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.668+0000 7f5c5ed9d700 1 -- 172.21.15.171:0/3179063607 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c601a5690 con 0x7f5c48006280 2024-05-20T16:58:43.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.668+0000 7f5c5e59c700 1 --2- 172.21.15.171:0/3179063607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c6019ed40 0x7f5c60198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T16:58:43.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.668+0000 7f5c5f59e700 1 --2- 172.21.15.171:0/3179063607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c60198f60 0x7f5c60199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T16:58:43.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.668+0000 7f5c5ed9d700 1 --2- 172.21.15.171:0/3179063607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c48006280 0x7f5c6019e800 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5c50003da0 tx=0x7f5c50003e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:43.671 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.669+0000 7f5c47fff700 1 -- 172.21.15.171:0/3179063607 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5001bc70 con 0x7f5c48006280 2024-05-20T16:58:43.671 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.669+0000 7f5c6517b700 1 -- 172.21.15.171:0/3179063607 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c601a58c0 con 0x7f5c48006280 2024-05-20T16:58:43.671 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.669+0000 7f5c47fff700 1 -- 172.21.15.171:0/3179063607 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5c5001be10 con 0x7f5c48006280 2024-05-20T16:58:43.671 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.669+0000 7f5c47fff700 1 -- 172.21.15.171:0/3179063607 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c50019910 con 0x7f5c48006280 2024-05-20T16:58:43.671 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.669+0000 7f5c6517b700 1 -- 172.21.15.171:0/3179063607 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c601a5d70 con 0x7f5c48006280 2024-05-20T16:58:43.672 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.670+0000 7f5c47fff700 1 -- 172.21.15.171:0/3179063607 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f5c50015040 con 0x7f5c48006280 2024-05-20T16:58:43.672 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.670+0000 7f5c6517b700 1 -- 172.21.15.171:0/3179063607 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c60063ca0 con 0x7f5c48006280 2024-05-20T16:58:43.672 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.670+0000 7f5c47fff700 1 --2- 172.21.15.171:0/3179063607 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5c4c039580 0x7f5c4c03ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:43.672 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.670+0000 7f5c47fff700 1 -- 172.21.15.171:0/3179063607 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5c5004f660 con 0x7f5c48006280 2024-05-20T16:58:43.672 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.670+0000 7f5c5e59c700 1 --2- 172.21.15.171:0/3179063607 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5c4c039580 0x7f5c4c03ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:43.672 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.671+0000 7f5c5e59c700 1 --2- 172.21.15.171:0/3179063607 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5c4c039580 0x7f5c4c03ba90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5c60105300 tx=0x7f5c54008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:43.675 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.675+0000 7f5c47fff700 1 -- 172.21.15.171:0/3179063607 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5c50032ca0 con 0x7f5c48006280 2024-05-20T16:58:43.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:43 smithi006 ceph-mon[32486]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:43.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:58:43.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T16:58:43.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.966+0000 7f5c6517b700 1 -- 172.21.15.171:0/3179063607 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5c6002de20 con 0x7f5c48006280 2024-05-20T16:58:43.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.966+0000 7f5c47fff700 1 -- 172.21.15.171:0/3179063607 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1275 (secure 0 0 0) 0x7f5c500189c0 con 0x7f5c48006280 2024-05-20T16:58:43.966 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T16:58:43.966 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":3,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","modified":"2024-05-20T16:58:37.379954Z","created":"2024-05-20T16:56:42.205459Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:3300","nonce":0},{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-20T16:58:43.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.968+0000 7f5c6517b700 1 -- 172.21.15.171:0/3179063607 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5c4c039580 msgr2=0x7f5c4c03ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:43.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.968+0000 7f5c6517b700 1 --2- 172.21.15.171:0/3179063607 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5c4c039580 0x7f5c4c03ba90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5c60105300 tx=0x7f5c54008040 comp rx=0 tx=0).stop 2024-05-20T16:58:43.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.968+0000 7f5c6517b700 1 -- 172.21.15.171:0/3179063607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c48006280 msgr2=0x7f5c6019e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:43.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.968+0000 7f5c6517b700 1 --2- 172.21.15.171:0/3179063607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c48006280 0x7f5c6019e800 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5c50003da0 tx=0x7f5c50003e80 comp rx=0 tx=0).stop 2024-05-20T16:58:43.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.969+0000 7f5c6517b700 1 -- 172.21.15.171:0/3179063607 shutdown_connections 2024-05-20T16:58:43.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.969+0000 7f5c6517b700 1 --2- 172.21.15.171:0/3179063607 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5c4c039580 0x7f5c4c03ba90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:43.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.969+0000 7f5c6517b700 1 --2- 172.21.15.171:0/3179063607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c60198f60 0x7f5c60199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:43.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.969+0000 7f5c6517b700 1 --2- 172.21.15.171:0/3179063607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c48006280 0x7f5c6019e800 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:43.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.969+0000 7f5c6517b700 1 --2- 172.21.15.171:0/3179063607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c6019ed40 0x7f5c60198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:43.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.969+0000 7f5c6517b700 1 -- 172.21.15.171:0/3179063607 >> 172.21.15.171:0/3179063607 conn(0x7f5c60078660 msgr2=0x7f5c60107be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:43.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.969+0000 7f5c6517b700 1 -- 172.21.15.171:0/3179063607 shutdown_connections 2024-05-20T16:58:43.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:43.969+0000 7f5c6517b700 1 -- 172.21.15.171:0/3179063607 wait complete. 2024-05-20T16:58:43.970 INFO:teuthology.orchestra.run.smithi171.stderr:dumped monmap epoch 3 2024-05-20T16:58:44.579 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-20T16:58:44.580 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph config generate-minimal-conf 2024-05-20T16:58:44.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T16:58:44.830 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T16:58:44.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: mon.b calling monitor election 2024-05-20T16:58:44.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: Updating smithi006:/etc/ceph/ceph.conf 2024-05-20T16:58:44.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: Updating smithi062:/etc/ceph/ceph.conf 2024-05-20T16:58:44.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: Updating smithi171:/etc/ceph/ceph.conf 2024-05-20T16:58:44.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:44.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: Updating smithi006:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T16:58:44.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: Updating smithi062:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T16:58:44.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: Updating smithi171:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T16:58:44.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: mon.b calling monitor election 2024-05-20T16:58:44.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: mon.c calling monitor election 2024-05-20T16:58:44.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: mon.a calling monitor election 2024-05-20T16:58:44.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-20T16:58:44.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: monmap epoch 3 2024-05-20T16:58:44.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: fsid c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:58:44.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: last_changed 2024-05-20T16:58:37.379954+0000 2024-05-20T16:58:44.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: created 2024-05-20T16:56:42.205459+0000 2024-05-20T16:58:44.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: min_mon_release 19 (squid) 2024-05-20T16:58:44.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: election_strategy: 1 2024-05-20T16:58:44.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-05-20T16:58:44.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-05-20T16:58:44.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: 2: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.b 2024-05-20T16:58:44.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: fsmap 2024-05-20T16:58:44.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: osdmap e4: 0 total, 0 up, 0 in 2024-05-20T16:58:44.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: mgrmap e13: x(active, since 62s) 2024-05-20T16:58:44.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: overall HEALTH_OK 2024-05-20T16:58:44.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:44.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:44.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:44.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:44.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:44.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:44.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:44.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:44.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:44.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:44.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:44.884 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: Reconfiguring mon.a (unknown last config time)... 2024-05-20T16:58:44.884 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T16:58:44.884 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T16:58:44.884 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:44.884 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:44 smithi006 ceph-mon[32486]: Reconfiguring daemon mon.a on smithi006 2024-05-20T16:58:45.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: mon.b calling monitor election 2024-05-20T16:58:45.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: Updating smithi006:/etc/ceph/ceph.conf 2024-05-20T16:58:45.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: Updating smithi062:/etc/ceph/ceph.conf 2024-05-20T16:58:45.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: Updating smithi171:/etc/ceph/ceph.conf 2024-05-20T16:58:45.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:45.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: Updating smithi006:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T16:58:45.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: Updating smithi062:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T16:58:45.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: Updating smithi171:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T16:58:45.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: mon.b calling monitor election 2024-05-20T16:58:45.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: mon.c calling monitor election 2024-05-20T16:58:45.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: mon.a calling monitor election 2024-05-20T16:58:45.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-20T16:58:45.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: monmap epoch 3 2024-05-20T16:58:45.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: fsid c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:58:45.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: last_changed 2024-05-20T16:58:37.379954+0000 2024-05-20T16:58:45.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: created 2024-05-20T16:56:42.205459+0000 2024-05-20T16:58:45.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: min_mon_release 19 (squid) 2024-05-20T16:58:45.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: election_strategy: 1 2024-05-20T16:58:45.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-05-20T16:58:45.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-05-20T16:58:45.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: 2: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.b 2024-05-20T16:58:45.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: fsmap 2024-05-20T16:58:45.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: osdmap e4: 0 total, 0 up, 0 in 2024-05-20T16:58:45.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: mgrmap e13: x(active, since 62s) 2024-05-20T16:58:45.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: overall HEALTH_OK 2024-05-20T16:58:45.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: Reconfiguring mon.a (unknown last config time)... 2024-05-20T16:58:45.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T16:58:45.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T16:58:45.120 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:45.120 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:44 smithi171 ceph-mon[35901]: Reconfiguring daemon mon.a on smithi006 2024-05-20T16:58:45.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: mon.b calling monitor election 2024-05-20T16:58:45.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: Updating smithi006:/etc/ceph/ceph.conf 2024-05-20T16:58:45.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: Updating smithi062:/etc/ceph/ceph.conf 2024-05-20T16:58:45.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: Updating smithi171:/etc/ceph/ceph.conf 2024-05-20T16:58:45.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:45.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: Updating smithi006:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T16:58:45.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: Updating smithi062:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T16:58:45.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: Updating smithi171:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/config/ceph.conf 2024-05-20T16:58:45.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: mon.b calling monitor election 2024-05-20T16:58:45.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: mon.c calling monitor election 2024-05-20T16:58:45.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: mon.a calling monitor election 2024-05-20T16:58:45.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-20T16:58:45.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: monmap epoch 3 2024-05-20T16:58:45.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: fsid c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:58:45.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: last_changed 2024-05-20T16:58:37.379954+0000 2024-05-20T16:58:45.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: created 2024-05-20T16:56:42.205459+0000 2024-05-20T16:58:45.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: min_mon_release 19 (squid) 2024-05-20T16:58:45.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: election_strategy: 1 2024-05-20T16:58:45.275 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-05-20T16:58:45.275 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-05-20T16:58:45.275 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: 2: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.b 2024-05-20T16:58:45.275 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: fsmap 2024-05-20T16:58:45.275 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: osdmap e4: 0 total, 0 up, 0 in 2024-05-20T16:58:45.275 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: mgrmap e13: x(active, since 62s) 2024-05-20T16:58:45.275 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: overall HEALTH_OK 2024-05-20T16:58:45.275 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.275 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.275 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.275 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.275 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.276 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.276 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.276 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.276 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.276 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.276 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:45.276 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: Reconfiguring mon.a (unknown last config time)... 2024-05-20T16:58:45.276 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T16:58:45.276 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T16:58:45.276 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:45.276 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:44 smithi062 ceph-mon[35425]: Reconfiguring daemon mon.a on smithi006 2024-05-20T16:58:46.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T16:58:46.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:45 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T16:58:46.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:45 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T16:58:47.074 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:46 smithi006 ceph-mon[32486]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:47.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.114+0000 7f0706e4d700 1 -- 172.21.15.6:0/1439362903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07001089f0 msgr2=0x7f0700108e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:47.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.114+0000 7f0706e4d700 1 --2- 172.21.15.6:0/1439362903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07001089f0 0x7f0700108e00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009910 tx=0x7f06f0009c20 comp rx=0 tx=0).stop 2024-05-20T16:58:47.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.114+0000 7f0706e4d700 1 -- 172.21.15.6:0/1439362903 shutdown_connections 2024-05-20T16:58:47.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.114+0000 7f0706e4d700 1 --2- 172.21.15.6:0/1439362903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07001089f0 0x7f0700108e00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:47.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.114+0000 7f0706e4d700 1 -- 172.21.15.6:0/1439362903 >> 172.21.15.6:0/1439362903 conn(0x7f07000fe4e0 msgr2=0x7f0700100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:47.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.114+0000 7f0706e4d700 1 -- 172.21.15.6:0/1439362903 shutdown_connections 2024-05-20T16:58:47.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.114+0000 7f0706e4d700 1 -- 172.21.15.6:0/1439362903 wait complete. 2024-05-20T16:58:47.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.115+0000 7f0706e4d700 1 Processor -- start 2024-05-20T16:58:47.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.115+0000 7f0706e4d700 1 -- start start 2024-05-20T16:58:47.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.115+0000 7f0706e4d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07001089f0 0x7f07001a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:47.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.115+0000 7f0706e4d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07001a0df0 0x7f070019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:47.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.115+0000 7f0706e4d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f070019b030 0x7f070019b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:47.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.115+0000 7f0706e4d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f070010cf40 con 0x7f070019b030 2024-05-20T16:58:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.115+0000 7f0706e4d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f070010cdc0 con 0x7f07001a0df0 2024-05-20T16:58:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.115+0000 7f0706e4d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f070010d0c0 con 0x7f07001089f0 2024-05-20T16:58:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.116+0000 7f07053ea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f070019b030 0x7f070019b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.116+0000 7f07053ea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f070019b030 0x7f070019b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36418/0 (socket says 172.21.15.6:36418) 2024-05-20T16:58:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.116+0000 7f07053ea700 1 -- 172.21.15.6:0/1118495677 learned_addr learned my addr 172.21.15.6:0/1118495677 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:58:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.116+0000 7f0704be9700 1 --2- 172.21.15.6:0/1118495677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07001089f0 0x7f07001a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.116+0000 7f06fffff700 1 --2- 172.21.15.6:0/1118495677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07001a0df0 0x7f070019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.116+0000 7f07053ea700 1 -- 172.21.15.6:0/1118495677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07001089f0 msgr2=0x7f07001a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.116+0000 7f07053ea700 1 --2- 172.21.15.6:0/1118495677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07001089f0 0x7f07001a08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.116+0000 7f07053ea700 1 -- 172.21.15.6:0/1118495677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07001a0df0 msgr2=0x7f070019aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.116+0000 7f07053ea700 1 --2- 172.21.15.6:0/1118495677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07001a0df0 0x7f070019aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.116+0000 7f07053ea700 1 -- 172.21.15.6:0/1118495677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07001a7760 con 0x7f070019b030 2024-05-20T16:58:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.116+0000 7f0704be9700 1 --2- 172.21.15.6:0/1118495677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07001089f0 0x7f07001a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T16:58:47.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.116+0000 7f06fffff700 1 --2- 172.21.15.6:0/1118495677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07001a0df0 0x7f070019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T16:58:47.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.116+0000 7f07053ea700 1 --2- 172.21.15.6:0/1118495677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f070019b030 0x7f070019b440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f06f800ba50 tx=0x7f06f800be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:47.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.116+0000 7f06fdffb700 1 -- 172.21.15.6:0/1118495677 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8019070 con 0x7f070019b030 2024-05-20T16:58:47.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.116+0000 7f06fdffb700 1 -- 172.21.15.6:0/1118495677 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f06f8014440 con 0x7f070019b030 2024-05-20T16:58:47.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.116+0000 7f0706e4d700 1 -- 172.21.15.6:0/1118495677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07001a79f0 con 0x7f070019b030 2024-05-20T16:58:47.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.116+0000 7f06fdffb700 1 -- 172.21.15.6:0/1118495677 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8007590 con 0x7f070019b030 2024-05-20T16:58:47.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.117+0000 7f0706e4d700 1 -- 172.21.15.6:0/1118495677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07001a7ee0 con 0x7f070019b030 2024-05-20T16:58:47.120 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:46 smithi171 ceph-mon[35901]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:47.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.117+0000 7f06fdffb700 1 -- 172.21.15.6:0/1118495677 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f06f801c070 con 0x7f070019b030 2024-05-20T16:58:47.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.118+0000 7f0706e4d700 1 -- 172.21.15.6:0/1118495677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0700063ca0 con 0x7f070019b030 2024-05-20T16:58:47.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.118+0000 7f06fdffb700 1 --2- 172.21.15.6:0/1118495677 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f06e8039580 0x7f06e803ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:47.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.118+0000 7f06fdffb700 1 -- 172.21.15.6:0/1118495677 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f06f804b900 con 0x7f070019b030 2024-05-20T16:58:47.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.118+0000 7f0704be9700 1 --2- 172.21.15.6:0/1118495677 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f06e8039580 0x7f06e803ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:47.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.118+0000 7f0704be9700 1 --2- 172.21.15.6:0/1118495677 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f06e8039580 0x7f06e803ba90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f06f0006010 tx=0x7f06f001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:47.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.123+0000 7f06fdffb700 1 -- 172.21.15.6:0/1118495677 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f06f8014980 con 0x7f070019b030 2024-05-20T16:58:47.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:46 smithi062 ceph-mon[35425]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:47.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.329+0000 7f0706e4d700 1 -- 172.21.15.6:0/1118495677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f070002dc60 con 0x7f070019b030 2024-05-20T16:58:47.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.330+0000 7f06fdffb700 1 -- 172.21.15.6:0/1118495677 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+271 (secure 0 0 0) 0x7f06f800e090 con 0x7f070019b030 2024-05-20T16:58:47.330 INFO:teuthology.orchestra.run.smithi006.stdout:# minimal ceph.conf for c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:58:47.330 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2024-05-20T16:58:47.331 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T16:58:47.331 INFO:teuthology.orchestra.run.smithi006.stdout: mon_host = [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-05-20T16:58:47.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.332+0000 7f0706e4d700 1 -- 172.21.15.6:0/1118495677 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f06e8039580 msgr2=0x7f06e803ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:47.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.332+0000 7f0706e4d700 1 --2- 172.21.15.6:0/1118495677 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f06e8039580 0x7f06e803ba90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f06f0006010 tx=0x7f06f001a040 comp rx=0 tx=0).stop 2024-05-20T16:58:47.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.332+0000 7f0706e4d700 1 -- 172.21.15.6:0/1118495677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f070019b030 msgr2=0x7f070019b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:47.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.332+0000 7f0706e4d700 1 --2- 172.21.15.6:0/1118495677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f070019b030 0x7f070019b440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f06f800ba50 tx=0x7f06f800be10 comp rx=0 tx=0).stop 2024-05-20T16:58:47.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.332+0000 7f0706e4d700 1 -- 172.21.15.6:0/1118495677 shutdown_connections 2024-05-20T16:58:47.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.332+0000 7f0706e4d700 1 --2- 172.21.15.6:0/1118495677 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f06e8039580 0x7f06e803ba90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:47.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.332+0000 7f0706e4d700 1 --2- 172.21.15.6:0/1118495677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f070019b030 0x7f070019b440 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:47.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.332+0000 7f0706e4d700 1 --2- 172.21.15.6:0/1118495677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07001089f0 0x7f07001a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:47.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.332+0000 7f0706e4d700 1 --2- 172.21.15.6:0/1118495677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07001a0df0 0x7f070019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:47.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.332+0000 7f0706e4d700 1 -- 172.21.15.6:0/1118495677 >> 172.21.15.6:0/1118495677 conn(0x7f07000fe4e0 msgr2=0x7f0700101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:47.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.333+0000 7f0706e4d700 1 -- 172.21.15.6:0/1118495677 shutdown_connections 2024-05-20T16:58:47.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:47.333+0000 7f0706e4d700 1 -- 172.21.15.6:0/1118495677 wait complete. 2024-05-20T16:58:47.982 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-20T16:58:47.982 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T16:58:47.982 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.conf 2024-05-20T16:58:48.015 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T16:58:48.015 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-20T16:58:48.085 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-20T16:58:48.085 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.conf 2024-05-20T16:58:48.119 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-20T16:58:48.120 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-20T16:58:48.192 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T16:58:48.192 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.conf 2024-05-20T16:58:48.225 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T16:58:48.225 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-20T16:58:48.295 INFO:tasks.cephadm:Adding mgr.x on smithi006 2024-05-20T16:58:48.295 INFO:tasks.cephadm:Adding mgr.y on smithi062 2024-05-20T16:58:48.295 INFO:tasks.cephadm:Adding mgr.z on smithi171 2024-05-20T16:58:48.295 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph orch apply mgr '3;smithi006=x;smithi062=y;smithi171=z' 2024-05-20T16:58:48.322 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:48 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:48.322 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:48 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1118495677' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:48.359 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:48 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:48.359 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:48 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1118495677' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:48.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:48 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:48.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:48 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1118495677' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:48.574 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T16:58:49.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:49 smithi171 ceph-mon[35901]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:49.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:49 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:49.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:49 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:49.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:49 smithi171 ceph-mon[35901]: Reconfiguring mon.b (monmap changed)... 2024-05-20T16:58:49.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:49 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T16:58:49.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:49 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T16:58:49.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:49 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:49.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:49 smithi171 ceph-mon[35901]: Reconfiguring daemon mon.b on smithi062 2024-05-20T16:58:49.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:49 smithi062 ceph-mon[35425]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:49.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:49 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:49.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:49 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:49.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:49 smithi062 ceph-mon[35425]: Reconfiguring mon.b (monmap changed)... 2024-05-20T16:58:49.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:49 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T16:58:49.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:49 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T16:58:49.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:49 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:49.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:49 smithi062 ceph-mon[35425]: Reconfiguring daemon mon.b on smithi062 2024-05-20T16:58:49.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:49 smithi006 ceph-mon[32486]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:49.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:49 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:49.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:49 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:49.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:49 smithi006 ceph-mon[32486]: Reconfiguring mon.b (monmap changed)... 2024-05-20T16:58:49.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:49 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T16:58:49.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:49 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T16:58:49.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:49 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:49.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:49 smithi006 ceph-mon[32486]: Reconfiguring daemon mon.b on smithi062 2024-05-20T16:58:50.153 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.152+0000 7f095370d700 1 -- 172.21.15.171:0/1934052028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094c103040 msgr2=0x7f094c103450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:50.153 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.152+0000 7f095370d700 1 --2- 172.21.15.171:0/1934052028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094c103040 0x7f094c103450 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0948009910 tx=0x7f0948009c20 comp rx=0 tx=0).stop 2024-05-20T16:58:50.153 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.152+0000 7f095370d700 1 -- 172.21.15.171:0/1934052028 shutdown_connections 2024-05-20T16:58:50.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.152+0000 7f095370d700 1 --2- 172.21.15.171:0/1934052028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094c103040 0x7f094c103450 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:50.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.152+0000 7f095370d700 1 -- 172.21.15.171:0/1934052028 >> 172.21.15.171:0/1934052028 conn(0x7f094c0fc7e0 msgr2=0x7f094c0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:50.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.152+0000 7f095370d700 1 -- 172.21.15.171:0/1934052028 shutdown_connections 2024-05-20T16:58:50.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.152+0000 7f095370d700 1 -- 172.21.15.171:0/1934052028 wait complete. 2024-05-20T16:58:50.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.153+0000 7f095370d700 1 Processor -- start 2024-05-20T16:58:50.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.153+0000 7f095370d700 1 -- start start 2024-05-20T16:58:50.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.153+0000 7f095370d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f094c103040 0x7f094c101670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:50.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.153+0000 7f095370d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094c19b580 0x7f094c19d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:50.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.153+0000 7f095370d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f094c19dee0 0x7f094c1a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:50.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.153+0000 7f095370d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f094c107a00 con 0x7f094c19b580 2024-05-20T16:58:50.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.153+0000 7f095370d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f094c107880 con 0x7f094c19dee0 2024-05-20T16:58:50.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.153+0000 7f095370d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f094c107b80 con 0x7f094c103040 2024-05-20T16:58:50.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.153+0000 7f09514a9700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f094c103040 0x7f094c101670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:50.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.153+0000 7f09514a9700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f094c103040 0x7f094c101670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:55654/0 (socket says 172.21.15.171:55654) 2024-05-20T16:58:50.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.154+0000 7f09514a9700 1 -- 172.21.15.171:0/2679386960 learned_addr learned my addr 172.21.15.171:0/2679386960 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T16:58:50.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.154+0000 7f0950ca8700 1 --2- 172.21.15.171:0/2679386960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094c19b580 0x7f094c19d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:50.156 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.154+0000 7f09514a9700 1 -- 172.21.15.171:0/2679386960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f094c19dee0 msgr2=0x7f094c1a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:50.156 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.154+0000 7f0951caa700 1 --2- 172.21.15.171:0/2679386960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f094c19dee0 0x7f094c1a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:50.156 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.154+0000 7f09514a9700 1 --2- 172.21.15.171:0/2679386960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f094c19dee0 0x7f094c1a0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:50.157 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.154+0000 7f09514a9700 1 -- 172.21.15.171:0/2679386960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094c19b580 msgr2=0x7f094c19d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:50.157 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.154+0000 7f09514a9700 1 --2- 172.21.15.171:0/2679386960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094c19b580 0x7f094c19d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:50.157 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.154+0000 7f09514a9700 1 -- 172.21.15.171:0/2679386960 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094c1a0bb0 con 0x7f094c103040 2024-05-20T16:58:50.157 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.154+0000 7f0950ca8700 1 --2- 172.21.15.171:0/2679386960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094c19b580 0x7f094c19d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T16:58:50.157 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.154+0000 7f09514a9700 1 --2- 172.21.15.171:0/2679386960 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f094c103040 0x7f094c101670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0948005850 tx=0x7f0948004f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:50.157 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.154+0000 7f09427fc700 1 -- 172.21.15.171:0/2679386960 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0948004300 con 0x7f094c103040 2024-05-20T16:58:50.157 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.154+0000 7f09427fc700 1 -- 172.21.15.171:0/2679386960 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f09480044a0 con 0x7f094c103040 2024-05-20T16:58:50.157 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.154+0000 7f095370d700 1 -- 172.21.15.171:0/2679386960 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f094c1a0e40 con 0x7f094c103040 2024-05-20T16:58:50.157 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.154+0000 7f09427fc700 1 -- 172.21.15.171:0/2679386960 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0948003b90 con 0x7f094c103040 2024-05-20T16:58:50.157 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.154+0000 7f095370d700 1 -- 172.21.15.171:0/2679386960 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f094c1a12c0 con 0x7f094c103040 2024-05-20T16:58:50.157 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.155+0000 7f09427fc700 1 -- 172.21.15.171:0/2679386960 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f094800f460 con 0x7f094c103040 2024-05-20T16:58:50.157 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.155+0000 7f095370d700 1 -- 172.21.15.171:0/2679386960 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f094c1a1520 con 0x7f094c103040 2024-05-20T16:58:50.158 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.156+0000 7f09427fc700 1 --2- 172.21.15.171:0/2679386960 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0938039580 0x7f093803ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:50.158 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.156+0000 7f09427fc700 1 -- 172.21.15.171:0/2679386960 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f094804d800 con 0x7f094c103040 2024-05-20T16:58:50.158 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.156+0000 7f0950ca8700 1 --2- 172.21.15.171:0/2679386960 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0938039580 0x7f093803ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:50.158 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.157+0000 7f0950ca8700 1 --2- 172.21.15.171:0/2679386960 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0938039580 0x7f093803ba90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f094c101020 tx=0x7f093c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:50.161 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.161+0000 7f09427fc700 1 -- 172.21.15.171:0/2679386960 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0948013070 con 0x7f094c103040 2024-05-20T16:58:50.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.377+0000 7f095370d700 1 -- 172.21.15.171:0/2679386960 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi006=x;smithi062=y;smithi171=z", "target": ["mon-mgr", ""]}) -- 0x7f094c0fe660 con 0x7f0938039580 2024-05-20T16:58:50.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.384+0000 7f09427fc700 1 -- 172.21.15.171:0/2679386960 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f094c0fe660 con 0x7f0938039580 2024-05-20T16:58:50.384 INFO:teuthology.orchestra.run.smithi171.stdout:Scheduled mgr update... 2024-05-20T16:58:50.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.386+0000 7f095370d700 1 -- 172.21.15.171:0/2679386960 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0938039580 msgr2=0x7f093803ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:50.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.386+0000 7f095370d700 1 --2- 172.21.15.171:0/2679386960 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0938039580 0x7f093803ba90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f094c101020 tx=0x7f093c008040 comp rx=0 tx=0).stop 2024-05-20T16:58:50.387 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.386+0000 7f095370d700 1 -- 172.21.15.171:0/2679386960 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f094c103040 msgr2=0x7f094c101670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:50.387 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.386+0000 7f095370d700 1 --2- 172.21.15.171:0/2679386960 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f094c103040 0x7f094c101670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0948005850 tx=0x7f0948004f80 comp rx=0 tx=0).stop 2024-05-20T16:58:50.387 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.386+0000 7f095370d700 1 -- 172.21.15.171:0/2679386960 shutdown_connections 2024-05-20T16:58:50.387 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.386+0000 7f095370d700 1 --2- 172.21.15.171:0/2679386960 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0938039580 0x7f093803ba90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:50.387 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.386+0000 7f095370d700 1 --2- 172.21.15.171:0/2679386960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f094c19dee0 0x7f094c1a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:50.387 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.386+0000 7f095370d700 1 --2- 172.21.15.171:0/2679386960 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f094c103040 0x7f094c101670 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:50.387 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.386+0000 7f095370d700 1 --2- 172.21.15.171:0/2679386960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094c19b580 0x7f094c19d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:50.387 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.386+0000 7f095370d700 1 -- 172.21.15.171:0/2679386960 >> 172.21.15.171:0/2679386960 conn(0x7f094c0fc7e0 msgr2=0x7f094c0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:50.387 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.387+0000 7f095370d700 1 -- 172.21.15.171:0/2679386960 shutdown_connections 2024-05-20T16:58:50.387 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:58:50.387+0000 7f095370d700 1 -- 172.21.15.171:0/2679386960 wait complete. 2024-05-20T16:58:51.025 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:50 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:51.025 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:50 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:51.025 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:50 smithi171 ceph-mon[35901]: Reconfiguring mon.c (monmap changed)... 2024-05-20T16:58:51.025 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:50 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T16:58:51.025 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:50 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T16:58:51.025 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:50 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:51.026 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:50 smithi171 ceph-mon[35901]: Reconfiguring daemon mon.c on smithi171 2024-05-20T16:58:51.026 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:50 smithi171 ceph-mon[35901]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:51.026 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:50 smithi171 ceph-mon[35901]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi006=x;smithi062=y;smithi171=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:58:51.026 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:50 smithi171 ceph-mon[35901]: Saving service mgr spec with placement smithi006=x;smithi062=y;smithi171=z;count:3 2024-05-20T16:58:51.026 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:50 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:51.053 DEBUG:teuthology.orchestra.run.smithi062:mgr.y> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mgr.y.service 2024-05-20T16:58:51.055 DEBUG:teuthology.orchestra.run.smithi171:mgr.z> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mgr.z.service 2024-05-20T16:58:51.082 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:50 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:51.082 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:50 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:51.082 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:50 smithi062 ceph-mon[35425]: Reconfiguring mon.c (monmap changed)... 2024-05-20T16:58:51.082 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:50 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T16:58:51.082 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:50 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T16:58:51.083 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:50 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:51.083 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:50 smithi062 ceph-mon[35425]: Reconfiguring daemon mon.c on smithi171 2024-05-20T16:58:51.083 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:50 smithi062 ceph-mon[35425]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:51.083 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:50 smithi062 ceph-mon[35425]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi006=x;smithi062=y;smithi171=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:58:51.083 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:50 smithi062 ceph-mon[35425]: Saving service mgr spec with placement smithi006=x;smithi062=y;smithi171=z;count:3 2024-05-20T16:58:51.083 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:50 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:51.095 INFO:tasks.cephadm:Deploying OSDs... 2024-05-20T16:58:51.095 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T16:58:51.095 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2024-05-20T16:58:51.116 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-20T16:58:51.116 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 2024-05-20T16:58:51.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:50 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:51.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:50 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:51.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:50 smithi006 ceph-mon[32486]: Reconfiguring mon.c (monmap changed)... 2024-05-20T16:58:51.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:50 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-20T16:58:51.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:50 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-20T16:58:51.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:50 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:51.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:50 smithi006 ceph-mon[32486]: Reconfiguring daemon mon.c on smithi171 2024-05-20T16:58:51.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:50 smithi006 ceph-mon[32486]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:51.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:50 smithi006 ceph-mon[32486]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi006=x;smithi062=y;smithi171=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:58:51.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:50 smithi006 ceph-mon[32486]: Saving service mgr spec with placement smithi006=x;smithi062=y;smithi171=z;count:3 2024-05-20T16:58:51.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:50 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:51.150 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-20T16:58:51.150 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T16:58:51.150 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-05-20T16:58:51.150 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T16:58:51.150 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T16:58:51.150 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-05-20 16:57:54.274485967 +0000 2024-05-20T16:58:51.150 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-05-20 16:52:26.510649838 +0000 2024-05-20T16:58:51.150 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-05-20 16:52:26.510649838 +0000 2024-05-20T16:58:51.150 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-05-20 16:52:26.510649838 +0000 2024-05-20T16:58:51.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-20T16:58:51.220 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-05-20T16:58:51.220 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-05-20T16:58:51.220 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000288127 s, 1.8 MB/s 2024-05-20T16:58:51.221 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-20T16:58:51.281 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 2024-05-20T16:58:51.339 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-20T16:58:51.339 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T16:58:51.339 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-05-20T16:58:51.339 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T16:58:51.339 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T16:58:51.339 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-05-20 16:57:54.302485642 +0000 2024-05-20T16:58:51.339 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-05-20 16:52:26.853645805 +0000 2024-05-20T16:58:51.339 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-05-20 16:52:26.853645805 +0000 2024-05-20T16:58:51.339 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-05-20 16:52:26.853645805 +0000 2024-05-20T16:58:51.340 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-20T16:58:51.406 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-05-20T16:58:51.406 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-05-20T16:58:51.407 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000324346 s, 1.6 MB/s 2024-05-20T16:58:51.408 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-20T16:58:51.467 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 2024-05-20T16:58:51.525 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-20T16:58:51.525 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T16:58:51.525 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-20T16:58:51.525 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T16:58:51.525 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T16:58:51.525 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-05-20 16:57:54.330485317 +0000 2024-05-20T16:58:51.525 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-05-20 16:52:27.175642017 +0000 2024-05-20T16:58:51.525 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-05-20 16:52:27.175642017 +0000 2024-05-20T16:58:51.525 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-05-20 16:52:27.175642017 +0000 2024-05-20T16:58:51.525 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-20T16:58:51.592 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-05-20T16:58:51.592 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-05-20T16:58:51.592 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000188633 s, 2.7 MB/s 2024-05-20T16:58:51.593 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-20T16:58:51.651 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 2024-05-20T16:58:51.710 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-20T16:58:51.710 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T16:58:51.710 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-05-20T16:58:51.710 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T16:58:51.710 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T16:58:51.710 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-05-20 16:57:54.359484981 +0000 2024-05-20T16:58:51.710 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-05-20 16:52:27.543637688 +0000 2024-05-20T16:58:51.710 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-05-20 16:52:27.543637688 +0000 2024-05-20T16:58:51.710 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-05-20 16:52:27.543637688 +0000 2024-05-20T16:58:51.711 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-20T16:58:51.776 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-05-20T16:58:51.777 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-05-20T16:58:51.777 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000211821 s, 2.4 MB/s 2024-05-20T16:58:51.778 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-20T16:58:51.835 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-20T16:58:51.835 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2024-05-20T16:58:51.855 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-20T16:58:51.856 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2024-05-20T16:58:51.915 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-20T16:58:51.916 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T16:58:51.916 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-05-20T16:58:51.916 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T16:58:51.916 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T16:58:51.916 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-05-20 16:58:36.737018290 +0000 2024-05-20T16:58:51.916 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-05-20 16:52:27.906803829 +0000 2024-05-20T16:58:51.916 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-05-20 16:52:27.906803829 +0000 2024-05-20T16:58:51.916 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-05-20 16:52:27.906803829 +0000 2024-05-20T16:58:51.916 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-20T16:58:51.986 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-05-20T16:58:51.986 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-05-20T16:58:51.986 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000394421 s, 1.3 MB/s 2024-05-20T16:58:51.987 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-20T16:58:52.048 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2024-05-20T16:58:52.108 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-20T16:58:52.108 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T16:58:52.108 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-05-20T16:58:52.108 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T16:58:52.108 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T16:58:52.108 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-05-20 16:58:36.738018275 +0000 2024-05-20T16:58:52.108 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-05-20 16:52:28.263798615 +0000 2024-05-20T16:58:52.108 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-05-20 16:52:28.263798615 +0000 2024-05-20T16:58:52.109 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-05-20 16:52:28.263798615 +0000 2024-05-20T16:58:52.109 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-20T16:58:52.179 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-05-20T16:58:52.179 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-05-20T16:58:52.179 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000202636 s, 2.5 MB/s 2024-05-20T16:58:52.179 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-20T16:58:52.238 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2024-05-20T16:58:52.296 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-20T16:58:52.296 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T16:58:52.296 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-05-20T16:58:52.296 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T16:58:52.296 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T16:58:52.296 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-05-20 16:58:36.738018275 +0000 2024-05-20T16:58:52.296 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-05-20 16:52:28.602793665 +0000 2024-05-20T16:58:52.296 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-05-20 16:52:28.602793665 +0000 2024-05-20T16:58:52.296 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-05-20 16:52:28.602793665 +0000 2024-05-20T16:58:52.297 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-20T16:58:52.363 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-05-20T16:58:52.363 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-05-20T16:58:52.364 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000217873 s, 2.3 MB/s 2024-05-20T16:58:52.365 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-20T16:58:52.423 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2024-05-20T16:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-20T16:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T16:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-05-20T16:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T16:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T16:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-05-20 16:58:36.739018261 +0000 2024-05-20T16:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-05-20 16:52:28.955788510 +0000 2024-05-20T16:58:52.481 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-05-20 16:52:28.955788510 +0000 2024-05-20T16:58:52.482 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-05-20 16:52:28.955788510 +0000 2024-05-20T16:58:52.482 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-20T16:58:52.546 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-05-20T16:58:52.547 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-05-20T16:58:52.547 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000226831 s, 2.3 MB/s 2024-05-20T16:58:52.548 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-20T16:58:52.606 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T16:58:52.607 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/scratch_devs of=/dev/stdout 2024-05-20T16:58:52.623 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-20T16:58:52.623 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_1 2024-05-20T16:58:52.680 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-20T16:58:52.680 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T16:58:52.680 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-05-20T16:58:52.680 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T16:58:52.680 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T16:58:52.680 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-05-20 16:58:26.817700095 +0000 2024-05-20T16:58:52.681 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-05-20 16:52:17.585623095 +0000 2024-05-20T16:58:52.681 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-05-20 16:52:17.585623095 +0000 2024-05-20T16:58:52.681 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-05-20 16:52:17.585623095 +0000 2024-05-20T16:58:52.681 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-20T16:58:52.747 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-05-20T16:58:52.747 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-05-20T16:58:52.747 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000196192 s, 2.6 MB/s 2024-05-20T16:58:52.748 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-20T16:58:52.805 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_2 2024-05-20T16:58:52.860 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-20T16:58:52.860 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T16:58:52.861 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-20T16:58:52.861 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T16:58:52.861 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T16:58:52.861 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-05-20 16:58:26.817700095 +0000 2024-05-20T16:58:52.861 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-05-20 16:52:17.929616090 +0000 2024-05-20T16:58:52.861 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-05-20 16:52:17.929616090 +0000 2024-05-20T16:58:52.861 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-05-20 16:52:17.929616090 +0000 2024-05-20T16:58:52.861 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-20T16:58:52.924 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:52 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:52.925 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:52 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:52.925 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:52 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:58:52.925 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:52 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:52.925 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:52 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:58:52.925 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:52 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:52.925 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:52 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T16:58:52.925 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:52 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-20T16:58:52.925 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:52 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T16:58:52.925 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:52 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:52.927 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-05-20T16:58:52.927 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-05-20T16:58:52.927 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000187663 s, 2.7 MB/s 2024-05-20T16:58:52.929 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-20T16:58:52.984 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_3 2024-05-20T16:58:53.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:52 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:53.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:52 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:53.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:52 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:58:53.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:52 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:53.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:52 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:58:53.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:52 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:53.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:52 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T16:58:53.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:52 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-20T16:58:53.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:52 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T16:58:53.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:52 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:53.040 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-20T16:58:53.040 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T16:58:53.040 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-20T16:58:53.040 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T16:58:53.040 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T16:58:53.040 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-05-20 16:58:26.818700076 +0000 2024-05-20T16:58:53.040 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-05-20 16:52:18.265609249 +0000 2024-05-20T16:58:53.040 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-05-20 16:52:18.265609249 +0000 2024-05-20T16:58:53.040 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-05-20 16:52:18.265609249 +0000 2024-05-20T16:58:53.040 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-20T16:58:53.103 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-05-20T16:58:53.103 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-05-20T16:58:53.103 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000178316 s, 2.9 MB/s 2024-05-20T16:58:53.104 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-20T16:58:53.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:52 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:53.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:52 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:53.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:52 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:58:53.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:52 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:53.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:52 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:58:53.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:52 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:53.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:52 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T16:58:53.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:52 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-20T16:58:53.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:52 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T16:58:53.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:52 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:53.160 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_4 2024-05-20T16:58:53.216 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-20T16:58:53.216 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T16:58:53.216 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-05-20T16:58:53.216 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T16:58:53.216 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T16:58:53.216 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-05-20 16:58:26.818700076 +0000 2024-05-20T16:58:53.216 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-05-20 16:52:18.580602835 +0000 2024-05-20T16:58:53.216 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-05-20 16:52:18.580602835 +0000 2024-05-20T16:58:53.216 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-05-20 16:52:18.580602835 +0000 2024-05-20T16:58:53.217 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-20T16:58:53.284 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-05-20T16:58:53.284 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-05-20T16:58:53.284 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000191297 s, 2.7 MB/s 2024-05-20T16:58:53.285 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-20T16:58:53.341 INFO:tasks.cephadm:Deploying osd.0 on smithi006 with /dev/vg_nvme/lv_4... 2024-05-20T16:58:53.342 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-20T16:58:53.595 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T16:58:53.961 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:53 smithi171 ceph-mon[35901]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:53.961 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:53 smithi171 ceph-mon[35901]: Deploying daemon mgr.z on smithi171 2024-05-20T16:58:54.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:53 smithi062 ceph-mon[35425]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:54.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:53 smithi062 ceph-mon[35425]: Deploying daemon mgr.z on smithi171 2024-05-20T16:58:54.043 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:53 smithi006 ceph-mon[32486]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:54.043 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:53 smithi006 ceph-mon[32486]: Deploying daemon mgr.z on smithi171 2024-05-20T16:58:54.616 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:54 smithi171 systemd[1]: Starting Ceph mgr.z for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T16:58:54.878 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:54 smithi171 podman[37739]: 2024-05-20 16:58:54.525411762 +0000 UTC m=+0.016982876 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T16:58:54.878 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:54 smithi171 podman[37739]: 2024-05-20 16:58:54.630366172 +0000 UTC m=+0.121937267 container create d51aa1f3ec89ae68b4dcd9a09b56b61db5434e333b755ce2f971f3c9b690a935 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514) 2024-05-20T16:58:54.878 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:54 smithi171 podman[37739]: 2024-05-20 16:58:54.84133018 +0000 UTC m=+0.332901287 container init d51aa1f3ec89ae68b4dcd9a09b56b61db5434e333b755ce2f971f3c9b690a935 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T16:58:54.879 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:54 smithi171 podman[37739]: 2024-05-20 16:58:54.844079298 +0000 UTC m=+0.335650393 container start d51aa1f3ec89ae68b4dcd9a09b56b61db5434e333b755ce2f971f3c9b690a935 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T16:58:54.879 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:54 smithi171 ceph-mgr[37758]: -- 172.21.15.171:0/378319059 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56425cd485a0 con 0x56425ce86900 2024-05-20T16:58:55.194 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:54 smithi171 bash[37739]: d51aa1f3ec89ae68b4dcd9a09b56b61db5434e333b755ce2f971f3c9b690a935 2024-05-20T16:58:55.195 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:54 smithi171 systemd[1]: Started Ceph mgr.z for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T16:58:55.195 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:55 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:58:55.007+0000 7f2564cce200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T16:58:55.195 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:55 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:58:55.194+0000 7f2564cce200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T16:58:55.604 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:55 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:58:55.296+0000 7f2564cce200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T16:58:55.604 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:55 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:58:55.604+0000 7f2564cce200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T16:58:55.615 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-20T16:58:55.615 INFO:teuthology.orchestra.run.smithi006.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-20T16:58:55.616 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10+0 records in 2024-05-20T16:58:55.616 INFO:teuthology.orchestra.run.smithi006.stderr:10+0 records out 2024-05-20T16:58:55.616 INFO:teuthology.orchestra.run.smithi006.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0129554 s, 809 MB/s 2024-05-20T16:58:55.616 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping successful for: 2024-05-20T16:58:55.866 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:55 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:58:55.689+0000 7f2564cce200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T16:58:55.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:55 smithi171 ceph-mon[35901]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:55.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:55 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:55.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:55 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:55.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:55 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:55.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:55 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T16:58:55.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:55 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-20T16:58:55.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:55 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T16:58:55.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:55 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:55.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:55 smithi006 ceph-mon[32486]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:55.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:55 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:55.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:55 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:55.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:55 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:55.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:55 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T16:58:55.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:55 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-20T16:58:55.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:55 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T16:58:55.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:55 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:56.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:55 smithi062 ceph-mon[35425]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:56.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:55 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:56.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:55 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:56.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:55 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:56.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:55 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T16:58:56.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:55 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-20T16:58:56.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:55 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T16:58:56.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:55 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:56.266 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi006:vg_nvme/lv_4 2024-05-20T16:58:56.513 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T16:58:56.931 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:56 smithi062 ceph-mon[35425]: Deploying daemon mgr.y on smithi062 2024-05-20T16:58:56.939 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:56 smithi006 ceph-mon[32486]: Deploying daemon mgr.y on smithi062 2024-05-20T16:58:57.061 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:56 smithi171 ceph-mon[35901]: Deploying daemon mgr.y on smithi062 2024-05-20T16:58:57.061 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:56 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:58:56.894+0000 7f2564cce200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T16:58:57.061 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:57 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:58:57.061+0000 7f2564cce200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T16:58:57.366 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:57 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:58:57.233+0000 7f2564cce200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T16:58:57.604 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:58:57 smithi062 ceph-mgr[36805]: -- 172.21.15.62:0/1822555904 <== mon.2 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560c8b82a5a0 con 0x560c8b968900 2024-05-20T16:58:57.839 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:57 smithi171 ceph-mon[35901]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:57.839 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:57 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:57.839 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:57 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:57.839 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:57 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:57.839 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:57 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:57.839 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:57 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:58:57.520+0000 7f2564cce200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T16:58:57.839 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:57 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:58:57.615+0000 7f2564cce200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T16:58:57.839 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:57 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:58:57.839+0000 7f2564cce200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T16:58:57.851 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:57 smithi006 ceph-mon[32486]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:57.851 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:57 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:57.851 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:57 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:57.851 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:57 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:57.851 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:57 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:57.888 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:57 smithi062 ceph-mon[35425]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:58:57.888 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:57 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:57.888 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:57 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:57.888 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:57 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:57.888 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:57 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:58:57.888 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:58:57 smithi062 bash[36785]: 30d3544b0d547bbff8cc8ef968b73792d5d8b8405911f1d5fc875bac52ea99bb 2024-05-20T16:58:57.889 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:58:57 smithi062 systemd[1]: Started Ceph mgr.y for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T16:58:57.889 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:58:57 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:58:57.694+0000 7f9025216200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T16:58:57.889 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:58:57 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:58:57.887+0000 7f9025216200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T16:58:58.116 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:58 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:58:58.041+0000 7f2564cce200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T16:58:58.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.116+0000 7f6cbd17e700 1 -- 172.21.15.6:0/3063378058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb8103ba0 msgr2=0x7f6cb810a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:58.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.116+0000 7f6cbd17e700 1 --2- 172.21.15.6:0/3063378058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb8103ba0 0x7f6cb810a450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000b0a0 tx=0x7f6cb000b3b0 comp rx=0 tx=0).stop 2024-05-20T16:58:58.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.116+0000 7f6cbd17e700 1 -- 172.21.15.6:0/3063378058 shutdown_connections 2024-05-20T16:58:58.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.116+0000 7f6cbd17e700 1 --2- 172.21.15.6:0/3063378058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb8103ba0 0x7f6cb810a450 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:58.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.116+0000 7f6cbd17e700 1 --2- 172.21.15.6:0/3063378058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cb81020d0 0x7f6cb81024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:58.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.116+0000 7f6cbd17e700 1 --2- 172.21.15.6:0/3063378058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cb8103200 0x7f6cb8103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:58.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.116+0000 7f6cbd17e700 1 -- 172.21.15.6:0/3063378058 >> 172.21.15.6:0/3063378058 conn(0x7f6cb80fd710 msgr2=0x7f6cb80ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:58:58.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.116+0000 7f6cbd17e700 1 -- 172.21.15.6:0/3063378058 shutdown_connections 2024-05-20T16:58:58.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.116+0000 7f6cbd17e700 1 -- 172.21.15.6:0/3063378058 wait complete. 2024-05-20T16:58:58.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.117+0000 7f6cbd17e700 1 Processor -- start 2024-05-20T16:58:58.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.117+0000 7f6cbd17e700 1 -- start start 2024-05-20T16:58:58.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.117+0000 7f6cbd17e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cb81020d0 0x7f6cb80752d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:58.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.117+0000 7f6cbd17e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cb8103200 0x7f6cb819e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:58.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.117+0000 7f6cbd17e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb8103ba0 0x7f6cb81a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:58.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.117+0000 7f6cbd17e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb810db50 con 0x7f6cb8103ba0 2024-05-20T16:58:58.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.117+0000 7f6cbd17e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb810d9d0 con 0x7f6cb8103200 2024-05-20T16:58:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.117+0000 7f6cbd17e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb810dcd0 con 0x7f6cb81020d0 2024-05-20T16:58:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.117+0000 7f6cb759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb8103ba0 0x7f6cb81a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.117+0000 7f6cb6d9d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cb81020d0 0x7f6cb80752d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.117+0000 7f6cb6d9d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cb81020d0 0x7f6cb80752d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:44782/0 (socket says 172.21.15.6:44782) 2024-05-20T16:58:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.117+0000 7f6cb759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb8103ba0 0x7f6cb81a0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47398/0 (socket says 172.21.15.6:47398) 2024-05-20T16:58:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.118+0000 7f6cb6d9d700 1 -- 172.21.15.6:0/19487441 learned_addr learned my addr 172.21.15.6:0/19487441 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T16:58:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.118+0000 7f6cb659c700 1 --2- 172.21.15.6:0/19487441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cb8103200 0x7f6cb819e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.118+0000 7f6cb6d9d700 1 -- 172.21.15.6:0/19487441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cb8103200 msgr2=0x7f6cb819e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.118+0000 7f6cb6d9d700 1 --2- 172.21.15.6:0/19487441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cb8103200 0x7f6cb819e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.118+0000 7f6cb6d9d700 1 -- 172.21.15.6:0/19487441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb8103ba0 msgr2=0x7f6cb81a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:58:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.118+0000 7f6cb6d9d700 1 --2- 172.21.15.6:0/19487441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb8103ba0 0x7f6cb81a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:58:58.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.118+0000 7f6cb6d9d700 1 -- 172.21.15.6:0/19487441 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb81a1260 con 0x7f6cb81020d0 2024-05-20T16:58:58.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.118+0000 7f6cb759e700 1 --2- 172.21.15.6:0/19487441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb8103ba0 0x7f6cb81a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T16:58:58.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.118+0000 7f6cb6d9d700 1 --2- 172.21.15.6:0/19487441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cb81020d0 0x7f6cb80752d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800e940 tx=0x7f6ca800ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:58.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.118+0000 7f6c9ffff700 1 -- 172.21.15.6:0/19487441 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8004220 con 0x7f6cb81020d0 2024-05-20T16:58:58.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.118+0000 7f6c9ffff700 1 -- 172.21.15.6:0/19487441 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ca80043c0 con 0x7f6cb81020d0 2024-05-20T16:58:58.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.118+0000 7f6cbd17e700 1 -- 172.21.15.6:0/19487441 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb81a1550 con 0x7f6cb81020d0 2024-05-20T16:58:58.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.118+0000 7f6c9ffff700 1 -- 172.21.15.6:0/19487441 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8003c70 con 0x7f6cb81020d0 2024-05-20T16:58:58.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.118+0000 7f6cbd17e700 1 -- 172.21.15.6:0/19487441 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb81a1ae0 con 0x7f6cb81020d0 2024-05-20T16:58:58.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.119+0000 7f6cbd17e700 1 -- 172.21.15.6:0/19487441 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cb8050170 con 0x7f6cb81020d0 2024-05-20T16:58:58.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.119+0000 7f6c9ffff700 1 -- 172.21.15.6:0/19487441 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f6ca8018430 con 0x7f6cb81020d0 2024-05-20T16:58:58.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.120+0000 7f6c9ffff700 1 --2- 172.21.15.6:0/19487441 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6ca0039330 0x7f6ca003b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:58:58.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.120+0000 7f6c9ffff700 1 -- 172.21.15.6:0/19487441 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6ca804c540 con 0x7f6cb81020d0 2024-05-20T16:58:58.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.120+0000 7f6cb659c700 1 --2- 172.21.15.6:0/19487441 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6ca0039330 0x7f6ca003b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:58:58.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.120+0000 7f6cb659c700 1 --2- 172.21.15.6:0/19487441 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6ca0039330 0x7f6ca003b840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8074c80 tx=0x7f6cac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:58:58.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.125+0000 7f6c9ffff700 1 -- 172.21.15.6:0/19487441 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6ca801f7e0 con 0x7f6cb81020d0 2024-05-20T16:58:58.272 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:58:57 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:58:57.998+0000 7f9025216200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T16:58:58.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:58:58.340+0000 7f6cbd17e700 1 -- 172.21.15.6:0/19487441 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f6cb8062b40 con 0x7f6ca0039330 2024-05-20T16:58:58.693 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:58:58 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:58:58.331+0000 7f9025216200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T16:58:58.693 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:58:58 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:58:58.432+0000 7f9025216200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T16:58:59.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:58 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:58:59.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:58 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T16:58:59.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:58 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T16:58:59.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:58 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:59.067 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:58 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:58:59.067 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:58 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T16:58:59.067 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:58 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T16:58:59.067 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:58 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:59.116 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:58 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:58:58.687+0000 7f2564cce200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T16:58:59.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:58 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:58:59.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:58 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T16:58:59.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:58 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T16:58:59.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:58 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:58:59.430 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:59 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:58:59.128+0000 7f2564cce200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T16:58:59.430 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:59 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:58:59.227+0000 7f2564cce200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T16:58:59.430 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:59 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:58:59.430+0000 7f2564cce200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T16:59:00.022 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:58:59 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:58:59.728+0000 7f9025216200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T16:59:00.022 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:58:59 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:58:59.904+0000 7f9025216200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T16:59:00.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:59 smithi062 ceph-mon[35425]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:00.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:59 smithi062 ceph-mon[35425]: from='client.24124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:59:00.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:59 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:00.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:59 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:00.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:59 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:00.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:59 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:00.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:59 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:00.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:59 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:59:00.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:59 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:00.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:59 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T16:59:00.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:59 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T16:59:00.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:58:59 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:00.052 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:58:59 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:58:59.960+0000 7f2564cce200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T16:59:00.052 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:59:00 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:59:00.051+0000 7f2564cce200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T16:59:00.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:59 smithi171 ceph-mon[35901]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:00.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:59 smithi171 ceph-mon[35901]: from='client.24124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:59:00.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:59 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:00.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:59 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:00.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:59 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:00.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:59 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:00.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:59 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:00.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:59 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:59:00.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:59 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:00.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:59 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T16:59:00.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:59 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T16:59:00.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:58:59 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:00.101 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:59 smithi006 ceph-mon[32486]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:00.102 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:59 smithi006 ceph-mon[32486]: from='client.24124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:59:00.102 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:00.102 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:00.102 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:00.102 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:00.102 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:00.102 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:59:00.102 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:00.102 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-20T16:59:00.102 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-20T16:59:00.102 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:58:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:00.366 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:59:00 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:59:00.296+0000 7f2564cce200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T16:59:00.381 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:59:00 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:59:00.081+0000 7f9025216200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T16:59:00.381 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:59:00 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:59:00.380+0000 7f9025216200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T16:59:00.688 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:59:00 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:59:00.476+0000 7f9025216200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T16:59:00.688 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:59:00 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:59:00.687+0000 7f9025216200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T16:59:00.737 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:59:00 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:59:00.431+0000 7f2564cce200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T16:59:00.737 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:59:00 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:59:00.527+0000 7f2564cce200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T16:59:00.737 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:59:00 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:59:00.645+0000 7f2564cce200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T16:59:01.022 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:59:00 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:59:00.888+0000 7f9025216200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T16:59:01.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:00 smithi062 ceph-mon[35425]: Reconfiguring mgr.x (unknown last config time)... 2024-05-20T16:59:01.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:00 smithi062 ceph-mon[35425]: Reconfiguring daemon mgr.x on smithi006 2024-05-20T16:59:01.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:00 smithi171 ceph-mon[35901]: Reconfiguring mgr.x (unknown last config time)... 2024-05-20T16:59:01.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:00 smithi171 ceph-mon[35901]: Reconfiguring daemon mgr.x on smithi006 2024-05-20T16:59:01.116 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:59:00 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:59:00.958+0000 7f2564cce200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T16:59:01.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:00 smithi006 ceph-mon[32486]: Reconfiguring mgr.x (unknown last config time)... 2024-05-20T16:59:01.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:00 smithi006 ceph-mon[32486]: Reconfiguring daemon mgr.x on smithi006 2024-05-20T16:59:01.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:01 smithi171 ceph-mon[35901]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:01.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:01 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1866303553' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7fee8c26-c79a-4b9d-aa3a-d31d00941060"}]: dispatch 2024-05-20T16:59:01.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:01 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1866303553' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7fee8c26-c79a-4b9d-aa3a-d31d00941060"}]': finished 2024-05-20T16:59:01.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:01 smithi171 ceph-mon[35901]: osdmap e5: 1 total, 0 up, 1 in 2024-05-20T16:59:01.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:01 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T16:59:01.867 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:59:01 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:59:01.566+0000 7f2564cce200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T16:59:01.867 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 16:59:01 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z[37754]: 2024-05-20T16:59:01.786+0000 7f2564cce200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T16:59:01.969 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:59:01 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:59:01.530+0000 7f9025216200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T16:59:01.969 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:01 smithi062 ceph-mon[35425]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:01.969 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:01 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1866303553' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7fee8c26-c79a-4b9d-aa3a-d31d00941060"}]: dispatch 2024-05-20T16:59:01.970 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:01 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1866303553' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7fee8c26-c79a-4b9d-aa3a-d31d00941060"}]': finished 2024-05-20T16:59:01.970 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:01 smithi062 ceph-mon[35425]: osdmap e5: 1 total, 0 up, 1 in 2024-05-20T16:59:01.970 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:01 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T16:59:02.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:01 smithi006 ceph-mon[32486]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:02.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:01 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1866303553' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7fee8c26-c79a-4b9d-aa3a-d31d00941060"}]: dispatch 2024-05-20T16:59:02.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:01 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1866303553' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7fee8c26-c79a-4b9d-aa3a-d31d00941060"}]': finished 2024-05-20T16:59:02.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:01 smithi006 ceph-mon[32486]: osdmap e5: 1 total, 0 up, 1 in 2024-05-20T16:59:02.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:01 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T16:59:02.272 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:59:01 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:59:01.969+0000 7f9025216200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T16:59:02.272 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:59:02 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:59:02.069+0000 7f9025216200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T16:59:02.744 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:59:02 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:59:02.278+0000 7f9025216200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T16:59:02.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:59:02.750+0000 7f6c9ffff700 1 -- 172.21.15.6:0/19487441 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mgrmap(e 14) ==== 92059+0+0 (secure 0 0 0) 0x7f6ca80214d0 con 0x7f6cb81020d0 2024-05-20T16:59:03.022 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:59:02 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:59:02.828+0000 7f9025216200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T16:59:03.022 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:59:02 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:59:02.923+0000 7f9025216200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T16:59:03.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:02 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2648295767' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T16:59:03.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:02 smithi062 ceph-mon[35425]: Standby manager daemon z started 2024-05-20T16:59:03.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:02 smithi062 ceph-mon[35425]: from='mgr.? 172.21.15.171:0/1434022775' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-20T16:59:03.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:02 smithi062 ceph-mon[35425]: from='mgr.? 172.21.15.171:0/1434022775' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T16:59:03.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:02 smithi062 ceph-mon[35425]: from='mgr.? 172.21.15.171:0/1434022775' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-20T16:59:03.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:02 smithi062 ceph-mon[35425]: from='mgr.? 172.21.15.171:0/1434022775' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T16:59:03.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:02 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:03.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:02 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2648295767' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T16:59:03.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:02 smithi171 ceph-mon[35901]: Standby manager daemon z started 2024-05-20T16:59:03.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:02 smithi171 ceph-mon[35901]: from='mgr.? 172.21.15.171:0/1434022775' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-20T16:59:03.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:02 smithi171 ceph-mon[35901]: from='mgr.? 172.21.15.171:0/1434022775' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T16:59:03.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:02 smithi171 ceph-mon[35901]: from='mgr.? 172.21.15.171:0/1434022775' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-20T16:59:03.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:02 smithi171 ceph-mon[35901]: from='mgr.? 172.21.15.171:0/1434022775' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T16:59:03.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:02 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:03.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:02 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2648295767' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T16:59:03.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:02 smithi006 ceph-mon[32486]: Standby manager daemon z started 2024-05-20T16:59:03.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:02 smithi006 ceph-mon[32486]: from='mgr.? 172.21.15.171:0/1434022775' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-20T16:59:03.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:02 smithi006 ceph-mon[32486]: from='mgr.? 172.21.15.171:0/1434022775' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T16:59:03.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:02 smithi006 ceph-mon[32486]: from='mgr.? 172.21.15.171:0/1434022775' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-20T16:59:03.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:02 smithi006 ceph-mon[32486]: from='mgr.? 172.21.15.171:0/1434022775' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T16:59:03.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:02 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:03.522 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:59:03 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:59:03.174+0000 7f9025216200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T16:59:03.522 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:59:03 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:59:03.312+0000 7f9025216200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T16:59:03.522 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:59:03 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:59:03.410+0000 7f9025216200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T16:59:03.844 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:59:03 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:59:03.531+0000 7f9025216200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T16:59:03.844 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:59:03 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:59:03.843+0000 7f9025216200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T16:59:03.844 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:03 smithi062 ceph-mon[35425]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:03.844 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:03 smithi062 ceph-mon[35425]: mgrmap e14: x(active, since 80s), standbys: z 2024-05-20T16:59:03.844 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:03 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-20T16:59:04.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:03 smithi171 ceph-mon[35901]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:04.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:03 smithi171 ceph-mon[35901]: mgrmap e14: x(active, since 80s), standbys: z 2024-05-20T16:59:04.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:03 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-20T16:59:04.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:03 smithi006 ceph-mon[32486]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:04.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:03 smithi006 ceph-mon[32486]: mgrmap e14: x(active, since 80s), standbys: z 2024-05-20T16:59:04.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:03 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-20T16:59:04.747 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:59:04 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:59:04.471+0000 7f9025216200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T16:59:04.747 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 16:59:04 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y[36801]: 2024-05-20T16:59:04.694+0000 7f9025216200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T16:59:04.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:59:04.757+0000 7f6c9ffff700 1 -- 172.21.15.6:0/19487441 <== mon.1 v2:172.21.15.171:3300/0 8 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7f6ca8020cc0 con 0x7f6cb81020d0 2024-05-20T16:59:05.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:04 smithi062 ceph-mon[35425]: Standby manager daemon y started 2024-05-20T16:59:05.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:04 smithi062 ceph-mon[35425]: from='mgr.? 172.21.15.62:0/306830496' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-20T16:59:05.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:04 smithi062 ceph-mon[35425]: from='mgr.? 172.21.15.62:0/306830496' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T16:59:05.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:04 smithi062 ceph-mon[35425]: from='mgr.? 172.21.15.62:0/306830496' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-20T16:59:05.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:04 smithi062 ceph-mon[35425]: from='mgr.? 172.21.15.62:0/306830496' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T16:59:05.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:04 smithi171 ceph-mon[35901]: Standby manager daemon y started 2024-05-20T16:59:05.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:04 smithi171 ceph-mon[35901]: from='mgr.? 172.21.15.62:0/306830496' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-20T16:59:05.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:04 smithi171 ceph-mon[35901]: from='mgr.? 172.21.15.62:0/306830496' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T16:59:05.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:04 smithi171 ceph-mon[35901]: from='mgr.? 172.21.15.62:0/306830496' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-20T16:59:05.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:04 smithi171 ceph-mon[35901]: from='mgr.? 172.21.15.62:0/306830496' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T16:59:05.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:04 smithi006 ceph-mon[32486]: Standby manager daemon y started 2024-05-20T16:59:05.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:04 smithi006 ceph-mon[32486]: from='mgr.? 172.21.15.62:0/306830496' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-20T16:59:05.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:04 smithi006 ceph-mon[32486]: from='mgr.? 172.21.15.62:0/306830496' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-20T16:59:05.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:04 smithi006 ceph-mon[32486]: from='mgr.? 172.21.15.62:0/306830496' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-20T16:59:05.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:04 smithi006 ceph-mon[32486]: from='mgr.? 172.21.15.62:0/306830496' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-20T16:59:05.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:05 smithi006 ceph-mon[32486]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:05.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:05 smithi006 ceph-mon[32486]: mgrmap e15: x(active, since 82s), standbys: y, z 2024-05-20T16:59:05.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:05 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-20T16:59:06.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:05 smithi062 ceph-mon[35425]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:06.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:05 smithi062 ceph-mon[35425]: mgrmap e15: x(active, since 82s), standbys: y, z 2024-05-20T16:59:06.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:05 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-20T16:59:06.062 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:05 smithi171 ceph-mon[35901]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:06.063 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:05 smithi171 ceph-mon[35901]: mgrmap e15: x(active, since 82s), standbys: y, z 2024-05-20T16:59:06.063 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:05 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-20T16:59:07.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:07 smithi006 ceph-mon[32486]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:07.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:07.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:07.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:59:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:59:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:07 smithi062 ceph-mon[35425]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:59:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:59:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:08.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:07 smithi171 ceph-mon[35901]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:08.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:08.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:08.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:59:08.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:08.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:59:08.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:10.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:09 smithi062 ceph-mon[35425]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:10.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:09 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-20T16:59:10.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:09 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:10.043 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:09 smithi006 ceph-mon[32486]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:10.044 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:09 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-20T16:59:10.044 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:09 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:10.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:09 smithi171 ceph-mon[35901]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:10.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:09 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-20T16:59:10.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:09 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:11.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:10 smithi062 ceph-mon[35425]: Deploying daemon osd.0 on smithi006 2024-05-20T16:59:11.056 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:10 smithi006 ceph-mon[32486]: Deploying daemon osd.0 on smithi006 2024-05-20T16:59:11.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:10 smithi171 ceph-mon[35901]: Deploying daemon osd.0 on smithi006 2024-05-20T16:59:12.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:11 smithi062 ceph-mon[35425]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:12.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:11 smithi171 ceph-mon[35901]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:12.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:11 smithi006 ceph-mon[32486]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:12.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:12 smithi006 ceph-mon[32486]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:13.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:12 smithi171 ceph-mon[35901]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:13.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:12 smithi062 ceph-mon[35425]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:15.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:15 smithi006 ceph-mon[32486]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:15.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:15 smithi171 ceph-mon[35901]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:15.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:15 smithi062 ceph-mon[35425]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:16.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:16 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:59:16.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:16 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:16.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:16 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:16.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:16 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:59:16.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:16 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:16.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:16 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:16.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:16 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:59:16.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:16 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:16.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:16 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:17.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:17 smithi171 ceph-mon[35901]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:17.376 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:17 smithi006 ceph-mon[32486]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:17.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:17 smithi062 ceph-mon[35425]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:18.685 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:18 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:18.685 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:18 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:18.685 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:18 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:18.685 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:18 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:59:18.685 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:18 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:18.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:59:18.753+0000 7f6c9ffff700 1 -- 172.21.15.6:0/19487441 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6cb8062b40 con 0x7f6ca0039330 2024-05-20T16:59:18.754 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 0 on host 'smithi006' 2024-05-20T16:59:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:59:18.756+0000 7f6cbd17e700 1 -- 172.21.15.6:0/19487441 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6ca0039330 msgr2=0x7f6ca003b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:59:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:59:18.756+0000 7f6cbd17e700 1 --2- 172.21.15.6:0/19487441 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6ca0039330 0x7f6ca003b840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8074c80 tx=0x7f6cac009260 comp rx=0 tx=0).stop 2024-05-20T16:59:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:59:18.756+0000 7f6cbd17e700 1 -- 172.21.15.6:0/19487441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cb81020d0 msgr2=0x7f6cb80752d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:59:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:59:18.756+0000 7f6cbd17e700 1 --2- 172.21.15.6:0/19487441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cb81020d0 0x7f6cb80752d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800e940 tx=0x7f6ca800ec50 comp rx=0 tx=0).stop 2024-05-20T16:59:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:59:18.756+0000 7f6cbd17e700 1 -- 172.21.15.6:0/19487441 shutdown_connections 2024-05-20T16:59:18.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:59:18.756+0000 7f6cbd17e700 1 --2- 172.21.15.6:0/19487441 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6ca0039330 0x7f6ca003b840 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:59:18.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:59:18.756+0000 7f6cbd17e700 1 --2- 172.21.15.6:0/19487441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cb8103ba0 0x7f6cb81a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:59:18.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:59:18.756+0000 7f6cbd17e700 1 --2- 172.21.15.6:0/19487441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cb81020d0 0x7f6cb80752d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:59:18.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:59:18.756+0000 7f6cbd17e700 1 --2- 172.21.15.6:0/19487441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cb8103200 0x7f6cb819e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:59:18.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:59:18.756+0000 7f6cbd17e700 1 -- 172.21.15.6:0/19487441 >> 172.21.15.6:0/19487441 conn(0x7f6cb80fd710 msgr2=0x7f6cb8106430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:59:18.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:59:18.756+0000 7f6cbd17e700 1 -- 172.21.15.6:0/19487441 shutdown_connections 2024-05-20T16:59:18.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T16:59:18.756+0000 7f6cbd17e700 1 -- 172.21.15.6:0/19487441 wait complete. 2024-05-20T16:59:18.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:18 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:18.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:18 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:18.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:18 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:18.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:18 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:59:18.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:18 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:19.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:18 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:19.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:18 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:19.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:18 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:19.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:18 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:59:19.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:18 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:19.441 DEBUG:teuthology.orchestra.run.smithi006:osd.0> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.0.service 2024-05-20T16:59:19.444 INFO:tasks.cephadm:Deploying osd.1 on smithi062 with /dev/vg_nvme/lv_4... 2024-05-20T16:59:19.444 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-20T16:59:19.701 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T16:59:19.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:19 smithi062 ceph-mon[35425]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:19.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:19 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:19.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:19 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:19.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:19 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:59:19.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:19 smithi062 ceph-mon[35425]: from='osd.0 [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-20T16:59:19.970 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:19 smithi006 ceph-mon[32486]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:19.971 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:19 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:19.971 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:19 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:19.971 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:19 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:59:19.971 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:19 smithi006 ceph-mon[32486]: from='osd.0 [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-20T16:59:20.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:19 smithi171 ceph-mon[35901]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:20.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:19 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:20.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:19 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:20.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:19 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:59:20.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:19 smithi171 ceph-mon[35901]: from='osd.0 [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-20T16:59:21.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:20 smithi062 ceph-mon[35425]: from='osd.0 [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-20T16:59:21.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:20 smithi062 ceph-mon[35425]: osdmap e6: 1 total, 0 up, 1 in 2024-05-20T16:59:21.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:20 smithi062 ceph-mon[35425]: from='osd.0 [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-05-20T16:59:21.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:20 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T16:59:21.017 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:20 smithi171 ceph-mon[35901]: from='osd.0 [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-20T16:59:21.017 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:20 smithi171 ceph-mon[35901]: osdmap e6: 1 total, 0 up, 1 in 2024-05-20T16:59:21.017 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:20 smithi171 ceph-mon[35901]: from='osd.0 [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-05-20T16:59:21.017 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:20 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T16:59:21.064 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:20 smithi006 ceph-mon[32486]: from='osd.0 [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-20T16:59:21.064 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:20 smithi006 ceph-mon[32486]: osdmap e6: 1 total, 0 up, 1 in 2024-05-20T16:59:21.065 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:20 smithi006 ceph-mon[32486]: from='osd.0 [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-05-20T16:59:21.065 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:20 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T16:59:21.671 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-20T16:59:21.671 INFO:teuthology.orchestra.run.smithi062.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-20T16:59:21.671 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10+0 records in 2024-05-20T16:59:21.671 INFO:teuthology.orchestra.run.smithi062.stderr:10+0 records out 2024-05-20T16:59:21.671 INFO:teuthology.orchestra.run.smithi062.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011226 s, 934 MB/s 2024-05-20T16:59:21.671 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping successful for: 2024-05-20T16:59:21.736 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 16:59:21 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-0[47208]: 2024-05-20T16:59:21.450+0000 7f58710fe700 -1 osd.0 0 waiting for initial osdmap 2024-05-20T16:59:21.736 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 16:59:21 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-0[47208]: 2024-05-20T16:59:21.454+0000 7f58686aa700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T16:59:21.986 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:21 smithi062 ceph-mon[35425]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:21.987 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:21 smithi062 ceph-mon[35425]: from='osd.0 [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-05-20T16:59:21.987 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:21 smithi062 ceph-mon[35425]: osdmap e7: 1 total, 0 up, 1 in 2024-05-20T16:59:21.987 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:21 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T16:59:21.987 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:21 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T16:59:21.987 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:21 smithi062 ceph-mon[35425]: from='osd.0 [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798]' entity='osd.0' 2024-05-20T16:59:21.992 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:21 smithi006 ceph-mon[32486]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:21.992 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:21 smithi006 ceph-mon[32486]: from='osd.0 [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-05-20T16:59:21.993 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:21 smithi006 ceph-mon[32486]: osdmap e7: 1 total, 0 up, 1 in 2024-05-20T16:59:21.993 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:21 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T16:59:21.993 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:21 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T16:59:21.993 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:21 smithi006 ceph-mon[32486]: from='osd.0 [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798]' entity='osd.0' 2024-05-20T16:59:22.034 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:21 smithi171 ceph-mon[35901]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:22.034 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:21 smithi171 ceph-mon[35901]: from='osd.0 [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-05-20T16:59:22.034 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:21 smithi171 ceph-mon[35901]: osdmap e7: 1 total, 0 up, 1 in 2024-05-20T16:59:22.034 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:21 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T16:59:22.035 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:21 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T16:59:22.035 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:21 smithi171 ceph-mon[35901]: from='osd.0 [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798]' entity='osd.0' 2024-05-20T16:59:22.274 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi062:vg_nvme/lv_4 2024-05-20T16:59:22.531 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T16:59:22.907 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:22 smithi062 ceph-mon[35425]: purged_snaps scrub starts 2024-05-20T16:59:22.907 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:22 smithi062 ceph-mon[35425]: purged_snaps scrub ok 2024-05-20T16:59:22.908 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:22 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T16:59:22.908 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:22 smithi062 ceph-mon[35425]: osd.0 [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798] boot 2024-05-20T16:59:22.908 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:22 smithi062 ceph-mon[35425]: osdmap e8: 1 total, 1 up, 1 in 2024-05-20T16:59:22.908 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:22 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T16:59:22.908 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:22 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:22.908 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:22 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:22.908 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:22 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T16:59:22.908 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:22 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:22.908 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:22 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:22.908 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:22 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:59:22.908 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:22 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:23.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:22 smithi171 ceph-mon[35901]: purged_snaps scrub starts 2024-05-20T16:59:23.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:22 smithi171 ceph-mon[35901]: purged_snaps scrub ok 2024-05-20T16:59:23.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:22 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T16:59:23.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:22 smithi171 ceph-mon[35901]: osd.0 [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798] boot 2024-05-20T16:59:23.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:22 smithi171 ceph-mon[35901]: osdmap e8: 1 total, 1 up, 1 in 2024-05-20T16:59:23.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:22 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T16:59:23.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:22 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:23.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:22 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:23.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:22 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T16:59:23.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:22 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:23.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:22 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:23.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:22 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:59:23.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:22 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:23.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:22 smithi006 ceph-mon[32486]: purged_snaps scrub starts 2024-05-20T16:59:23.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:22 smithi006 ceph-mon[32486]: purged_snaps scrub ok 2024-05-20T16:59:23.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:22 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T16:59:23.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:22 smithi006 ceph-mon[32486]: osd.0 [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798] boot 2024-05-20T16:59:23.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:22 smithi006 ceph-mon[32486]: osdmap e8: 1 total, 1 up, 1 in 2024-05-20T16:59:23.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:22 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-20T16:59:23.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:22 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:23.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:22 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:23.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:22 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T16:59:23.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:22 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:23.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:22 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:23.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:22 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:59:23.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:22 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:24.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:23 smithi062 ceph-mon[35425]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:24.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:23 smithi062 ceph-mon[35425]: Detected new or changed devices on smithi006 2024-05-20T16:59:24.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:23 smithi062 ceph-mon[35425]: Adjusting osd_memory_target on smithi006 to 17093M 2024-05-20T16:59:24.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.098+0000 7ff19431c700 1 -- 172.21.15.62:0/1043685776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff18c1031f0 msgr2=0x7ff18c103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:59:24.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.098+0000 7ff19431c700 1 --2- 172.21.15.62:0/1043685776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff18c1031f0 0x7ff18c103600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff188009990 tx=0x7ff188009ca0 comp rx=0 tx=0).stop 2024-05-20T16:59:24.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.098+0000 7ff19431c700 1 -- 172.21.15.62:0/1043685776 shutdown_connections 2024-05-20T16:59:24.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.098+0000 7ff19431c700 1 --2- 172.21.15.62:0/1043685776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff18c104cc0 0x7ff18c10b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:59:24.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.098+0000 7ff19431c700 1 --2- 172.21.15.62:0/1043685776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff18c1031f0 0x7ff18c103600 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:59:24.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.098+0000 7ff19431c700 1 --2- 172.21.15.62:0/1043685776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff18c104320 0x7ff18c104730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:59:24.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.098+0000 7ff19431c700 1 -- 172.21.15.62:0/1043685776 >> 172.21.15.62:0/1043685776 conn(0x7ff18c0fe850 msgr2=0x7ff18c100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:59:24.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.098+0000 7ff19431c700 1 -- 172.21.15.62:0/1043685776 shutdown_connections 2024-05-20T16:59:24.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.098+0000 7ff19431c700 1 -- 172.21.15.62:0/1043685776 wait complete. 2024-05-20T16:59:24.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.099+0000 7ff19431c700 1 Processor -- start 2024-05-20T16:59:24.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.099+0000 7ff19431c700 1 -- start start 2024-05-20T16:59:24.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.099+0000 7ff19431c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff18c1031f0 0x7ff18c199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:59:24.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.099+0000 7ff19431c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff18c104320 0x7ff18c199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:59:24.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.099+0000 7ff19431c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff18c104cc0 0x7ff18c1a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:59:24.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.099+0000 7ff19431c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c10ed20 con 0x7ff18c1031f0 2024-05-20T16:59:24.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.099+0000 7ff19431c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c10eba0 con 0x7ff18c104320 2024-05-20T16:59:24.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.099+0000 7ff19431c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c10eea0 con 0x7ff18c104cc0 2024-05-20T16:59:24.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.099+0000 7ff1918b7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff18c104320 0x7ff18c199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:59:24.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.099+0000 7ff1918b7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff18c104320 0x7ff18c199da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42832/0 (socket says 172.21.15.62:42832) 2024-05-20T16:59:24.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.099+0000 7ff1918b7700 1 -- 172.21.15.62:0/3149024432 learned_addr learned my addr 172.21.15.62:0/3149024432 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-20T16:59:24.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.099+0000 7ff1920b8700 1 --2- 172.21.15.62:0/3149024432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff18c1031f0 0x7ff18c199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:59:24.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.099+0000 7ff1928b9700 1 --2- 172.21.15.62:0/3149024432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff18c104cc0 0x7ff18c1a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:59:24.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.099+0000 7ff1918b7700 1 -- 172.21.15.62:0/3149024432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff18c104cc0 msgr2=0x7ff18c1a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:59:24.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.099+0000 7ff1918b7700 1 --2- 172.21.15.62:0/3149024432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff18c104cc0 0x7ff18c1a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:59:24.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.099+0000 7ff1918b7700 1 -- 172.21.15.62:0/3149024432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff18c1031f0 msgr2=0x7ff18c199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:59:24.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.099+0000 7ff1918b7700 1 --2- 172.21.15.62:0/3149024432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff18c1031f0 0x7ff18c199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:59:24.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.099+0000 7ff1918b7700 1 -- 172.21.15.62:0/3149024432 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18c1a13c0 con 0x7ff18c104320 2024-05-20T16:59:24.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.100+0000 7ff1920b8700 1 --2- 172.21.15.62:0/3149024432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff18c1031f0 0x7ff18c199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T16:59:24.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.100+0000 7ff1918b7700 1 --2- 172.21.15.62:0/3149024432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff18c104320 0x7ff18c199da0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff17c00c970 tx=0x7ff17c00cd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:59:24.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.100+0000 7ff1837fe700 1 -- 172.21.15.62:0/3149024432 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c007aa0 con 0x7ff18c104320 2024-05-20T16:59:24.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.100+0000 7ff1837fe700 1 -- 172.21.15.62:0/3149024432 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff17c004ce0 con 0x7ff18c104320 2024-05-20T16:59:24.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.100+0000 7ff19431c700 1 -- 172.21.15.62:0/3149024432 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff18c1a16b0 con 0x7ff18c104320 2024-05-20T16:59:24.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.100+0000 7ff1837fe700 1 -- 172.21.15.62:0/3149024432 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c005620 con 0x7ff18c104320 2024-05-20T16:59:24.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.100+0000 7ff19431c700 1 -- 172.21.15.62:0/3149024432 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff18c1a1ba0 con 0x7ff18c104320 2024-05-20T16:59:24.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.101+0000 7ff19431c700 1 -- 172.21.15.62:0/3149024432 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff18c050170 con 0x7ff18c104320 2024-05-20T16:59:24.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.102+0000 7ff1837fe700 1 -- 172.21.15.62:0/3149024432 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7ff17c004750 con 0x7ff18c104320 2024-05-20T16:59:24.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.103+0000 7ff1837fe700 1 --2- 172.21.15.62:0/3149024432 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff1780a2b90 0x7ff1780a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:59:24.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.103+0000 7ff1837fe700 1 -- 172.21.15.62:0/3149024432 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7ff17c0cd420 con 0x7ff18c104320 2024-05-20T16:59:24.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.103+0000 7ff1920b8700 1 --2- 172.21.15.62:0/3149024432 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff1780a2b90 0x7ff1780a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:59:24.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.104+0000 7ff1920b8700 1 --2- 172.21.15.62:0/3149024432 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff1780a2b90 0x7ff1780a50a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff188006010 tx=0x7ff18801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:59:24.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.108+0000 7ff1837fe700 1 -- 172.21.15.62:0/3149024432 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff17c09be80 con 0x7ff18c104320 2024-05-20T16:59:24.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:23 smithi171 ceph-mon[35901]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:24.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:23 smithi171 ceph-mon[35901]: Detected new or changed devices on smithi006 2024-05-20T16:59:24.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:23 smithi171 ceph-mon[35901]: Adjusting osd_memory_target on smithi006 to 17093M 2024-05-20T16:59:24.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:23 smithi006 ceph-mon[32486]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-20T16:59:24.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:23 smithi006 ceph-mon[32486]: Detected new or changed devices on smithi006 2024-05-20T16:59:24.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:23 smithi006 ceph-mon[32486]: Adjusting osd_memory_target on smithi006 to 17093M 2024-05-20T16:59:24.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:24.323+0000 7ff19431c700 1 -- 172.21.15.62:0/3149024432 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ff18c062a80 con 0x7ff1780a2b90 2024-05-20T16:59:25.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:24 smithi062 ceph-mon[35425]: osdmap e9: 1 total, 1 up, 1 in 2024-05-20T16:59:25.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:24 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T16:59:25.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:24 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T16:59:25.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:24 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:25.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:24 smithi171 ceph-mon[35901]: osdmap e9: 1 total, 1 up, 1 in 2024-05-20T16:59:25.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:24 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T16:59:25.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:24 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T16:59:25.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:24 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:25.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:24 smithi006 ceph-mon[32486]: osdmap e9: 1 total, 1 up, 1 in 2024-05-20T16:59:25.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:24 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T16:59:25.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:24 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T16:59:25.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:24 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:26.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:25 smithi062 ceph-mon[35425]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:26.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:25 smithi062 ceph-mon[35425]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:59:26.031 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:25 smithi006 ceph-mon[32486]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:26.031 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:25 smithi006 ceph-mon[32486]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:59:26.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:25 smithi171 ceph-mon[35901]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:26.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:25 smithi171 ceph-mon[35901]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:59:28.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:27 smithi062 ceph-mon[35425]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:28.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:27 smithi062 ceph-mon[35425]: from='client.? 172.21.15.62:0/749417280' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5f34ba7-73bc-4b7c-b02e-be24d5f9b458"}]: dispatch 2024-05-20T16:59:28.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:27 smithi062 ceph-mon[35425]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5f34ba7-73bc-4b7c-b02e-be24d5f9b458"}]: dispatch 2024-05-20T16:59:28.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:27 smithi062 ceph-mon[35425]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5f34ba7-73bc-4b7c-b02e-be24d5f9b458"}]': finished 2024-05-20T16:59:28.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:27 smithi062 ceph-mon[35425]: osdmap e10: 2 total, 1 up, 2 in 2024-05-20T16:59:28.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:27 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T16:59:28.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:27 smithi171 ceph-mon[35901]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:28.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:27 smithi171 ceph-mon[35901]: from='client.? 172.21.15.62:0/749417280' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5f34ba7-73bc-4b7c-b02e-be24d5f9b458"}]: dispatch 2024-05-20T16:59:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:27 smithi171 ceph-mon[35901]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5f34ba7-73bc-4b7c-b02e-be24d5f9b458"}]: dispatch 2024-05-20T16:59:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:27 smithi171 ceph-mon[35901]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5f34ba7-73bc-4b7c-b02e-be24d5f9b458"}]': finished 2024-05-20T16:59:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:27 smithi171 ceph-mon[35901]: osdmap e10: 2 total, 1 up, 2 in 2024-05-20T16:59:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T16:59:28.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:27 smithi006 ceph-mon[32486]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:28.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:27 smithi006 ceph-mon[32486]: from='client.? 172.21.15.62:0/749417280' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5f34ba7-73bc-4b7c-b02e-be24d5f9b458"}]: dispatch 2024-05-20T16:59:28.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:27 smithi006 ceph-mon[32486]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5f34ba7-73bc-4b7c-b02e-be24d5f9b458"}]: dispatch 2024-05-20T16:59:28.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:27 smithi006 ceph-mon[32486]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5f34ba7-73bc-4b7c-b02e-be24d5f9b458"}]': finished 2024-05-20T16:59:28.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:27 smithi006 ceph-mon[32486]: osdmap e10: 2 total, 1 up, 2 in 2024-05-20T16:59:28.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:27 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T16:59:29.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:28 smithi062 ceph-mon[35425]: from='client.? 172.21.15.62:0/2976479840' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T16:59:29.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:28 smithi171 ceph-mon[35901]: from='client.? 172.21.15.62:0/2976479840' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T16:59:29.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:28 smithi006 ceph-mon[32486]: from='client.? 172.21.15.62:0/2976479840' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T16:59:30.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:29 smithi062 ceph-mon[35425]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:30.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:29 smithi171 ceph-mon[35901]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:30.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:29 smithi006 ceph-mon[32486]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:32.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:31 smithi062 ceph-mon[35425]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:32.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:31 smithi171 ceph-mon[35901]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:32.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:31 smithi006 ceph-mon[32486]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:34.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:33 smithi062 ceph-mon[35425]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:34.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:33 smithi171 ceph-mon[35901]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:34.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:33 smithi006 ceph-mon[32486]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:35.083 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:34 smithi062 ceph-mon[35425]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:35.083 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:34 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-20T16:59:35.083 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:34 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:35.083 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:34 smithi062 ceph-mon[35425]: Deploying daemon osd.1 on smithi062 2024-05-20T16:59:35.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:34 smithi171 ceph-mon[35901]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:35.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:34 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-20T16:59:35.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:34 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:35.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:34 smithi171 ceph-mon[35901]: Deploying daemon osd.1 on smithi062 2024-05-20T16:59:35.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:34 smithi006 ceph-mon[32486]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:35.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:34 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-20T16:59:35.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:34 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:35.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:34 smithi006 ceph-mon[32486]: Deploying daemon osd.1 on smithi062 2024-05-20T16:59:37.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:37 smithi062 ceph-mon[35425]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:37.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:37 smithi171 ceph-mon[35901]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:37.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:37 smithi006 ceph-mon[32486]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:39.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:39 smithi062 ceph-mon[35425]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:39.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:39 smithi171 ceph-mon[35901]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:39.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:39 smithi006 ceph-mon[32486]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:41.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:40 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:41.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:40 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:41.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:40 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:59:41.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:40 smithi171 ceph-mon[35901]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:41.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:40 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:41.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:40 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:41.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:40 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:59:41.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:40 smithi006 ceph-mon[32486]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:41.199 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:40 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:41.199 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:40 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:41.199 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:40 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:59:41.199 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:40 smithi062 ceph-mon[35425]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:43.460 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:43 smithi062 ceph-mon[35425]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:43.460 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:43.461 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:43.461 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:43.461 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:59:43.461 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:43.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:43 smithi171 ceph-mon[35901]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:43.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:43.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:43.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:43.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:59:43.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:43.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:43 smithi006 ceph-mon[32486]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:43.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:43.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:43.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:43.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:59:43.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:43.794 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 1 on host 'smithi062' 2024-05-20T16:59:43.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:43.793+0000 7ff1837fe700 1 -- 172.21.15.62:0/3149024432 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff18c062a80 con 0x7ff1780a2b90 2024-05-20T16:59:43.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:43.796+0000 7ff19431c700 1 -- 172.21.15.62:0/3149024432 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff1780a2b90 msgr2=0x7ff1780a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:59:43.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:43.796+0000 7ff19431c700 1 --2- 172.21.15.62:0/3149024432 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff1780a2b90 0x7ff1780a50a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff188006010 tx=0x7ff18801a040 comp rx=0 tx=0).stop 2024-05-20T16:59:43.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:43.796+0000 7ff19431c700 1 -- 172.21.15.62:0/3149024432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff18c104320 msgr2=0x7ff18c199da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:59:43.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:43.796+0000 7ff19431c700 1 --2- 172.21.15.62:0/3149024432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff18c104320 0x7ff18c199da0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff17c00c970 tx=0x7ff17c00cd30 comp rx=0 tx=0).stop 2024-05-20T16:59:43.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:43.796+0000 7ff19431c700 1 -- 172.21.15.62:0/3149024432 shutdown_connections 2024-05-20T16:59:43.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:43.796+0000 7ff19431c700 1 --2- 172.21.15.62:0/3149024432 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff1780a2b90 0x7ff1780a50a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:59:43.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:43.796+0000 7ff19431c700 1 --2- 172.21.15.62:0/3149024432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff18c104cc0 0x7ff18c1a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:59:43.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:43.796+0000 7ff19431c700 1 --2- 172.21.15.62:0/3149024432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff18c1031f0 0x7ff18c199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:59:43.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:43.796+0000 7ff19431c700 1 --2- 172.21.15.62:0/3149024432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff18c104320 0x7ff18c199da0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:59:43.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:43.796+0000 7ff19431c700 1 -- 172.21.15.62:0/3149024432 >> 172.21.15.62:0/3149024432 conn(0x7ff18c0fe850 msgr2=0x7ff18c107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:59:43.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:43.796+0000 7ff19431c700 1 -- 172.21.15.62:0/3149024432 shutdown_connections 2024-05-20T16:59:43.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T16:59:43.796+0000 7ff19431c700 1 -- 172.21.15.62:0/3149024432 wait complete. 2024-05-20T16:59:44.424 DEBUG:teuthology.orchestra.run.smithi062:osd.1> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.1.service 2024-05-20T16:59:44.426 INFO:tasks.cephadm:Deploying osd.2 on smithi171 with /dev/vg_nvme/lv_4... 2024-05-20T16:59:44.427 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-20T16:59:44.675 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T16:59:45.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:45.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:45.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:44 smithi062 ceph-mon[35425]: from='osd.1 [v2:172.21.15.62:6800/2080543878,v1:172.21.15.62:6801/2080543878]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-20T16:59:45.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:44 smithi062 ceph-mon[35425]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-20T16:59:45.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:59:45.034 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:44 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:45.034 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:44 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:45.034 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:44 smithi171 ceph-mon[35901]: from='osd.1 [v2:172.21.15.62:6800/2080543878,v1:172.21.15.62:6801/2080543878]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-20T16:59:45.034 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:44 smithi171 ceph-mon[35901]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-20T16:59:45.034 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:44 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:59:45.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:45.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:45.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:44 smithi006 ceph-mon[32486]: from='osd.1 [v2:172.21.15.62:6800/2080543878,v1:172.21.15.62:6801/2080543878]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-20T16:59:45.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:44 smithi006 ceph-mon[32486]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-20T16:59:45.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T16:59:45.915 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:45 smithi171 ceph-mon[35901]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:45.915 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:45 smithi171 ceph-mon[35901]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-20T16:59:45.915 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:45 smithi171 ceph-mon[35901]: from='osd.1 [v2:172.21.15.62:6800/2080543878,v1:172.21.15.62:6801/2080543878]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T16:59:45.915 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:45 smithi171 ceph-mon[35901]: osdmap e11: 2 total, 1 up, 2 in 2024-05-20T16:59:45.915 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:45 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T16:59:45.915 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:45 smithi171 ceph-mon[35901]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T16:59:45.934 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:45 smithi062 ceph-mon[35425]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:45.934 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:45 smithi062 ceph-mon[35425]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-20T16:59:45.934 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:45 smithi062 ceph-mon[35425]: from='osd.1 [v2:172.21.15.62:6800/2080543878,v1:172.21.15.62:6801/2080543878]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T16:59:45.935 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:45 smithi062 ceph-mon[35425]: osdmap e11: 2 total, 1 up, 2 in 2024-05-20T16:59:45.935 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:45 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T16:59:45.935 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:45 smithi062 ceph-mon[35425]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T16:59:46.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:45 smithi006 ceph-mon[32486]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:46.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:45 smithi006 ceph-mon[32486]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-20T16:59:46.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:45 smithi006 ceph-mon[32486]: from='osd.1 [v2:172.21.15.62:6800/2080543878,v1:172.21.15.62:6801/2080543878]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T16:59:46.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:45 smithi006 ceph-mon[32486]: osdmap e11: 2 total, 1 up, 2 in 2024-05-20T16:59:46.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T16:59:46.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:45 smithi006 ceph-mon[32486]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T16:59:46.489 INFO:teuthology.orchestra.run.smithi171.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-20T16:59:46.489 INFO:teuthology.orchestra.run.smithi171.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-20T16:59:46.489 INFO:teuthology.orchestra.run.smithi171.stderr: stderr: 10+0 records in 2024-05-20T16:59:46.490 INFO:teuthology.orchestra.run.smithi171.stderr:10+0 records out 2024-05-20T16:59:46.490 INFO:teuthology.orchestra.run.smithi171.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112395 s, 933 MB/s 2024-05-20T16:59:46.490 INFO:teuthology.orchestra.run.smithi171.stderr:--> Zapping successful for: 2024-05-20T16:59:46.853 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:46 smithi062 ceph-mon[35425]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-05-20T16:59:46.854 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:46 smithi062 ceph-mon[35425]: osdmap e12: 2 total, 1 up, 2 in 2024-05-20T16:59:46.854 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:46 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T16:59:46.854 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:46 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T16:59:46.854 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:46 smithi062 ceph-mon[35425]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:46.854 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:46 smithi062 ceph-mon[35425]: from='osd.1 ' entity='osd.1' 2024-05-20T16:59:46.854 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 16:59:46 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-1[39980]: 2024-05-20T16:59:46.549+0000 7f91bfb00700 -1 osd.1 0 waiting for initial osdmap 2024-05-20T16:59:46.854 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 16:59:46 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-1[39980]: 2024-05-20T16:59:46.554+0000 7f91b70ac700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T16:59:47.035 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:46 smithi171 ceph-mon[35901]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-05-20T16:59:47.036 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:46 smithi171 ceph-mon[35901]: osdmap e12: 2 total, 1 up, 2 in 2024-05-20T16:59:47.036 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:46 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T16:59:47.036 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:46 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T16:59:47.036 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:46 smithi171 ceph-mon[35901]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:47.036 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:46 smithi171 ceph-mon[35901]: from='osd.1 ' entity='osd.1' 2024-05-20T16:59:47.063 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi171:vg_nvme/lv_4 2024-05-20T16:59:47.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:46 smithi006 ceph-mon[32486]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-05-20T16:59:47.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:46 smithi006 ceph-mon[32486]: osdmap e12: 2 total, 1 up, 2 in 2024-05-20T16:59:47.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:46 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T16:59:47.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:46 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T16:59:47.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:46 smithi006 ceph-mon[32486]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-20T16:59:47.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:46 smithi006 ceph-mon[32486]: from='osd.1 ' entity='osd.1' 2024-05-20T16:59:47.317 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T16:59:48.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:47 smithi062 ceph-mon[35425]: purged_snaps scrub starts 2024-05-20T16:59:48.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:47 smithi062 ceph-mon[35425]: purged_snaps scrub ok 2024-05-20T16:59:48.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:47 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T16:59:48.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:47 smithi062 ceph-mon[35425]: osd.1 [v2:172.21.15.62:6800/2080543878,v1:172.21.15.62:6801/2080543878] boot 2024-05-20T16:59:48.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:47 smithi062 ceph-mon[35425]: osdmap e13: 2 total, 2 up, 2 in 2024-05-20T16:59:48.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:47 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T16:59:48.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:47 smithi062 ceph-mon[35425]: Detected new or changed devices on smithi062 2024-05-20T16:59:48.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:47 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:48.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:47 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:48.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:47 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T16:59:48.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:47 smithi062 ceph-mon[35425]: Adjusting osd_memory_target on smithi062 to 17088M 2024-05-20T16:59:48.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:47 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:48.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:47 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:48.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:47 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:59:48.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:47 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:48.108 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:47 smithi171 ceph-mon[35901]: purged_snaps scrub starts 2024-05-20T16:59:48.109 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:47 smithi171 ceph-mon[35901]: purged_snaps scrub ok 2024-05-20T16:59:48.109 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:47 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T16:59:48.109 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:47 smithi171 ceph-mon[35901]: osd.1 [v2:172.21.15.62:6800/2080543878,v1:172.21.15.62:6801/2080543878] boot 2024-05-20T16:59:48.109 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:47 smithi171 ceph-mon[35901]: osdmap e13: 2 total, 2 up, 2 in 2024-05-20T16:59:48.109 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:47 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T16:59:48.109 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:47 smithi171 ceph-mon[35901]: Detected new or changed devices on smithi062 2024-05-20T16:59:48.109 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:47 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:48.109 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:47 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:48.109 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:47 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T16:59:48.109 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:47 smithi171 ceph-mon[35901]: Adjusting osd_memory_target on smithi062 to 17088M 2024-05-20T16:59:48.109 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:47 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:48.109 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:47 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:48.109 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:47 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:59:48.110 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:47 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:48.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:47 smithi006 ceph-mon[32486]: purged_snaps scrub starts 2024-05-20T16:59:48.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:47 smithi006 ceph-mon[32486]: purged_snaps scrub ok 2024-05-20T16:59:48.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:47 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T16:59:48.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:47 smithi006 ceph-mon[32486]: osd.1 [v2:172.21.15.62:6800/2080543878,v1:172.21.15.62:6801/2080543878] boot 2024-05-20T16:59:48.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:47 smithi006 ceph-mon[32486]: osdmap e13: 2 total, 2 up, 2 in 2024-05-20T16:59:48.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:47 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-20T16:59:48.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:47 smithi006 ceph-mon[32486]: Detected new or changed devices on smithi062 2024-05-20T16:59:48.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:47 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:48.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:47 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:48.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:47 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T16:59:48.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:47 smithi006 ceph-mon[32486]: Adjusting osd_memory_target on smithi062 to 17088M 2024-05-20T16:59:48.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:47 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:48.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:47 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:48.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:47 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T16:59:48.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:47 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T16:59:48.854 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.854+0000 7fa21a918700 1 -- 172.21.15.171:0/3554076055 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2141020d0 msgr2=0x7fa2141024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:59:48.854 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.854+0000 7fa21a918700 1 --2- 172.21.15.171:0/3554076055 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2141020d0 0x7fa2141024e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa204009990 tx=0x7fa204009ca0 comp rx=0 tx=0).stop 2024-05-20T16:59:48.854 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.854+0000 7fa21a918700 1 -- 172.21.15.171:0/3554076055 shutdown_connections 2024-05-20T16:59:48.854 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.854+0000 7fa21a918700 1 --2- 172.21.15.171:0/3554076055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa214103ba0 0x7fa21410a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:59:48.855 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.854+0000 7fa21a918700 1 --2- 172.21.15.171:0/3554076055 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2141020d0 0x7fa2141024e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:59:48.855 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.854+0000 7fa21a918700 1 --2- 172.21.15.171:0/3554076055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa214103200 0x7fa214103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:59:48.855 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.854+0000 7fa21a918700 1 -- 172.21.15.171:0/3554076055 >> 172.21.15.171:0/3554076055 conn(0x7fa2140fd710 msgr2=0x7fa2140ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T16:59:48.855 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.854+0000 7fa21a918700 1 -- 172.21.15.171:0/3554076055 shutdown_connections 2024-05-20T16:59:48.855 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.854+0000 7fa21a918700 1 -- 172.21.15.171:0/3554076055 wait complete. 2024-05-20T16:59:48.857 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.855+0000 7fa21a918700 1 Processor -- start 2024-05-20T16:59:48.857 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.855+0000 7fa21a918700 1 -- start start 2024-05-20T16:59:48.857 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.855+0000 7fa21a918700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2141020d0 0x7fa214199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:59:48.857 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.855+0000 7fa21a918700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa214103200 0x7fa214199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:59:48.857 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.855+0000 7fa21a918700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa214103ba0 0x7fa2141a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:59:48.857 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.855+0000 7fa21a918700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa21410ed00 con 0x7fa214103200 2024-05-20T16:59:48.857 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.855+0000 7fa21a918700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa21410eb80 con 0x7fa2141020d0 2024-05-20T16:59:48.857 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.855+0000 7fa21a918700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa21410ee80 con 0x7fa214103ba0 2024-05-20T16:59:48.857 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.855+0000 7fa218eb5700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa214103ba0 0x7fa2141a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:59:48.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.855+0000 7fa218eb5700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa214103ba0 0x7fa2141a0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:36816/0 (socket says 172.21.15.171:36816) 2024-05-20T16:59:48.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.855+0000 7fa218eb5700 1 -- 172.21.15.171:0/1190226666 learned_addr learned my addr 172.21.15.171:0/1190226666 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T16:59:48.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.855+0000 7fa213fff700 1 --2- 172.21.15.171:0/1190226666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2141020d0 0x7fa214199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:59:48.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.855+0000 7fa20bfff700 1 --2- 172.21.15.171:0/1190226666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa214103200 0x7fa214199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:59:48.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.856+0000 7fa218eb5700 1 -- 172.21.15.171:0/1190226666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2141020d0 msgr2=0x7fa214199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:59:48.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.856+0000 7fa218eb5700 1 --2- 172.21.15.171:0/1190226666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2141020d0 0x7fa214199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:59:48.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.856+0000 7fa218eb5700 1 -- 172.21.15.171:0/1190226666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa214103200 msgr2=0x7fa214199dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T16:59:48.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.856+0000 7fa218eb5700 1 --2- 172.21.15.171:0/1190226666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa214103200 0x7fa214199dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T16:59:48.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.856+0000 7fa218eb5700 1 -- 172.21.15.171:0/1190226666 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2141a13e0 con 0x7fa214103ba0 2024-05-20T16:59:48.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.856+0000 7fa218eb5700 1 --2- 172.21.15.171:0/1190226666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa214103ba0 0x7fa2141a0d60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa20c007ee0 tx=0x7fa20c00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:59:48.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.856+0000 7fa211ffb700 1 -- 172.21.15.171:0/1190226666 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c004bb0 con 0x7fa214103ba0 2024-05-20T16:59:48.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.856+0000 7fa21a918700 1 -- 172.21.15.171:0/1190226666 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2141a16d0 con 0x7fa214103ba0 2024-05-20T16:59:48.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.856+0000 7fa211ffb700 1 -- 172.21.15.171:0/1190226666 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa20c004d50 con 0x7fa214103ba0 2024-05-20T16:59:48.859 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.856+0000 7fa211ffb700 1 -- 172.21.15.171:0/1190226666 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c0058e0 con 0x7fa214103ba0 2024-05-20T16:59:48.859 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.856+0000 7fa21a918700 1 -- 172.21.15.171:0/1190226666 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2141a1c10 con 0x7fa214103ba0 2024-05-20T16:59:48.859 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.857+0000 7fa21a918700 1 -- 172.21.15.171:0/1190226666 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa214050170 con 0x7fa214103ba0 2024-05-20T16:59:48.859 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.858+0000 7fa211ffb700 1 -- 172.21.15.171:0/1190226666 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7fa20c01a020 con 0x7fa214103ba0 2024-05-20T16:59:48.860 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.859+0000 7fa211ffb700 1 --2- 172.21.15.171:0/1190226666 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa2000a2b90 0x7fa2000a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T16:59:48.860 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.859+0000 7fa211ffb700 1 -- 172.21.15.171:0/1190226666 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7fa20c0ccee0 con 0x7fa214103ba0 2024-05-20T16:59:48.860 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.859+0000 7fa213fff700 1 --2- 172.21.15.171:0/1190226666 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa2000a2b90 0x7fa2000a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T16:59:48.860 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.860+0000 7fa213fff700 1 --2- 172.21.15.171:0/1190226666 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa2000a2b90 0x7fa2000a50a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa2040038b0 tx=0x7fa20401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T16:59:48.863 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:48.864+0000 7fa211ffb700 1 -- 172.21.15.171:0/1190226666 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa20c010070 con 0x7fa214103ba0 2024-05-20T16:59:48.864 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:48 smithi171 ceph-mon[35901]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T16:59:49.072 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T16:59:49.072+0000 7fa21a918700 1 -- 172.21.15.171:0/1190226666 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa214062a80 con 0x7fa2000a2b90 2024-05-20T16:59:49.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:48 smithi006 ceph-mon[32486]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T16:59:49.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:48 smithi062 ceph-mon[35425]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T16:59:49.973 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:49 smithi171 ceph-mon[35901]: osdmap e14: 2 total, 2 up, 2 in 2024-05-20T16:59:49.973 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:49 smithi171 ceph-mon[35901]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:59:49.973 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:49 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T16:59:49.973 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:49 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T16:59:49.973 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:49 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:50.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:49 smithi006 ceph-mon[32486]: osdmap e14: 2 total, 2 up, 2 in 2024-05-20T16:59:50.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:49 smithi006 ceph-mon[32486]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:59:50.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:49 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T16:59:50.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:49 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T16:59:50.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:49 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:50.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:49 smithi062 ceph-mon[35425]: osdmap e14: 2 total, 2 up, 2 in 2024-05-20T16:59:50.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:49 smithi062 ceph-mon[35425]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T16:59:50.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:49 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T16:59:50.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:49 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T16:59:50.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:49 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:50 smithi171 ceph-mon[35901]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T16:59:51.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:50 smithi006 ceph-mon[32486]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T16:59:51.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:50 smithi062 ceph-mon[35425]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T16:59:52.085 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:51 smithi171 ceph-mon[35901]: from='client.? 172.21.15.171:0/322487295' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3ceaced-2797-4274-8b88-18b9c6dedb4a"}]: dispatch 2024-05-20T16:59:52.085 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:51 smithi171 ceph-mon[35901]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3ceaced-2797-4274-8b88-18b9c6dedb4a"}]: dispatch 2024-05-20T16:59:52.085 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:51 smithi171 ceph-mon[35901]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e3ceaced-2797-4274-8b88-18b9c6dedb4a"}]': finished 2024-05-20T16:59:52.085 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:51 smithi171 ceph-mon[35901]: osdmap e15: 3 total, 2 up, 3 in 2024-05-20T16:59:52.085 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:51 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T16:59:52.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:51 smithi006 ceph-mon[32486]: from='client.? 172.21.15.171:0/322487295' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3ceaced-2797-4274-8b88-18b9c6dedb4a"}]: dispatch 2024-05-20T16:59:52.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:51 smithi006 ceph-mon[32486]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3ceaced-2797-4274-8b88-18b9c6dedb4a"}]: dispatch 2024-05-20T16:59:52.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:51 smithi006 ceph-mon[32486]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e3ceaced-2797-4274-8b88-18b9c6dedb4a"}]': finished 2024-05-20T16:59:52.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:51 smithi006 ceph-mon[32486]: osdmap e15: 3 total, 2 up, 3 in 2024-05-20T16:59:52.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:51 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T16:59:52.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:51 smithi062 ceph-mon[35425]: from='client.? 172.21.15.171:0/322487295' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3ceaced-2797-4274-8b88-18b9c6dedb4a"}]: dispatch 2024-05-20T16:59:52.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:51 smithi062 ceph-mon[35425]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3ceaced-2797-4274-8b88-18b9c6dedb4a"}]: dispatch 2024-05-20T16:59:52.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:51 smithi062 ceph-mon[35425]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e3ceaced-2797-4274-8b88-18b9c6dedb4a"}]': finished 2024-05-20T16:59:52.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:51 smithi062 ceph-mon[35425]: osdmap e15: 3 total, 2 up, 3 in 2024-05-20T16:59:52.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:51 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T16:59:53.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:52 smithi171 ceph-mon[35901]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T16:59:53.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:52 smithi171 ceph-mon[35901]: from='client.? 172.21.15.171:0/3971826263' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T16:59:53.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:52 smithi006 ceph-mon[32486]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T16:59:53.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:52 smithi006 ceph-mon[32486]: from='client.? 172.21.15.171:0/3971826263' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T16:59:53.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:52 smithi062 ceph-mon[35425]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T16:59:53.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:52 smithi062 ceph-mon[35425]: from='client.? 172.21.15.171:0/3971826263' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T16:59:55.360 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:55 smithi062 ceph-mon[35425]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T16:59:55.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:55 smithi171 ceph-mon[35901]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T16:59:55.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:55 smithi006 ceph-mon[32486]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T16:59:57.240 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:57 smithi171 ceph-mon[35901]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T16:59:57.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:57 smithi006 ceph-mon[32486]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T16:59:57.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:57 smithi062 ceph-mon[35425]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T16:59:59.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:59 smithi171 ceph-mon[35901]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T16:59:59.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:59 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-20T16:59:59.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 16:59:59 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:59.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:59 smithi006 ceph-mon[32486]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T16:59:59.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-20T16:59:59.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 16:59:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T16:59:59.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:59 smithi062 ceph-mon[35425]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T16:59:59.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:59 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-20T16:59:59.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 16:59:59 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:00.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:00 smithi171 ceph-mon[35901]: Deploying daemon osd.2 on smithi171 2024-05-20T17:00:00.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:00 smithi171 ceph-mon[35901]: overall HEALTH_OK 2024-05-20T17:00:00.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:00 smithi006 ceph-mon[32486]: Deploying daemon osd.2 on smithi171 2024-05-20T17:00:00.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:00 smithi006 ceph-mon[32486]: overall HEALTH_OK 2024-05-20T17:00:00.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:00 smithi062 ceph-mon[35425]: Deploying daemon osd.2 on smithi171 2024-05-20T17:00:00.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:00 smithi062 ceph-mon[35425]: overall HEALTH_OK 2024-05-20T17:00:01.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:01 smithi171 ceph-mon[35901]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:00:01.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:01 smithi006 ceph-mon[32486]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:00:01.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:01 smithi062 ceph-mon[35425]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:00:03.209 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:03 smithi171 ceph-mon[35901]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:00:03.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:03 smithi006 ceph-mon[32486]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:00:03.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:03 smithi062 ceph-mon[35425]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:00:05.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:05 smithi171 ceph-mon[35901]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:00:05.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:05 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:05.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:05 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:05.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:05 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:00:05.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:05 smithi006 ceph-mon[32486]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:00:05.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:05 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:05.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:05 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:05.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:05 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:00:05.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:05 smithi062 ceph-mon[35425]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:00:05.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:05 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:05.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:05 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:05.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:05 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:00:07.812 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:07 smithi171 ceph-mon[35901]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:00:07.812 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:07.812 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:07.812 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:07.812 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:00:07.813 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:07.893 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:00:07.893+0000 7fa211ffb700 1 -- 172.21.15.171:0/1190226666 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa214062a80 con 0x7fa2000a2b90 2024-05-20T17:00:07.893 INFO:teuthology.orchestra.run.smithi171.stdout:Created osd(s) 2 on host 'smithi171' 2024-05-20T17:00:07.896 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:00:07.894+0000 7fa21a918700 1 -- 172.21.15.171:0/1190226666 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa2000a2b90 msgr2=0x7fa2000a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:00:07.896 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:00:07.894+0000 7fa21a918700 1 --2- 172.21.15.171:0/1190226666 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa2000a2b90 0x7fa2000a50a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa2040038b0 tx=0x7fa20401a040 comp rx=0 tx=0).stop 2024-05-20T17:00:07.896 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:00:07.894+0000 7fa21a918700 1 -- 172.21.15.171:0/1190226666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa214103ba0 msgr2=0x7fa2141a0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:00:07.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:00:07.894+0000 7fa21a918700 1 --2- 172.21.15.171:0/1190226666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa214103ba0 0x7fa2141a0d60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa20c007ee0 tx=0x7fa20c00d3b0 comp rx=0 tx=0).stop 2024-05-20T17:00:07.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:00:07.894+0000 7fa21a918700 1 -- 172.21.15.171:0/1190226666 shutdown_connections 2024-05-20T17:00:07.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:00:07.894+0000 7fa21a918700 1 --2- 172.21.15.171:0/1190226666 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa2000a2b90 0x7fa2000a50a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:00:07.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:00:07.894+0000 7fa21a918700 1 --2- 172.21.15.171:0/1190226666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa214103ba0 0x7fa2141a0d60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:00:07.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:00:07.894+0000 7fa21a918700 1 --2- 172.21.15.171:0/1190226666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2141020d0 0x7fa214199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:00:07.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:00:07.894+0000 7fa21a918700 1 --2- 172.21.15.171:0/1190226666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa214103200 0x7fa214199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:00:07.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:00:07.894+0000 7fa21a918700 1 -- 172.21.15.171:0/1190226666 >> 172.21.15.171:0/1190226666 conn(0x7fa2140fd710 msgr2=0x7fa214106430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:00:07.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:00:07.894+0000 7fa21a918700 1 -- 172.21.15.171:0/1190226666 shutdown_connections 2024-05-20T17:00:07.897 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:00:07.894+0000 7fa21a918700 1 -- 172.21.15.171:0/1190226666 wait complete. 2024-05-20T17:00:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:07 smithi062 ceph-mon[35425]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:00:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:00:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:08.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:07 smithi006 ceph-mon[32486]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:00:08.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:08.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:08.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:08.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:00:08.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:08.457 DEBUG:teuthology.orchestra.run.smithi171:osd.2> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.2.service 2024-05-20T17:00:08.459 INFO:tasks.cephadm:Deploying osd.3 on smithi006 with /dev/vg_nvme/lv_3... 2024-05-20T17:00:08.459 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-20T17:00:08.721 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:00:08.742 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:00:08.742 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:08.742 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:08.742 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:08 smithi171 ceph-mon[35901]: from='osd.2 [v2:172.21.15.171:6800/56436737,v1:172.21.15.171:6801/56436737]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-20T17:00:08.742 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:08 smithi171 ceph-mon[35901]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-20T17:00:08.843 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:00:08.844 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:08.844 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:08.844 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:08 smithi006 ceph-mon[32486]: from='osd.2 [v2:172.21.15.171:6800/56436737,v1:172.21.15.171:6801/56436737]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-20T17:00:08.844 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:08 smithi006 ceph-mon[32486]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-20T17:00:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:00:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:08 smithi062 ceph-mon[35425]: from='osd.2 [v2:172.21.15.171:6800/56436737,v1:172.21.15.171:6801/56436737]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-20T17:00:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:08 smithi062 ceph-mon[35425]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-20T17:00:09.865 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:09 smithi171 ceph-mon[35901]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:00:09.865 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:09 smithi171 ceph-mon[35901]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-20T17:00:09.865 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:09 smithi171 ceph-mon[35901]: osdmap e16: 3 total, 2 up, 3 in 2024-05-20T17:00:09.865 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:09 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:00:09.865 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:09 smithi171 ceph-mon[35901]: from='osd.2 [v2:172.21.15.171:6800/56436737,v1:172.21.15.171:6801/56436737]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:00:09.865 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:09 smithi171 ceph-mon[35901]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:00:10.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:09 smithi062 ceph-mon[35425]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:00:10.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:09 smithi062 ceph-mon[35425]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-20T17:00:10.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:09 smithi062 ceph-mon[35425]: osdmap e16: 3 total, 2 up, 3 in 2024-05-20T17:00:10.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:09 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:00:10.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:09 smithi062 ceph-mon[35425]: from='osd.2 [v2:172.21.15.171:6800/56436737,v1:172.21.15.171:6801/56436737]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:00:10.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:09 smithi062 ceph-mon[35425]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:00:10.058 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:09 smithi006 ceph-mon[32486]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:00:10.059 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:09 smithi006 ceph-mon[32486]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-20T17:00:10.059 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:09 smithi006 ceph-mon[32486]: osdmap e16: 3 total, 2 up, 3 in 2024-05-20T17:00:10.059 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:09 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:00:10.059 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:09 smithi006 ceph-mon[32486]: from='osd.2 [v2:172.21.15.171:6800/56436737,v1:172.21.15.171:6801/56436737]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:00:10.059 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:09 smithi006 ceph-mon[32486]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:00:10.116 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:00:09 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-2[41014]: 2024-05-20T17:00:09.864+0000 7f884493f700 -1 osd.2 0 waiting for initial osdmap 2024-05-20T17:00:10.116 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:00:09 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-2[41014]: 2024-05-20T17:00:09.869+0000 7f88406f4700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:00:10.993 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-20T17:00:10.993 INFO:teuthology.orchestra.run.smithi006.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-20T17:00:10.993 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10+0 records in 2024-05-20T17:00:10.994 INFO:teuthology.orchestra.run.smithi006.stderr:10+0 records out 2024-05-20T17:00:10.994 INFO:teuthology.orchestra.run.smithi006.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112768 s, 930 MB/s 2024-05-20T17:00:10.994 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping successful for: 2024-05-20T17:00:10.994 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:10 smithi006 ceph-mon[32486]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-20T17:00:10.994 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:10 smithi006 ceph-mon[32486]: osdmap e17: 3 total, 2 up, 3 in 2024-05-20T17:00:10.994 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:10 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:00:10.994 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:10 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:00:10.994 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:10 smithi006 ceph-mon[32486]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:00:11.029 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:10 smithi171 ceph-mon[35901]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-20T17:00:11.029 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:10 smithi171 ceph-mon[35901]: osdmap e17: 3 total, 2 up, 3 in 2024-05-20T17:00:11.029 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:10 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:00:11.029 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:10 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:00:11.029 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:10 smithi171 ceph-mon[35901]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:00:11.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:10 smithi062 ceph-mon[35425]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-20T17:00:11.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:10 smithi062 ceph-mon[35425]: osdmap e17: 3 total, 2 up, 3 in 2024-05-20T17:00:11.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:10 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:00:11.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:10 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:00:11.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:10 smithi062 ceph-mon[35425]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-20T17:00:11.654 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi006:vg_nvme/lv_3 2024-05-20T17:00:11.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:11 smithi006 ceph-mon[32486]: purged_snaps scrub starts 2024-05-20T17:00:11.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:11 smithi006 ceph-mon[32486]: purged_snaps scrub ok 2024-05-20T17:00:11.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:11 smithi006 ceph-mon[32486]: osd.2 [v2:172.21.15.171:6800/56436737,v1:172.21.15.171:6801/56436737] boot 2024-05-20T17:00:11.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:11 smithi006 ceph-mon[32486]: osdmap e18: 3 total, 3 up, 3 in 2024-05-20T17:00:11.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:00:11.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:11 smithi006 ceph-mon[32486]: Detected new or changed devices on smithi171 2024-05-20T17:00:11.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:11.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:11.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:00:11.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:11 smithi006 ceph-mon[32486]: Adjusting osd_memory_target on smithi171 to 17088M 2024-05-20T17:00:11.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:11.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:11.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:00:11.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:11.911 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:00:12.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:11 smithi062 ceph-mon[35425]: purged_snaps scrub starts 2024-05-20T17:00:12.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:11 smithi062 ceph-mon[35425]: purged_snaps scrub ok 2024-05-20T17:00:12.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:11 smithi062 ceph-mon[35425]: osd.2 [v2:172.21.15.171:6800/56436737,v1:172.21.15.171:6801/56436737] boot 2024-05-20T17:00:12.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:11 smithi062 ceph-mon[35425]: osdmap e18: 3 total, 3 up, 3 in 2024-05-20T17:00:12.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:11 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:00:12.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:11 smithi062 ceph-mon[35425]: Detected new or changed devices on smithi171 2024-05-20T17:00:12.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:11 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:12.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:11 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:12.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:11 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:00:12.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:11 smithi062 ceph-mon[35425]: Adjusting osd_memory_target on smithi171 to 17088M 2024-05-20T17:00:12.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:11 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:12.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:11 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:12.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:11 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:00:12.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:11 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:12.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:11 smithi171 ceph-mon[35901]: purged_snaps scrub starts 2024-05-20T17:00:12.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:11 smithi171 ceph-mon[35901]: purged_snaps scrub ok 2024-05-20T17:00:12.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:11 smithi171 ceph-mon[35901]: osd.2 [v2:172.21.15.171:6800/56436737,v1:172.21.15.171:6801/56436737] boot 2024-05-20T17:00:12.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:11 smithi171 ceph-mon[35901]: osdmap e18: 3 total, 3 up, 3 in 2024-05-20T17:00:12.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:11 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-20T17:00:12.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:11 smithi171 ceph-mon[35901]: Detected new or changed devices on smithi171 2024-05-20T17:00:12.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:11 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:12.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:11 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:12.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:11 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:00:12.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:11 smithi171 ceph-mon[35901]: Adjusting osd_memory_target on smithi171 to 17088M 2024-05-20T17:00:12.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:11 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:12.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:11 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:12.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:11 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:00:12.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:11 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:13.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:12 smithi006 ceph-mon[32486]: osdmap e19: 3 total, 3 up, 3 in 2024-05-20T17:00:13.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:12 smithi006 ceph-mon[32486]: pgmap v84: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:13.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:12 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-20T17:00:13.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:12 smithi062 ceph-mon[35425]: osdmap e19: 3 total, 3 up, 3 in 2024-05-20T17:00:13.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:12 smithi062 ceph-mon[35425]: pgmap v84: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:13.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:12 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-20T17:00:13.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:12 smithi171 ceph-mon[35901]: osdmap e19: 3 total, 3 up, 3 in 2024-05-20T17:00:13.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:12 smithi171 ceph-mon[35901]: pgmap v84: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:13.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:12 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-20T17:00:13.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.741+0000 7f47f1ec0700 1 -- 172.21.15.6:0/4134879960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47ec108f80 msgr2=0x7f47ec10b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:00:13.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.741+0000 7f47f1ec0700 1 --2- 172.21.15.6:0/4134879960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47ec108f80 0x7f47ec10b3a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009990 tx=0x7f47e4009ca0 comp rx=0 tx=0).stop 2024-05-20T17:00:13.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.741+0000 7f47f1ec0700 1 -- 172.21.15.6:0/4134879960 shutdown_connections 2024-05-20T17:00:13.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.741+0000 7f47f1ec0700 1 --2- 172.21.15.6:0/4134879960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47ec108f80 0x7f47ec10b3a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:00:13.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.742+0000 7f47f1ec0700 1 --2- 172.21.15.6:0/4134879960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47ec103cc0 0x7f47ec1060e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:00:13.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.742+0000 7f47f1ec0700 1 --2- 172.21.15.6:0/4134879960 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47ec106620 0x7f47ec108a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:00:13.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.742+0000 7f47f1ec0700 1 -- 172.21.15.6:0/4134879960 >> 172.21.15.6:0/4134879960 conn(0x7f47ec0fd700 msgr2=0x7f47ec0ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:00:13.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.742+0000 7f47f1ec0700 1 -- 172.21.15.6:0/4134879960 shutdown_connections 2024-05-20T17:00:13.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.742+0000 7f47f1ec0700 1 -- 172.21.15.6:0/4134879960 wait complete. 2024-05-20T17:00:13.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.742+0000 7f47f1ec0700 1 Processor -- start 2024-05-20T17:00:13.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.743+0000 7f47f1ec0700 1 -- start start 2024-05-20T17:00:13.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.743+0000 7f47f1ec0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47ec103cc0 0x7f47ec199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:00:13.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.743+0000 7f47f1ec0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47ec106620 0x7f47ec199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:00:13.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.743+0000 7f47f1ec0700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47ec108f80 0x7f47ec1a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:00:13.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.743+0000 7f47f1ec0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec10ec30 con 0x7f47ec106620 2024-05-20T17:00:13.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.743+0000 7f47f1ec0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec10eab0 con 0x7f47ec103cc0 2024-05-20T17:00:13.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.743+0000 7f47f1ec0700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec10edb0 con 0x7f47ec108f80 2024-05-20T17:00:13.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.743+0000 7f47eaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47ec106620 0x7f47ec199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:00:13.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.743+0000 7f47eaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47ec106620 0x7f47ec199c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54872/0 (socket says 172.21.15.6:54872) 2024-05-20T17:00:13.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.743+0000 7f47eaffd700 1 -- 172.21.15.6:0/315186469 learned_addr learned my addr 172.21.15.6:0/315186469 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:00:13.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.743+0000 7f47eb7fe700 1 --2- 172.21.15.6:0/315186469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47ec103cc0 0x7f47ec199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:00:13.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.743+0000 7f47ebfff700 1 --2- 172.21.15.6:0/315186469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47ec108f80 0x7f47ec1a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:00:13.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.743+0000 7f47eaffd700 1 -- 172.21.15.6:0/315186469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47ec108f80 msgr2=0x7f47ec1a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:00:13.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.743+0000 7f47eaffd700 1 --2- 172.21.15.6:0/315186469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47ec108f80 0x7f47ec1a0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:00:13.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.743+0000 7f47eaffd700 1 -- 172.21.15.6:0/315186469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47ec103cc0 msgr2=0x7f47ec199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:00:13.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.743+0000 7f47eaffd700 1 --2- 172.21.15.6:0/315186469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47ec103cc0 0x7f47ec199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:00:13.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.743+0000 7f47eaffd700 1 -- 172.21.15.6:0/315186469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ec1a1280 con 0x7f47ec106620 2024-05-20T17:00:13.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.744+0000 7f47eaffd700 1 --2- 172.21.15.6:0/315186469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47ec106620 0x7f47ec199c60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f47d400c920 tx=0x7f47d400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:00:13.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.744+0000 7f47e8ff9700 1 -- 172.21.15.6:0/315186469 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d4004a30 con 0x7f47ec106620 2024-05-20T17:00:13.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.744+0000 7f47e8ff9700 1 -- 172.21.15.6:0/315186469 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47d40054d0 con 0x7f47ec106620 2024-05-20T17:00:13.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.744+0000 7f47f1ec0700 1 -- 172.21.15.6:0/315186469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47ec1a1570 con 0x7f47ec106620 2024-05-20T17:00:13.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.744+0000 7f47e8ff9700 1 -- 172.21.15.6:0/315186469 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d4007c30 con 0x7f47ec106620 2024-05-20T17:00:13.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.744+0000 7f47f1ec0700 1 -- 172.21.15.6:0/315186469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47ec1a1b00 con 0x7f47ec106620 2024-05-20T17:00:13.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.745+0000 7f47f1ec0700 1 -- 172.21.15.6:0/315186469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47ec050170 con 0x7f47ec106620 2024-05-20T17:00:13.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.746+0000 7f47e8ff9700 1 -- 172.21.15.6:0/315186469 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7f47d4004bd0 con 0x7f47ec106620 2024-05-20T17:00:13.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.747+0000 7f47e8ff9700 1 --2- 172.21.15.6:0/315186469 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f47d80a2c10 0x7f47d80a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:00:13.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.747+0000 7f47e8ff9700 1 -- 172.21.15.6:0/315186469 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3226+0+0 (secure 0 0 0) 0x7f47d40cd9b0 con 0x7f47ec106620 2024-05-20T17:00:13.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.748+0000 7f47eb7fe700 1 --2- 172.21.15.6:0/315186469 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f47d80a2c10 0x7f47d80a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:00:13.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.749+0000 7f47eb7fe700 1 --2- 172.21.15.6:0/315186469 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f47d80a2c10 0x7f47d80a5120 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009550 tx=0x7f47dc0091f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:00:13.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.752+0000 7f47e8ff9700 1 -- 172.21.15.6:0/315186469 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f47d4014030 con 0x7f47ec106620 2024-05-20T17:00:13.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:13.987+0000 7f47f1ec0700 1 -- 172.21.15.6:0/315186469 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f47ec062a80 con 0x7f47d80a2c10 2024-05-20T17:00:14.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:13 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-20T17:00:14.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:13 smithi006 ceph-mon[32486]: osdmap e20: 3 total, 3 up, 3 in 2024-05-20T17:00:14.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:13 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T17:00:14.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:13 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-20T17:00:14.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:13 smithi062 ceph-mon[35425]: osdmap e20: 3 total, 3 up, 3 in 2024-05-20T17:00:14.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:13 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T17:00:14.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:13 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-20T17:00:14.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:13 smithi171 ceph-mon[35901]: osdmap e20: 3 total, 3 up, 3 in 2024-05-20T17:00:14.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:13 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T17:00:14.726 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:00:14 smithi006 sudo[51923]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-20T17:00:14.726 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:00:14 smithi006 sudo[51923]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:00:14.726 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:00:14 smithi006 sudo[51923]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:00:14.726 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:00:14 smithi006 sudo[51923]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:00:14.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:14.906+0000 7f47e8ff9700 1 -- 172.21.15.6:0/315186469 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f47d4097dc0 con 0x7f47ec106620 2024-05-20T17:00:15.130 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:00:14 smithi006 sudo[51991]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-20T17:00:15.130 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:00:14 smithi006 sudo[51991]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:00:15.130 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:00:14 smithi006 sudo[51991]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:00:15.130 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:00:14 smithi006 sudo[51991]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:00:15.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:14 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-20T17:00:15.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:14 smithi006 ceph-mon[32486]: osdmap e21: 3 total, 3 up, 3 in 2024-05-20T17:00:15.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:14 smithi006 ceph-mon[32486]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:00:15.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:14 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:00:15.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:14 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:00:15.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:14 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:15.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:14 smithi006 ceph-mon[32486]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:15.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:14 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-20T17:00:15.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:14 smithi062 ceph-mon[35425]: osdmap e21: 3 total, 3 up, 3 in 2024-05-20T17:00:15.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:14 smithi062 ceph-mon[35425]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:00:15.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:14 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:00:15.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:14 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:00:15.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:14 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:15.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:14 smithi062 ceph-mon[35425]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:15.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:14 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-20T17:00:15.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:14 smithi171 ceph-mon[35901]: osdmap e21: 3 total, 3 up, 3 in 2024-05-20T17:00:15.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:14 smithi171 ceph-mon[35901]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:00:15.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:14 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:00:15.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:14 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:00:15.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:14 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:15.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:14 smithi171 ceph-mon[35901]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:15.772 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:00:15 smithi062 sudo[43775]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-20T17:00:15.772 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:00:15 smithi062 sudo[43775]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:00:15.772 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:00:15 smithi062 sudo[43775]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:00:15.773 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:00:15 smithi062 sudo[43775]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:00:16.167 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:15 smithi006 ceph-mon[32486]: osdmap e22: 3 total, 3 up, 3 in 2024-05-20T17:00:16.167 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:15 smithi006 ceph-mon[32486]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-05-20T17:00:16.167 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:15 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:16.168 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:15 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:16.272 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:00:15 smithi062 sudo[43778]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-20T17:00:16.272 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:00:15 smithi062 sudo[43778]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:00:16.272 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:00:15 smithi062 sudo[43778]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:00:16.272 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:00:15 smithi062 sudo[43778]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:00:16.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:15 smithi062 ceph-mon[35425]: osdmap e22: 3 total, 3 up, 3 in 2024-05-20T17:00:16.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:15 smithi062 ceph-mon[35425]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-05-20T17:00:16.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:15 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:16.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:15 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:16.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:15 smithi171 ceph-mon[35901]: osdmap e22: 3 total, 3 up, 3 in 2024-05-20T17:00:16.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:15 smithi171 ceph-mon[35901]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-05-20T17:00:16.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:15 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:16.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:15 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:16.367 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:00:16 smithi171 sudo[44586]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-20T17:00:16.367 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:00:16 smithi171 sudo[44586]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:00:16.367 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:00:16 smithi171 sudo[44586]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:00:16.367 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:00:16 smithi171 sudo[44586]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:00:16.866 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:00:16 smithi171 sudo[44589]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-20T17:00:16.866 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:00:16 smithi171 sudo[44589]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:00:16.866 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:00:16 smithi171 sudo[44589]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:00:16.866 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:00:16 smithi171 sudo[44589]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:00:17.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:16 smithi006 sudo[52067]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-20T17:00:17.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:16 smithi006 sudo[52067]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:00:17.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:16 smithi006 sudo[52067]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:00:17.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:16 smithi006 sudo[52067]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:00:17.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:17 smithi006 sudo[52070]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-20T17:00:17.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:17 smithi006 sudo[52070]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:00:17.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:17 smithi006 sudo[52070]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:00:17.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:17 smithi006 sudo[52070]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:00:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:17 smithi171 sudo[44592]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-20T17:00:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:17 smithi171 sudo[44592]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:00:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:17 smithi171 sudo[44592]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:00:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:17 smithi171 sudo[44592]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:00:18.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:17 smithi171 sudo[44595]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-20T17:00:18.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:17 smithi171 sudo[44595]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:00:18.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:17 smithi171 sudo[44595]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:00:18.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:17 smithi171 sudo[44595]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:00:18.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:17 smithi171 ceph-mon[35901]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:18.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:17 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:18.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:17 smithi171 ceph-mon[35901]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T17:00:18.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:17 smithi171 ceph-mon[35901]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T17:00:18.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:17 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:00:18.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:17 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:00:18.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:17 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:00:18.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:17 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:00:18.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:17 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:00:18.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:17 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:00:18.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:17 smithi006 ceph-mon[32486]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:18.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:17 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:18.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:17 smithi006 ceph-mon[32486]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T17:00:18.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:17 smithi006 ceph-mon[32486]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T17:00:18.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:17 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:00:18.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:17 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:00:18.134 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:17 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:00:18.134 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:17 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:00:18.134 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:17 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:00:18.134 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:17 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:00:18.252 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:17 smithi062 ceph-mon[35425]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:18.252 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:17 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:18.252 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:17 smithi062 ceph-mon[35425]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T17:00:18.252 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:17 smithi062 ceph-mon[35425]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T17:00:18.252 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:17 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:00:18.252 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:17 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:00:18.252 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:17 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:00:18.252 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:17 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:00:18.252 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:17 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:00:18.253 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:17 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:00:18.253 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:18 smithi062 sudo[43781]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-20T17:00:18.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:18 smithi062 sudo[43781]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:00:18.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:18 smithi062 sudo[43781]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:00:18.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:18 smithi062 sudo[43781]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:00:19.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:18 smithi062 sudo[43784]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-20T17:00:19.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:18 smithi062 sudo[43784]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-20T17:00:19.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:18 smithi062 sudo[43784]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-20T17:00:19.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:18 smithi062 sudo[43784]: pam_unix(sudo:session): session closed for user root 2024-05-20T17:00:19.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:18 smithi062 ceph-mon[35425]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T17:00:19.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:18 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2589679264' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8eabe078-e351-4877-9954-b472a88ca266"}]: dispatch 2024-05-20T17:00:19.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:18 smithi062 ceph-mon[35425]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T17:00:19.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:18 smithi062 ceph-mon[35425]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T17:00:19.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:18 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:00:19.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:18 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:00:19.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:18 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:00:19.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:18 smithi062 ceph-mon[35425]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:19.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:18 smithi062 ceph-mon[35425]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T17:00:19.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:18 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2589679264' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8eabe078-e351-4877-9954-b472a88ca266"}]': finished 2024-05-20T17:00:19.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:18 smithi062 ceph-mon[35425]: osdmap e23: 4 total, 3 up, 4 in 2024-05-20T17:00:19.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:18 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:00:19.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:18 smithi171 ceph-mon[35901]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T17:00:19.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:18 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2589679264' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8eabe078-e351-4877-9954-b472a88ca266"}]: dispatch 2024-05-20T17:00:19.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:18 smithi171 ceph-mon[35901]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T17:00:19.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:18 smithi171 ceph-mon[35901]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T17:00:19.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:18 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:00:19.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:18 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:00:19.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:18 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:00:19.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:18 smithi171 ceph-mon[35901]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:19.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:18 smithi171 ceph-mon[35901]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T17:00:19.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:18 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2589679264' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8eabe078-e351-4877-9954-b472a88ca266"}]': finished 2024-05-20T17:00:19.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:18 smithi171 ceph-mon[35901]: osdmap e23: 4 total, 3 up, 4 in 2024-05-20T17:00:19.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:18 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:00:19.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:18 smithi006 ceph-mon[32486]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T17:00:19.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:18 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2589679264' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8eabe078-e351-4877-9954-b472a88ca266"}]: dispatch 2024-05-20T17:00:19.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:18 smithi006 ceph-mon[32486]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T17:00:19.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:18 smithi006 ceph-mon[32486]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-20T17:00:19.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:18 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-20T17:00:19.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:18 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-20T17:00:19.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:18 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-20T17:00:19.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:18 smithi006 ceph-mon[32486]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:19.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:18 smithi006 ceph-mon[32486]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-20T17:00:19.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:18 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2589679264' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8eabe078-e351-4877-9954-b472a88ca266"}]': finished 2024-05-20T17:00:19.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:18 smithi006 ceph-mon[32486]: osdmap e23: 4 total, 3 up, 4 in 2024-05-20T17:00:19.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:18 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:00:20.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:19 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2418263183' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:00:20.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:19 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2418263183' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:00:20.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:19 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2418263183' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:00:21.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:20 smithi171 ceph-mon[35901]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:21.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:20 smithi006 ceph-mon[32486]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:21.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:20 smithi062 ceph-mon[35425]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:23.198 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:23 smithi006 ceph-mon[32486]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:23.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:23 smithi171 ceph-mon[35901]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:23.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:23 smithi062 ceph-mon[35425]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:25.324 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:25 smithi062 ceph-mon[35425]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-05-20T17:00:25.344 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:25 smithi006 ceph-mon[32486]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-05-20T17:00:25.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:25 smithi171 ceph-mon[35901]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-05-20T17:00:27.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:27 smithi171 ceph-mon[35901]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-05-20T17:00:27.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-20T17:00:27.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:27.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:27 smithi171 ceph-mon[35901]: Deploying daemon osd.3 on smithi006 2024-05-20T17:00:27.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:27 smithi006 ceph-mon[32486]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-05-20T17:00:27.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:27 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-20T17:00:27.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:27 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:27.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:27 smithi006 ceph-mon[32486]: Deploying daemon osd.3 on smithi006 2024-05-20T17:00:27.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:27 smithi062 ceph-mon[35425]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-05-20T17:00:27.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:27 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-20T17:00:27.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:27 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:27.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:27 smithi062 ceph-mon[35425]: Deploying daemon osd.3 on smithi006 2024-05-20T17:00:29.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:29 smithi171 ceph-mon[35901]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-05-20T17:00:29.374 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:29 smithi006 ceph-mon[32486]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-05-20T17:00:29.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:29 smithi062 ceph-mon[35425]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-05-20T17:00:31.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:31 smithi171 ceph-mon[35901]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 814 B/s rd, 23 KiB/s wr, 2 op/s 2024-05-20T17:00:31.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:31 smithi006 ceph-mon[32486]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 814 B/s rd, 23 KiB/s wr, 2 op/s 2024-05-20T17:00:31.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:31 smithi062 ceph-mon[35425]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 814 B/s rd, 23 KiB/s wr, 2 op/s 2024-05-20T17:00:33.213 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:33 smithi006 ceph-mon[32486]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-05-20T17:00:33.213 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:00:33.213 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:33.213 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:33.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:33 smithi171 ceph-mon[35901]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-05-20T17:00:33.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:00:33.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:33.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:33.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:33 smithi062 ceph-mon[35425]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-05-20T17:00:33.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:33 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:00:33.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:33 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:33.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:33 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:35.313 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:35 smithi006 ceph-mon[32486]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-05-20T17:00:35.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:35 smithi171 ceph-mon[35901]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-05-20T17:00:35.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:35 smithi062 ceph-mon[35425]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-05-20T17:00:36.459 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 3 on host 'smithi006' 2024-05-20T17:00:36.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:36.459+0000 7f47e8ff9700 1 -- 172.21.15.6:0/315186469 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f47ec062a80 con 0x7f47d80a2c10 2024-05-20T17:00:36.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:36.461+0000 7f47f1ec0700 1 -- 172.21.15.6:0/315186469 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f47d80a2c10 msgr2=0x7f47d80a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:00:36.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:36.461+0000 7f47f1ec0700 1 --2- 172.21.15.6:0/315186469 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f47d80a2c10 0x7f47d80a5120 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009550 tx=0x7f47dc0091f0 comp rx=0 tx=0).stop 2024-05-20T17:00:36.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:36.461+0000 7f47f1ec0700 1 -- 172.21.15.6:0/315186469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47ec106620 msgr2=0x7f47ec199c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:00:36.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:36.461+0000 7f47f1ec0700 1 --2- 172.21.15.6:0/315186469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47ec106620 0x7f47ec199c60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f47d400c920 tx=0x7f47d400cc30 comp rx=0 tx=0).stop 2024-05-20T17:00:36.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:36.461+0000 7f47f1ec0700 1 -- 172.21.15.6:0/315186469 shutdown_connections 2024-05-20T17:00:36.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:36.461+0000 7f47f1ec0700 1 --2- 172.21.15.6:0/315186469 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f47d80a2c10 0x7f47d80a5120 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:00:36.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:36.461+0000 7f47f1ec0700 1 --2- 172.21.15.6:0/315186469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47ec108f80 0x7f47ec1a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:00:36.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:36.461+0000 7f47f1ec0700 1 --2- 172.21.15.6:0/315186469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47ec103cc0 0x7f47ec199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:00:36.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:36.461+0000 7f47f1ec0700 1 --2- 172.21.15.6:0/315186469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47ec106620 0x7f47ec199c60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:00:36.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:36.461+0000 7f47f1ec0700 1 -- 172.21.15.6:0/315186469 >> 172.21.15.6:0/315186469 conn(0x7f47ec0fd700 msgr2=0x7f47ec104790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:00:36.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:36.461+0000 7f47f1ec0700 1 -- 172.21.15.6:0/315186469 shutdown_connections 2024-05-20T17:00:36.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:00:36.461+0000 7f47f1ec0700 1 -- 172.21.15.6:0/315186469 wait complete. 2024-05-20T17:00:36.837 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:36 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:36.838 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:36 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:36.838 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:36 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:36.838 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:36 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:00:36.838 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:36 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:36.838 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:36 smithi006 ceph-mon[32486]: from='osd.3 [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-20T17:00:36.838 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:36 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:36.838 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:36 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:36.838 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:36 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:00:36.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:36 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:36.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:36 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:36.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:36 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:36.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:36 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:00:36.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:36 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:36.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:36 smithi171 ceph-mon[35901]: from='osd.3 [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-20T17:00:36.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:36 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:36.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:36 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:36.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:36 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:00:37.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:36 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:37.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:36 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:37.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:36 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:37.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:36 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:00:37.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:36 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:37.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:36 smithi062 ceph-mon[35425]: from='osd.3 [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-20T17:00:37.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:36 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:37.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:36 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:37.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:36 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:00:37.188 DEBUG:teuthology.orchestra.run.smithi006:osd.3> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.3.service 2024-05-20T17:00:37.191 INFO:tasks.cephadm:Deploying osd.4 on smithi062 with /dev/vg_nvme/lv_3... 2024-05-20T17:00:37.191 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-20T17:00:37.448 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:00:37.822 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:37 smithi062 ceph-mon[35425]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:37.822 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:37 smithi062 ceph-mon[35425]: from='osd.3 [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-20T17:00:37.822 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:37 smithi062 ceph-mon[35425]: osdmap e24: 4 total, 3 up, 4 in 2024-05-20T17:00:37.823 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:37 smithi062 ceph-mon[35425]: from='osd.3 [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-05-20T17:00:37.823 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:37 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:00:37.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:37 smithi006 ceph-mon[32486]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:37.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:37 smithi006 ceph-mon[32486]: from='osd.3 [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-20T17:00:37.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:37 smithi006 ceph-mon[32486]: osdmap e24: 4 total, 3 up, 4 in 2024-05-20T17:00:37.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:37 smithi006 ceph-mon[32486]: from='osd.3 [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-05-20T17:00:37.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:37 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:00:37.881 INFO:journalctl@ceph.osd.3.smithi006.stdout:May 20 17:00:37 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-3[54116]: 2024-05-20T17:00:37.622+0000 7f8c6789a700 -1 osd.3 0 waiting for initial osdmap 2024-05-20T17:00:37.881 INFO:journalctl@ceph.osd.3.smithi006.stdout:May 20 17:00:37 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-3[54116]: 2024-05-20T17:00:37.627+0000 7f8c6364f700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:00:38.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:37 smithi171 ceph-mon[35901]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:38.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:37 smithi171 ceph-mon[35901]: from='osd.3 [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-20T17:00:38.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:37 smithi171 ceph-mon[35901]: osdmap e24: 4 total, 3 up, 4 in 2024-05-20T17:00:38.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:37 smithi171 ceph-mon[35901]: from='osd.3 [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-05-20T17:00:38.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:37 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:00:38.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:38 smithi006 ceph-mon[32486]: from='osd.3 [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-05-20T17:00:38.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:38 smithi006 ceph-mon[32486]: osdmap e25: 4 total, 3 up, 4 in 2024-05-20T17:00:38.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:38 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:00:38.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:38 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:00:38.942 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:38 smithi062 ceph-mon[35425]: from='osd.3 [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-05-20T17:00:38.943 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:38 smithi062 ceph-mon[35425]: osdmap e25: 4 total, 3 up, 4 in 2024-05-20T17:00:38.943 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:38 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:00:38.943 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:38 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:00:39.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:38 smithi171 ceph-mon[35901]: from='osd.3 [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-05-20T17:00:39.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:38 smithi171 ceph-mon[35901]: osdmap e25: 4 total, 3 up, 4 in 2024-05-20T17:00:39.798 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:38 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:00:39.798 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:38 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:00:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-20T17:00:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-20T17:00:39.799 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10+0 records in 2024-05-20T17:00:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:10+0 records out 2024-05-20T17:00:39.799 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112298 s, 934 MB/s 2024-05-20T17:00:39.799 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping successful for: 2024-05-20T17:00:39.829 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:39 smithi006 ceph-mon[32486]: purged_snaps scrub starts 2024-05-20T17:00:39.829 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:39 smithi006 ceph-mon[32486]: purged_snaps scrub ok 2024-05-20T17:00:39.830 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:39 smithi006 ceph-mon[32486]: pgmap v103: 1 pgs: 1 peering; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:39.830 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:39 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:00:39.830 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:39 smithi006 ceph-mon[32486]: osd.3 [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924] boot 2024-05-20T17:00:39.830 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:39 smithi006 ceph-mon[32486]: osdmap e26: 4 total, 4 up, 4 in 2024-05-20T17:00:39.830 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:39 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:00:39.876 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:39 smithi062 ceph-mon[35425]: purged_snaps scrub starts 2024-05-20T17:00:39.876 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:39 smithi062 ceph-mon[35425]: purged_snaps scrub ok 2024-05-20T17:00:39.876 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:39 smithi062 ceph-mon[35425]: pgmap v103: 1 pgs: 1 peering; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:39.876 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:39 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:00:39.876 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:39 smithi062 ceph-mon[35425]: osd.3 [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924] boot 2024-05-20T17:00:39.876 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:39 smithi062 ceph-mon[35425]: osdmap e26: 4 total, 4 up, 4 in 2024-05-20T17:00:39.876 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:39 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:00:40.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:39 smithi171 ceph-mon[35901]: purged_snaps scrub starts 2024-05-20T17:00:40.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:39 smithi171 ceph-mon[35901]: purged_snaps scrub ok 2024-05-20T17:00:40.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:39 smithi171 ceph-mon[35901]: pgmap v103: 1 pgs: 1 peering; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-20T17:00:40.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:39 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:00:40.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:39 smithi171 ceph-mon[35901]: osd.3 [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924] boot 2024-05-20T17:00:40.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:39 smithi171 ceph-mon[35901]: osdmap e26: 4 total, 4 up, 4 in 2024-05-20T17:00:40.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:39 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-20T17:00:40.224 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi062:vg_nvme/lv_3 2024-05-20T17:00:40.490 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:00:40.846 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:40 smithi062 ceph-mon[35425]: osdmap e27: 4 total, 4 up, 4 in 2024-05-20T17:00:40.846 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:40 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:40.847 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:40 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:40.847 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:40 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:00:40.847 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:40 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:00:40.847 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:40 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:40.847 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:40 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:40.847 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:40 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:00:40.847 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:40 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:41.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:40 smithi171 ceph-mon[35901]: osdmap e27: 4 total, 4 up, 4 in 2024-05-20T17:00:41.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:40 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:41.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:40 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:41.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:40 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:00:41.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:40 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:00:41.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:40 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:41.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:40 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:41.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:40 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:00:41.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:40 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:41.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:40 smithi006 ceph-mon[32486]: osdmap e27: 4 total, 4 up, 4 in 2024-05-20T17:00:41.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:40 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:41.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:40 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:41.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:40 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:00:41.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:40 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:00:41.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:40 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:41.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:40 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:41.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:40 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:00:41.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:40 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:00:41.921 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:41 smithi062 ceph-mon[35425]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:00:41.921 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:41 smithi062 ceph-mon[35425]: Detected new or changed devices on smithi006 2024-05-20T17:00:41.921 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:41 smithi062 ceph-mon[35425]: Adjusting osd_memory_target on smithi006 to 8546M 2024-05-20T17:00:41.922 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:41 smithi062 ceph-mon[35425]: osdmap e28: 4 total, 4 up, 4 in 2024-05-20T17:00:42.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:41 smithi171 ceph-mon[35901]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:00:42.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:41 smithi171 ceph-mon[35901]: Detected new or changed devices on smithi006 2024-05-20T17:00:42.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:41 smithi171 ceph-mon[35901]: Adjusting osd_memory_target on smithi006 to 8546M 2024-05-20T17:00:42.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:41 smithi171 ceph-mon[35901]: osdmap e28: 4 total, 4 up, 4 in 2024-05-20T17:00:42.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:41 smithi006 ceph-mon[32486]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:00:42.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:41 smithi006 ceph-mon[32486]: Detected new or changed devices on smithi006 2024-05-20T17:00:42.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:41 smithi006 ceph-mon[32486]: Adjusting osd_memory_target on smithi006 to 8546M 2024-05-20T17:00:42.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:41 smithi006 ceph-mon[32486]: osdmap e28: 4 total, 4 up, 4 in 2024-05-20T17:00:42.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.161+0000 7f3d12d4b700 1 -- 172.21.15.62:0/2120875879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d0c1020d0 msgr2=0x7f3d0c1024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:00:42.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.162+0000 7f3d12d4b700 1 --2- 172.21.15.62:0/2120875879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d0c1020d0 0x7f3d0c1024e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009990 tx=0x7f3cfc009ca0 comp rx=0 tx=0).stop 2024-05-20T17:00:42.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.162+0000 7f3d12d4b700 1 -- 172.21.15.62:0/2120875879 shutdown_connections 2024-05-20T17:00:42.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.162+0000 7f3d12d4b700 1 --2- 172.21.15.62:0/2120875879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d0c103ba0 0x7f3d0c10a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:00:42.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.162+0000 7f3d12d4b700 1 --2- 172.21.15.62:0/2120875879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d0c1020d0 0x7f3d0c1024e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:00:42.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.162+0000 7f3d12d4b700 1 --2- 172.21.15.62:0/2120875879 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d0c103200 0x7f3d0c103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:00:42.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.162+0000 7f3d12d4b700 1 -- 172.21.15.62:0/2120875879 >> 172.21.15.62:0/2120875879 conn(0x7f3d0c0fd710 msgr2=0x7f3d0c0ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:00:42.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.162+0000 7f3d12d4b700 1 -- 172.21.15.62:0/2120875879 shutdown_connections 2024-05-20T17:00:42.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.162+0000 7f3d12d4b700 1 -- 172.21.15.62:0/2120875879 wait complete. 2024-05-20T17:00:42.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.162+0000 7f3d12d4b700 1 Processor -- start 2024-05-20T17:00:42.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.162+0000 7f3d12d4b700 1 -- start start 2024-05-20T17:00:42.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.163+0000 7f3d12d4b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d0c1020d0 0x7f3d0c10ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:00:42.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.163+0000 7f3d12d4b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d0c103200 0x7f3d0c10b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:00:42.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.163+0000 7f3d12d4b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d0c103ba0 0x7f3d0c10b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:00:42.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.163+0000 7f3d12d4b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c10ecb0 con 0x7f3d0c103200 2024-05-20T17:00:42.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.163+0000 7f3d12d4b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c10eb30 con 0x7f3d0c1020d0 2024-05-20T17:00:42.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.163+0000 7f3d12d4b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c10ee30 con 0x7f3d0c103ba0 2024-05-20T17:00:42.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.163+0000 7f3d10ae7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d0c1020d0 0x7f3d0c10ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:00:42.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.163+0000 7f3d10ae7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d0c1020d0 0x7f3d0c10ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55490/0 (socket says 172.21.15.62:55490) 2024-05-20T17:00:42.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.163+0000 7f3d10ae7700 1 -- 172.21.15.62:0/663561278 learned_addr learned my addr 172.21.15.62:0/663561278 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-20T17:00:42.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.163+0000 7f3d0bfff700 1 --2- 172.21.15.62:0/663561278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d0c103200 0x7f3d0c10b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:00:42.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.163+0000 7f3d10ae7700 1 -- 172.21.15.62:0/663561278 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d0c103ba0 msgr2=0x7f3d0c10b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:00:42.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.163+0000 7f3d112e8700 1 --2- 172.21.15.62:0/663561278 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d0c103ba0 0x7f3d0c10b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:00:42.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.163+0000 7f3d10ae7700 1 --2- 172.21.15.62:0/663561278 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d0c103ba0 0x7f3d0c10b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:00:42.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.163+0000 7f3d10ae7700 1 -- 172.21.15.62:0/663561278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d0c103200 msgr2=0x7f3d0c10b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:00:42.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.163+0000 7f3d10ae7700 1 --2- 172.21.15.62:0/663561278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d0c103200 0x7f3d0c10b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:00:42.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.163+0000 7f3d10ae7700 1 -- 172.21.15.62:0/663561278 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0c10bd60 con 0x7f3d0c1020d0 2024-05-20T17:00:42.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.163+0000 7f3d0bfff700 1 --2- 172.21.15.62:0/663561278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d0c103200 0x7f3d0c10b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:00:42.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.163+0000 7f3d10ae7700 1 --2- 172.21.15.62:0/663561278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d0c1020d0 0x7f3d0c10ca10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc0098e0 tx=0x7f3cfc005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:00:42.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.163+0000 7f3d09ffb700 1 -- 172.21.15.62:0/663561278 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc027070 con 0x7f3d0c1020d0 2024-05-20T17:00:42.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.164+0000 7f3d09ffb700 1 -- 172.21.15.62:0/663561278 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3cfc004110 con 0x7f3d0c1020d0 2024-05-20T17:00:42.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.164+0000 7f3d09ffb700 1 -- 172.21.15.62:0/663561278 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc022d30 con 0x7f3d0c1020d0 2024-05-20T17:00:42.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.164+0000 7f3d12d4b700 1 -- 172.21.15.62:0/663561278 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d0c1a38d0 con 0x7f3d0c1020d0 2024-05-20T17:00:42.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.164+0000 7f3d12d4b700 1 -- 172.21.15.62:0/663561278 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d0c1a3cd0 con 0x7f3d0c1020d0 2024-05-20T17:00:42.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.165+0000 7f3d12d4b700 1 -- 172.21.15.62:0/663561278 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d0c050170 con 0x7f3d0c1020d0 2024-05-20T17:00:42.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.166+0000 7f3d09ffb700 1 -- 172.21.15.62:0/663561278 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f3cfc02a070 con 0x7f3d0c1020d0 2024-05-20T17:00:42.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.167+0000 7f3d09ffb700 1 --2- 172.21.15.62:0/663561278 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3cf40a2c20 0x7f3cf40a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:00:42.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.167+0000 7f3d09ffb700 1 -- 172.21.15.62:0/663561278 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3669+0+0 (secure 0 0 0) 0x7f3cfc0cf530 con 0x7f3d0c1020d0 2024-05-20T17:00:42.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.167+0000 7f3d0bfff700 1 --2- 172.21.15.62:0/663561278 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3cf40a2c20 0x7f3cf40a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:00:42.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.168+0000 7f3d0bfff700 1 --2- 172.21.15.62:0/663561278 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3cf40a2c20 0x7f3cf40a5130 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c10c3c0 tx=0x7f3d00008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:00:42.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.171+0000 7f3d09ffb700 1 -- 172.21.15.62:0/663561278 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3cfc031020 con 0x7f3d0c1020d0 2024-05-20T17:00:42.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:00:42.387+0000 7f3d12d4b700 1 -- 172.21.15.62:0/663561278 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f3d0c062b40 con 0x7f3cf40a2c20 2024-05-20T17:00:43.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:42 smithi062 ceph-mon[35425]: osdmap e29: 4 total, 4 up, 4 in 2024-05-20T17:00:43.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:00:43.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:00:43.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:43.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:42 smithi171 ceph-mon[35901]: osdmap e29: 4 total, 4 up, 4 in 2024-05-20T17:00:43.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:00:43.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:00:43.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:43.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:42 smithi006 ceph-mon[32486]: osdmap e29: 4 total, 4 up, 4 in 2024-05-20T17:00:43.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:00:43.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:00:43.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:43.936 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:43 smithi062 ceph-mon[35425]: pgmap v109: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:00:43.936 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:43 smithi062 ceph-mon[35425]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:00:43.936 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:43 smithi062 ceph-mon[35425]: osdmap e30: 4 total, 4 up, 4 in 2024-05-20T17:00:44.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:43 smithi171 ceph-mon[35901]: pgmap v109: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:00:44.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:43 smithi171 ceph-mon[35901]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:00:44.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:43 smithi171 ceph-mon[35901]: osdmap e30: 4 total, 4 up, 4 in 2024-05-20T17:00:44.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:43 smithi006 ceph-mon[32486]: pgmap v109: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:00:44.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:43 smithi006 ceph-mon[32486]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:00:44.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:43 smithi006 ceph-mon[32486]: osdmap e30: 4 total, 4 up, 4 in 2024-05-20T17:00:46.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:45 smithi062 ceph-mon[35425]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 131 KiB/s, 0 objects/s recovering 2024-05-20T17:00:46.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:45 smithi062 ceph-mon[35425]: from='client.? 172.21.15.62:0/2358067081' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20b150c9-3f76-40f5-af1d-9dc70923637a"}]: dispatch 2024-05-20T17:00:46.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:45 smithi062 ceph-mon[35425]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20b150c9-3f76-40f5-af1d-9dc70923637a"}]: dispatch 2024-05-20T17:00:46.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:45 smithi062 ceph-mon[35425]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20b150c9-3f76-40f5-af1d-9dc70923637a"}]': finished 2024-05-20T17:00:46.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:45 smithi062 ceph-mon[35425]: osdmap e31: 5 total, 4 up, 5 in 2024-05-20T17:00:46.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:45 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:00:46.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:45 smithi171 ceph-mon[35901]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 131 KiB/s, 0 objects/s recovering 2024-05-20T17:00:46.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:45 smithi171 ceph-mon[35901]: from='client.? 172.21.15.62:0/2358067081' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20b150c9-3f76-40f5-af1d-9dc70923637a"}]: dispatch 2024-05-20T17:00:46.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:45 smithi171 ceph-mon[35901]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20b150c9-3f76-40f5-af1d-9dc70923637a"}]: dispatch 2024-05-20T17:00:46.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:45 smithi171 ceph-mon[35901]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20b150c9-3f76-40f5-af1d-9dc70923637a"}]': finished 2024-05-20T17:00:46.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:45 smithi171 ceph-mon[35901]: osdmap e31: 5 total, 4 up, 5 in 2024-05-20T17:00:46.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:45 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:00:46.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:45 smithi006 ceph-mon[32486]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 131 KiB/s, 0 objects/s recovering 2024-05-20T17:00:46.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:45 smithi006 ceph-mon[32486]: from='client.? 172.21.15.62:0/2358067081' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20b150c9-3f76-40f5-af1d-9dc70923637a"}]: dispatch 2024-05-20T17:00:46.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:45 smithi006 ceph-mon[32486]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20b150c9-3f76-40f5-af1d-9dc70923637a"}]: dispatch 2024-05-20T17:00:46.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:45 smithi006 ceph-mon[32486]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20b150c9-3f76-40f5-af1d-9dc70923637a"}]': finished 2024-05-20T17:00:46.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:45 smithi006 ceph-mon[32486]: osdmap e31: 5 total, 4 up, 5 in 2024-05-20T17:00:46.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:00:47.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:46 smithi062 ceph-mon[35425]: from='client.? 172.21.15.62:0/2633398630' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:00:47.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:46 smithi171 ceph-mon[35901]: from='client.? 172.21.15.62:0/2633398630' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:00:47.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:46 smithi006 ceph-mon[32486]: from='client.? 172.21.15.62:0/2633398630' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:00:48.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:47 smithi062 ceph-mon[35425]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-05-20T17:00:48.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:47 smithi171 ceph-mon[35901]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-05-20T17:00:48.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:47 smithi006 ceph-mon[32486]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-05-20T17:00:50.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:49 smithi062 ceph-mon[35425]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-20T17:00:50.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:49 smithi171 ceph-mon[35901]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-20T17:00:50.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:49 smithi006 ceph-mon[32486]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-20T17:00:52.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:51 smithi062 ceph-mon[35425]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-20T17:00:52.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:51 smithi171 ceph-mon[35901]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-20T17:00:52.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:51 smithi006 ceph-mon[32486]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-20T17:00:53.757 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:53 smithi062 ceph-mon[35425]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-20T17:00:53.757 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:53 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-20T17:00:53.757 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:53 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:54.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:53 smithi171 ceph-mon[35901]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-20T17:00:54.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:53 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-20T17:00:54.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:53 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:54.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:53 smithi006 ceph-mon[32486]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-20T17:00:54.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:53 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-20T17:00:54.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:53 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:00:54.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:54 smithi062 ceph-mon[35425]: Deploying daemon osd.4 on smithi062 2024-05-20T17:00:55.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:54 smithi171 ceph-mon[35901]: Deploying daemon osd.4 on smithi062 2024-05-20T17:00:55.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:54 smithi006 ceph-mon[32486]: Deploying daemon osd.4 on smithi062 2024-05-20T17:00:55.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:55 smithi062 ceph-mon[35425]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:00:56.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:55 smithi171 ceph-mon[35901]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:00:56.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:55 smithi006 ceph-mon[32486]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:00:57.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:57 smithi062 ceph-mon[35425]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:00:57.944 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:57 smithi006 ceph-mon[32486]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:00:58.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:57 smithi171 ceph-mon[35901]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:01:00.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:59 smithi062 ceph-mon[35425]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:01:00.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:59 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:00.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:59 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:00.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:00:59 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:01:00.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:59 smithi171 ceph-mon[35901]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:01:00.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:59 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:00.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:59 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:00.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:00:59 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:01:00.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:59 smithi006 ceph-mon[32486]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:01:00.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:00.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:00.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:00:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:01:01.985 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:01 smithi062 ceph-mon[35425]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:01:02.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:01 smithi171 ceph-mon[35901]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:01:02.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:01 smithi006 ceph-mon[32486]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:01:02.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:01:02.356+0000 7f3d09ffb700 1 -- 172.21.15.62:0/663561278 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3d0c062b40 con 0x7f3cf40a2c20 2024-05-20T17:01:02.358 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 4 on host 'smithi062' 2024-05-20T17:01:02.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:01:02.359+0000 7f3d12d4b700 1 -- 172.21.15.62:0/663561278 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3cf40a2c20 msgr2=0x7f3cf40a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:01:02.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:01:02.359+0000 7f3d12d4b700 1 --2- 172.21.15.62:0/663561278 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3cf40a2c20 0x7f3cf40a5130 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c10c3c0 tx=0x7f3d00008040 comp rx=0 tx=0).stop 2024-05-20T17:01:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:01:02.359+0000 7f3d12d4b700 1 -- 172.21.15.62:0/663561278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d0c1020d0 msgr2=0x7f3d0c10ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:01:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:01:02.359+0000 7f3d12d4b700 1 --2- 172.21.15.62:0/663561278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d0c1020d0 0x7f3d0c10ca10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc0098e0 tx=0x7f3cfc005e80 comp rx=0 tx=0).stop 2024-05-20T17:01:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:01:02.359+0000 7f3d12d4b700 1 -- 172.21.15.62:0/663561278 shutdown_connections 2024-05-20T17:01:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:01:02.359+0000 7f3d12d4b700 1 --2- 172.21.15.62:0/663561278 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3cf40a2c20 0x7f3cf40a5130 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:01:02.359+0000 7f3d12d4b700 1 --2- 172.21.15.62:0/663561278 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d0c103ba0 0x7f3d0c10b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:01:02.359+0000 7f3d12d4b700 1 --2- 172.21.15.62:0/663561278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d0c1020d0 0x7f3d0c10ca10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:01:02.359+0000 7f3d12d4b700 1 --2- 172.21.15.62:0/663561278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d0c103200 0x7f3d0c10b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:01:02.359+0000 7f3d12d4b700 1 -- 172.21.15.62:0/663561278 >> 172.21.15.62:0/663561278 conn(0x7f3d0c0fd710 msgr2=0x7f3d0c106430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:01:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:01:02.359+0000 7f3d12d4b700 1 -- 172.21.15.62:0/663561278 shutdown_connections 2024-05-20T17:01:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:01:02.359+0000 7f3d12d4b700 1 -- 172.21.15.62:0/663561278 wait complete. 2024-05-20T17:01:03.018 DEBUG:teuthology.orchestra.run.smithi062:osd.4> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.4.service 2024-05-20T17:01:03.021 INFO:tasks.cephadm:Deploying osd.5 on smithi171 with /dev/vg_nvme/lv_3... 2024-05-20T17:01:03.021 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-20T17:01:03.271 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:01:03.568 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:03 smithi062 ceph-mon[35425]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:01:03.568 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:03 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:03.569 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:03 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:03.569 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:03 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:03.569 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:03 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:03.569 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:03 smithi062 ceph-mon[35425]: from='osd.4 [v2:172.21.15.62:6808/1161846805,v1:172.21.15.62:6809/1161846805]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-20T17:01:03.569 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:03 smithi062 ceph-mon[35425]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-20T17:01:03.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:03 smithi171 ceph-mon[35901]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:01:03.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:03 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:03.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:03 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:03.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:03 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:03.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:03 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:03.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:03 smithi171 ceph-mon[35901]: from='osd.4 [v2:172.21.15.62:6808/1161846805,v1:172.21.15.62:6809/1161846805]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-20T17:01:03.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:03 smithi171 ceph-mon[35901]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-20T17:01:03.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:03 smithi006 ceph-mon[32486]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:01:03.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:03 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:03.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:03 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:03.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:03 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:03.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:03 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:03.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:03 smithi006 ceph-mon[32486]: from='osd.4 [v2:172.21.15.62:6808/1161846805,v1:172.21.15.62:6809/1161846805]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-20T17:01:03.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:03 smithi006 ceph-mon[32486]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-20T17:01:05.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:04 smithi062 ceph-mon[35425]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-20T17:01:05.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:04 smithi062 ceph-mon[35425]: osdmap e32: 5 total, 4 up, 5 in 2024-05-20T17:01:05.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:04 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:01:05.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:04 smithi062 ceph-mon[35425]: from='osd.4 [v2:172.21.15.62:6808/1161846805,v1:172.21.15.62:6809/1161846805]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T17:01:05.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:04 smithi062 ceph-mon[35425]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T17:01:05.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:04 smithi171 ceph-mon[35901]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-20T17:01:05.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:04 smithi171 ceph-mon[35901]: osdmap e32: 5 total, 4 up, 5 in 2024-05-20T17:01:05.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:04 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:01:05.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:04 smithi171 ceph-mon[35901]: from='osd.4 [v2:172.21.15.62:6808/1161846805,v1:172.21.15.62:6809/1161846805]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T17:01:05.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:04 smithi171 ceph-mon[35901]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T17:01:05.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:04 smithi006 ceph-mon[32486]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-20T17:01:05.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:04 smithi006 ceph-mon[32486]: osdmap e32: 5 total, 4 up, 5 in 2024-05-20T17:01:05.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:04 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:01:05.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:04 smithi006 ceph-mon[32486]: from='osd.4 [v2:172.21.15.62:6808/1161846805,v1:172.21.15.62:6809/1161846805]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T17:01:05.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:04 smithi006 ceph-mon[32486]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T17:01:05.233 INFO:teuthology.orchestra.run.smithi171.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-20T17:01:05.233 INFO:teuthology.orchestra.run.smithi171.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-20T17:01:05.233 INFO:teuthology.orchestra.run.smithi171.stderr: stderr: 10+0 records in 2024-05-20T17:01:05.233 INFO:teuthology.orchestra.run.smithi171.stderr:10+0 records out 2024-05-20T17:01:05.233 INFO:teuthology.orchestra.run.smithi171.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114306 s, 917 MB/s 2024-05-20T17:01:05.233 INFO:teuthology.orchestra.run.smithi171.stderr:--> Zapping successful for: 2024-05-20T17:01:05.664 INFO:journalctl@ceph.osd.4.smithi062.stdout:May 20 17:01:05 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-4[46617]: 2024-05-20T17:01:05.405+0000 7feae730e700 -1 osd.4 0 waiting for initial osdmap 2024-05-20T17:01:05.665 INFO:journalctl@ceph.osd.4.smithi062.stdout:May 20 17:01:05 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-4[46617]: 2024-05-20T17:01:05.412+0000 7feadf0bb700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:01:05.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:05 smithi171 ceph-mon[35901]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:01:05.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:05 smithi171 ceph-mon[35901]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-05-20T17:01:05.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:05 smithi171 ceph-mon[35901]: osdmap e33: 5 total, 4 up, 5 in 2024-05-20T17:01:05.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:05 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:01:05.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:05 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:01:05.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:05 smithi171 ceph-mon[35901]: from='osd.4 ' entity='osd.4' 2024-05-20T17:01:05.911 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi171:vg_nvme/lv_3 2024-05-20T17:01:05.939 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:05 smithi062 ceph-mon[35425]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:01:05.939 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:05 smithi062 ceph-mon[35425]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-05-20T17:01:05.939 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:05 smithi062 ceph-mon[35425]: osdmap e33: 5 total, 4 up, 5 in 2024-05-20T17:01:05.939 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:05 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:01:05.940 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:05 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:01:05.940 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:05 smithi062 ceph-mon[35425]: from='osd.4 ' entity='osd.4' 2024-05-20T17:01:06.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:05 smithi006 ceph-mon[32486]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:01:06.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:05 smithi006 ceph-mon[32486]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-05-20T17:01:06.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:05 smithi006 ceph-mon[32486]: osdmap e33: 5 total, 4 up, 5 in 2024-05-20T17:01:06.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:05 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:01:06.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:05 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:01:06.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:05 smithi006 ceph-mon[32486]: from='osd.4 ' entity='osd.4' 2024-05-20T17:01:06.155 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:01:06.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:06 smithi171 ceph-mon[35901]: purged_snaps scrub starts 2024-05-20T17:01:06.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:06 smithi171 ceph-mon[35901]: purged_snaps scrub ok 2024-05-20T17:01:06.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:06 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:01:06.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:06 smithi171 ceph-mon[35901]: osd.4 [v2:172.21.15.62:6808/1161846805,v1:172.21.15.62:6809/1161846805] boot 2024-05-20T17:01:06.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:06 smithi171 ceph-mon[35901]: osdmap e34: 5 total, 5 up, 5 in 2024-05-20T17:01:06.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:06 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:01:07.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:06 smithi062 ceph-mon[35425]: purged_snaps scrub starts 2024-05-20T17:01:07.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:06 smithi062 ceph-mon[35425]: purged_snaps scrub ok 2024-05-20T17:01:07.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:06 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:01:07.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:06 smithi062 ceph-mon[35425]: osd.4 [v2:172.21.15.62:6808/1161846805,v1:172.21.15.62:6809/1161846805] boot 2024-05-20T17:01:07.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:06 smithi062 ceph-mon[35425]: osdmap e34: 5 total, 5 up, 5 in 2024-05-20T17:01:07.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:06 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:01:07.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:06 smithi006 ceph-mon[32486]: purged_snaps scrub starts 2024-05-20T17:01:07.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:06 smithi006 ceph-mon[32486]: purged_snaps scrub ok 2024-05-20T17:01:07.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:06 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:01:07.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:06 smithi006 ceph-mon[32486]: osd.4 [v2:172.21.15.62:6808/1161846805,v1:172.21.15.62:6809/1161846805] boot 2024-05-20T17:01:07.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:06 smithi006 ceph-mon[32486]: osdmap e34: 5 total, 5 up, 5 in 2024-05-20T17:01:07.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:06 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-20T17:01:07.815 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.814+0000 7f3105e47700 1 -- 172.21.15.171:0/2398354110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3100103b80 msgr2=0x7f310010a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:01:07.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.814+0000 7f3105e47700 1 --2- 172.21.15.171:0/2398354110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3100103b80 0x7f310010a430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f30f8009990 tx=0x7f30f8009ca0 comp rx=0 tx=0).stop 2024-05-20T17:01:07.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.814+0000 7f3105e47700 1 -- 172.21.15.171:0/2398354110 shutdown_connections 2024-05-20T17:01:07.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.814+0000 7f3105e47700 1 --2- 172.21.15.171:0/2398354110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3100103b80 0x7f310010a430 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:07.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.814+0000 7f3105e47700 1 --2- 172.21.15.171:0/2398354110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31001020b0 0x7f31001024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:07.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.814+0000 7f3105e47700 1 --2- 172.21.15.171:0/2398354110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31001031e0 0x7f31001035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:07.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.814+0000 7f3105e47700 1 -- 172.21.15.171:0/2398354110 >> 172.21.15.171:0/2398354110 conn(0x7f31000fd6f0 msgr2=0x7f31000ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:01:07.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.814+0000 7f3105e47700 1 -- 172.21.15.171:0/2398354110 shutdown_connections 2024-05-20T17:01:07.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.814+0000 7f3105e47700 1 -- 172.21.15.171:0/2398354110 wait complete. 2024-05-20T17:01:07.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.814+0000 7f3105e47700 1 Processor -- start 2024-05-20T17:01:07.816 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.814+0000 7f3105e47700 1 -- start start 2024-05-20T17:01:07.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.815+0000 7f3105e47700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31001020b0 0x7f3100198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:01:07.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.815+0000 7f3105e47700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31001031e0 0x7f3100198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:01:07.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.815+0000 7f3105e47700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3100103b80 0x7f310019fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:01:07.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.815+0000 7f3105e47700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f310010db90 con 0x7f31001031e0 2024-05-20T17:01:07.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.815+0000 7f3105e47700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f310010da10 con 0x7f31001020b0 2024-05-20T17:01:07.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.815+0000 7f3105e47700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f310010dd10 con 0x7f3100103b80 2024-05-20T17:01:07.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.815+0000 7f30fffff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3100103b80 0x7f310019fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:01:07.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.815+0000 7f30fffff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3100103b80 0x7f310019fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:39160/0 (socket says 172.21.15.171:39160) 2024-05-20T17:01:07.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.815+0000 7f30fffff700 1 -- 172.21.15.171:0/957472029 learned_addr learned my addr 172.21.15.171:0/957472029 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T17:01:07.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.815+0000 7f30ff7fe700 1 --2- 172.21.15.171:0/957472029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31001020b0 0x7f3100198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:01:07.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.815+0000 7f30feffd700 1 --2- 172.21.15.171:0/957472029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31001031e0 0x7f3100198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:01:07.817 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.815+0000 7f30fffff700 1 -- 172.21.15.171:0/957472029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31001020b0 msgr2=0x7f3100198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:01:07.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.815+0000 7f30fffff700 1 --2- 172.21.15.171:0/957472029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31001020b0 0x7f3100198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:07.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.815+0000 7f30fffff700 1 -- 172.21.15.171:0/957472029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31001031e0 msgr2=0x7f3100198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:01:07.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.815+0000 7f30fffff700 1 --2- 172.21.15.171:0/957472029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31001031e0 0x7f3100198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:07.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.815+0000 7f30fffff700 1 -- 172.21.15.171:0/957472029 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31001a01d0 con 0x7f3100103b80 2024-05-20T17:01:07.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.815+0000 7f30fffff700 1 --2- 172.21.15.171:0/957472029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3100103b80 0x7f310019fb50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f30f8003860 tx=0x7f30f80057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:01:07.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.815+0000 7f30fcff9700 1 -- 172.21.15.171:0/957472029 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f8029070 con 0x7f3100103b80 2024-05-20T17:01:07.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.816+0000 7f30fcff9700 1 -- 172.21.15.171:0/957472029 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30f8019cc0 con 0x7f3100103b80 2024-05-20T17:01:07.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.816+0000 7f3105e47700 1 -- 172.21.15.171:0/957472029 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f310006aec0 con 0x7f3100103b80 2024-05-20T17:01:07.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.816+0000 7f30fcff9700 1 -- 172.21.15.171:0/957472029 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f8024470 con 0x7f3100103b80 2024-05-20T17:01:07.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.816+0000 7f3105e47700 1 -- 172.21.15.171:0/957472029 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f310006b420 con 0x7f3100103b80 2024-05-20T17:01:07.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.817+0000 7f3105e47700 1 -- 172.21.15.171:0/957472029 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3100050170 con 0x7f3100103b80 2024-05-20T17:01:07.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.818+0000 7f30fcff9700 1 -- 172.21.15.171:0/957472029 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f30f802c070 con 0x7f3100103b80 2024-05-20T17:01:07.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.819+0000 7f30fcff9700 1 --2- 172.21.15.171:0/957472029 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f30e80a2c20 0x7f30e80a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:01:07.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.819+0000 7f30fcff9700 1 -- 172.21.15.171:0/957472029 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4101+0+0 (secure 0 0 0) 0x7f30f80d1510 con 0x7f3100103b80 2024-05-20T17:01:07.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.819+0000 7f30ff7fe700 1 --2- 172.21.15.171:0/957472029 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f30e80a2c20 0x7f30e80a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:01:07.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.819+0000 7f30ff7fe700 1 --2- 172.21.15.171:0/957472029 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f30e80a2c20 0x7f30e80a5130 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f31001030e0 tx=0x7f30f000d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:01:07.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:07.823+0000 7f30fcff9700 1 -- 172.21.15.171:0/957472029 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f30f8060850 con 0x7f3100103b80 2024-05-20T17:01:07.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:07 smithi171 ceph-mon[35901]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:01:07.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:07 smithi171 ceph-mon[35901]: Detected new or changed devices on smithi062 2024-05-20T17:01:07.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:07.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:07 smithi171 ceph-mon[35901]: Adjusting osd_memory_target on smithi062 to 8544M 2024-05-20T17:01:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:01:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:01:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:07 smithi171 ceph-mon[35901]: osdmap e35: 5 total, 5 up, 5 in 2024-05-20T17:01:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:01:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:07 smithi062 ceph-mon[35425]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:01:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:07 smithi062 ceph-mon[35425]: Detected new or changed devices on smithi062 2024-05-20T17:01:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:07 smithi062 ceph-mon[35425]: Adjusting osd_memory_target on smithi062 to 8544M 2024-05-20T17:01:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:01:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:01:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:07 smithi062 ceph-mon[35425]: osdmap e35: 5 total, 5 up, 5 in 2024-05-20T17:01:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:01:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:08.028 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:08.029+0000 7f3105e47700 1 -- 172.21.15.171:0/957472029 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f31001092a0 con 0x7f30e80a2c20 2024-05-20T17:01:08.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:07 smithi006 ceph-mon[32486]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-20T17:01:08.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:07 smithi006 ceph-mon[32486]: Detected new or changed devices on smithi062 2024-05-20T17:01:08.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:08.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:08.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:08.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:08.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:07 smithi006 ceph-mon[32486]: Adjusting osd_memory_target on smithi062 to 8544M 2024-05-20T17:01:08.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:08.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:08.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:01:08.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:08.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:01:08.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:07 smithi006 ceph-mon[32486]: osdmap e35: 5 total, 5 up, 5 in 2024-05-20T17:01:08.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:08.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:01:08.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:08.936 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:01:08.936 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:01:08.936 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:09.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:01:09.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:01:09.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:09.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:01:09.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:01:09.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:09.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:09 smithi171 ceph-mon[35901]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:09.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:09 smithi171 ceph-mon[35901]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:01:10.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:09 smithi062 ceph-mon[35425]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:10.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:09 smithi062 ceph-mon[35425]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:01:10.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:09 smithi006 ceph-mon[32486]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:10.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:09 smithi006 ceph-mon[32486]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:01:12.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:11 smithi062 ceph-mon[35425]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:12.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:11 smithi062 ceph-mon[35425]: from='client.? 172.21.15.171:0/3002047860' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0183cc90-abec-4ad7-af28-03008fc59528"}]: dispatch 2024-05-20T17:01:12.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:11 smithi062 ceph-mon[35425]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0183cc90-abec-4ad7-af28-03008fc59528"}]: dispatch 2024-05-20T17:01:12.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:11 smithi062 ceph-mon[35425]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0183cc90-abec-4ad7-af28-03008fc59528"}]': finished 2024-05-20T17:01:12.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:11 smithi062 ceph-mon[35425]: osdmap e36: 6 total, 5 up, 6 in 2024-05-20T17:01:12.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:11 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:01:12.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:11 smithi062 ceph-mon[35425]: from='client.? 172.21.15.171:0/974043498' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:01:12.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:11 smithi171 ceph-mon[35901]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:12.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:11 smithi171 ceph-mon[35901]: from='client.? 172.21.15.171:0/3002047860' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0183cc90-abec-4ad7-af28-03008fc59528"}]: dispatch 2024-05-20T17:01:12.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:11 smithi171 ceph-mon[35901]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0183cc90-abec-4ad7-af28-03008fc59528"}]: dispatch 2024-05-20T17:01:12.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:11 smithi171 ceph-mon[35901]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0183cc90-abec-4ad7-af28-03008fc59528"}]': finished 2024-05-20T17:01:12.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:11 smithi171 ceph-mon[35901]: osdmap e36: 6 total, 5 up, 6 in 2024-05-20T17:01:12.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:11 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:01:12.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:11 smithi171 ceph-mon[35901]: from='client.? 172.21.15.171:0/974043498' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:01:12.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:11 smithi006 ceph-mon[32486]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:12.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:11 smithi006 ceph-mon[32486]: from='client.? 172.21.15.171:0/3002047860' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0183cc90-abec-4ad7-af28-03008fc59528"}]: dispatch 2024-05-20T17:01:12.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:11 smithi006 ceph-mon[32486]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0183cc90-abec-4ad7-af28-03008fc59528"}]: dispatch 2024-05-20T17:01:12.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:11 smithi006 ceph-mon[32486]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0183cc90-abec-4ad7-af28-03008fc59528"}]': finished 2024-05-20T17:01:12.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:11 smithi006 ceph-mon[32486]: osdmap e36: 6 total, 5 up, 6 in 2024-05-20T17:01:12.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:01:12.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:11 smithi006 ceph-mon[32486]: from='client.? 172.21.15.171:0/974043498' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:01:14.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:13 smithi062 ceph-mon[35425]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:14.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:13 smithi171 ceph-mon[35901]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:14.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:13 smithi006 ceph-mon[32486]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:15.982 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:15 smithi171 ceph-mon[35901]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:16.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:15 smithi062 ceph-mon[35425]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:16.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:15 smithi006 ceph-mon[32486]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:17.811 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:17 smithi171 ceph-mon[35901]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:18.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:17 smithi062 ceph-mon[35425]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:18.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:17 smithi006 ceph-mon[32486]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:18.975 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:18 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-20T17:01:18.975 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:18 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:19.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:18 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-20T17:01:19.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:18 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:19.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:18 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-20T17:01:19.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:18 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:20.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:19 smithi062 ceph-mon[35425]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:20.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:19 smithi062 ceph-mon[35425]: Deploying daemon osd.5 on smithi171 2024-05-20T17:01:20.068 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:19 smithi171 ceph-mon[35901]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:20.069 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:19 smithi171 ceph-mon[35901]: Deploying daemon osd.5 on smithi171 2024-05-20T17:01:20.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:19 smithi006 ceph-mon[32486]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:20.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:19 smithi006 ceph-mon[32486]: Deploying daemon osd.5 on smithi171 2024-05-20T17:01:21.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:21 smithi171 ceph-mon[35901]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:22.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:21 smithi062 ceph-mon[35425]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:22.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:21 smithi006 ceph-mon[32486]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:24.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:23 smithi062 ceph-mon[35425]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:24.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:23 smithi171 ceph-mon[35901]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:24.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:23 smithi006 ceph-mon[32486]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:25.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:24 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:25.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:24 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:25.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:24 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:01:25.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:24 smithi171 ceph-mon[35901]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:25.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:24 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:25.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:24 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:25.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:24 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:01:25.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:24 smithi006 ceph-mon[32486]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:25.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:24 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:25.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:24 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:25.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:24 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:01:25.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:24 smithi062 ceph-mon[35425]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:27.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:27 smithi171 ceph-mon[35901]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:27.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:27.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:27.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:27.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:01:27.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:27.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:27 smithi006 ceph-mon[32486]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:27.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:27 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:27.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:27 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:27.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:27 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:27.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:27 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:01:27.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:27 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:27.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:27 smithi062 ceph-mon[35425]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:27.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:27 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:27.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:27 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:27.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:27 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:27.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:27 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:01:27.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:27 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:27.848 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:27.848+0000 7f30fcff9700 1 -- 172.21.15.171:0/957472029 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f31001092a0 con 0x7f30e80a2c20 2024-05-20T17:01:27.848 INFO:teuthology.orchestra.run.smithi171.stdout:Created osd(s) 5 on host 'smithi171' 2024-05-20T17:01:27.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:27.851+0000 7f3105e47700 1 -- 172.21.15.171:0/957472029 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f30e80a2c20 msgr2=0x7f30e80a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:01:27.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:27.851+0000 7f3105e47700 1 --2- 172.21.15.171:0/957472029 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f30e80a2c20 0x7f30e80a5130 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f31001030e0 tx=0x7f30f000d040 comp rx=0 tx=0).stop 2024-05-20T17:01:27.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:27.851+0000 7f3105e47700 1 -- 172.21.15.171:0/957472029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3100103b80 msgr2=0x7f310019fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:01:27.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:27.851+0000 7f3105e47700 1 --2- 172.21.15.171:0/957472029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3100103b80 0x7f310019fb50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f30f8003860 tx=0x7f30f80057c0 comp rx=0 tx=0).stop 2024-05-20T17:01:27.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:27.851+0000 7f3105e47700 1 -- 172.21.15.171:0/957472029 shutdown_connections 2024-05-20T17:01:27.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:27.851+0000 7f3105e47700 1 --2- 172.21.15.171:0/957472029 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f30e80a2c20 0x7f30e80a5130 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:27.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:27.851+0000 7f3105e47700 1 --2- 172.21.15.171:0/957472029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3100103b80 0x7f310019fb50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:27.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:27.851+0000 7f3105e47700 1 --2- 172.21.15.171:0/957472029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31001020b0 0x7f3100198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:27.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:27.851+0000 7f3105e47700 1 --2- 172.21.15.171:0/957472029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31001031e0 0x7f3100198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:27.851 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:27.851+0000 7f3105e47700 1 -- 172.21.15.171:0/957472029 >> 172.21.15.171:0/957472029 conn(0x7f31000fd6f0 msgr2=0x7f3100106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:01:27.852 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:27.851+0000 7f3105e47700 1 -- 172.21.15.171:0/957472029 shutdown_connections 2024-05-20T17:01:27.852 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:01:27.851+0000 7f3105e47700 1 -- 172.21.15.171:0/957472029 wait complete. 2024-05-20T17:01:28.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:28 smithi171 ceph-mon[35901]: from='osd.5 [v2:172.21.15.171:6808/2616695062,v1:172.21.15.171:6809/2616695062]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-20T17:01:28.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:28 smithi171 ceph-mon[35901]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-20T17:01:28.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:28 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:28.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:28 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:28.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:28 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:01:28.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:28 smithi006 ceph-mon[32486]: from='osd.5 [v2:172.21.15.171:6808/2616695062,v1:172.21.15.171:6809/2616695062]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-20T17:01:28.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:28 smithi006 ceph-mon[32486]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-20T17:01:28.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:28 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:28.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:28 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:28.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:28 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:01:28.497 DEBUG:teuthology.orchestra.run.smithi171:osd.5> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.5.service 2024-05-20T17:01:28.499 INFO:tasks.cephadm:Deploying osd.6 on smithi006 with /dev/vg_nvme/lv_2... 2024-05-20T17:01:28.500 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-20T17:01:28.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:28 smithi062 ceph-mon[35425]: from='osd.5 [v2:172.21.15.171:6808/2616695062,v1:172.21.15.171:6809/2616695062]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-20T17:01:28.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:28 smithi062 ceph-mon[35425]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-20T17:01:28.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:28 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:28.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:28 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:28.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:28 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:01:28.748 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:01:29.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:29 smithi006 ceph-mon[32486]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:29.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:29 smithi006 ceph-mon[32486]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-20T17:01:29.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:29 smithi006 ceph-mon[32486]: osdmap e37: 6 total, 5 up, 6 in 2024-05-20T17:01:29.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:29 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:01:29.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:29 smithi006 ceph-mon[32486]: from='osd.5 [v2:172.21.15.171:6808/2616695062,v1:172.21.15.171:6809/2616695062]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:01:29.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:29 smithi006 ceph-mon[32486]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:01:29.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:29 smithi171 ceph-mon[35901]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:29.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:29 smithi171 ceph-mon[35901]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-20T17:01:29.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:29 smithi171 ceph-mon[35901]: osdmap e37: 6 total, 5 up, 6 in 2024-05-20T17:01:29.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:29 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:01:29.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:29 smithi171 ceph-mon[35901]: from='osd.5 [v2:172.21.15.171:6808/2616695062,v1:172.21.15.171:6809/2616695062]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:01:29.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:29 smithi171 ceph-mon[35901]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:01:29.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:29 smithi062 ceph-mon[35425]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:29.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:29 smithi062 ceph-mon[35425]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-20T17:01:29.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:29 smithi062 ceph-mon[35425]: osdmap e37: 6 total, 5 up, 6 in 2024-05-20T17:01:29.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:29 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:01:29.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:29 smithi062 ceph-mon[35425]: from='osd.5 [v2:172.21.15.171:6808/2616695062,v1:172.21.15.171:6809/2616695062]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:01:29.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:29 smithi062 ceph-mon[35425]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:01:30.043 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:01:29 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:01:29.801+0000 7fdcf2cca700 -1 osd.5 0 waiting for initial osdmap 2024-05-20T17:01:30.043 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:01:29 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:01:29.809+0000 7fdcea276700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:01:30.247 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:30 smithi006 ceph-mon[32486]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-20T17:01:30.247 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:30 smithi006 ceph-mon[32486]: osdmap e38: 6 total, 5 up, 6 in 2024-05-20T17:01:30.248 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:30 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:01:30.248 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:30 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:01:30.248 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:30 smithi006 ceph-mon[32486]: from='osd.5 ' entity='osd.5' 2024-05-20T17:01:30.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:30 smithi171 ceph-mon[35901]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-20T17:01:30.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:30 smithi171 ceph-mon[35901]: osdmap e38: 6 total, 5 up, 6 in 2024-05-20T17:01:30.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:30 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:01:30.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:30 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:01:30.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:30 smithi171 ceph-mon[35901]: from='osd.5 ' entity='osd.5' 2024-05-20T17:01:30.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:30 smithi062 ceph-mon[35425]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-20T17:01:30.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:30 smithi062 ceph-mon[35425]: osdmap e38: 6 total, 5 up, 6 in 2024-05-20T17:01:30.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:30 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:01:30.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:30 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:01:30.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:30 smithi062 ceph-mon[35425]: from='osd.5 ' entity='osd.5' 2024-05-20T17:01:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-20T17:01:30.894 INFO:teuthology.orchestra.run.smithi006.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-20T17:01:30.894 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10+0 records in 2024-05-20T17:01:30.894 INFO:teuthology.orchestra.run.smithi006.stderr:10+0 records out 2024-05-20T17:01:30.894 INFO:teuthology.orchestra.run.smithi006.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110883 s, 946 MB/s 2024-05-20T17:01:30.894 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping successful for: 2024-05-20T17:01:31.223 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:31 smithi006 ceph-mon[32486]: purged_snaps scrub starts 2024-05-20T17:01:31.223 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:31 smithi006 ceph-mon[32486]: purged_snaps scrub ok 2024-05-20T17:01:31.223 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:31 smithi006 ceph-mon[32486]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:31.223 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:31 smithi006 ceph-mon[32486]: osd.5 [v2:172.21.15.171:6808/2616695062,v1:172.21.15.171:6809/2616695062] boot 2024-05-20T17:01:31.224 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:31 smithi006 ceph-mon[32486]: osdmap e39: 6 total, 6 up, 6 in 2024-05-20T17:01:31.224 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:31 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:01:31.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:31 smithi171 ceph-mon[35901]: purged_snaps scrub starts 2024-05-20T17:01:31.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:31 smithi171 ceph-mon[35901]: purged_snaps scrub ok 2024-05-20T17:01:31.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:31 smithi171 ceph-mon[35901]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:31.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:31 smithi171 ceph-mon[35901]: osd.5 [v2:172.21.15.171:6808/2616695062,v1:172.21.15.171:6809/2616695062] boot 2024-05-20T17:01:31.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:31 smithi171 ceph-mon[35901]: osdmap e39: 6 total, 6 up, 6 in 2024-05-20T17:01:31.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:31 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:01:31.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:31 smithi062 ceph-mon[35425]: purged_snaps scrub starts 2024-05-20T17:01:31.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:31 smithi062 ceph-mon[35425]: purged_snaps scrub ok 2024-05-20T17:01:31.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:31 smithi062 ceph-mon[35425]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-20T17:01:31.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:31 smithi062 ceph-mon[35425]: osd.5 [v2:172.21.15.171:6808/2616695062,v1:172.21.15.171:6809/2616695062] boot 2024-05-20T17:01:31.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:31 smithi062 ceph-mon[35425]: osdmap e39: 6 total, 6 up, 6 in 2024-05-20T17:01:31.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:31 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-20T17:01:31.560 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi006:vg_nvme/lv_2 2024-05-20T17:01:31.811 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:01:32.184 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:32 smithi006 ceph-mon[32486]: osdmap e40: 6 total, 6 up, 6 in 2024-05-20T17:01:32.184 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:32 smithi006 ceph-mon[32486]: Detected new or changed devices on smithi171 2024-05-20T17:01:32.184 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:32 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:32.184 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:32 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:32.185 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:32 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:32.185 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:32 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:32.185 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:32 smithi006 ceph-mon[32486]: Adjusting osd_memory_target on smithi171 to 8544M 2024-05-20T17:01:32.185 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:32 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:32.185 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:32 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:32.185 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:32 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:01:32.185 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:32 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:32.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:32 smithi062 ceph-mon[35425]: osdmap e40: 6 total, 6 up, 6 in 2024-05-20T17:01:32.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:32 smithi062 ceph-mon[35425]: Detected new or changed devices on smithi171 2024-05-20T17:01:32.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:32 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:32.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:32 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:32.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:32 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:32.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:32 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:32.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:32 smithi062 ceph-mon[35425]: Adjusting osd_memory_target on smithi171 to 8544M 2024-05-20T17:01:32.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:32 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:32.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:32 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:32.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:32 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:01:32.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:32 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:32.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:32 smithi171 ceph-mon[35901]: osdmap e40: 6 total, 6 up, 6 in 2024-05-20T17:01:32.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:32 smithi171 ceph-mon[35901]: Detected new or changed devices on smithi171 2024-05-20T17:01:32.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:32 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:32.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:32 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:32.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:32 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:32.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:32 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:32.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:32 smithi171 ceph-mon[35901]: Adjusting osd_memory_target on smithi171 to 8544M 2024-05-20T17:01:32.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:32 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:32.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:32 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:32.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:32 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:01:32.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:32 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:33.246 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:33 smithi006 ceph-mon[32486]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:33.246 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:33 smithi006 ceph-mon[32486]: osdmap e41: 6 total, 6 up, 6 in 2024-05-20T17:01:33.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.504+0000 7ff8e615d700 1 -- 172.21.15.6:0/2421428474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e0106630 msgr2=0x7ff8e0108a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:01:33.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.504+0000 7ff8e615d700 1 --2- 172.21.15.6:0/2421428474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e0106630 0x7ff8e0108a50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009990 tx=0x7ff8c8009ca0 comp rx=0 tx=0).stop 2024-05-20T17:01:33.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.504+0000 7ff8e615d700 1 -- 172.21.15.6:0/2421428474 shutdown_connections 2024-05-20T17:01:33.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.504+0000 7ff8e615d700 1 --2- 172.21.15.6:0/2421428474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8e0108f90 0x7ff8e010b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:33.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.504+0000 7ff8e615d700 1 --2- 172.21.15.6:0/2421428474 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8e0103cd0 0x7ff8e01060f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:33.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.504+0000 7ff8e615d700 1 --2- 172.21.15.6:0/2421428474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e0106630 0x7ff8e0108a50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:33.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.504+0000 7ff8e615d700 1 -- 172.21.15.6:0/2421428474 >> 172.21.15.6:0/2421428474 conn(0x7ff8e00fd710 msgr2=0x7ff8e00ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:01:33.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.504+0000 7ff8e615d700 1 -- 172.21.15.6:0/2421428474 shutdown_connections 2024-05-20T17:01:33.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.504+0000 7ff8e615d700 1 -- 172.21.15.6:0/2421428474 wait complete. 2024-05-20T17:01:33.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.505+0000 7ff8e615d700 1 Processor -- start 2024-05-20T17:01:33.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.505+0000 7ff8e615d700 1 -- start start 2024-05-20T17:01:33.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.505+0000 7ff8e615d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e0103cd0 0x7ff8e0199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:01:33.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.505+0000 7ff8e615d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8e0106630 0x7ff8e0199cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:01:33.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.505+0000 7ff8e615d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8e0108f90 0x7ff8e01a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:01:33.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.505+0000 7ff8e615d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e010ec40 con 0x7ff8e0103cd0 2024-05-20T17:01:33.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.506+0000 7ff8e615d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e010eac0 con 0x7ff8e0106630 2024-05-20T17:01:33.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.506+0000 7ff8e615d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e010edc0 con 0x7ff8e0108f90 2024-05-20T17:01:33.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.506+0000 7ff8df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e0103cd0 0x7ff8e0199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:01:33.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.506+0000 7ff8df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e0103cd0 0x7ff8e0199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59204/0 (socket says 172.21.15.6:59204) 2024-05-20T17:01:33.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.506+0000 7ff8df7fe700 1 -- 172.21.15.6:0/2050361478 learned_addr learned my addr 172.21.15.6:0/2050361478 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:01:33.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.506+0000 7ff8deffd700 1 --2- 172.21.15.6:0/2050361478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8e0106630 0x7ff8e0199cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:01:33.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.506+0000 7ff8dffff700 1 --2- 172.21.15.6:0/2050361478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8e0108f90 0x7ff8e01a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:01:33.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.506+0000 7ff8df7fe700 1 -- 172.21.15.6:0/2050361478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8e0108f90 msgr2=0x7ff8e01a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:01:33.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.506+0000 7ff8df7fe700 1 --2- 172.21.15.6:0/2050361478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8e0108f90 0x7ff8e01a0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:33.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.506+0000 7ff8df7fe700 1 -- 172.21.15.6:0/2050361478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8e0106630 msgr2=0x7ff8e0199cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:01:33.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.506+0000 7ff8df7fe700 1 --2- 172.21.15.6:0/2050361478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8e0106630 0x7ff8e0199cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:33.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.506+0000 7ff8df7fe700 1 -- 172.21.15.6:0/2050361478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e01a12f0 con 0x7ff8e0103cd0 2024-05-20T17:01:33.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.506+0000 7ff8df7fe700 1 --2- 172.21.15.6:0/2050361478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e0103cd0 0x7ff8e0199790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000efc0 tx=0x7ff8d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:01:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.506+0000 7ff8dcff9700 1 -- 172.21.15.6:0/2050361478 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d000ca70 con 0x7ff8e0103cd0 2024-05-20T17:01:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.507+0000 7ff8e615d700 1 -- 172.21.15.6:0/2050361478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e01a1580 con 0x7ff8e0103cd0 2024-05-20T17:01:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.507+0000 7ff8dcff9700 1 -- 172.21.15.6:0/2050361478 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff8d0019070 con 0x7ff8e0103cd0 2024-05-20T17:01:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.507+0000 7ff8dcff9700 1 -- 172.21.15.6:0/2050361478 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00146e0 con 0x7ff8e0103cd0 2024-05-20T17:01:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.507+0000 7ff8e615d700 1 -- 172.21.15.6:0/2050361478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e01a1ac0 con 0x7ff8e0103cd0 2024-05-20T17:01:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.508+0000 7ff8e615d700 1 -- 172.21.15.6:0/2050361478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e0050170 con 0x7ff8e0103cd0 2024-05-20T17:01:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.509+0000 7ff8dcff9700 1 -- 172.21.15.6:0/2050361478 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ff8d0012050 con 0x7ff8e0103cd0 2024-05-20T17:01:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.510+0000 7ff8dcff9700 1 --2- 172.21.15.6:0/2050361478 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff8cc0a2c20 0x7ff8cc0a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:01:33.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.510+0000 7ff8deffd700 1 --2- 172.21.15.6:0/2050361478 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff8cc0a2c20 0x7ff8cc0a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:01:33.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.510+0000 7ff8dcff9700 1 -- 172.21.15.6:0/2050361478 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4562+0+0 (secure 0 0 0) 0x7ff8d00ce240 con 0x7ff8e0103cd0 2024-05-20T17:01:33.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.510+0000 7ff8deffd700 1 --2- 172.21.15.6:0/2050361478 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff8cc0a2c20 0x7ff8cc0a5130 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800b2e0 tx=0x7ff8c800b7e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:01:33.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.515+0000 7ff8dcff9700 1 -- 172.21.15.6:0/2050361478 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff8d0010040 con 0x7ff8e0103cd0 2024-05-20T17:01:33.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:33 smithi062 ceph-mon[35425]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:33.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:33 smithi062 ceph-mon[35425]: osdmap e41: 6 total, 6 up, 6 in 2024-05-20T17:01:33.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:33 smithi171 ceph-mon[35901]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:33.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:33 smithi171 ceph-mon[35901]: osdmap e41: 6 total, 6 up, 6 in 2024-05-20T17:01:33.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:33.731+0000 7ff8e615d700 1 -- 172.21.15.6:0/2050361478 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff8e0062a80 con 0x7ff8cc0a2c20 2024-05-20T17:01:34.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:34 smithi006 ceph-mon[32486]: osdmap e42: 6 total, 6 up, 6 in 2024-05-20T17:01:34.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:34 smithi006 ceph-mon[32486]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:01:34.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:34 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:01:34.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:34 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:01:34.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:34 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:34.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:34 smithi171 ceph-mon[35901]: osdmap e42: 6 total, 6 up, 6 in 2024-05-20T17:01:34.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:34 smithi171 ceph-mon[35901]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:01:34.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:34 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:01:34.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:34 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:01:34.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:34 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:35.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:34 smithi062 ceph-mon[35425]: osdmap e42: 6 total, 6 up, 6 in 2024-05-20T17:01:35.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:34 smithi062 ceph-mon[35425]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:01:35.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:34 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:01:35.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:34 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:01:35.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:34 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:35.740 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:35 smithi006 ceph-mon[32486]: pgmap v148: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-20T17:01:35.740 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:35 smithi006 ceph-mon[32486]: osdmap e43: 6 total, 6 up, 6 in 2024-05-20T17:01:35.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:35 smithi171 ceph-mon[35901]: pgmap v148: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-20T17:01:35.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:35 smithi171 ceph-mon[35901]: osdmap e43: 6 total, 6 up, 6 in 2024-05-20T17:01:36.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:35 smithi062 ceph-mon[35425]: pgmap v148: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-20T17:01:36.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:35 smithi062 ceph-mon[35425]: osdmap e43: 6 total, 6 up, 6 in 2024-05-20T17:01:37.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:37 smithi171 ceph-mon[35901]: pgmap v150: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-05-20T17:01:37.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:37 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/4033917567' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2be5095-5b84-41d2-ad24-7696926ebe47"}]: dispatch 2024-05-20T17:01:37.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:37 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/4033917567' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2be5095-5b84-41d2-ad24-7696926ebe47"}]': finished 2024-05-20T17:01:37.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:37 smithi171 ceph-mon[35901]: osdmap e44: 7 total, 6 up, 7 in 2024-05-20T17:01:37.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:37 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:01:37.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:37 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3654685463' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:01:37.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:37 smithi006 ceph-mon[32486]: pgmap v150: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-05-20T17:01:37.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:37 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/4033917567' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2be5095-5b84-41d2-ad24-7696926ebe47"}]: dispatch 2024-05-20T17:01:37.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:37 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/4033917567' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2be5095-5b84-41d2-ad24-7696926ebe47"}]': finished 2024-05-20T17:01:37.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:37 smithi006 ceph-mon[32486]: osdmap e44: 7 total, 6 up, 7 in 2024-05-20T17:01:37.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:37 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:01:37.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:37 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3654685463' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:01:38.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:37 smithi062 ceph-mon[35425]: pgmap v150: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-05-20T17:01:38.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:37 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/4033917567' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2be5095-5b84-41d2-ad24-7696926ebe47"}]: dispatch 2024-05-20T17:01:38.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:37 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/4033917567' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2be5095-5b84-41d2-ad24-7696926ebe47"}]': finished 2024-05-20T17:01:38.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:37 smithi062 ceph-mon[35425]: osdmap e44: 7 total, 6 up, 7 in 2024-05-20T17:01:38.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:37 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:01:38.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:37 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3654685463' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:01:39.863 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:39 smithi062 ceph-mon[35425]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-05-20T17:01:39.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:39 smithi171 ceph-mon[35901]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-05-20T17:01:39.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:39 smithi006 ceph-mon[32486]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-05-20T17:01:41.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:41 smithi171 ceph-mon[35901]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:41.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:41 smithi006 ceph-mon[32486]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:42.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:41 smithi062 ceph-mon[35425]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:43.853 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:43 smithi006 ceph-mon[32486]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:43.876 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:43 smithi171 ceph-mon[35901]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:44.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:43 smithi062 ceph-mon[35425]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:44.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:44 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-20T17:01:44.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:44 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:44.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-20T17:01:44.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:45.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-20T17:01:45.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:45.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:45 smithi171 ceph-mon[35901]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:45.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:45 smithi171 ceph-mon[35901]: Deploying daemon osd.6 on smithi006 2024-05-20T17:01:45.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:45 smithi006 ceph-mon[32486]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:45.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:45 smithi006 ceph-mon[32486]: Deploying daemon osd.6 on smithi006 2024-05-20T17:01:46.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:45 smithi062 ceph-mon[35425]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:46.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:45 smithi062 ceph-mon[35425]: Deploying daemon osd.6 on smithi006 2024-05-20T17:01:47.625 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:47 smithi006 ceph-mon[32486]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:47.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:47 smithi171 ceph-mon[35901]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:48.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:47 smithi062 ceph-mon[35425]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:49.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:49 smithi171 ceph-mon[35901]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:49.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:49 smithi006 ceph-mon[32486]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:50.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:49 smithi062 ceph-mon[35425]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:51.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:51 smithi171 ceph-mon[35901]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:51.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:51 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:51.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:51 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:51.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:51 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:01:51.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:51 smithi006 ceph-mon[32486]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:51.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:51 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:51.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:51 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:51.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:51 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:01:52.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:51 smithi062 ceph-mon[35425]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:52.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:51 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:52.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:51 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:52.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:51 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:01:53.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:53 smithi171 ceph-mon[35901]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:53.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:53 smithi006 ceph-mon[32486]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:54.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:53 smithi062 ceph-mon[35425]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:54.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:54.799+0000 7ff8dcff9700 1 -- 172.21.15.6:0/2050361478 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff8e0062a80 con 0x7ff8cc0a2c20 2024-05-20T17:01:54.800 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 6 on host 'smithi006' 2024-05-20T17:01:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:54.802+0000 7ff8e615d700 1 -- 172.21.15.6:0/2050361478 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff8cc0a2c20 msgr2=0x7ff8cc0a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:01:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:54.802+0000 7ff8e615d700 1 --2- 172.21.15.6:0/2050361478 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff8cc0a2c20 0x7ff8cc0a5130 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800b2e0 tx=0x7ff8c800b7e0 comp rx=0 tx=0).stop 2024-05-20T17:01:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:54.802+0000 7ff8e615d700 1 -- 172.21.15.6:0/2050361478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e0103cd0 msgr2=0x7ff8e0199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:01:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:54.802+0000 7ff8e615d700 1 --2- 172.21.15.6:0/2050361478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e0103cd0 0x7ff8e0199790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000efc0 tx=0x7ff8d000c3a0 comp rx=0 tx=0).stop 2024-05-20T17:01:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:54.802+0000 7ff8e615d700 1 -- 172.21.15.6:0/2050361478 shutdown_connections 2024-05-20T17:01:54.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:54.802+0000 7ff8e615d700 1 --2- 172.21.15.6:0/2050361478 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff8cc0a2c20 0x7ff8cc0a5130 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:54.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:54.802+0000 7ff8e615d700 1 --2- 172.21.15.6:0/2050361478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8e0108f90 0x7ff8e01a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:54.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:54.802+0000 7ff8e615d700 1 --2- 172.21.15.6:0/2050361478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e0103cd0 0x7ff8e0199790 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:54.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:54.802+0000 7ff8e615d700 1 --2- 172.21.15.6:0/2050361478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8e0106630 0x7ff8e0199cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:01:54.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:54.802+0000 7ff8e615d700 1 -- 172.21.15.6:0/2050361478 >> 172.21.15.6:0/2050361478 conn(0x7ff8e00fd710 msgr2=0x7ff8e01047a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:01:54.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:54.802+0000 7ff8e615d700 1 -- 172.21.15.6:0/2050361478 shutdown_connections 2024-05-20T17:01:54.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:01:54.802+0000 7ff8e615d700 1 -- 172.21.15.6:0/2050361478 wait complete. 2024-05-20T17:01:55.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:54 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:55.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:54 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:55.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:54 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:55.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:54 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:01:55.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:54 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:55.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:54 smithi062 ceph-mon[35425]: from='osd.6 [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-20T17:01:55.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:54 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:55.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:54 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:55.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:54 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:55.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:54 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:01:55.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:54 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:55.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:54 smithi171 ceph-mon[35901]: from='osd.6 [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-20T17:01:55.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:54 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:55.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:54 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:55.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:54 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:55.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:54 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:01:55.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:54 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:55.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:54 smithi006 ceph-mon[32486]: from='osd.6 [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-20T17:01:55.494 DEBUG:teuthology.orchestra.run.smithi006:osd.6> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.6.service 2024-05-20T17:01:55.496 INFO:tasks.cephadm:Deploying osd.7 on smithi062 with /dev/vg_nvme/lv_2... 2024-05-20T17:01:55.497 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-20T17:01:55.758 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:01:55.881 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:55 smithi062 ceph-mon[35425]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:55.881 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:55 smithi062 ceph-mon[35425]: from='osd.6 [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-20T17:01:55.881 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:55 smithi062 ceph-mon[35425]: osdmap e45: 7 total, 6 up, 7 in 2024-05-20T17:01:55.881 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:55 smithi062 ceph-mon[35425]: from='osd.6 [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-05-20T17:01:55.881 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:55 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:01:55.881 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:55 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:55.881 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:55 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:55.881 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:55 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:01:56.000 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:55 smithi006 ceph-mon[32486]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:56.000 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:55 smithi006 ceph-mon[32486]: from='osd.6 [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-20T17:01:56.000 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:55 smithi006 ceph-mon[32486]: osdmap e45: 7 total, 6 up, 7 in 2024-05-20T17:01:56.000 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:55 smithi006 ceph-mon[32486]: from='osd.6 [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-05-20T17:01:56.000 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:55 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:01:56.000 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:55 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:56.000 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:55 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:56.000 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:55 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:01:56.001 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:01:55 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:01:55.740+0000 7f6234bdb700 -1 osd.6 0 waiting for initial osdmap 2024-05-20T17:01:56.001 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:01:55 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:01:55.749+0000 7f6230990700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:01:56.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:55 smithi171 ceph-mon[35901]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:56.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:55 smithi171 ceph-mon[35901]: from='osd.6 [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-20T17:01:56.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:55 smithi171 ceph-mon[35901]: osdmap e45: 7 total, 6 up, 7 in 2024-05-20T17:01:56.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:55 smithi171 ceph-mon[35901]: from='osd.6 [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-05-20T17:01:56.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:55 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:01:56.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:55 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:56.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:55 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:56.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:55 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:01:56.965 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:56 smithi006 ceph-mon[32486]: from='osd.6 [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-05-20T17:01:56.966 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:56 smithi006 ceph-mon[32486]: osdmap e46: 7 total, 6 up, 7 in 2024-05-20T17:01:56.966 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:56 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:01:56.966 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:56 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:01:56.979 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:56 smithi062 ceph-mon[35425]: from='osd.6 [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-05-20T17:01:56.979 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:56 smithi062 ceph-mon[35425]: osdmap e46: 7 total, 6 up, 7 in 2024-05-20T17:01:56.980 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:56 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:01:56.980 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:56 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:01:57.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:56 smithi171 ceph-mon[35901]: from='osd.6 [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-05-20T17:01:57.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:56 smithi171 ceph-mon[35901]: osdmap e46: 7 total, 6 up, 7 in 2024-05-20T17:01:57.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:56 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:01:57.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:56 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:01:57.743 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:57 smithi006 ceph-mon[32486]: purged_snaps scrub starts 2024-05-20T17:01:57.743 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:57 smithi006 ceph-mon[32486]: purged_snaps scrub ok 2024-05-20T17:01:57.743 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:57 smithi006 ceph-mon[32486]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:57.854 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-20T17:01:57.854 INFO:teuthology.orchestra.run.smithi062.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-20T17:01:57.854 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10+0 records in 2024-05-20T17:01:57.855 INFO:teuthology.orchestra.run.smithi062.stderr:10+0 records out 2024-05-20T17:01:57.855 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112666 s, 931 MB/s 2024-05-20T17:01:57.855 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping successful for: 2024-05-20T17:01:57.855 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:57 smithi062 ceph-mon[35425]: purged_snaps scrub starts 2024-05-20T17:01:57.855 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:57 smithi062 ceph-mon[35425]: purged_snaps scrub ok 2024-05-20T17:01:57.855 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:57 smithi062 ceph-mon[35425]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:57.855 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:57 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:01:57.855 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:57 smithi062 ceph-mon[35425]: osd.6 [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023] boot 2024-05-20T17:01:57.855 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:57 smithi062 ceph-mon[35425]: osdmap e47: 7 total, 7 up, 7 in 2024-05-20T17:01:57.855 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:57 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:01:58.106 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:57 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:01:58.106 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:57 smithi006 ceph-mon[32486]: osd.6 [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023] boot 2024-05-20T17:01:58.107 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:57 smithi006 ceph-mon[32486]: osdmap e47: 7 total, 7 up, 7 in 2024-05-20T17:01:58.107 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:57 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:01:58.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:57 smithi171 ceph-mon[35901]: purged_snaps scrub starts 2024-05-20T17:01:58.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:57 smithi171 ceph-mon[35901]: purged_snaps scrub ok 2024-05-20T17:01:58.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:57 smithi171 ceph-mon[35901]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-05-20T17:01:58.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:57 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:01:58.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:57 smithi171 ceph-mon[35901]: osd.6 [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023] boot 2024-05-20T17:01:58.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:57 smithi171 ceph-mon[35901]: osdmap e47: 7 total, 7 up, 7 in 2024-05-20T17:01:58.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:57 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-20T17:01:58.578 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi062:vg_nvme/lv_2 2024-05-20T17:01:58.844 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:01:58.893 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:58 smithi062 ceph-mon[35425]: osdmap e48: 7 total, 7 up, 7 in 2024-05-20T17:01:58.893 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:58 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:58.893 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:58 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:58.893 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:58 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:58.893 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:58 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:58.893 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:58 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:58.894 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:58 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:58.894 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:58 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:58.894 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:58 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:01:58.894 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:58 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:59.090 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:58 smithi006 ceph-mon[32486]: osdmap e48: 7 total, 7 up, 7 in 2024-05-20T17:01:59.090 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:58 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:59.090 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:58 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:59.090 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:58 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:59.090 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:58 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:59.090 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:58 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:59.090 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:58 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:59.090 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:58 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:59.090 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:58 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:01:59.091 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:58 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:59.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:58 smithi171 ceph-mon[35901]: osdmap e48: 7 total, 7 up, 7 in 2024-05-20T17:01:59.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:58 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:59.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:58 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:59.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:58 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:59.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:58 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:59.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:58 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:01:59.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:58 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:59.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:58 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:01:59.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:58 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:01:59.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:58 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:01:59.938 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:59 smithi062 ceph-mon[35425]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:01:59.938 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:59 smithi062 ceph-mon[35425]: Detected new or changed devices on smithi006 2024-05-20T17:01:59.938 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:01:59 smithi062 ceph-mon[35425]: Adjusting osd_memory_target on smithi006 to 5697M 2024-05-20T17:02:00.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:59 smithi171 ceph-mon[35901]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:00.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:59 smithi171 ceph-mon[35901]: Detected new or changed devices on smithi006 2024-05-20T17:02:00.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:01:59 smithi171 ceph-mon[35901]: Adjusting osd_memory_target on smithi006 to 5697M 2024-05-20T17:02:00.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:59 smithi006 ceph-mon[32486]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:00.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:59 smithi006 ceph-mon[32486]: Detected new or changed devices on smithi006 2024-05-20T17:02:00.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:01:59 smithi006 ceph-mon[32486]: Adjusting osd_memory_target on smithi006 to 5697M 2024-05-20T17:02:00.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.460+0000 7f8993d3c700 1 -- 172.21.15.62:0/1880772157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c103200 msgr2=0x7f898c103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:02:00.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.460+0000 7f8993d3c700 1 --2- 172.21.15.62:0/1880772157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c103200 0x7f898c103610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f897c009990 tx=0x7f897c009ca0 comp rx=0 tx=0).stop 2024-05-20T17:02:00.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.460+0000 7f8993d3c700 1 -- 172.21.15.62:0/1880772157 shutdown_connections 2024-05-20T17:02:00.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.460+0000 7f8993d3c700 1 --2- 172.21.15.62:0/1880772157 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f898c103ba0 0x7f898c10a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:00.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.460+0000 7f8993d3c700 1 --2- 172.21.15.62:0/1880772157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f898c1020d0 0x7f898c1024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:00.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.460+0000 7f8993d3c700 1 --2- 172.21.15.62:0/1880772157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c103200 0x7f898c103610 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:00.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.460+0000 7f8993d3c700 1 -- 172.21.15.62:0/1880772157 >> 172.21.15.62:0/1880772157 conn(0x7f898c0fd710 msgr2=0x7f898c0ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:02:00.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.460+0000 7f8993d3c700 1 -- 172.21.15.62:0/1880772157 shutdown_connections 2024-05-20T17:02:00.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.461+0000 7f8993d3c700 1 -- 172.21.15.62:0/1880772157 wait complete. 2024-05-20T17:02:00.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.461+0000 7f8993d3c700 1 Processor -- start 2024-05-20T17:02:00.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.461+0000 7f8993d3c700 1 -- start start 2024-05-20T17:02:00.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f8993d3c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c1020d0 0x7f898c1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:02:00.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f8993d3c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f898c103200 0x7f898c199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:02:00.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f8993d3c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f898c103ba0 0x7f898c1a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:02:00.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f8993d3c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f898c10db90 con 0x7f898c103ba0 2024-05-20T17:02:00.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f8993d3c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f898c10da10 con 0x7f898c1020d0 2024-05-20T17:02:00.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f8993d3c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f898c10dd10 con 0x7f898c103200 2024-05-20T17:02:00.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f8991ad8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c1020d0 0x7f898c1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:02:00.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f8991ad8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c1020d0 0x7f898c1997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36784/0 (socket says 172.21.15.62:36784) 2024-05-20T17:02:00.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f8991ad8700 1 -- 172.21.15.62:0/186741114 learned_addr learned my addr 172.21.15.62:0/186741114 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-20T17:02:00.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f89922d9700 1 --2- 172.21.15.62:0/186741114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f898c103ba0 0x7f898c1a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:02:00.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f89912d7700 1 --2- 172.21.15.62:0/186741114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f898c103200 0x7f898c199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:02:00.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f8991ad8700 1 -- 172.21.15.62:0/186741114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f898c103200 msgr2=0x7f898c199d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:02:00.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f8991ad8700 1 --2- 172.21.15.62:0/186741114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f898c103200 0x7f898c199d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:00.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f8991ad8700 1 -- 172.21.15.62:0/186741114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f898c103ba0 msgr2=0x7f898c1a0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:02:00.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f8991ad8700 1 --2- 172.21.15.62:0/186741114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f898c103ba0 0x7f898c1a0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:00.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f8991ad8700 1 -- 172.21.15.62:0/186741114 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898c1a1350 con 0x7f898c1020d0 2024-05-20T17:02:00.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f89922d9700 1 --2- 172.21.15.62:0/186741114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f898c103ba0 0x7f898c1a0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:02:00.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f8991ad8700 1 --2- 172.21.15.62:0/186741114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c1020d0 0x7f898c1997f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f898800e940 tx=0x7f898800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:02:00.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f8982ffd700 1 -- 172.21.15.62:0/186741114 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898800cbd0 con 0x7f898c1020d0 2024-05-20T17:02:00.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f8993d3c700 1 -- 172.21.15.62:0/186741114 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f898c1a1640 con 0x7f898c1020d0 2024-05-20T17:02:00.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f8982ffd700 1 -- 172.21.15.62:0/186741114 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f89880044d0 con 0x7f898c1020d0 2024-05-20T17:02:00.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.462+0000 7f8982ffd700 1 -- 172.21.15.62:0/186741114 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8988003e10 con 0x7f898c1020d0 2024-05-20T17:02:00.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.463+0000 7f8993d3c700 1 -- 172.21.15.62:0/186741114 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f898c1a1bd0 con 0x7f898c1020d0 2024-05-20T17:02:00.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.463+0000 7f8993d3c700 1 -- 172.21.15.62:0/186741114 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f898c050170 con 0x7f898c1020d0 2024-05-20T17:02:00.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.465+0000 7f8982ffd700 1 -- 172.21.15.62:0/186741114 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f8988003fb0 con 0x7f898c1020d0 2024-05-20T17:02:00.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.465+0000 7f8982ffd700 1 --2- 172.21.15.62:0/186741114 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f89780a2c20 0x7f89780a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:02:00.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.466+0000 7f8982ffd700 1 -- 172.21.15.62:0/186741114 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4965+0+0 (secure 0 0 0) 0x7f89880ce730 con 0x7f898c1020d0 2024-05-20T17:02:00.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.466+0000 7f89912d7700 1 --2- 172.21.15.62:0/186741114 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f89780a2c20 0x7f89780a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:02:00.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.466+0000 7f89912d7700 1 --2- 172.21.15.62:0/186741114 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f89780a2c20 0x7f89780a5130 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f897c00b670 tx=0x7f897c00b800 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:02:00.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.469+0000 7f8982ffd700 1 -- 172.21.15.62:0/186741114 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f898809c430 con 0x7f898c1020d0 2024-05-20T17:02:00.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:00.683+0000 7f8993d3c700 1 -- 172.21.15.62:0/186741114 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f898c1a1e90 con 0x7f89780a2c20 2024-05-20T17:02:01.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:00 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:02:01.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:00 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:02:01.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:00 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:01.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:00 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:02:01.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:00 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:02:01.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:00 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:01.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:00 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:02:01.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:00 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:02:01.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:00 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:02.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:01 smithi062 ceph-mon[35425]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:02.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:01 smithi062 ceph-mon[35425]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:02:02.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:01 smithi171 ceph-mon[35901]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:02.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:01 smithi171 ceph-mon[35901]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:02:02.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:01 smithi006 ceph-mon[32486]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:02.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:01 smithi006 ceph-mon[32486]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:02:04.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:03 smithi062 ceph-mon[35425]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:04.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:03 smithi062 ceph-mon[35425]: from='client.? 172.21.15.62:0/1666605735' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b04311f-971f-4fff-b8bf-9b8103d97c90"}]: dispatch 2024-05-20T17:02:04.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:03 smithi062 ceph-mon[35425]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b04311f-971f-4fff-b8bf-9b8103d97c90"}]: dispatch 2024-05-20T17:02:04.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:03 smithi062 ceph-mon[35425]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b04311f-971f-4fff-b8bf-9b8103d97c90"}]': finished 2024-05-20T17:02:04.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:03 smithi062 ceph-mon[35425]: osdmap e49: 8 total, 7 up, 8 in 2024-05-20T17:02:04.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:03 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:02:04.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:03 smithi171 ceph-mon[35901]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:04.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:03 smithi171 ceph-mon[35901]: from='client.? 172.21.15.62:0/1666605735' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b04311f-971f-4fff-b8bf-9b8103d97c90"}]: dispatch 2024-05-20T17:02:04.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:03 smithi171 ceph-mon[35901]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b04311f-971f-4fff-b8bf-9b8103d97c90"}]: dispatch 2024-05-20T17:02:04.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:03 smithi171 ceph-mon[35901]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b04311f-971f-4fff-b8bf-9b8103d97c90"}]': finished 2024-05-20T17:02:04.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:03 smithi171 ceph-mon[35901]: osdmap e49: 8 total, 7 up, 8 in 2024-05-20T17:02:04.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:03 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:02:04.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:03 smithi006 ceph-mon[32486]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:04.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:03 smithi006 ceph-mon[32486]: from='client.? 172.21.15.62:0/1666605735' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b04311f-971f-4fff-b8bf-9b8103d97c90"}]: dispatch 2024-05-20T17:02:04.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:03 smithi006 ceph-mon[32486]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b04311f-971f-4fff-b8bf-9b8103d97c90"}]: dispatch 2024-05-20T17:02:04.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:03 smithi006 ceph-mon[32486]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b04311f-971f-4fff-b8bf-9b8103d97c90"}]': finished 2024-05-20T17:02:04.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:03 smithi006 ceph-mon[32486]: osdmap e49: 8 total, 7 up, 8 in 2024-05-20T17:02:04.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:03 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:02:05.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:04 smithi171 ceph-mon[35901]: from='client.? 172.21.15.62:0/75676376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:02:05.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:04 smithi006 ceph-mon[32486]: from='client.? 172.21.15.62:0/75676376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:02:05.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:04 smithi062 ceph-mon[35425]: from='client.? 172.21.15.62:0/75676376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:02:06.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:05 smithi171 ceph-mon[35901]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:06.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:05 smithi006 ceph-mon[32486]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:06.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:05 smithi062 ceph-mon[35425]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:07 smithi062 ceph-mon[35425]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:08.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:07 smithi171 ceph-mon[35901]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:08.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:07 smithi006 ceph-mon[32486]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:10.103 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:09 smithi062 ceph-mon[35425]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:10.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:09 smithi171 ceph-mon[35901]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:10.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:09 smithi006 ceph-mon[32486]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:12.103 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:11 smithi062 ceph-mon[35425]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:12.103 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:11 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-20T17:02:12.103 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:11 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:12.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:11 smithi171 ceph-mon[35901]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:12.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:11 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-20T17:02:12.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:11 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:12.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:11 smithi006 ceph-mon[32486]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:12.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-20T17:02:12.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:13.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:12 smithi171 ceph-mon[35901]: Deploying daemon osd.7 on smithi062 2024-05-20T17:02:13.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:12 smithi006 ceph-mon[32486]: Deploying daemon osd.7 on smithi062 2024-05-20T17:02:13.187 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:12 smithi062 ceph-mon[35425]: Deploying daemon osd.7 on smithi062 2024-05-20T17:02:14.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:13 smithi171 ceph-mon[35901]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:14.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:13 smithi006 ceph-mon[32486]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:14.233 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:13 smithi062 ceph-mon[35425]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:16.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:15 smithi062 ceph-mon[35425]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:16.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:15 smithi171 ceph-mon[35901]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:16.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:15 smithi006 ceph-mon[32486]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:18.099 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:17 smithi062 ceph-mon[35425]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:18.099 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:17 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:18.099 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:17 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:18.099 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:17 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:02:18.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:17 smithi171 ceph-mon[35901]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:18.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:17 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:18.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:17 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:18.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:17 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:02:18.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:17 smithi006 ceph-mon[32486]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:18.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:17 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:18.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:17 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:18.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:17 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:02:20.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:19 smithi062 ceph-mon[35425]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:20.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:19 smithi171 ceph-mon[35901]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:20.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:19 smithi006 ceph-mon[32486]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:21.385 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:21 smithi062 ceph-mon[35425]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:21.385 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:21 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:21.385 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:21 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:21.385 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:21 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:21.385 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:21 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:02:21.385 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:21 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:21.385 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:21 smithi062 ceph-mon[35425]: from='osd.7 [v2:172.21.15.62:6816/598452691,v1:172.21.15.62:6817/598452691]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-20T17:02:21.385 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:21 smithi062 ceph-mon[35425]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-20T17:02:21.457 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 7 on host 'smithi062' 2024-05-20T17:02:21.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:21.456+0000 7f8982ffd700 1 -- 172.21.15.62:0/186741114 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f898c1a1e90 con 0x7f89780a2c20 2024-05-20T17:02:21.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:21.459+0000 7f8993d3c700 1 -- 172.21.15.62:0/186741114 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f89780a2c20 msgr2=0x7f89780a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:02:21.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:21.459+0000 7f8993d3c700 1 --2- 172.21.15.62:0/186741114 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f89780a2c20 0x7f89780a5130 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f897c00b670 tx=0x7f897c00b800 comp rx=0 tx=0).stop 2024-05-20T17:02:21.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:21.459+0000 7f8993d3c700 1 -- 172.21.15.62:0/186741114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c1020d0 msgr2=0x7f898c1997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:02:21.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:21.459+0000 7f8993d3c700 1 --2- 172.21.15.62:0/186741114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c1020d0 0x7f898c1997f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f898800e940 tx=0x7f898800ed00 comp rx=0 tx=0).stop 2024-05-20T17:02:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:21.459+0000 7f8993d3c700 1 -- 172.21.15.62:0/186741114 shutdown_connections 2024-05-20T17:02:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:21.459+0000 7f8993d3c700 1 --2- 172.21.15.62:0/186741114 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f89780a2c20 0x7f89780a5130 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:21.459+0000 7f8993d3c700 1 --2- 172.21.15.62:0/186741114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f898c103ba0 0x7f898c1a0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:21.459+0000 7f8993d3c700 1 --2- 172.21.15.62:0/186741114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f898c1020d0 0x7f898c1997f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:21.459+0000 7f8993d3c700 1 --2- 172.21.15.62:0/186741114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f898c103200 0x7f898c199d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:21.459+0000 7f8993d3c700 1 -- 172.21.15.62:0/186741114 >> 172.21.15.62:0/186741114 conn(0x7f898c0fd710 msgr2=0x7f898c0ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:02:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:21.459+0000 7f8993d3c700 1 -- 172.21.15.62:0/186741114 shutdown_connections 2024-05-20T17:02:21.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:02:21.459+0000 7f8993d3c700 1 -- 172.21.15.62:0/186741114 wait complete. 2024-05-20T17:02:21.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:21 smithi171 ceph-mon[35901]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:21.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:21 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:21.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:21 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:21.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:21 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:21.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:21 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:02:21.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:21 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:21.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:21 smithi171 ceph-mon[35901]: from='osd.7 [v2:172.21.15.62:6816/598452691,v1:172.21.15.62:6817/598452691]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-20T17:02:21.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:21 smithi171 ceph-mon[35901]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-20T17:02:21.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:21 smithi006 ceph-mon[32486]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:21.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:21 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:21.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:21 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:21.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:21 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:21.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:21 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:02:21.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:21 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:21.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:21 smithi006 ceph-mon[32486]: from='osd.7 [v2:172.21.15.62:6816/598452691,v1:172.21.15.62:6817/598452691]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-20T17:02:21.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:21 smithi006 ceph-mon[32486]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-20T17:02:22.064 DEBUG:teuthology.orchestra.run.smithi062:osd.7> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.7.service 2024-05-20T17:02:22.067 INFO:tasks.cephadm:Deploying osd.8 on smithi171 with /dev/vg_nvme/lv_2... 2024-05-20T17:02:22.067 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-20T17:02:22.305 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:02:22.703 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:22 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:22.703 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:22 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:22.703 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:22 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:02:22.703 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:22 smithi171 ceph-mon[35901]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-20T17:02:22.703 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:22 smithi171 ceph-mon[35901]: osdmap e50: 8 total, 7 up, 8 in 2024-05-20T17:02:22.703 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:22 smithi171 ceph-mon[35901]: from='osd.7 [v2:172.21.15.62:6816/598452691,v1:172.21.15.62:6817/598452691]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T17:02:22.703 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:22 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:02:22.704 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:22 smithi171 ceph-mon[35901]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T17:02:22.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:22 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:22.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:22 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:22.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:22 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:02:22.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:22 smithi062 ceph-mon[35425]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-20T17:02:22.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:22 smithi062 ceph-mon[35425]: osdmap e50: 8 total, 7 up, 8 in 2024-05-20T17:02:22.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:22 smithi062 ceph-mon[35425]: from='osd.7 [v2:172.21.15.62:6816/598452691,v1:172.21.15.62:6817/598452691]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T17:02:22.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:22 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:02:22.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:22 smithi062 ceph-mon[35425]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T17:02:22.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:22 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:22.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:22 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:22.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:22 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:02:22.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:22 smithi006 ceph-mon[32486]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-20T17:02:22.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:22 smithi006 ceph-mon[32486]: osdmap e50: 8 total, 7 up, 8 in 2024-05-20T17:02:22.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:22 smithi006 ceph-mon[32486]: from='osd.7 [v2:172.21.15.62:6816/598452691,v1:172.21.15.62:6817/598452691]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T17:02:22.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:22 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:02:22.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:22 smithi006 ceph-mon[32486]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T17:02:23.262 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:02:22 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:02:22.816+0000 7f02108eb700 -1 osd.7 0 waiting for initial osdmap 2024-05-20T17:02:23.262 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:02:22 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:02:22.829+0000 7f020c6a0700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:02:23.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:23 smithi062 ceph-mon[35425]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:23.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:23 smithi062 ceph-mon[35425]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-05-20T17:02:23.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:23 smithi062 ceph-mon[35425]: osdmap e51: 8 total, 7 up, 8 in 2024-05-20T17:02:23.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:23 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:02:23.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:23 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:02:23.782 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:23 smithi171 ceph-mon[35901]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:23.782 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:23 smithi171 ceph-mon[35901]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-05-20T17:02:23.782 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:23 smithi171 ceph-mon[35901]: osdmap e51: 8 total, 7 up, 8 in 2024-05-20T17:02:23.782 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:23 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:02:23.782 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:23 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:02:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:23 smithi006 ceph-mon[32486]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-20T17:02:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:23 smithi006 ceph-mon[32486]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-05-20T17:02:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:23 smithi006 ceph-mon[32486]: osdmap e51: 8 total, 7 up, 8 in 2024-05-20T17:02:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:23 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:02:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:23 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:02:24.362 INFO:teuthology.orchestra.run.smithi171.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-20T17:02:24.362 INFO:teuthology.orchestra.run.smithi171.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-20T17:02:24.362 INFO:teuthology.orchestra.run.smithi171.stderr: stderr: 10+0 records in 2024-05-20T17:02:24.362 INFO:teuthology.orchestra.run.smithi171.stderr:10+0 records out 2024-05-20T17:02:24.362 INFO:teuthology.orchestra.run.smithi171.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111214 s, 943 MB/s 2024-05-20T17:02:24.362 INFO:teuthology.orchestra.run.smithi171.stderr:--> Zapping successful for: 2024-05-20T17:02:25.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:24 smithi062 ceph-mon[35425]: purged_snaps scrub starts 2024-05-20T17:02:25.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:24 smithi062 ceph-mon[35425]: purged_snaps scrub ok 2024-05-20T17:02:25.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:24 smithi062 ceph-mon[35425]: osd.7 [v2:172.21.15.62:6816/598452691,v1:172.21.15.62:6817/598452691] boot 2024-05-20T17:02:25.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:24 smithi062 ceph-mon[35425]: osdmap e52: 8 total, 8 up, 8 in 2024-05-20T17:02:25.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:24 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:02:25.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:24 smithi062 ceph-mon[35425]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:25.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:24 smithi171 ceph-mon[35901]: purged_snaps scrub starts 2024-05-20T17:02:25.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:24 smithi171 ceph-mon[35901]: purged_snaps scrub ok 2024-05-20T17:02:25.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:24 smithi171 ceph-mon[35901]: osd.7 [v2:172.21.15.62:6816/598452691,v1:172.21.15.62:6817/598452691] boot 2024-05-20T17:02:25.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:24 smithi171 ceph-mon[35901]: osdmap e52: 8 total, 8 up, 8 in 2024-05-20T17:02:25.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:24 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:02:25.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:24 smithi171 ceph-mon[35901]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:25.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:24 smithi006 ceph-mon[32486]: purged_snaps scrub starts 2024-05-20T17:02:25.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:24 smithi006 ceph-mon[32486]: purged_snaps scrub ok 2024-05-20T17:02:25.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:24 smithi006 ceph-mon[32486]: osd.7 [v2:172.21.15.62:6816/598452691,v1:172.21.15.62:6817/598452691] boot 2024-05-20T17:02:25.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:24 smithi006 ceph-mon[32486]: osdmap e52: 8 total, 8 up, 8 in 2024-05-20T17:02:25.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:24 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-20T17:02:25.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:24 smithi006 ceph-mon[32486]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:25.195 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi171:vg_nvme/lv_2 2024-05-20T17:02:25.436 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:02:26.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:25 smithi171 ceph-mon[35901]: osdmap e53: 8 total, 8 up, 8 in 2024-05-20T17:02:26.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:25 smithi171 ceph-mon[35901]: Detected new or changed devices on smithi062 2024-05-20T17:02:26.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:25 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:26.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:25 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:26.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:25 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:02:26.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:25 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:02:26.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:25 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:02:26.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:25 smithi171 ceph-mon[35901]: Adjusting osd_memory_target on smithi062 to 5696M 2024-05-20T17:02:26.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:25 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:26.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:25 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:26.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:25 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:02:26.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:25 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:26.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:25 smithi006 ceph-mon[32486]: osdmap e53: 8 total, 8 up, 8 in 2024-05-20T17:02:26.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:25 smithi006 ceph-mon[32486]: Detected new or changed devices on smithi062 2024-05-20T17:02:26.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:25 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:26.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:25 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:26.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:25 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:02:26.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:25 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:02:26.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:25 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:02:26.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:25 smithi006 ceph-mon[32486]: Adjusting osd_memory_target on smithi062 to 5696M 2024-05-20T17:02:26.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:25 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:26.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:25 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:26.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:25 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:02:26.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:25 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:26.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:25 smithi062 ceph-mon[35425]: osdmap e53: 8 total, 8 up, 8 in 2024-05-20T17:02:26.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:25 smithi062 ceph-mon[35425]: Detected new or changed devices on smithi062 2024-05-20T17:02:26.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:25 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:26.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:25 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:26.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:25 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:02:26.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:25 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:02:26.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:25 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:02:26.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:25 smithi062 ceph-mon[35425]: Adjusting osd_memory_target on smithi062 to 5696M 2024-05-20T17:02:26.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:25 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:26.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:25 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:26.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:25 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:02:26.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:25 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:27.036 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.036+0000 7f1cc55df700 1 -- 172.21.15.171:0/307810599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cc0106620 msgr2=0x7f1cc0108a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:02:27.036 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.036+0000 7f1cc55df700 1 --2- 172.21.15.171:0/307810599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cc0106620 0x7f1cc0108a40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4009990 tx=0x7f1cb4009ca0 comp rx=0 tx=0).stop 2024-05-20T17:02:27.036 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.036+0000 7f1cc55df700 1 -- 172.21.15.171:0/307810599 shutdown_connections 2024-05-20T17:02:27.037 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.036+0000 7f1cc55df700 1 --2- 172.21.15.171:0/307810599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cc0108f80 0x7f1cc010b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:27.037 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.036+0000 7f1cc55df700 1 --2- 172.21.15.171:0/307810599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cc0103cc0 0x7f1cc01060e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:27.037 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.036+0000 7f1cc55df700 1 --2- 172.21.15.171:0/307810599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cc0106620 0x7f1cc0108a40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:27.037 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.036+0000 7f1cc55df700 1 -- 172.21.15.171:0/307810599 >> 172.21.15.171:0/307810599 conn(0x7f1cc00fd700 msgr2=0x7f1cc00ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:02:27.037 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.036+0000 7f1cc55df700 1 -- 172.21.15.171:0/307810599 shutdown_connections 2024-05-20T17:02:27.037 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.036+0000 7f1cc55df700 1 -- 172.21.15.171:0/307810599 wait complete. 2024-05-20T17:02:27.037 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.037+0000 7f1cc55df700 1 Processor -- start 2024-05-20T17:02:27.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.037+0000 7f1cc55df700 1 -- start start 2024-05-20T17:02:27.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.037+0000 7f1cc55df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cc0103cc0 0x7f1cc0199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:02:27.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.037+0000 7f1cc55df700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cc0106620 0x7f1cc0199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:02:27.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.037+0000 7f1cc55df700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cc0108f80 0x7f1cc01a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:02:27.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.037+0000 7f1cc55df700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc010ec30 con 0x7f1cc0103cc0 2024-05-20T17:02:27.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.037+0000 7f1cc55df700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc010eab0 con 0x7f1cc0108f80 2024-05-20T17:02:27.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.037+0000 7f1cc55df700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc010edb0 con 0x7f1cc0106620 2024-05-20T17:02:27.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.037+0000 7f1cbe7fc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cc0106620 0x7f1cc0199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:02:27.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.037+0000 7f1cbe7fc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cc0106620 0x7f1cc0199cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:35704/0 (socket says 172.21.15.171:35704) 2024-05-20T17:02:27.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.037+0000 7f1cbe7fc700 1 -- 172.21.15.171:0/35806498 learned_addr learned my addr 172.21.15.171:0/35806498 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T17:02:27.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.037+0000 7f1cbeffd700 1 --2- 172.21.15.171:0/35806498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cc0103cc0 0x7f1cc0199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:02:27.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.037+0000 7f1cbf7fe700 1 --2- 172.21.15.171:0/35806498 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cc0108f80 0x7f1cc01a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:02:27.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.038+0000 7f1cbe7fc700 1 -- 172.21.15.171:0/35806498 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cc0108f80 msgr2=0x7f1cc01a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:02:27.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.038+0000 7f1cbe7fc700 1 --2- 172.21.15.171:0/35806498 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cc0108f80 0x7f1cc01a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:27.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.038+0000 7f1cbe7fc700 1 -- 172.21.15.171:0/35806498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cc0103cc0 msgr2=0x7f1cc0199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:02:27.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.038+0000 7f1cbe7fc700 1 --2- 172.21.15.171:0/35806498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cc0103cc0 0x7f1cc0199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:27.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.038+0000 7f1cbe7fc700 1 -- 172.21.15.171:0/35806498 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc01a1250 con 0x7f1cc0106620 2024-05-20T17:02:27.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.038+0000 7f1cbe7fc700 1 --2- 172.21.15.171:0/35806498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cc0106620 0x7f1cc0199cc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40057f0 tx=0x7f1cb4009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:02:27.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.038+0000 7f1ca7fff700 1 -- 172.21.15.171:0/35806498 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4027070 con 0x7f1cc0106620 2024-05-20T17:02:27.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.038+0000 7f1cc55df700 1 -- 172.21.15.171:0/35806498 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc01a14e0 con 0x7f1cc0106620 2024-05-20T17:02:27.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.038+0000 7f1ca7fff700 1 -- 172.21.15.171:0/35806498 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1cb40040d0 con 0x7f1cc0106620 2024-05-20T17:02:27.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.038+0000 7f1ca7fff700 1 -- 172.21.15.171:0/35806498 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4022dc0 con 0x7f1cc0106620 2024-05-20T17:02:27.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.038+0000 7f1cc55df700 1 -- 172.21.15.171:0/35806498 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc01a1930 con 0x7f1cc0106620 2024-05-20T17:02:27.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.039+0000 7f1cc55df700 1 -- 172.21.15.171:0/35806498 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cc0050170 con 0x7f1cc0106620 2024-05-20T17:02:27.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.040+0000 7f1ca7fff700 1 -- 172.21.15.171:0/35806498 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f1cb402a070 con 0x7f1cc0106620 2024-05-20T17:02:27.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.041+0000 7f1ca7fff700 1 --2- 172.21.15.171:0/35806498 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1ca80a2c20 0x7f1ca80a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:02:27.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.041+0000 7f1ca7fff700 1 -- 172.21.15.171:0/35806498 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5397+0+0 (secure 0 0 0) 0x7f1cb40cf960 con 0x7f1cc0106620 2024-05-20T17:02:27.042 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.041+0000 7f1cbeffd700 1 --2- 172.21.15.171:0/35806498 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1ca80a2c20 0x7f1ca80a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:02:27.042 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.042+0000 7f1cbeffd700 1 --2- 172.21.15.171:0/35806498 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1ca80a2c20 0x7f1ca80a5130 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1cc006aeb0 tx=0x7f1cb000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:02:27.044 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.044+0000 7f1ca7fff700 1 -- 172.21.15.171:0/35806498 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1cb4031080 con 0x7f1cc0106620 2024-05-20T17:02:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:26 smithi171 ceph-mon[35901]: osdmap e54: 8 total, 8 up, 8 in 2024-05-20T17:02:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:26 smithi171 ceph-mon[35901]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:27.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:26 smithi006 ceph-mon[32486]: osdmap e54: 8 total, 8 up, 8 in 2024-05-20T17:02:27.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:26 smithi006 ceph-mon[32486]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:27.175 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:26 smithi062 ceph-mon[35425]: osdmap e54: 8 total, 8 up, 8 in 2024-05-20T17:02:27.175 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:26 smithi062 ceph-mon[35425]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:27.250 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:27.250+0000 7f1cc55df700 1 -- 172.21.15.171:0/35806498 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1cc0062b40 con 0x7f1ca80a2c20 2024-05-20T17:02:28.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:27 smithi171 ceph-mon[35901]: osdmap e55: 8 total, 8 up, 8 in 2024-05-20T17:02:28.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:27 smithi171 ceph-mon[35901]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:02:28.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:02:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:02:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:28.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:27 smithi006 ceph-mon[32486]: osdmap e55: 8 total, 8 up, 8 in 2024-05-20T17:02:28.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:27 smithi006 ceph-mon[32486]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:02:28.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:27 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:02:28.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:27 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:02:28.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:27 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:28.191 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:27 smithi062 ceph-mon[35425]: osdmap e55: 8 total, 8 up, 8 in 2024-05-20T17:02:28.191 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:27 smithi062 ceph-mon[35425]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:02:28.192 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:27 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:02:28.192 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:27 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:02:28.192 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:27 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:29.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:28 smithi171 ceph-mon[35901]: osdmap e56: 8 total, 8 up, 8 in 2024-05-20T17:02:29.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:28 smithi171 ceph-mon[35901]: pgmap v189: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-05-20T17:02:29.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:28 smithi006 ceph-mon[32486]: osdmap e56: 8 total, 8 up, 8 in 2024-05-20T17:02:29.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:28 smithi006 ceph-mon[32486]: pgmap v189: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-05-20T17:02:29.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:28 smithi062 ceph-mon[35425]: osdmap e56: 8 total, 8 up, 8 in 2024-05-20T17:02:29.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:28 smithi062 ceph-mon[35425]: pgmap v189: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-05-20T17:02:30.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:29 smithi171 ceph-mon[35901]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-20T17:02:30.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:29 smithi006 ceph-mon[32486]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-20T17:02:30.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:29 smithi062 ceph-mon[35425]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-20T17:02:31.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:30 smithi171 ceph-mon[35901]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:31.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:30 smithi171 ceph-mon[35901]: from='client.? 172.21.15.171:0/605060812' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6c75e8b-23ac-4bfc-8621-11c533acf1a3"}]: dispatch 2024-05-20T17:02:31.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:30 smithi171 ceph-mon[35901]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6c75e8b-23ac-4bfc-8621-11c533acf1a3"}]: dispatch 2024-05-20T17:02:31.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:30 smithi171 ceph-mon[35901]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6c75e8b-23ac-4bfc-8621-11c533acf1a3"}]': finished 2024-05-20T17:02:31.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:30 smithi171 ceph-mon[35901]: osdmap e57: 9 total, 8 up, 9 in 2024-05-20T17:02:31.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:30 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:02:31.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:30 smithi171 ceph-mon[35901]: from='client.? 172.21.15.171:0/1357035096' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:02:31.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:30 smithi006 ceph-mon[32486]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:31.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:30 smithi006 ceph-mon[32486]: from='client.? 172.21.15.171:0/605060812' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6c75e8b-23ac-4bfc-8621-11c533acf1a3"}]: dispatch 2024-05-20T17:02:31.134 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:30 smithi006 ceph-mon[32486]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6c75e8b-23ac-4bfc-8621-11c533acf1a3"}]: dispatch 2024-05-20T17:02:31.134 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:30 smithi006 ceph-mon[32486]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6c75e8b-23ac-4bfc-8621-11c533acf1a3"}]': finished 2024-05-20T17:02:31.134 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:30 smithi006 ceph-mon[32486]: osdmap e57: 9 total, 8 up, 9 in 2024-05-20T17:02:31.134 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:30 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:02:31.134 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:30 smithi006 ceph-mon[32486]: from='client.? 172.21.15.171:0/1357035096' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:02:31.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:30 smithi062 ceph-mon[35425]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:31.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:30 smithi062 ceph-mon[35425]: from='client.? 172.21.15.171:0/605060812' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6c75e8b-23ac-4bfc-8621-11c533acf1a3"}]: dispatch 2024-05-20T17:02:31.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:30 smithi062 ceph-mon[35425]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6c75e8b-23ac-4bfc-8621-11c533acf1a3"}]: dispatch 2024-05-20T17:02:31.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:30 smithi062 ceph-mon[35425]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6c75e8b-23ac-4bfc-8621-11c533acf1a3"}]': finished 2024-05-20T17:02:31.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:30 smithi062 ceph-mon[35425]: osdmap e57: 9 total, 8 up, 9 in 2024-05-20T17:02:31.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:30 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:02:31.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:30 smithi062 ceph-mon[35425]: from='client.? 172.21.15.171:0/1357035096' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:02:32.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:31 smithi171 ceph-mon[35901]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-20T17:02:32.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:31 smithi171 ceph-mon[35901]: Cluster is now healthy 2024-05-20T17:02:32.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:31 smithi006 ceph-mon[32486]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-20T17:02:32.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:31 smithi006 ceph-mon[32486]: Cluster is now healthy 2024-05-20T17:02:32.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:31 smithi062 ceph-mon[35425]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-20T17:02:32.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:31 smithi062 ceph-mon[35425]: Cluster is now healthy 2024-05-20T17:02:33.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:32 smithi171 ceph-mon[35901]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:33.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:32 smithi006 ceph-mon[32486]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:33.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:32 smithi062 ceph-mon[35425]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:35.261 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:35 smithi171 ceph-mon[35901]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:35.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:35 smithi006 ceph-mon[32486]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:35.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:35 smithi062 ceph-mon[35425]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:37.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:37 smithi171 ceph-mon[35901]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:37.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:37 smithi006 ceph-mon[32486]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:37.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:37 smithi062 ceph-mon[35425]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:38.284 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:38 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-20T17:02:38.284 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:38 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:38.284 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:38 smithi171 ceph-mon[35901]: Deploying daemon osd.8 on smithi171 2024-05-20T17:02:38.378 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:38 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-20T17:02:38.378 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:38 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:38.378 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:38 smithi006 ceph-mon[32486]: Deploying daemon osd.8 on smithi171 2024-05-20T17:02:38.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:38 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-20T17:02:38.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:38 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:38.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:38 smithi062 ceph-mon[35425]: Deploying daemon osd.8 on smithi171 2024-05-20T17:02:39.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:39 smithi062 ceph-mon[35425]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:39.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:39 smithi171 ceph-mon[35901]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:39.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:39 smithi006 ceph-mon[32486]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:41.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:41 smithi171 ceph-mon[35901]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:41.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:41 smithi006 ceph-mon[32486]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:41.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:41 smithi062 ceph-mon[35425]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:43.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:43 smithi006 ceph-mon[32486]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:43.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:43.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:43.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:02:43.429 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:43 smithi171 ceph-mon[35901]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:43.429 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:43.429 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:43.429 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:02:43.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:43 smithi062 ceph-mon[35425]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:43.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:43.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:43.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:02:45.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:45 smithi171 ceph-mon[35901]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:45.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:45 smithi006 ceph-mon[32486]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:45.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:45 smithi062 ceph-mon[35425]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:47.018 INFO:teuthology.orchestra.run.smithi171.stdout:Created osd(s) 8 on host 'smithi171' 2024-05-20T17:02:47.018 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:47.017+0000 7f1ca7fff700 1 -- 172.21.15.171:0/35806498 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1cc0062b40 con 0x7f1ca80a2c20 2024-05-20T17:02:47.020 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:47.020+0000 7f1cc55df700 1 -- 172.21.15.171:0/35806498 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1ca80a2c20 msgr2=0x7f1ca80a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:02:47.020 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:47.020+0000 7f1cc55df700 1 --2- 172.21.15.171:0/35806498 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1ca80a2c20 0x7f1ca80a5130 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1cc006aeb0 tx=0x7f1cb000a380 comp rx=0 tx=0).stop 2024-05-20T17:02:47.020 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:47.020+0000 7f1cc55df700 1 -- 172.21.15.171:0/35806498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cc0106620 msgr2=0x7f1cc0199cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:02:47.020 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:47.020+0000 7f1cc55df700 1 --2- 172.21.15.171:0/35806498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cc0106620 0x7f1cc0199cc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40057f0 tx=0x7f1cb4009510 comp rx=0 tx=0).stop 2024-05-20T17:02:47.021 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:47.020+0000 7f1cc55df700 1 -- 172.21.15.171:0/35806498 shutdown_connections 2024-05-20T17:02:47.021 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:47.020+0000 7f1cc55df700 1 --2- 172.21.15.171:0/35806498 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1ca80a2c20 0x7f1ca80a5130 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:47.021 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:47.020+0000 7f1cc55df700 1 --2- 172.21.15.171:0/35806498 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1cc0108f80 0x7f1cc01a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:47.021 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:47.020+0000 7f1cc55df700 1 --2- 172.21.15.171:0/35806498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cc0103cc0 0x7f1cc0199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:47.021 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:47.020+0000 7f1cc55df700 1 --2- 172.21.15.171:0/35806498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cc0106620 0x7f1cc0199cc0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:47.021 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:47.020+0000 7f1cc55df700 1 -- 172.21.15.171:0/35806498 >> 172.21.15.171:0/35806498 conn(0x7f1cc00fd700 msgr2=0x7f1cc0104790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:02:47.021 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:47.020+0000 7f1cc55df700 1 -- 172.21.15.171:0/35806498 shutdown_connections 2024-05-20T17:02:47.021 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:02:47.020+0000 7f1cc55df700 1 -- 172.21.15.171:0/35806498 wait complete. 2024-05-20T17:02:47.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:46 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:47.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:46 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:47.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:46 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:47.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:46 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:02:47.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:46 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:47.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:46 smithi062 ceph-mon[35425]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:47.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:46 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:47.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:46 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:47.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:46 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:47.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:46 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:02:47.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:46 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:47.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:46 smithi171 ceph-mon[35901]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:47.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:46 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:47.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:46 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:47.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:46 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:47.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:46 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:02:47.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:46 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:47.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:46 smithi006 ceph-mon[32486]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:47.737 DEBUG:teuthology.orchestra.run.smithi171:osd.8> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.8.service 2024-05-20T17:02:47.739 INFO:tasks.cephadm:Deploying osd.9 on smithi006 with /dev/vg_nvme/lv_1... 2024-05-20T17:02:47.740 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-20T17:02:47.977 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:47 smithi171 ceph-mon[35901]: from='osd.8 [v2:172.21.15.171:6816/1159983887,v1:172.21.15.171:6817/1159983887]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-20T17:02:47.978 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:47 smithi171 ceph-mon[35901]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-20T17:02:47.978 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:47 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:47.978 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:47 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:47.978 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:47 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:02:48.004 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:02:48.127 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:47 smithi006 ceph-mon[32486]: from='osd.8 [v2:172.21.15.171:6816/1159983887,v1:172.21.15.171:6817/1159983887]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-20T17:02:48.127 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:47 smithi006 ceph-mon[32486]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-20T17:02:48.127 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:47 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:48.128 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:47 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:48.128 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:47 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:02:48.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:47 smithi062 ceph-mon[35425]: from='osd.8 [v2:172.21.15.171:6816/1159983887,v1:172.21.15.171:6817/1159983887]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-20T17:02:48.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:47 smithi062 ceph-mon[35425]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-20T17:02:48.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:47 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:48.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:47 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:48.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:47 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:02:49.265 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:48 smithi171 ceph-mon[35901]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-20T17:02:49.265 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:48 smithi171 ceph-mon[35901]: from='osd.8 [v2:172.21.15.171:6816/1159983887,v1:172.21.15.171:6817/1159983887]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:02:49.265 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:48 smithi171 ceph-mon[35901]: osdmap e58: 9 total, 8 up, 9 in 2024-05-20T17:02:49.265 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:48 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:02:49.265 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:48 smithi171 ceph-mon[35901]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:02:49.266 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:48 smithi171 ceph-mon[35901]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:49.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:48 smithi062 ceph-mon[35425]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-20T17:02:49.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:48 smithi062 ceph-mon[35425]: from='osd.8 [v2:172.21.15.171:6816/1159983887,v1:172.21.15.171:6817/1159983887]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:02:49.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:48 smithi062 ceph-mon[35425]: osdmap e58: 9 total, 8 up, 9 in 2024-05-20T17:02:49.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:48 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:02:49.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:48 smithi062 ceph-mon[35425]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:02:49.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:48 smithi062 ceph-mon[35425]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:49.305 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:48 smithi006 ceph-mon[32486]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-20T17:02:49.305 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:48 smithi006 ceph-mon[32486]: from='osd.8 [v2:172.21.15.171:6816/1159983887,v1:172.21.15.171:6817/1159983887]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:02:49.305 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:48 smithi006 ceph-mon[32486]: osdmap e58: 9 total, 8 up, 9 in 2024-05-20T17:02:49.305 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:48 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:02:49.305 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:48 smithi006 ceph-mon[32486]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:02:49.305 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:48 smithi006 ceph-mon[32486]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:50.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:49 smithi171 ceph-mon[35901]: purged_snaps scrub starts 2024-05-20T17:02:50.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:49 smithi171 ceph-mon[35901]: purged_snaps scrub ok 2024-05-20T17:02:50.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:49 smithi171 ceph-mon[35901]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-20T17:02:50.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:49 smithi171 ceph-mon[35901]: osdmap e59: 9 total, 8 up, 9 in 2024-05-20T17:02:50.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:49 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:02:50.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:49 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:02:50.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:49 smithi171 ceph-mon[35901]: from='osd.8 ' entity='osd.8' 2024-05-20T17:02:50.118 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:02:49 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:02:49.729+0000 7f439d959700 -1 osd.8 0 waiting for initial osdmap 2024-05-20T17:02:50.118 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:02:49 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:02:49.743+0000 7f4395706700 -1 osd.8 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:02:50.208 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-20T17:02:50.208 INFO:teuthology.orchestra.run.smithi006.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-20T17:02:50.208 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10+0 records in 2024-05-20T17:02:50.209 INFO:teuthology.orchestra.run.smithi006.stderr:10+0 records out 2024-05-20T17:02:50.209 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0108328 s, 968 MB/s 2024-05-20T17:02:50.209 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping successful for: 2024-05-20T17:02:50.209 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:49 smithi006 ceph-mon[32486]: purged_snaps scrub starts 2024-05-20T17:02:50.209 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:49 smithi006 ceph-mon[32486]: purged_snaps scrub ok 2024-05-20T17:02:50.209 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:49 smithi006 ceph-mon[32486]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-20T17:02:50.209 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:49 smithi006 ceph-mon[32486]: osdmap e59: 9 total, 8 up, 9 in 2024-05-20T17:02:50.209 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:49 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:02:50.209 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:49 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:02:50.209 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:49 smithi006 ceph-mon[32486]: from='osd.8 ' entity='osd.8' 2024-05-20T17:02:50.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:49 smithi062 ceph-mon[35425]: purged_snaps scrub starts 2024-05-20T17:02:50.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:49 smithi062 ceph-mon[35425]: purged_snaps scrub ok 2024-05-20T17:02:50.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:49 smithi062 ceph-mon[35425]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-20T17:02:50.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:49 smithi062 ceph-mon[35425]: osdmap e59: 9 total, 8 up, 9 in 2024-05-20T17:02:50.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:49 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:02:50.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:49 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:02:50.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:49 smithi062 ceph-mon[35425]: from='osd.8 ' entity='osd.8' 2024-05-20T17:02:51.043 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi006:vg_nvme/lv_1 2024-05-20T17:02:51.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:50 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:02:51.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:50 smithi171 ceph-mon[35901]: osd.8 [v2:172.21.15.171:6816/1159983887,v1:172.21.15.171:6817/1159983887] boot 2024-05-20T17:02:51.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:50 smithi171 ceph-mon[35901]: osdmap e60: 9 total, 9 up, 9 in 2024-05-20T17:02:51.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:50 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:02:51.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:50 smithi171 ceph-mon[35901]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:51.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:50 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:51.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:50 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:51.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:50 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:02:51.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:50 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:02:51.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:50 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:02:51.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:50 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:51.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:50 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:51.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:50 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:02:51.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:50 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:51.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:50 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:02:51.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:50 smithi062 ceph-mon[35425]: osd.8 [v2:172.21.15.171:6816/1159983887,v1:172.21.15.171:6817/1159983887] boot 2024-05-20T17:02:51.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:50 smithi062 ceph-mon[35425]: osdmap e60: 9 total, 9 up, 9 in 2024-05-20T17:02:51.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:50 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:02:51.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:50 smithi062 ceph-mon[35425]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:51.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:50 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:51.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:50 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:51.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:50 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:02:51.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:50 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:02:51.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:50 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:02:51.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:50 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:51.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:50 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:51.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:50 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:02:51.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:50 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:51.299 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:02:51.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:50 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:02:51.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:50 smithi006 ceph-mon[32486]: osd.8 [v2:172.21.15.171:6816/1159983887,v1:172.21.15.171:6817/1159983887] boot 2024-05-20T17:02:51.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:50 smithi006 ceph-mon[32486]: osdmap e60: 9 total, 9 up, 9 in 2024-05-20T17:02:51.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:50 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-20T17:02:51.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:50 smithi006 ceph-mon[32486]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-05-20T17:02:51.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:50 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:51.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:50 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:51.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:50 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:02:51.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:50 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:02:51.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:50 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:02:51.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:50 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:51.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:50 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:51.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:50 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:02:51.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:50 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:02:52.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:51 smithi006 ceph-mon[32486]: Detected new or changed devices on smithi171 2024-05-20T17:02:52.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:51 smithi006 ceph-mon[32486]: Adjusting osd_memory_target on smithi171 to 5696M 2024-05-20T17:02:52.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:51 smithi006 ceph-mon[32486]: osdmap e61: 9 total, 9 up, 9 in 2024-05-20T17:02:52.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:51 smithi062 ceph-mon[35425]: Detected new or changed devices on smithi171 2024-05-20T17:02:52.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:51 smithi062 ceph-mon[35425]: Adjusting osd_memory_target on smithi171 to 5696M 2024-05-20T17:02:52.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:51 smithi062 ceph-mon[35425]: osdmap e61: 9 total, 9 up, 9 in 2024-05-20T17:02:52.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:51 smithi171 ceph-mon[35901]: Detected new or changed devices on smithi171 2024-05-20T17:02:52.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:51 smithi171 ceph-mon[35901]: Adjusting osd_memory_target on smithi171 to 5696M 2024-05-20T17:02:52.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:51 smithi171 ceph-mon[35901]: osdmap e61: 9 total, 9 up, 9 in 2024-05-20T17:02:53.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.177+0000 7fc8c3d7c700 1 -- 172.21.15.6:0/1082283428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8bc1020c0 msgr2=0x7fc8bc1024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:02:53.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.177+0000 7fc8c3d7c700 1 --2- 172.21.15.6:0/1082283428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8bc1020c0 0x7fc8bc1024d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009990 tx=0x7fc8b8009ca0 comp rx=0 tx=0).stop 2024-05-20T17:02:53.178 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:52 smithi006 ceph-mon[32486]: osdmap e62: 9 total, 9 up, 9 in 2024-05-20T17:02:53.178 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:52 smithi006 ceph-mon[32486]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:02:53.178 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:52 smithi006 ceph-mon[32486]: osdmap e63: 9 total, 9 up, 9 in 2024-05-20T17:02:53.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.178+0000 7fc8c3d7c700 1 -- 172.21.15.6:0/1082283428 shutdown_connections 2024-05-20T17:02:53.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.178+0000 7fc8c3d7c700 1 --2- 172.21.15.6:0/1082283428 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8bc103b90 0x7fc8bc10a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:53.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.178+0000 7fc8c3d7c700 1 --2- 172.21.15.6:0/1082283428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8bc1020c0 0x7fc8bc1024d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:53.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.178+0000 7fc8c3d7c700 1 --2- 172.21.15.6:0/1082283428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8bc1031f0 0x7fc8bc103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:53.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.178+0000 7fc8c3d7c700 1 -- 172.21.15.6:0/1082283428 >> 172.21.15.6:0/1082283428 conn(0x7fc8bc0fd700 msgr2=0x7fc8bc0ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:02:53.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.178+0000 7fc8c3d7c700 1 -- 172.21.15.6:0/1082283428 shutdown_connections 2024-05-20T17:02:53.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.178+0000 7fc8c3d7c700 1 -- 172.21.15.6:0/1082283428 wait complete. 2024-05-20T17:02:53.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.178+0000 7fc8c3d7c700 1 Processor -- start 2024-05-20T17:02:53.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.179+0000 7fc8c3d7c700 1 -- start start 2024-05-20T17:02:53.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.179+0000 7fc8c3d7c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8bc1020c0 0x7fc8bc199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:02:53.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.179+0000 7fc8c3d7c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8bc1031f0 0x7fc8bc199d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:02:53.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.179+0000 7fc8c3d7c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8bc103b90 0x7fc8bc1a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:02:53.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.179+0000 7fc8c3d7c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc10dba0 con 0x7fc8bc103b90 2024-05-20T17:02:53.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.179+0000 7fc8c3d7c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc10da20 con 0x7fc8bc1020c0 2024-05-20T17:02:53.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.179+0000 7fc8c3d7c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc10dd20 con 0x7fc8bc1031f0 2024-05-20T17:02:53.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.179+0000 7fc8c2319700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8bc103b90 0x7fc8bc1a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:02:53.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.179+0000 7fc8c2319700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8bc103b90 0x7fc8bc1a0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44066/0 (socket says 172.21.15.6:44066) 2024-05-20T17:02:53.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.179+0000 7fc8c2319700 1 -- 172.21.15.6:0/114823974 learned_addr learned my addr 172.21.15.6:0/114823974 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:02:53.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.179+0000 7fc8c1317700 1 --2- 172.21.15.6:0/114823974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8bc1031f0 0x7fc8bc199d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:02:53.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.179+0000 7fc8c1b18700 1 --2- 172.21.15.6:0/114823974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8bc1020c0 0x7fc8bc199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:02:53.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.179+0000 7fc8c2319700 1 -- 172.21.15.6:0/114823974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8bc1031f0 msgr2=0x7fc8bc199d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:02:53.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.179+0000 7fc8c2319700 1 --2- 172.21.15.6:0/114823974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8bc1031f0 0x7fc8bc199d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:53.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.179+0000 7fc8c2319700 1 -- 172.21.15.6:0/114823974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8bc1020c0 msgr2=0x7fc8bc199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:02:53.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.179+0000 7fc8c2319700 1 --2- 172.21.15.6:0/114823974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8bc1020c0 0x7fc8bc199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:02:53.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.179+0000 7fc8c2319700 1 -- 172.21.15.6:0/114823974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8bc1a1390 con 0x7fc8bc103b90 2024-05-20T17:02:53.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.179+0000 7fc8c1b18700 1 --2- 172.21.15.6:0/114823974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8bc1020c0 0x7fc8bc199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:02:53.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.180+0000 7fc8c2319700 1 --2- 172.21.15.6:0/114823974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8bc103b90 0x7fc8bc1a0d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400ef30 tx=0x7fc8b400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:02:53.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.180+0000 7fc8b2ffd700 1 -- 172.21.15.6:0/114823974 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b40092e0 con 0x7fc8bc103b90 2024-05-20T17:02:53.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.180+0000 7fc8b2ffd700 1 -- 172.21.15.6:0/114823974 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc8b4004bb0 con 0x7fc8bc103b90 2024-05-20T17:02:53.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.180+0000 7fc8b2ffd700 1 -- 172.21.15.6:0/114823974 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4004060 con 0x7fc8bc103b90 2024-05-20T17:02:53.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.180+0000 7fc8c3d7c700 1 -- 172.21.15.6:0/114823974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8bc1a1620 con 0x7fc8bc103b90 2024-05-20T17:02:53.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.180+0000 7fc8c3d7c700 1 -- 172.21.15.6:0/114823974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8bc1a1c30 con 0x7fc8bc103b90 2024-05-20T17:02:53.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.181+0000 7fc8c3d7c700 1 -- 172.21.15.6:0/114823974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8bc050170 con 0x7fc8bc103b90 2024-05-20T17:02:53.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.183+0000 7fc8b2ffd700 1 -- 172.21.15.6:0/114823974 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc8b401b030 con 0x7fc8bc103b90 2024-05-20T17:02:53.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.183+0000 7fc8b2ffd700 1 --2- 172.21.15.6:0/114823974 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc8a80a2ca0 0x7fc8a80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:02:53.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.183+0000 7fc8c1b18700 1 --2- 172.21.15.6:0/114823974 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc8a80a2ca0 0x7fc8a80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:02:53.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.183+0000 7fc8b2ffd700 1 -- 172.21.15.6:0/114823974 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5829+0+0 (secure 0 0 0) 0x7fc8b40ceaf0 con 0x7fc8bc103b90 2024-05-20T17:02:53.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.184+0000 7fc8c1b18700 1 --2- 172.21.15.6:0/114823974 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc8a80a2ca0 0x7fc8a80a51b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800b840 tx=0x7fc8b800b610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:02:53.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.187+0000 7fc8b2ffd700 1 -- 172.21.15.6:0/114823974 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc8b4022020 con 0x7fc8bc103b90 2024-05-20T17:02:53.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:52 smithi062 ceph-mon[35425]: osdmap e62: 9 total, 9 up, 9 in 2024-05-20T17:02:53.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:52 smithi062 ceph-mon[35425]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:02:53.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:52 smithi062 ceph-mon[35425]: osdmap e63: 9 total, 9 up, 9 in 2024-05-20T17:02:53.339 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:52 smithi171 ceph-mon[35901]: osdmap e62: 9 total, 9 up, 9 in 2024-05-20T17:02:53.339 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:52 smithi171 ceph-mon[35901]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:02:53.339 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:52 smithi171 ceph-mon[35901]: osdmap e63: 9 total, 9 up, 9 in 2024-05-20T17:02:53.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:02:53.403+0000 7fc8c3d7c700 1 -- 172.21.15.6:0/114823974 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc8bc1a1e90 con 0x7fc8a80a2ca0 2024-05-20T17:02:54.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:54 smithi171 ceph-mon[35901]: osdmap e64: 9 total, 9 up, 9 in 2024-05-20T17:02:54.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:54 smithi171 ceph-mon[35901]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:02:54.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:54 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:02:54.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:54 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:02:54.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:54 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:54.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:54 smithi006 ceph-mon[32486]: osdmap e64: 9 total, 9 up, 9 in 2024-05-20T17:02:54.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:54 smithi006 ceph-mon[32486]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:02:54.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:54 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:02:54.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:54 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:02:54.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:54 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:54.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:54 smithi062 ceph-mon[35425]: osdmap e64: 9 total, 9 up, 9 in 2024-05-20T17:02:54.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:54 smithi062 ceph-mon[35425]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:02:54.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:54 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:02:54.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:54 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:02:54.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:54 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:02:55.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:55 smithi171 ceph-mon[35901]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-20T17:02:55.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:55 smithi006 ceph-mon[32486]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-20T17:02:55.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:55 smithi062 ceph-mon[35425]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-20T17:02:57.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:57 smithi171 ceph-mon[35901]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-05-20T17:02:57.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:57 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/294771473' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23515136-a538-4352-adf4-b988ea887720"}]: dispatch 2024-05-20T17:02:57.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:57 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/294771473' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23515136-a538-4352-adf4-b988ea887720"}]': finished 2024-05-20T17:02:57.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:57 smithi171 ceph-mon[35901]: osdmap e65: 10 total, 9 up, 10 in 2024-05-20T17:02:57.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:57 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:02:57.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:57 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1896906892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:02:57.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:57 smithi006 ceph-mon[32486]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-05-20T17:02:57.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:57 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/294771473' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23515136-a538-4352-adf4-b988ea887720"}]: dispatch 2024-05-20T17:02:57.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:57 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/294771473' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23515136-a538-4352-adf4-b988ea887720"}]': finished 2024-05-20T17:02:57.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:57 smithi006 ceph-mon[32486]: osdmap e65: 10 total, 9 up, 10 in 2024-05-20T17:02:57.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:57 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:02:57.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:57 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1896906892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:02:57.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:57 smithi062 ceph-mon[35425]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-05-20T17:02:57.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:57 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/294771473' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23515136-a538-4352-adf4-b988ea887720"}]: dispatch 2024-05-20T17:02:57.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:57 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/294771473' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23515136-a538-4352-adf4-b988ea887720"}]': finished 2024-05-20T17:02:57.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:57 smithi062 ceph-mon[35425]: osdmap e65: 10 total, 9 up, 10 in 2024-05-20T17:02:57.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:57 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:02:57.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:57 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1896906892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:02:59.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:02:59 smithi171 ceph-mon[35901]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-20T17:02:59.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:02:59 smithi006 ceph-mon[32486]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-20T17:02:59.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:02:59 smithi062 ceph-mon[35425]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-20T17:03:01.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:01 smithi171 ceph-mon[35901]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-20T17:03:01.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:01 smithi006 ceph-mon[32486]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-20T17:03:01.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:01 smithi062 ceph-mon[35425]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-20T17:03:03.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:03 smithi171 ceph-mon[35901]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-20T17:03:03.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:03 smithi006 ceph-mon[32486]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-20T17:03:03.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:03 smithi062 ceph-mon[35425]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-20T17:03:05.559 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:05 smithi006 ceph-mon[32486]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:05.560 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:05 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-20T17:03:05.560 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:05 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:05.560 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:05 smithi006 ceph-mon[32486]: Deploying daemon osd.9 on smithi006 2024-05-20T17:03:05.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:05 smithi171 ceph-mon[35901]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:05.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:05 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-20T17:03:05.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:05 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:05.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:05 smithi171 ceph-mon[35901]: Deploying daemon osd.9 on smithi006 2024-05-20T17:03:05.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:05 smithi062 ceph-mon[35425]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:05.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:05 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-20T17:03:05.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:05 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:05.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:05 smithi062 ceph-mon[35425]: Deploying daemon osd.9 on smithi006 2024-05-20T17:03:07.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:07 smithi171 ceph-mon[35901]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:07.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:07 smithi006 ceph-mon[32486]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:07.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:07 smithi062 ceph-mon[35425]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:09.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:09 smithi171 ceph-mon[35901]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:09.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:09 smithi006 ceph-mon[32486]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:09.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:09 smithi062 ceph-mon[35425]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:11.514 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:11 smithi006 ceph-mon[32486]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:11.514 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:11.514 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:11.514 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:03:11.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:11 smithi171 ceph-mon[35901]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:11.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:11 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:11.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:11 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:11.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:11 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:03:11.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:11 smithi062 ceph-mon[35425]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:11.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:11 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:11.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:11 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:11.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:11 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:03:13.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:13 smithi006 ceph-mon[32486]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:13.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:13 smithi062 ceph-mon[35425]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:13.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:13 smithi171 ceph-mon[35901]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:14.415 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 9 on host 'smithi006' 2024-05-20T17:03:14.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:03:14.414+0000 7fc8b2ffd700 1 -- 172.21.15.6:0/114823974 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc8bc1a1e90 con 0x7fc8a80a2ca0 2024-05-20T17:03:14.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:03:14.417+0000 7fc8c3d7c700 1 -- 172.21.15.6:0/114823974 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc8a80a2ca0 msgr2=0x7fc8a80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:03:14.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:03:14.417+0000 7fc8c3d7c700 1 --2- 172.21.15.6:0/114823974 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc8a80a2ca0 0x7fc8a80a51b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800b840 tx=0x7fc8b800b610 comp rx=0 tx=0).stop 2024-05-20T17:03:14.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:03:14.417+0000 7fc8c3d7c700 1 -- 172.21.15.6:0/114823974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8bc103b90 msgr2=0x7fc8bc1a0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:03:14.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:03:14.417+0000 7fc8c3d7c700 1 --2- 172.21.15.6:0/114823974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8bc103b90 0x7fc8bc1a0d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400ef30 tx=0x7fc8b400c3a0 comp rx=0 tx=0).stop 2024-05-20T17:03:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:03:14.417+0000 7fc8c3d7c700 1 -- 172.21.15.6:0/114823974 shutdown_connections 2024-05-20T17:03:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:03:14.417+0000 7fc8c3d7c700 1 --2- 172.21.15.6:0/114823974 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc8a80a2ca0 0x7fc8a80a51b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:03:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:03:14.417+0000 7fc8c3d7c700 1 --2- 172.21.15.6:0/114823974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8bc103b90 0x7fc8bc1a0d10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:03:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:03:14.417+0000 7fc8c3d7c700 1 --2- 172.21.15.6:0/114823974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8bc1020c0 0x7fc8bc199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:03:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:03:14.417+0000 7fc8c3d7c700 1 --2- 172.21.15.6:0/114823974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8bc1031f0 0x7fc8bc199d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:03:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:03:14.417+0000 7fc8c3d7c700 1 -- 172.21.15.6:0/114823974 >> 172.21.15.6:0/114823974 conn(0x7fc8bc0fd700 msgr2=0x7fc8bc0ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:03:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:03:14.417+0000 7fc8c3d7c700 1 -- 172.21.15.6:0/114823974 shutdown_connections 2024-05-20T17:03:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:03:14.417+0000 7fc8c3d7c700 1 -- 172.21.15.6:0/114823974 wait complete. 2024-05-20T17:03:15.041 DEBUG:teuthology.orchestra.run.smithi006:osd.9> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.9.service 2024-05-20T17:03:15.044 INFO:tasks.cephadm:Deploying osd.10 on smithi062 with /dev/vg_nvme/lv_1... 2024-05-20T17:03:15.044 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-20T17:03:15.308 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:03:15.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:15 smithi062 ceph-mon[35425]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:15.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:15 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:15.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:15 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:15.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:15 smithi062 ceph-mon[35425]: from='osd.9 [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-20T17:03:15.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:15 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:15.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:15 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:15.827 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:15 smithi006 ceph-mon[32486]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:15.827 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:15 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:15.828 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:15 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:15.828 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:15 smithi006 ceph-mon[32486]: from='osd.9 [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-20T17:03:15.828 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:15 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:15.828 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:15 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:15.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:15 smithi171 ceph-mon[35901]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:15.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:15 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:15.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:15 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:15.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:15 smithi171 ceph-mon[35901]: from='osd.9 [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-20T17:03:15.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:15 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:15.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:15 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:16.734 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:16 smithi062 ceph-mon[35425]: from='osd.9 [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-20T17:03:16.734 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:16 smithi062 ceph-mon[35425]: osdmap e66: 10 total, 9 up, 10 in 2024-05-20T17:03:16.734 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:16 smithi062 ceph-mon[35425]: from='osd.9 [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-05-20T17:03:16.734 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:16 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:03:16.865 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:16 smithi006 ceph-mon[32486]: from='osd.9 [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-20T17:03:16.865 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:16 smithi006 ceph-mon[32486]: osdmap e66: 10 total, 9 up, 10 in 2024-05-20T17:03:16.865 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:16 smithi006 ceph-mon[32486]: from='osd.9 [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-05-20T17:03:16.865 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:16 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:03:16.866 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:03:16 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:03:16.422+0000 7fef6d498700 -1 osd.9 0 waiting for initial osdmap 2024-05-20T17:03:16.866 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:03:16 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:03:16.436+0000 7fef6924d700 -1 osd.9 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:03:16.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:16 smithi171 ceph-mon[35901]: from='osd.9 [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-20T17:03:16.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:16 smithi171 ceph-mon[35901]: osdmap e66: 10 total, 9 up, 10 in 2024-05-20T17:03:16.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:16 smithi171 ceph-mon[35901]: from='osd.9 [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-05-20T17:03:16.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:16 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:03:17.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:17 smithi006 ceph-mon[32486]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:17.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:17 smithi006 ceph-mon[32486]: from='osd.9 [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-05-20T17:03:17.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:17 smithi006 ceph-mon[32486]: osdmap e67: 10 total, 9 up, 10 in 2024-05-20T17:03:17.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:17 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:03:17.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:17 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:03:17.638 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:17 smithi062 ceph-mon[35425]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:17.638 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:17 smithi062 ceph-mon[35425]: from='osd.9 [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-05-20T17:03:17.638 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:17 smithi062 ceph-mon[35425]: osdmap e67: 10 total, 9 up, 10 in 2024-05-20T17:03:17.638 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:17 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:03:17.638 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:17 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:03:17.743 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-20T17:03:17.743 INFO:teuthology.orchestra.run.smithi062.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-20T17:03:17.743 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10+0 records in 2024-05-20T17:03:17.743 INFO:teuthology.orchestra.run.smithi062.stderr:10+0 records out 2024-05-20T17:03:17.743 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011302 s, 928 MB/s 2024-05-20T17:03:17.744 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping successful for: 2024-05-20T17:03:17.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:17 smithi171 ceph-mon[35901]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-20T17:03:17.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:17 smithi171 ceph-mon[35901]: from='osd.9 [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-05-20T17:03:17.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:17 smithi171 ceph-mon[35901]: osdmap e67: 10 total, 9 up, 10 in 2024-05-20T17:03:17.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:17 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:03:17.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:17 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:03:18.470 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi062:vg_nvme/lv_1 2024-05-20T17:03:18.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:18 smithi006 ceph-mon[32486]: purged_snaps scrub starts 2024-05-20T17:03:18.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:18 smithi006 ceph-mon[32486]: purged_snaps scrub ok 2024-05-20T17:03:18.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:18 smithi006 ceph-mon[32486]: osd.9 [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917] boot 2024-05-20T17:03:18.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:18 smithi006 ceph-mon[32486]: osdmap e68: 10 total, 10 up, 10 in 2024-05-20T17:03:18.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:18 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:03:18.719 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:03:18.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:18 smithi062 ceph-mon[35425]: purged_snaps scrub starts 2024-05-20T17:03:18.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:18 smithi062 ceph-mon[35425]: purged_snaps scrub ok 2024-05-20T17:03:18.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:18 smithi062 ceph-mon[35425]: osd.9 [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917] boot 2024-05-20T17:03:18.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:18 smithi062 ceph-mon[35425]: osdmap e68: 10 total, 10 up, 10 in 2024-05-20T17:03:18.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:18 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:03:18.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:18 smithi171 ceph-mon[35901]: purged_snaps scrub starts 2024-05-20T17:03:18.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:18 smithi171 ceph-mon[35901]: purged_snaps scrub ok 2024-05-20T17:03:18.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:18 smithi171 ceph-mon[35901]: osd.9 [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917] boot 2024-05-20T17:03:18.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:18 smithi171 ceph-mon[35901]: osdmap e68: 10 total, 10 up, 10 in 2024-05-20T17:03:18.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:18 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-20T17:03:19.431 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:19 smithi062 ceph-mon[35425]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:19.431 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:19 smithi062 ceph-mon[35425]: osdmap e69: 10 total, 10 up, 10 in 2024-05-20T17:03:19.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:19 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:19.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:19 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:19.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:19 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:19.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:19 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:19.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:19 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:19.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:19 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:19.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:19 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:19.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:19 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:19.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:19 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:03:19.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:19 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:19.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:19 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:03:19.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:19 smithi171 ceph-mon[35901]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:19.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:19 smithi171 ceph-mon[35901]: osdmap e69: 10 total, 10 up, 10 in 2024-05-20T17:03:19.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:19 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:19.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:19 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:19.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:19 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:19.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:19 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:19.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:19 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:19.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:19 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:19.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:19 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:19.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:19 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:19.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:19 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:03:19.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:19 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:19.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:19 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:03:19.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:19 smithi006 ceph-mon[32486]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:19.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:19 smithi006 ceph-mon[32486]: osdmap e69: 10 total, 10 up, 10 in 2024-05-20T17:03:19.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:19 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:19.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:19 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:19.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:19 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:19.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:19 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:19.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:19 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:19.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:19 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:19.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:19 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:19.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:19 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:19.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:19 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:03:19.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:19 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:19.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:19 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:03:20.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.454+0000 7fbf4e9b4700 1 -- 172.21.15.62:0/2370803112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf48103b80 msgr2=0x7fbf4810a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:03:20.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.454+0000 7fbf4e9b4700 1 --2- 172.21.15.62:0/2370803112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf48103b80 0x7fbf4810a430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000b0a0 tx=0x7fbf4000b3b0 comp rx=0 tx=0).stop 2024-05-20T17:03:20.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.455+0000 7fbf4e9b4700 1 -- 172.21.15.62:0/2370803112 shutdown_connections 2024-05-20T17:03:20.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.455+0000 7fbf4e9b4700 1 --2- 172.21.15.62:0/2370803112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf48103b80 0x7fbf4810a430 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:03:20.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.455+0000 7fbf4e9b4700 1 --2- 172.21.15.62:0/2370803112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf481020b0 0x7fbf481024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:03:20.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.455+0000 7fbf4e9b4700 1 --2- 172.21.15.62:0/2370803112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf481031e0 0x7fbf481035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:03:20.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.455+0000 7fbf4e9b4700 1 -- 172.21.15.62:0/2370803112 >> 172.21.15.62:0/2370803112 conn(0x7fbf480fd6f0 msgr2=0x7fbf480ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:03:20.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.455+0000 7fbf4e9b4700 1 -- 172.21.15.62:0/2370803112 shutdown_connections 2024-05-20T17:03:20.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.455+0000 7fbf4e9b4700 1 -- 172.21.15.62:0/2370803112 wait complete. 2024-05-20T17:03:20.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.455+0000 7fbf4e9b4700 1 Processor -- start 2024-05-20T17:03:20.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.455+0000 7fbf4e9b4700 1 -- start start 2024-05-20T17:03:20.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.456+0000 7fbf4e9b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf481020b0 0x7fbf481996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:03:20.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.456+0000 7fbf4e9b4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf481031e0 0x7fbf48199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:03:20.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.456+0000 7fbf4e9b4700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf48103b80 0x7fbf481a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:03:20.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.456+0000 7fbf4e9b4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4810ec90 con 0x7fbf481020b0 2024-05-20T17:03:20.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.456+0000 7fbf4e9b4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4810eb10 con 0x7fbf481031e0 2024-05-20T17:03:20.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.456+0000 7fbf4e9b4700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4810ee10 con 0x7fbf48103b80 2024-05-20T17:03:20.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.456+0000 7fbf3ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf481031e0 0x7fbf48199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:03:20.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.456+0000 7fbf3ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf481031e0 0x7fbf48199c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34450/0 (socket says 172.21.15.62:34450) 2024-05-20T17:03:20.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.456+0000 7fbf3ffff700 1 -- 172.21.15.62:0/2130494707 learned_addr learned my addr 172.21.15.62:0/2130494707 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-20T17:03:20.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.456+0000 7fbf47fff700 1 --2- 172.21.15.62:0/2130494707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf481020b0 0x7fbf481996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:03:20.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.456+0000 7fbf4cf51700 1 --2- 172.21.15.62:0/2130494707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf48103b80 0x7fbf481a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:03:20.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.456+0000 7fbf3ffff700 1 -- 172.21.15.62:0/2130494707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf48103b80 msgr2=0x7fbf481a0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:03:20.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.456+0000 7fbf3ffff700 1 --2- 172.21.15.62:0/2130494707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf48103b80 0x7fbf481a0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:03:20.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.456+0000 7fbf3ffff700 1 -- 172.21.15.62:0/2130494707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf481020b0 msgr2=0x7fbf481996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:03:20.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.456+0000 7fbf3ffff700 1 --2- 172.21.15.62:0/2130494707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf481020b0 0x7fbf481996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:03:20.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.456+0000 7fbf3ffff700 1 -- 172.21.15.62:0/2130494707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf481a11b0 con 0x7fbf481031e0 2024-05-20T17:03:20.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.456+0000 7fbf3ffff700 1 --2- 172.21.15.62:0/2130494707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf481031e0 0x7fbf48199c20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000c9b0 tx=0x7fbf3000ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:03:20.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.456+0000 7fbf45ffb700 1 -- 172.21.15.62:0/2130494707 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf30007b00 con 0x7fbf481031e0 2024-05-20T17:03:20.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.456+0000 7fbf4e9b4700 1 -- 172.21.15.62:0/2130494707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf481a14a0 con 0x7fbf481031e0 2024-05-20T17:03:20.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.457+0000 7fbf45ffb700 1 -- 172.21.15.62:0/2130494707 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbf30007ca0 con 0x7fbf481031e0 2024-05-20T17:03:20.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.457+0000 7fbf4e9b4700 1 -- 172.21.15.62:0/2130494707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf481a1a30 con 0x7fbf481031e0 2024-05-20T17:03:20.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.457+0000 7fbf45ffb700 1 -- 172.21.15.62:0/2130494707 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf30018660 con 0x7fbf481031e0 2024-05-20T17:03:20.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.457+0000 7fbf4e9b4700 1 -- 172.21.15.62:0/2130494707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf48050170 con 0x7fbf481031e0 2024-05-20T17:03:20.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.459+0000 7fbf45ffb700 1 -- 172.21.15.62:0/2130494707 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fbf3000f450 con 0x7fbf481031e0 2024-05-20T17:03:20.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.460+0000 7fbf45ffb700 1 --2- 172.21.15.62:0/2130494707 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbf340a2c20 0x7fbf340a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:03:20.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.460+0000 7fbf45ffb700 1 -- 172.21.15.62:0/2130494707 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6261+0+0 (secure 0 0 0) 0x7fbf300ceac0 con 0x7fbf481031e0 2024-05-20T17:03:20.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.460+0000 7fbf47fff700 1 --2- 172.21.15.62:0/2130494707 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbf340a2c20 0x7fbf340a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:03:20.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.461+0000 7fbf47fff700 1 --2- 172.21.15.62:0/2130494707 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbf340a2c20 0x7fbf340a5130 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbf481030e0 tx=0x7fbf3800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:03:20.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.463+0000 7fbf45ffb700 1 -- 172.21.15.62:0/2130494707 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbf30014030 con 0x7fbf481031e0 2024-05-20T17:03:20.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:20.678+0000 7fbf4e9b4700 1 -- 172.21.15.62:0/2130494707 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fbf48062a80 con 0x7fbf340a2c20 2024-05-20T17:03:20.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:20 smithi062 ceph-mon[35425]: Detected new or changed devices on smithi006 2024-05-20T17:03:20.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:20 smithi062 ceph-mon[35425]: Adjusting osd_memory_target on smithi006 to 4273M 2024-05-20T17:03:20.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:20 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:20.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:20 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:03:20.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:20 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:20.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:20 smithi171 ceph-mon[35901]: Detected new or changed devices on smithi006 2024-05-20T17:03:20.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:20 smithi171 ceph-mon[35901]: Adjusting osd_memory_target on smithi006 to 4273M 2024-05-20T17:03:20.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:20 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:20.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:20 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:03:20.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:20 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:20.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:20 smithi006 ceph-mon[32486]: Detected new or changed devices on smithi006 2024-05-20T17:03:20.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:20 smithi006 ceph-mon[32486]: Adjusting osd_memory_target on smithi006 to 4273M 2024-05-20T17:03:20.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:20 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:20.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:20 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:03:20.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:20 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:21.665 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:21 smithi062 ceph-mon[35425]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:21.665 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:21 smithi062 ceph-mon[35425]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:03:21.665 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:21 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:03:21.665 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:21 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:03:21.665 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:21 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:21.767 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:21 smithi171 ceph-mon[35901]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:21.767 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:21 smithi171 ceph-mon[35901]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:03:21.767 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:21 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:03:21.767 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:21 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:03:21.767 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:21 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:21.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:21 smithi006 ceph-mon[32486]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:21.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:21 smithi006 ceph-mon[32486]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:03:21.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:21 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:03:21.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:21 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:03:21.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:21 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:23.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:23 smithi062 ceph-mon[35425]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:23.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:23 smithi171 ceph-mon[35901]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:23 smithi006 ceph-mon[32486]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:24.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:24 smithi062 ceph-mon[35425]: from='client.? 172.21.15.62:0/1425699150' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f"}]: dispatch 2024-05-20T17:03:24.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:24 smithi062 ceph-mon[35425]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f"}]: dispatch 2024-05-20T17:03:24.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:24 smithi062 ceph-mon[35425]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f"}]': finished 2024-05-20T17:03:24.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:24 smithi062 ceph-mon[35425]: osdmap e70: 11 total, 10 up, 11 in 2024-05-20T17:03:24.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:24 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:03:24.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:24 smithi062 ceph-mon[35425]: from='client.? 172.21.15.62:0/1501635955' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:03:24.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:24 smithi171 ceph-mon[35901]: from='client.? 172.21.15.62:0/1425699150' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f"}]: dispatch 2024-05-20T17:03:24.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:24 smithi171 ceph-mon[35901]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f"}]: dispatch 2024-05-20T17:03:24.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:24 smithi171 ceph-mon[35901]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f"}]': finished 2024-05-20T17:03:24.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:24 smithi171 ceph-mon[35901]: osdmap e70: 11 total, 10 up, 11 in 2024-05-20T17:03:24.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:24 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:03:24.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:24 smithi171 ceph-mon[35901]: from='client.? 172.21.15.62:0/1501635955' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:03:24.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:24 smithi006 ceph-mon[32486]: from='client.? 172.21.15.62:0/1425699150' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f"}]: dispatch 2024-05-20T17:03:24.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:24 smithi006 ceph-mon[32486]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f"}]: dispatch 2024-05-20T17:03:24.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:24 smithi006 ceph-mon[32486]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f"}]': finished 2024-05-20T17:03:24.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:24 smithi006 ceph-mon[32486]: osdmap e70: 11 total, 10 up, 11 in 2024-05-20T17:03:24.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:24 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:03:24.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:24 smithi006 ceph-mon[32486]: from='client.? 172.21.15.62:0/1501635955' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:03:25.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:25 smithi171 ceph-mon[35901]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:25.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:25 smithi006 ceph-mon[32486]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:26.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:25 smithi062 ceph-mon[35425]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:27.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:27 smithi171 ceph-mon[35901]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:27.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:27 smithi006 ceph-mon[32486]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:28.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:27 smithi062 ceph-mon[35425]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:29.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:29 smithi062 ceph-mon[35425]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:29.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:29 smithi171 ceph-mon[35901]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:29.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:29 smithi006 ceph-mon[32486]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:31.859 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:31 smithi062 ceph-mon[35425]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:31.859 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:31 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-20T17:03:31.859 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:31 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:31.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:31 smithi171 ceph-mon[35901]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:31.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:31 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-20T17:03:31.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:31 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:31.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:31 smithi006 ceph-mon[32486]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:31.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:31 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-20T17:03:31.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:31 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:32.658 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:32 smithi062 ceph-mon[35425]: Deploying daemon osd.10 on smithi062 2024-05-20T17:03:32.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:32 smithi171 ceph-mon[35901]: Deploying daemon osd.10 on smithi062 2024-05-20T17:03:32.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:32 smithi006 ceph-mon[32486]: Deploying daemon osd.10 on smithi062 2024-05-20T17:03:33.725 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:33 smithi062 ceph-mon[35425]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:33.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:33 smithi171 ceph-mon[35901]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:33.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:33 smithi006 ceph-mon[32486]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:35.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:35 smithi171 ceph-mon[35901]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:35.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:35 smithi006 ceph-mon[32486]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:36.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:35 smithi062 ceph-mon[35425]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:37.743 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:37 smithi062 ceph-mon[35425]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:37.743 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:37 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:37.743 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:37 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:03:37.743 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:37 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:37.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:37 smithi171 ceph-mon[35901]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:37.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:37 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:37.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:37 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:03:37.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:37 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:37.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:37 smithi006 ceph-mon[32486]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:37.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:37 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:37.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:37 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:03:37.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:37 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:39.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:39 smithi171 ceph-mon[35901]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:39.866 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:39 smithi062 ceph-mon[35425]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:39.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:39 smithi006 ceph-mon[32486]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:41.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:41.248+0000 7fbf45ffb700 1 -- 172.21.15.62:0/2130494707 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fbf48062a80 con 0x7fbf340a2c20 2024-05-20T17:03:41.249 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 10 on host 'smithi062' 2024-05-20T17:03:41.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:41.250+0000 7fbf4e9b4700 1 -- 172.21.15.62:0/2130494707 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbf340a2c20 msgr2=0x7fbf340a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:03:41.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:41.250+0000 7fbf4e9b4700 1 --2- 172.21.15.62:0/2130494707 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbf340a2c20 0x7fbf340a5130 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbf481030e0 tx=0x7fbf3800a380 comp rx=0 tx=0).stop 2024-05-20T17:03:41.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:41.250+0000 7fbf4e9b4700 1 -- 172.21.15.62:0/2130494707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf481031e0 msgr2=0x7fbf48199c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:03:41.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:41.250+0000 7fbf4e9b4700 1 --2- 172.21.15.62:0/2130494707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf481031e0 0x7fbf48199c20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000c9b0 tx=0x7fbf3000ccc0 comp rx=0 tx=0).stop 2024-05-20T17:03:41.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:41.250+0000 7fbf4e9b4700 1 -- 172.21.15.62:0/2130494707 shutdown_connections 2024-05-20T17:03:41.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:41.250+0000 7fbf4e9b4700 1 --2- 172.21.15.62:0/2130494707 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbf340a2c20 0x7fbf340a5130 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:03:41.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:41.250+0000 7fbf4e9b4700 1 --2- 172.21.15.62:0/2130494707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf48103b80 0x7fbf481a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:03:41.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:41.250+0000 7fbf4e9b4700 1 --2- 172.21.15.62:0/2130494707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf481020b0 0x7fbf481996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:03:41.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:41.250+0000 7fbf4e9b4700 1 --2- 172.21.15.62:0/2130494707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf481031e0 0x7fbf48199c20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:03:41.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:41.250+0000 7fbf4e9b4700 1 -- 172.21.15.62:0/2130494707 >> 172.21.15.62:0/2130494707 conn(0x7fbf480fd6f0 msgr2=0x7fbf48106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:03:41.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:41.251+0000 7fbf4e9b4700 1 -- 172.21.15.62:0/2130494707 shutdown_connections 2024-05-20T17:03:41.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-20T17:03:41.251+0000 7fbf4e9b4700 1 -- 172.21.15.62:0/2130494707 wait complete. 2024-05-20T17:03:41.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:41 smithi062 ceph-mon[35425]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:41.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:41 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:41.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:41 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:41.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:41 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:41.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:41 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:03:41.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:41 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:41.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:41 smithi062 ceph-mon[35425]: from='osd.10 [v2:172.21.15.62:6824/2012507198,v1:172.21.15.62:6825/2012507198]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-20T17:03:41.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:41 smithi062 ceph-mon[35425]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-20T17:03:41.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:41 smithi171 ceph-mon[35901]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:41.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:41 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:41.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:41 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:41.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:41 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:41.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:41 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:03:41.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:41 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:41.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:41 smithi171 ceph-mon[35901]: from='osd.10 [v2:172.21.15.62:6824/2012507198,v1:172.21.15.62:6825/2012507198]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-20T17:03:41.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:41 smithi171 ceph-mon[35901]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-20T17:03:41.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:41 smithi006 ceph-mon[32486]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:41.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:41 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:41.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:41 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:41.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:41 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:41.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:41 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:03:41.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:41 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:41.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:41 smithi006 ceph-mon[32486]: from='osd.10 [v2:172.21.15.62:6824/2012507198,v1:172.21.15.62:6825/2012507198]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-20T17:03:41.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:41 smithi006 ceph-mon[32486]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-20T17:03:41.971 DEBUG:teuthology.orchestra.run.smithi062:osd.10> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.10.service 2024-05-20T17:03:41.973 INFO:tasks.cephadm:Deploying osd.11 on smithi171 with /dev/vg_nvme/lv_1... 2024-05-20T17:03:41.973 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-20T17:03:42.225 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:03:42.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:42.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:42.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:03:42.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:42 smithi171 ceph-mon[35901]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-20T17:03:42.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:42 smithi171 ceph-mon[35901]: from='osd.10 [v2:172.21.15.62:6824/2012507198,v1:172.21.15.62:6825/2012507198]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T17:03:42.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:42 smithi171 ceph-mon[35901]: osdmap e71: 11 total, 10 up, 11 in 2024-05-20T17:03:42.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:03:42.348 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:42 smithi171 ceph-mon[35901]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T17:03:42.486 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:42.486 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:42.486 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:03:42.486 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:42 smithi062 ceph-mon[35425]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-20T17:03:42.486 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:42 smithi062 ceph-mon[35425]: from='osd.10 [v2:172.21.15.62:6824/2012507198,v1:172.21.15.62:6825/2012507198]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T17:03:42.487 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:42 smithi062 ceph-mon[35425]: osdmap e71: 11 total, 10 up, 11 in 2024-05-20T17:03:42.487 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:03:42.487 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:42 smithi062 ceph-mon[35425]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T17:03:42.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:42.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:42.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:03:42.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:42 smithi006 ceph-mon[32486]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-20T17:03:42.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:42 smithi006 ceph-mon[32486]: from='osd.10 [v2:172.21.15.62:6824/2012507198,v1:172.21.15.62:6825/2012507198]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T17:03:42.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:42 smithi006 ceph-mon[32486]: osdmap e71: 11 total, 10 up, 11 in 2024-05-20T17:03:42.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:03:42.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:42 smithi006 ceph-mon[32486]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-20T17:03:42.772 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:03:42 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:03:42.585+0000 7f55e3408700 -1 osd.10 0 waiting for initial osdmap 2024-05-20T17:03:42.772 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:03:42 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:03:42.606+0000 7f55df1bd700 -1 osd.10 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:03:43.642 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:43 smithi171 ceph-mon[35901]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:43.642 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:43 smithi171 ceph-mon[35901]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-05-20T17:03:43.642 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:43 smithi171 ceph-mon[35901]: osdmap e72: 11 total, 10 up, 11 in 2024-05-20T17:03:43.643 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:03:43.643 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:03:43.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:43 smithi006 ceph-mon[32486]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:43.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:43 smithi006 ceph-mon[32486]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-05-20T17:03:43.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:43 smithi006 ceph-mon[32486]: osdmap e72: 11 total, 10 up, 11 in 2024-05-20T17:03:43.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:03:43.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:03:44.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:43 smithi062 ceph-mon[35425]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-05-20T17:03:44.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:43 smithi062 ceph-mon[35425]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-05-20T17:03:44.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:43 smithi062 ceph-mon[35425]: osdmap e72: 11 total, 10 up, 11 in 2024-05-20T17:03:44.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:03:44.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:03:44.379 INFO:teuthology.orchestra.run.smithi171.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-20T17:03:44.379 INFO:teuthology.orchestra.run.smithi171.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-20T17:03:44.379 INFO:teuthology.orchestra.run.smithi171.stderr: stderr: 10+0 records in 2024-05-20T17:03:44.380 INFO:teuthology.orchestra.run.smithi171.stderr:10+0 records out 2024-05-20T17:03:44.380 INFO:teuthology.orchestra.run.smithi171.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0131456 s, 798 MB/s 2024-05-20T17:03:44.380 INFO:teuthology.orchestra.run.smithi171.stderr:--> Zapping successful for: 2024-05-20T17:03:44.697 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:44 smithi171 ceph-mon[35901]: purged_snaps scrub starts 2024-05-20T17:03:44.697 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:44 smithi171 ceph-mon[35901]: purged_snaps scrub ok 2024-05-20T17:03:44.697 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:44 smithi171 ceph-mon[35901]: osd.10 [v2:172.21.15.62:6824/2012507198,v1:172.21.15.62:6825/2012507198] boot 2024-05-20T17:03:44.697 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:44 smithi171 ceph-mon[35901]: osdmap e73: 11 total, 11 up, 11 in 2024-05-20T17:03:44.697 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:44 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:03:44.697 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:44 smithi171 ceph-mon[35901]: osdmap e74: 11 total, 11 up, 11 in 2024-05-20T17:03:44.707 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:44 smithi062 ceph-mon[35425]: purged_snaps scrub starts 2024-05-20T17:03:44.707 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:44 smithi062 ceph-mon[35425]: purged_snaps scrub ok 2024-05-20T17:03:44.707 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:44 smithi062 ceph-mon[35425]: osd.10 [v2:172.21.15.62:6824/2012507198,v1:172.21.15.62:6825/2012507198] boot 2024-05-20T17:03:44.707 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:44 smithi062 ceph-mon[35425]: osdmap e73: 11 total, 11 up, 11 in 2024-05-20T17:03:44.708 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:44 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:03:44.708 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:44 smithi062 ceph-mon[35425]: osdmap e74: 11 total, 11 up, 11 in 2024-05-20T17:03:44.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:44 smithi006 ceph-mon[32486]: purged_snaps scrub starts 2024-05-20T17:03:44.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:44 smithi006 ceph-mon[32486]: purged_snaps scrub ok 2024-05-20T17:03:44.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:44 smithi006 ceph-mon[32486]: osd.10 [v2:172.21.15.62:6824/2012507198,v1:172.21.15.62:6825/2012507198] boot 2024-05-20T17:03:44.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:44 smithi006 ceph-mon[32486]: osdmap e73: 11 total, 11 up, 11 in 2024-05-20T17:03:44.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:44 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-20T17:03:44.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:44 smithi006 ceph-mon[32486]: osdmap e74: 11 total, 11 up, 11 in 2024-05-20T17:03:45.032 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph orch daemon add osd smithi171:vg_nvme/lv_1 2024-05-20T17:03:45.296 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:03:45.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:45 smithi171 ceph-mon[35901]: pgmap v244: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:03:45.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:45 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:45.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:45 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:45.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:45 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:45.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:45 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:45.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:45 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:45.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:45 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:45.673 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:45 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:45.673 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:45 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:45.673 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:45 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:03:45.673 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:45 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:45.673 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:45 smithi171 ceph-mon[35901]: osdmap e75: 11 total, 11 up, 11 in 2024-05-20T17:03:45.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:45 smithi006 ceph-mon[32486]: pgmap v244: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:03:45.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:45.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:45.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:45.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:45.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:45.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:45.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:45.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:45.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:03:45.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:45.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:45 smithi006 ceph-mon[32486]: osdmap e75: 11 total, 11 up, 11 in 2024-05-20T17:03:46.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:45 smithi062 ceph-mon[35425]: pgmap v244: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:03:46.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:45 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:46.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:45 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:46.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:45 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:46.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:45 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:46.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:45 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:46.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:45 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:03:46.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:45 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:46.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:45 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:46.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:45 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:03:46.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:45 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:03:46.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:45 smithi062 ceph-mon[35425]: osdmap e75: 11 total, 11 up, 11 in 2024-05-20T17:03:46.715 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:46 smithi171 ceph-mon[35901]: Detected new or changed devices on smithi062 2024-05-20T17:03:46.715 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:46 smithi171 ceph-mon[35901]: Adjusting osd_memory_target on smithi062 to 4272M 2024-05-20T17:03:46.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:46 smithi006 ceph-mon[32486]: Detected new or changed devices on smithi062 2024-05-20T17:03:46.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:46 smithi006 ceph-mon[32486]: Adjusting osd_memory_target on smithi062 to 4272M 2024-05-20T17:03:46.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.944+0000 7f2abdc2b700 1 -- 172.21.15.171:0/592525892 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ab81020c0 msgr2=0x7f2ab81024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:03:46.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.944+0000 7f2abdc2b700 1 --2- 172.21.15.171:0/592525892 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ab81020c0 0x7f2ab81024d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009990 tx=0x7f2aa8009ca0 comp rx=0 tx=0).stop 2024-05-20T17:03:46.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.944+0000 7f2abdc2b700 1 -- 172.21.15.171:0/592525892 shutdown_connections 2024-05-20T17:03:46.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.944+0000 7f2abdc2b700 1 --2- 172.21.15.171:0/592525892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ab8103b90 0x7f2ab810a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:03:46.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.944+0000 7f2abdc2b700 1 --2- 172.21.15.171:0/592525892 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ab81020c0 0x7f2ab81024d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:03:46.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.944+0000 7f2abdc2b700 1 --2- 172.21.15.171:0/592525892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab81031f0 0x7f2ab8103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:03:46.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.944+0000 7f2abdc2b700 1 -- 172.21.15.171:0/592525892 >> 172.21.15.171:0/592525892 conn(0x7f2ab80fd700 msgr2=0x7f2ab80ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:03:46.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.944+0000 7f2abdc2b700 1 -- 172.21.15.171:0/592525892 shutdown_connections 2024-05-20T17:03:46.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.944+0000 7f2abdc2b700 1 -- 172.21.15.171:0/592525892 wait complete. 2024-05-20T17:03:46.945 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.944+0000 7f2abdc2b700 1 Processor -- start 2024-05-20T17:03:46.946 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.945+0000 7f2abdc2b700 1 -- start start 2024-05-20T17:03:46.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.945+0000 7f2abdc2b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ab81020c0 0x7f2ab806af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:03:46.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.945+0000 7f2abdc2b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab81031f0 0x7f2ab819e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:03:46.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.945+0000 7f2abdc2b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ab8103b90 0x7f2ab81a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:03:46.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.945+0000 7f2abdc2b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab810db80 con 0x7f2ab81031f0 2024-05-20T17:03:46.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.945+0000 7f2abdc2b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab810da00 con 0x7f2ab81020c0 2024-05-20T17:03:46.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.945+0000 7f2abdc2b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab810dd00 con 0x7f2ab8103b90 2024-05-20T17:03:46.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.945+0000 7f2ab7fff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ab8103b90 0x7f2ab81a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:03:46.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.945+0000 7f2ab7fff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ab8103b90 0x7f2ab81a0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:35332/0 (socket says 172.21.15.171:35332) 2024-05-20T17:03:46.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.945+0000 7f2ab7fff700 1 -- 172.21.15.171:0/2195477376 learned_addr learned my addr 172.21.15.171:0/2195477376 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T17:03:46.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.945+0000 7f2ab77fe700 1 --2- 172.21.15.171:0/2195477376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ab81020c0 0x7f2ab806af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:03:46.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.945+0000 7f2ab6ffd700 1 --2- 172.21.15.171:0/2195477376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab81031f0 0x7f2ab819e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:03:46.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.945+0000 7f2ab7fff700 1 -- 172.21.15.171:0/2195477376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ab81020c0 msgr2=0x7f2ab806af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:03:46.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.945+0000 7f2ab7fff700 1 --2- 172.21.15.171:0/2195477376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ab81020c0 0x7f2ab806af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:03:46.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.945+0000 7f2ab7fff700 1 -- 172.21.15.171:0/2195477376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab81031f0 msgr2=0x7f2ab819e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:03:46.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.945+0000 7f2ab7fff700 1 --2- 172.21.15.171:0/2195477376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab81031f0 0x7f2ab819e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:03:46.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.945+0000 7f2ab7fff700 1 -- 172.21.15.171:0/2195477376 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab81a1350 con 0x7f2ab8103b90 2024-05-20T17:03:46.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.946+0000 7f2ab7fff700 1 --2- 172.21.15.171:0/2195477376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ab8103b90 0x7f2ab81a0b20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0007ee0 tx=0x7f2ab000d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:03:46.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.946+0000 7f2ab4ff9700 1 -- 172.21.15.171:0/2195477376 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab000dbd0 con 0x7f2ab8103b90 2024-05-20T17:03:46.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.946+0000 7f2abdc2b700 1 -- 172.21.15.171:0/2195477376 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab81a1640 con 0x7f2ab8103b90 2024-05-20T17:03:46.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.946+0000 7f2ab4ff9700 1 -- 172.21.15.171:0/2195477376 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ab000dd70 con 0x7f2ab8103b90 2024-05-20T17:03:46.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.946+0000 7f2ab4ff9700 1 -- 172.21.15.171:0/2195477376 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0005a20 con 0x7f2ab8103b90 2024-05-20T17:03:46.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.946+0000 7f2abdc2b700 1 -- 172.21.15.171:0/2195477376 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab81a1b80 con 0x7f2ab8103b90 2024-05-20T17:03:46.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.947+0000 7f2abdc2b700 1 -- 172.21.15.171:0/2195477376 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ab8050170 con 0x7f2ab8103b90 2024-05-20T17:03:46.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.949+0000 7f2ab4ff9700 1 -- 172.21.15.171:0/2195477376 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f2ab001a020 con 0x7f2ab8103b90 2024-05-20T17:03:46.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.950+0000 7f2ab4ff9700 1 --2- 172.21.15.171:0/2195477376 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2aa00a2c20 0x7f2aa00a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:03:46.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.950+0000 7f2ab4ff9700 1 -- 172.21.15.171:0/2195477376 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6694+0+0 (secure 0 0 0) 0x7f2ab00ce890 con 0x7f2ab8103b90 2024-05-20T17:03:46.950 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.950+0000 7f2ab77fe700 1 --2- 172.21.15.171:0/2195477376 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2aa00a2c20 0x7f2aa00a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:03:46.950 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.951+0000 7f2ab77fe700 1 --2- 172.21.15.171:0/2195477376 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2aa00a2c20 0x7f2aa00a5130 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2aa80038b0 tx=0x7f2aa801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:03:46.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:46.953+0000 7f2ab4ff9700 1 -- 172.21.15.171:0/2195477376 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2ab0010070 con 0x7f2ab8103b90 2024-05-20T17:03:47.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:46 smithi062 ceph-mon[35425]: Detected new or changed devices on smithi062 2024-05-20T17:03:47.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:46 smithi062 ceph-mon[35425]: Adjusting osd_memory_target on smithi062 to 4272M 2024-05-20T17:03:47.157 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:03:47.157+0000 7f2abdc2b700 1 -- 172.21.15.171:0/2195477376 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f2ab8062a80 con 0x7f2aa00a2c20 2024-05-20T17:03:47.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:47 smithi171 ceph-mon[35901]: pgmap v247: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:03:47.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:47 smithi171 ceph-mon[35901]: osdmap e76: 11 total, 11 up, 11 in 2024-05-20T17:03:47.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:47 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:03:47.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:47 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:03:47.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:47 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:47.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:47 smithi006 ceph-mon[32486]: pgmap v247: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:03:47.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:47 smithi006 ceph-mon[32486]: osdmap e76: 11 total, 11 up, 11 in 2024-05-20T17:03:47.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:47 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:03:47.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:47 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:03:47.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:47 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:48.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:47 smithi062 ceph-mon[35425]: pgmap v247: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:03:48.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:47 smithi062 ceph-mon[35425]: osdmap e76: 11 total, 11 up, 11 in 2024-05-20T17:03:48.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:47 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-20T17:03:48.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:47 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-20T17:03:48.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:47 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:48.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:48 smithi171 ceph-mon[35901]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:03:48.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:48 smithi171 ceph-mon[35901]: osdmap e77: 11 total, 11 up, 11 in 2024-05-20T17:03:48.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:48 smithi006 ceph-mon[32486]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:03:48.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:48 smithi006 ceph-mon[32486]: osdmap e77: 11 total, 11 up, 11 in 2024-05-20T17:03:49.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:48 smithi062 ceph-mon[35425]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:03:49.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:48 smithi062 ceph-mon[35425]: osdmap e77: 11 total, 11 up, 11 in 2024-05-20T17:03:49.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:49 smithi006 ceph-mon[32486]: pgmap v250: 1 pgs: 1 remapped+peering; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:03:50.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:49 smithi062 ceph-mon[35425]: pgmap v250: 1 pgs: 1 remapped+peering; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:03:50.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:49 smithi171 ceph-mon[35901]: pgmap v250: 1 pgs: 1 remapped+peering; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:03:50.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:50 smithi171 ceph-mon[35901]: from='client.? 172.21.15.171:0/3652525117' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11cd0c8a-f493-4c30-8324-11adc674c650"}]: dispatch 2024-05-20T17:03:50.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:50 smithi171 ceph-mon[35901]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11cd0c8a-f493-4c30-8324-11adc674c650"}]: dispatch 2024-05-20T17:03:50.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:50 smithi171 ceph-mon[35901]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "11cd0c8a-f493-4c30-8324-11adc674c650"}]': finished 2024-05-20T17:03:50.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:50 smithi171 ceph-mon[35901]: osdmap e78: 12 total, 11 up, 12 in 2024-05-20T17:03:50.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:50 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:03:50.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:50 smithi006 ceph-mon[32486]: from='client.? 172.21.15.171:0/3652525117' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11cd0c8a-f493-4c30-8324-11adc674c650"}]: dispatch 2024-05-20T17:03:50.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:50 smithi006 ceph-mon[32486]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11cd0c8a-f493-4c30-8324-11adc674c650"}]: dispatch 2024-05-20T17:03:50.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:50 smithi006 ceph-mon[32486]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "11cd0c8a-f493-4c30-8324-11adc674c650"}]': finished 2024-05-20T17:03:50.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:50 smithi006 ceph-mon[32486]: osdmap e78: 12 total, 11 up, 12 in 2024-05-20T17:03:50.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:50 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:03:51.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:50 smithi062 ceph-mon[35425]: from='client.? 172.21.15.171:0/3652525117' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11cd0c8a-f493-4c30-8324-11adc674c650"}]: dispatch 2024-05-20T17:03:51.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:50 smithi062 ceph-mon[35425]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11cd0c8a-f493-4c30-8324-11adc674c650"}]: dispatch 2024-05-20T17:03:51.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:50 smithi062 ceph-mon[35425]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "11cd0c8a-f493-4c30-8324-11adc674c650"}]': finished 2024-05-20T17:03:51.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:50 smithi062 ceph-mon[35425]: osdmap e78: 12 total, 11 up, 12 in 2024-05-20T17:03:51.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:50 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:03:51.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:51 smithi006 ceph-mon[32486]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-05-20T17:03:51.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:51 smithi006 ceph-mon[32486]: from='client.? 172.21.15.171:0/2420209012' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:03:52.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:51 smithi062 ceph-mon[35425]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-05-20T17:03:52.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:51 smithi062 ceph-mon[35425]: from='client.? 172.21.15.171:0/2420209012' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:03:52.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:51 smithi171 ceph-mon[35901]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-05-20T17:03:52.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:51 smithi171 ceph-mon[35901]: from='client.? 172.21.15.171:0/2420209012' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-20T17:03:53.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:53 smithi006 ceph-mon[32486]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-20T17:03:54.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:53 smithi062 ceph-mon[35425]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-20T17:03:54.112 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:53 smithi171 ceph-mon[35901]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-20T17:03:55.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:55 smithi171 ceph-mon[35901]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-05-20T17:03:55.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:55 smithi006 ceph-mon[32486]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-05-20T17:03:56.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:55 smithi062 ceph-mon[35425]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-05-20T17:03:57.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:57 smithi171 ceph-mon[35901]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-05-20T17:03:58.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:57 smithi062 ceph-mon[35425]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-05-20T17:03:58.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:57 smithi006 ceph-mon[32486]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-05-20T17:03:58.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:58 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-20T17:03:58.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:58 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:58.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:58 smithi171 ceph-mon[35901]: Deploying daemon osd.11 on smithi171 2024-05-20T17:03:59.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:58 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-20T17:03:59.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:58 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:59.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:58 smithi062 ceph-mon[35425]: Deploying daemon osd.11 on smithi171 2024-05-20T17:03:59.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:58 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-20T17:03:59.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:58 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:03:59.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:58 smithi006 ceph-mon[32486]: Deploying daemon osd.11 on smithi171 2024-05-20T17:03:59.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:03:59 smithi171 ceph-mon[35901]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T17:04:00.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:03:59 smithi062 ceph-mon[35425]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T17:04:00.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:03:59 smithi006 ceph-mon[32486]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-20T17:04:01.847 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:01 smithi171 ceph-mon[35901]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:04:02.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:01 smithi062 ceph-mon[35425]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:04:02.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:01 smithi006 ceph-mon[32486]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:04:03.911 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:03 smithi171 ceph-mon[35901]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:04:03.912 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:03 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:03.912 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:03 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:04:03.912 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:03 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:04.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:03 smithi062 ceph-mon[35425]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:04:04.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:03 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:04.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:03 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:04:04.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:03 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:04.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:03 smithi006 ceph-mon[32486]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:04:04.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:03 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:04.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:03 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:04:04.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:03 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:05.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:05 smithi171 ceph-mon[35901]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:04:06.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:05 smithi062 ceph-mon[35425]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:04:06.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:05 smithi006 ceph-mon[32486]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:04:07.430 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:07.430+0000 7f2ab4ff9700 1 -- 172.21.15.171:0/2195477376 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f2ab8062a80 con 0x7f2aa00a2c20 2024-05-20T17:04:07.430 INFO:teuthology.orchestra.run.smithi171.stdout:Created osd(s) 11 on host 'smithi171' 2024-05-20T17:04:07.432 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:07.432+0000 7f2abdc2b700 1 -- 172.21.15.171:0/2195477376 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2aa00a2c20 msgr2=0x7f2aa00a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:07.432 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:07.432+0000 7f2abdc2b700 1 --2- 172.21.15.171:0/2195477376 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2aa00a2c20 0x7f2aa00a5130 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2aa80038b0 tx=0x7f2aa801a040 comp rx=0 tx=0).stop 2024-05-20T17:04:07.432 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:07.432+0000 7f2abdc2b700 1 -- 172.21.15.171:0/2195477376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ab8103b90 msgr2=0x7f2ab81a0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:07.432 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:07.432+0000 7f2abdc2b700 1 --2- 172.21.15.171:0/2195477376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ab8103b90 0x7f2ab81a0b20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0007ee0 tx=0x7f2ab000d3b0 comp rx=0 tx=0).stop 2024-05-20T17:04:07.432 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:07.432+0000 7f2abdc2b700 1 -- 172.21.15.171:0/2195477376 shutdown_connections 2024-05-20T17:04:07.433 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:07.432+0000 7f2abdc2b700 1 --2- 172.21.15.171:0/2195477376 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2aa00a2c20 0x7f2aa00a5130 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:07.433 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:07.432+0000 7f2abdc2b700 1 --2- 172.21.15.171:0/2195477376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ab8103b90 0x7f2ab81a0b20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:07.433 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:07.432+0000 7f2abdc2b700 1 --2- 172.21.15.171:0/2195477376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ab81020c0 0x7f2ab806af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:07.433 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:07.432+0000 7f2abdc2b700 1 --2- 172.21.15.171:0/2195477376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab81031f0 0x7f2ab819e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:07.433 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:07.432+0000 7f2abdc2b700 1 -- 172.21.15.171:0/2195477376 >> 172.21.15.171:0/2195477376 conn(0x7f2ab80fd700 msgr2=0x7f2ab8106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:07.433 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:07.432+0000 7f2abdc2b700 1 -- 172.21.15.171:0/2195477376 shutdown_connections 2024-05-20T17:04:07.433 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:07.432+0000 7f2abdc2b700 1 -- 172.21.15.171:0/2195477376 wait complete. 2024-05-20T17:04:07.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:07 smithi171 ceph-mon[35901]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:04:07.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:07.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:07.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:07.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:04:07.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:07.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:07.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:04:07.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:07.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:07 smithi171 ceph-mon[35901]: from='osd.11 [v2:172.21.15.171:6824/698174151,v1:172.21.15.171:6825/698174151]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-20T17:04:07.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:07 smithi171 ceph-mon[35901]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-20T17:04:07.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:07 smithi006 ceph-mon[32486]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:04:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:04:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:04:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:07 smithi006 ceph-mon[32486]: from='osd.11 [v2:172.21.15.171:6824/698174151,v1:172.21.15.171:6825/698174151]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-20T17:04:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:07 smithi006 ceph-mon[32486]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-20T17:04:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:07 smithi062 ceph-mon[35425]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:04:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:04:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:04:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:07 smithi062 ceph-mon[35425]: from='osd.11 [v2:172.21.15.171:6824/698174151,v1:172.21.15.171:6825/698174151]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-20T17:04:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:07 smithi062 ceph-mon[35425]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-20T17:04:08.139 DEBUG:teuthology.orchestra.run.smithi171:osd.11> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.11.service 2024-05-20T17:04:08.141 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-05-20T17:04:08.141 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph osd stat -f json 2024-05-20T17:04:08.404 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:04:09.690 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:09 smithi171 ceph-mon[35901]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:04:09.690 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:09 smithi171 ceph-mon[35901]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-20T17:04:09.690 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:09 smithi171 ceph-mon[35901]: from='osd.11 [v2:172.21.15.171:6824/698174151,v1:172.21.15.171:6825/698174151]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:04:09.690 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:09 smithi171 ceph-mon[35901]: osdmap e79: 12 total, 11 up, 12 in 2024-05-20T17:04:09.690 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:09 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:04:09.690 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:09 smithi171 ceph-mon[35901]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:04:09.698 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:09 smithi006 ceph-mon[32486]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:04:09.698 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:09 smithi006 ceph-mon[32486]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-20T17:04:09.699 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:09 smithi006 ceph-mon[32486]: from='osd.11 [v2:172.21.15.171:6824/698174151,v1:172.21.15.171:6825/698174151]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:04:09.699 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:09 smithi006 ceph-mon[32486]: osdmap e79: 12 total, 11 up, 12 in 2024-05-20T17:04:09.699 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:09 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:04:09.699 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:09 smithi006 ceph-mon[32486]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:04:09.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:09 smithi062 ceph-mon[35425]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:04:09.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:09 smithi062 ceph-mon[35425]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-20T17:04:09.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:09 smithi062 ceph-mon[35425]: from='osd.11 [v2:172.21.15.171:6824/698174151,v1:172.21.15.171:6825/698174151]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:04:09.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:09 smithi062 ceph-mon[35425]: osdmap e79: 12 total, 11 up, 12 in 2024-05-20T17:04:09.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:09 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:04:09.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:09 smithi062 ceph-mon[35425]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-20T17:04:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.357+0000 7ff55d6e8700 1 -- 172.21.15.6:0/3465704586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff558106620 msgr2=0x7ff558108a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.357+0000 7ff55d6e8700 1 --2- 172.21.15.6:0/3465704586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff558106620 0x7ff558108a40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff540009990 tx=0x7ff540009ca0 comp rx=0 tx=0).stop 2024-05-20T17:04:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.357+0000 7ff55d6e8700 1 -- 172.21.15.6:0/3465704586 shutdown_connections 2024-05-20T17:04:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.357+0000 7ff55d6e8700 1 --2- 172.21.15.6:0/3465704586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff558108f80 0x7ff55810b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.357+0000 7ff55d6e8700 1 --2- 172.21.15.6:0/3465704586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff558103cc0 0x7ff5581060e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.357+0000 7ff55d6e8700 1 --2- 172.21.15.6:0/3465704586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff558106620 0x7ff558108a40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.357+0000 7ff55d6e8700 1 -- 172.21.15.6:0/3465704586 >> 172.21.15.6:0/3465704586 conn(0x7ff5580fd700 msgr2=0x7ff5580ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.357+0000 7ff55d6e8700 1 -- 172.21.15.6:0/3465704586 shutdown_connections 2024-05-20T17:04:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.357+0000 7ff55d6e8700 1 -- 172.21.15.6:0/3465704586 wait complete. 2024-05-20T17:04:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.357+0000 7ff55d6e8700 1 Processor -- start 2024-05-20T17:04:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.357+0000 7ff55d6e8700 1 -- start start 2024-05-20T17:04:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff55d6e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff558103cc0 0x7ff558199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff55d6e8700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff558106620 0x7ff558199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff55d6e8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff558108f80 0x7ff5581a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff55d6e8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff55810ec10 con 0x7ff558103cc0 2024-05-20T17:04:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff55d6e8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff55810ea90 con 0x7ff558108f80 2024-05-20T17:04:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff55d6e8700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff55810ed90 con 0x7ff558106620 2024-05-20T17:04:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff556ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff558103cc0 0x7ff558199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff556ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff558103cc0 0x7ff558199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47364/0 (socket says 172.21.15.6:47364) 2024-05-20T17:04:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff556ffd700 1 -- 172.21.15.6:0/103287502 learned_addr learned my addr 172.21.15.6:0/103287502 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff54ffff700 1 --2- 172.21.15.6:0/103287502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff558106620 0x7ff558199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff5577fe700 1 --2- 172.21.15.6:0/103287502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff558108f80 0x7ff5581a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:10.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff556ffd700 1 -- 172.21.15.6:0/103287502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff558106620 msgr2=0x7ff558199cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:10.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff556ffd700 1 --2- 172.21.15.6:0/103287502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff558106620 0x7ff558199cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:10.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff556ffd700 1 -- 172.21.15.6:0/103287502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff558108f80 msgr2=0x7ff5581a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:10.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff556ffd700 1 --2- 172.21.15.6:0/103287502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff558108f80 0x7ff5581a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:10.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff556ffd700 1 -- 172.21.15.6:0/103287502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5581a12e0 con 0x7ff558103cc0 2024-05-20T17:04:10.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff556ffd700 1 --2- 172.21.15.6:0/103287502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff558103cc0 0x7ff558199780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff54800e970 tx=0x7ff54800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:10.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff554ff9700 1 -- 172.21.15.6:0/103287502 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff548004a30 con 0x7ff558103cc0 2024-05-20T17:04:10.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff55d6e8700 1 -- 172.21.15.6:0/103287502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5581a15d0 con 0x7ff558103cc0 2024-05-20T17:04:10.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff554ff9700 1 -- 172.21.15.6:0/103287502 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff54800cc90 con 0x7ff558103cc0 2024-05-20T17:04:10.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.358+0000 7ff554ff9700 1 -- 172.21.15.6:0/103287502 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5480055e0 con 0x7ff558103cc0 2024-05-20T17:04:10.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.359+0000 7ff55d6e8700 1 -- 172.21.15.6:0/103287502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5581a1b60 con 0x7ff558103cc0 2024-05-20T17:04:10.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.360+0000 7ff55d6e8700 1 -- 172.21.15.6:0/103287502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff558050170 con 0x7ff558103cc0 2024-05-20T17:04:10.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.361+0000 7ff554ff9700 1 -- 172.21.15.6:0/103287502 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ff54800c7e0 con 0x7ff558103cc0 2024-05-20T17:04:10.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.362+0000 7ff554ff9700 1 --2- 172.21.15.6:0/103287502 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff5440a2c20 0x7ff5440a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:10.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.362+0000 7ff54ffff700 1 --2- 172.21.15.6:0/103287502 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff5440a2c20 0x7ff5440a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:10.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.362+0000 7ff554ff9700 1 -- 172.21.15.6:0/103287502 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6847+0+0 (secure 0 0 0) 0x7ff5480ceee0 con 0x7ff558103cc0 2024-05-20T17:04:10.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.362+0000 7ff54ffff700 1 --2- 172.21.15.6:0/103287502 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff5440a2c20 0x7ff5440a5130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff54000b2e0 tx=0x7ff54000b7e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:10.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.366+0000 7ff554ff9700 1 -- 172.21.15.6:0/103287502 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff548053850 con 0x7ff558103cc0 2024-05-20T17:04:10.438 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:10 smithi171 ceph-mon[35901]: purged_snaps scrub starts 2024-05-20T17:04:10.438 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:10 smithi171 ceph-mon[35901]: purged_snaps scrub ok 2024-05-20T17:04:10.438 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:10 smithi171 ceph-mon[35901]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-20T17:04:10.438 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:10 smithi171 ceph-mon[35901]: osdmap e80: 12 total, 11 up, 12 in 2024-05-20T17:04:10.438 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:10 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:04:10.438 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:10 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:04:10.438 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:10 smithi171 ceph-mon[35901]: from='osd.11 ' entity='osd.11' 2024-05-20T17:04:10.439 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:04:10 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:04:10.178+0000 7fe709406700 -1 osd.11 0 waiting for initial osdmap 2024-05-20T17:04:10.439 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:04:10 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:04:10.193+0000 7fe7011b3700 -1 osd.11 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:04:10.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:10 smithi062 ceph-mon[35425]: purged_snaps scrub starts 2024-05-20T17:04:10.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:10 smithi062 ceph-mon[35425]: purged_snaps scrub ok 2024-05-20T17:04:10.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:10 smithi062 ceph-mon[35425]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-20T17:04:10.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:10 smithi062 ceph-mon[35425]: osdmap e80: 12 total, 11 up, 12 in 2024-05-20T17:04:10.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:10 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:04:10.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:10 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:04:10.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:10 smithi062 ceph-mon[35425]: from='osd.11 ' entity='osd.11' 2024-05-20T17:04:10.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.572+0000 7ff55d6e8700 1 -- 172.21.15.6:0/103287502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7ff55802dc60 con 0x7ff558103cc0 2024-05-20T17:04:10.572 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:10 smithi006 ceph-mon[32486]: purged_snaps scrub starts 2024-05-20T17:04:10.572 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:10 smithi006 ceph-mon[32486]: purged_snaps scrub ok 2024-05-20T17:04:10.572 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:10 smithi006 ceph-mon[32486]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-20T17:04:10.572 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:10 smithi006 ceph-mon[32486]: osdmap e80: 12 total, 11 up, 12 in 2024-05-20T17:04:10.572 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:10 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:04:10.572 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:10 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:04:10.572 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:10 smithi006 ceph-mon[32486]: from='osd.11 ' entity='osd.11' 2024-05-20T17:04:10.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.573+0000 7ff554ff9700 1 -- 172.21.15.6:0/103287502 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) ==== 74+0+133 (secure 0 0 0) 0x7ff54809c360 con 0x7ff558103cc0 2024-05-20T17:04:10.573 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:04:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.576+0000 7ff55d6e8700 1 -- 172.21.15.6:0/103287502 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff5440a2c20 msgr2=0x7ff5440a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.576+0000 7ff55d6e8700 1 --2- 172.21.15.6:0/103287502 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff5440a2c20 0x7ff5440a5130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff54000b2e0 tx=0x7ff54000b7e0 comp rx=0 tx=0).stop 2024-05-20T17:04:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.576+0000 7ff55d6e8700 1 -- 172.21.15.6:0/103287502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff558103cc0 msgr2=0x7ff558199780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.576+0000 7ff55d6e8700 1 --2- 172.21.15.6:0/103287502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff558103cc0 0x7ff558199780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff54800e970 tx=0x7ff54800ec80 comp rx=0 tx=0).stop 2024-05-20T17:04:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.576+0000 7ff55d6e8700 1 -- 172.21.15.6:0/103287502 shutdown_connections 2024-05-20T17:04:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.576+0000 7ff55d6e8700 1 --2- 172.21.15.6:0/103287502 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff5440a2c20 0x7ff5440a5130 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.576+0000 7ff55d6e8700 1 --2- 172.21.15.6:0/103287502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff558108f80 0x7ff5581a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.576+0000 7ff55d6e8700 1 --2- 172.21.15.6:0/103287502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff558103cc0 0x7ff558199780 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.576+0000 7ff55d6e8700 1 --2- 172.21.15.6:0/103287502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff558106620 0x7ff558199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.576+0000 7ff55d6e8700 1 -- 172.21.15.6:0/103287502 >> 172.21.15.6:0/103287502 conn(0x7ff5580fd700 msgr2=0x7ff558104c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.576+0000 7ff55d6e8700 1 -- 172.21.15.6:0/103287502 shutdown_connections 2024-05-20T17:04:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:10.576+0000 7ff55d6e8700 1 -- 172.21.15.6:0/103287502 wait complete. 2024-05-20T17:04:11.335 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":80,"num_osds":12,"num_up_osds":11,"osd_up_since":1716224623,"num_in_osds":12,"osd_in_since":1716224630,"num_remapped_pgs":0} 2024-05-20T17:04:11.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:11 smithi006 ceph-mon[32486]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:04:11.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:04:11.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:11 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/103287502' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-20T17:04:11.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:11 smithi006 ceph-mon[32486]: osd.11 [v2:172.21.15.171:6824/698174151,v1:172.21.15.171:6825/698174151] boot 2024-05-20T17:04:11.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:11 smithi006 ceph-mon[32486]: osdmap e81: 12 total, 12 up, 12 in 2024-05-20T17:04:11.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:11 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:04:11.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:11 smithi062 ceph-mon[35425]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:04:11.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:11 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:04:11.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:11 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/103287502' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-20T17:04:11.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:11 smithi062 ceph-mon[35425]: osd.11 [v2:172.21.15.171:6824/698174151,v1:172.21.15.171:6825/698174151] boot 2024-05-20T17:04:11.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:11 smithi062 ceph-mon[35425]: osdmap e81: 12 total, 12 up, 12 in 2024-05-20T17:04:11.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:11 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:04:11.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:11 smithi171 ceph-mon[35901]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-05-20T17:04:11.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:11 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:04:11.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:11 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/103287502' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-20T17:04:11.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:11 smithi171 ceph-mon[35901]: osd.11 [v2:172.21.15.171:6824/698174151,v1:172.21.15.171:6825/698174151] boot 2024-05-20T17:04:11.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:11 smithi171 ceph-mon[35901]: osdmap e81: 12 total, 12 up, 12 in 2024-05-20T17:04:11.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:11 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-20T17:04:12.336 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph osd stat -f json 2024-05-20T17:04:12.591 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:04:12.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:12 smithi006 ceph-mon[32486]: Detected new or changed devices on smithi171 2024-05-20T17:04:12.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:12 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:12.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:12 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:12.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:12 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:04:12.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:12 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:04:12.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:12 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:04:12.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:12 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:04:12.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:12 smithi006 ceph-mon[32486]: Adjusting osd_memory_target on smithi171 to 4272M 2024-05-20T17:04:12.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:12 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:12.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:12 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:12.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:12 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:04:12.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:12 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:12.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:12 smithi006 ceph-mon[32486]: osdmap e82: 12 total, 12 up, 12 in 2024-05-20T17:04:12.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:12 smithi062 ceph-mon[35425]: Detected new or changed devices on smithi171 2024-05-20T17:04:12.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:12 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:12.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:12 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:12.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:12 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:04:12.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:12 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:04:12.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:12 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:04:12.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:12 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:04:12.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:12 smithi062 ceph-mon[35425]: Adjusting osd_memory_target on smithi171 to 4272M 2024-05-20T17:04:12.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:12 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:12.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:12 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:12.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:12 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:04:12.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:12 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:12.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:12 smithi062 ceph-mon[35425]: osdmap e82: 12 total, 12 up, 12 in 2024-05-20T17:04:12.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:12 smithi171 ceph-mon[35901]: Detected new or changed devices on smithi171 2024-05-20T17:04:12.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:12 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:12.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:12 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:12.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:12 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:04:12.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:12 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:04:12.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:12 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:04:12.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:12 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:04:12.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:12 smithi171 ceph-mon[35901]: Adjusting osd_memory_target on smithi171 to 4272M 2024-05-20T17:04:12.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:12 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:12.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:12 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:12.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:12 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:04:12.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:12 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:12.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:12 smithi171 ceph-mon[35901]: osdmap e82: 12 total, 12 up, 12 in 2024-05-20T17:04:13.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:13 smithi006 ceph-mon[32486]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:13.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:13 smithi062 ceph-mon[35425]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:13.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:13 smithi171 ceph-mon[35901]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:14.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.256+0000 7f5de43a2700 1 -- 172.21.15.6:0/3462754068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc104c90 msgr2=0x7f5ddc10b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:14.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.256+0000 7f5de43a2700 1 --2- 172.21.15.6:0/3462754068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc104c90 0x7f5ddc10b540 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5dd400b0a0 tx=0x7f5dd400b3b0 comp rx=0 tx=0).stop 2024-05-20T17:04:14.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.256+0000 7f5de43a2700 1 -- 172.21.15.6:0/3462754068 shutdown_connections 2024-05-20T17:04:14.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.256+0000 7f5de43a2700 1 --2- 172.21.15.6:0/3462754068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc104c90 0x7f5ddc10b540 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:14.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.256+0000 7f5de43a2700 1 --2- 172.21.15.6:0/3462754068 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ddc1031c0 0x7f5ddc1035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:14.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.256+0000 7f5de43a2700 1 --2- 172.21.15.6:0/3462754068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ddc1042f0 0x7f5ddc104700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:14.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.256+0000 7f5de43a2700 1 -- 172.21.15.6:0/3462754068 >> 172.21.15.6:0/3462754068 conn(0x7f5ddc0fe840 msgr2=0x7f5ddc100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:14.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.256+0000 7f5de43a2700 1 -- 172.21.15.6:0/3462754068 shutdown_connections 2024-05-20T17:04:14.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.256+0000 7f5de43a2700 1 -- 172.21.15.6:0/3462754068 wait complete. 2024-05-20T17:04:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.257+0000 7f5de43a2700 1 Processor -- start 2024-05-20T17:04:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.257+0000 7f5de43a2700 1 -- start start 2024-05-20T17:04:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.257+0000 7f5de43a2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ddc1031c0 0x7f5ddc1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.258+0000 7f5de43a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc1042f0 0x7f5ddc199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.258+0000 7f5de43a2700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ddc104c90 0x7f5ddc1a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.258+0000 7f5de43a2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc10ec20 con 0x7f5ddc1042f0 2024-05-20T17:04:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.258+0000 7f5de43a2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc10eaa0 con 0x7f5ddc1031c0 2024-05-20T17:04:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.258+0000 7f5de43a2700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc10eda0 con 0x7f5ddc104c90 2024-05-20T17:04:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.258+0000 7f5de193d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc1042f0 0x7f5ddc199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.258+0000 7f5de193d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc1042f0 0x7f5ddc199c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55062/0 (socket says 172.21.15.6:55062) 2024-05-20T17:04:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.258+0000 7f5de193d700 1 -- 172.21.15.6:0/2250152805 learned_addr learned my addr 172.21.15.6:0/2250152805 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.258+0000 7f5de213e700 1 --2- 172.21.15.6:0/2250152805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ddc1031c0 0x7f5ddc1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.258+0000 7f5de293f700 1 --2- 172.21.15.6:0/2250152805 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ddc104c90 0x7f5ddc1a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.258+0000 7f5de193d700 1 -- 172.21.15.6:0/2250152805 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ddc104c90 msgr2=0x7f5ddc1a0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.258+0000 7f5de193d700 1 --2- 172.21.15.6:0/2250152805 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ddc104c90 0x7f5ddc1a0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.258+0000 7f5de193d700 1 -- 172.21.15.6:0/2250152805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ddc1031c0 msgr2=0x7f5ddc1996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.258+0000 7f5de193d700 1 --2- 172.21.15.6:0/2250152805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ddc1031c0 0x7f5ddc1996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:14.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.258+0000 7f5de193d700 1 -- 172.21.15.6:0/2250152805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ddc1a1240 con 0x7f5ddc1042f0 2024-05-20T17:04:14.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.258+0000 7f5de193d700 1 --2- 172.21.15.6:0/2250152805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc1042f0 0x7f5ddc199c20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00d950 tx=0x7f5dcc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:14.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.259+0000 7f5dd37fe700 1 -- 172.21.15.6:0/2250152805 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc016070 con 0x7f5ddc1042f0 2024-05-20T17:04:14.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.259+0000 7f5dd37fe700 1 -- 172.21.15.6:0/2250152805 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5dcc00fd40 con 0x7f5ddc1042f0 2024-05-20T17:04:14.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.259+0000 7f5de43a2700 1 -- 172.21.15.6:0/2250152805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ddc1a1530 con 0x7f5ddc1042f0 2024-05-20T17:04:14.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.259+0000 7f5dd37fe700 1 -- 172.21.15.6:0/2250152805 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00e3b0 con 0x7f5ddc1042f0 2024-05-20T17:04:14.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.259+0000 7f5de43a2700 1 -- 172.21.15.6:0/2250152805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ddc1a1a70 con 0x7f5ddc1042f0 2024-05-20T17:04:14.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.260+0000 7f5de43a2700 1 -- 172.21.15.6:0/2250152805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ddc050170 con 0x7f5ddc1042f0 2024-05-20T17:04:14.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.261+0000 7f5dd37fe700 1 -- 172.21.15.6:0/2250152805 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f5dcc019070 con 0x7f5ddc1042f0 2024-05-20T17:04:14.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.262+0000 7f5dd37fe700 1 --2- 172.21.15.6:0/2250152805 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5dc80a2c20 0x7f5dc80a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:14.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.262+0000 7f5de213e700 1 --2- 172.21.15.6:0/2250152805 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5dc80a2c20 0x7f5dc80a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:14.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.262+0000 7f5dd37fe700 1 -- 172.21.15.6:0/2250152805 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f5dcc0ce660 con 0x7f5ddc1042f0 2024-05-20T17:04:14.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.263+0000 7f5de213e700 1 --2- 172.21.15.6:0/2250152805 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5dc80a2c20 0x7f5dc80a5130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc1041f0 tx=0x7f5dd8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:14.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.266+0000 7f5dd37fe700 1 -- 172.21.15.6:0/2250152805 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5dcc09ba40 con 0x7f5ddc1042f0 2024-05-20T17:04:14.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.471+0000 7f5de43a2700 1 -- 172.21.15.6:0/2250152805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5ddc063250 con 0x7f5ddc1042f0 2024-05-20T17:04:14.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.472+0000 7f5dd37fe700 1 -- 172.21.15.6:0/2250152805 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v82) ==== 74+0+133 (secure 0 0 0) 0x7f5dcc09b340 con 0x7f5ddc1042f0 2024-05-20T17:04:14.471 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:04:14.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.474+0000 7f5de43a2700 1 -- 172.21.15.6:0/2250152805 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5dc80a2c20 msgr2=0x7f5dc80a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:14.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.474+0000 7f5de43a2700 1 --2- 172.21.15.6:0/2250152805 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5dc80a2c20 0x7f5dc80a5130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc1041f0 tx=0x7f5dd8009260 comp rx=0 tx=0).stop 2024-05-20T17:04:14.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.474+0000 7f5de43a2700 1 -- 172.21.15.6:0/2250152805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc1042f0 msgr2=0x7f5ddc199c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:14.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.474+0000 7f5de43a2700 1 --2- 172.21.15.6:0/2250152805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc1042f0 0x7f5ddc199c20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00d950 tx=0x7f5dcc00dc60 comp rx=0 tx=0).stop 2024-05-20T17:04:14.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.474+0000 7f5de43a2700 1 -- 172.21.15.6:0/2250152805 shutdown_connections 2024-05-20T17:04:14.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.474+0000 7f5de43a2700 1 --2- 172.21.15.6:0/2250152805 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5dc80a2c20 0x7f5dc80a5130 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:14.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.474+0000 7f5de43a2700 1 --2- 172.21.15.6:0/2250152805 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ddc104c90 0x7f5ddc1a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:14.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.474+0000 7f5de43a2700 1 --2- 172.21.15.6:0/2250152805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ddc1031c0 0x7f5ddc1996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:14.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.474+0000 7f5de43a2700 1 --2- 172.21.15.6:0/2250152805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc1042f0 0x7f5ddc199c20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:14.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.474+0000 7f5de43a2700 1 -- 172.21.15.6:0/2250152805 >> 172.21.15.6:0/2250152805 conn(0x7f5ddc0fe840 msgr2=0x7f5ddc107520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:14.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.474+0000 7f5de43a2700 1 -- 172.21.15.6:0/2250152805 shutdown_connections 2024-05-20T17:04:14.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:14.474+0000 7f5de43a2700 1 -- 172.21.15.6:0/2250152805 wait complete. 2024-05-20T17:04:14.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:14 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2250152805' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-20T17:04:14.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:14 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2250152805' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-20T17:04:14.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:14 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2250152805' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-20T17:04:15.072 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":82,"num_osds":12,"num_up_osds":12,"osd_up_since":1716224651,"num_in_osds":12,"osd_in_since":1716224630,"num_remapped_pgs":0} 2024-05-20T17:04:15.073 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph osd dump --format=json 2024-05-20T17:04:15.322 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:04:15.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:15 smithi062 ceph-mon[35425]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:15.773 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:15 smithi006 ceph-mon[32486]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:15.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:15 smithi171 ceph-mon[35901]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:17.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.085+0000 7ff0cdae7700 1 -- 172.21.15.6:0/4130323951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0c8101610 msgr2=0x7ff0c8101a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:17.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.085+0000 7ff0cdae7700 1 --2- 172.21.15.6:0/4130323951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0c8101610 0x7ff0c8101a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009990 tx=0x7ff0bc009ca0 comp rx=0 tx=0).stop 2024-05-20T17:04:17.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.085+0000 7ff0cdae7700 1 -- 172.21.15.6:0/4130323951 shutdown_connections 2024-05-20T17:04:17.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.085+0000 7ff0cdae7700 1 --2- 172.21.15.6:0/4130323951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0c8101f60 0x7ff0c810fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:17.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.085+0000 7ff0cdae7700 1 --2- 172.21.15.6:0/4130323951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0c8108180 0x7ff0c8108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:17.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.085+0000 7ff0cdae7700 1 --2- 172.21.15.6:0/4130323951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0c8101610 0x7ff0c8101a20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:17.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.085+0000 7ff0cdae7700 1 -- 172.21.15.6:0/4130323951 >> 172.21.15.6:0/4130323951 conn(0x7ff0c80fd360 msgr2=0x7ff0c80ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:17.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.085+0000 7ff0cdae7700 1 -- 172.21.15.6:0/4130323951 shutdown_connections 2024-05-20T17:04:17.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.085+0000 7ff0cdae7700 1 -- 172.21.15.6:0/4130323951 wait complete. 2024-05-20T17:04:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.086+0000 7ff0cdae7700 1 Processor -- start 2024-05-20T17:04:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.086+0000 7ff0cdae7700 1 -- start start 2024-05-20T17:04:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.086+0000 7ff0cdae7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0c8101610 0x7ff0c8199dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.086+0000 7ff0cdae7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0c8101f60 0x7ff0c819a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.087+0000 7ff0cdae7700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0c8108180 0x7ff0c819e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.087+0000 7ff0cdae7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c8113420 con 0x7ff0c8101f60 2024-05-20T17:04:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.087+0000 7ff0cdae7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c81132a0 con 0x7ff0c8101610 2024-05-20T17:04:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.087+0000 7ff0cdae7700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c81135a0 con 0x7ff0c8108180 2024-05-20T17:04:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.087+0000 7ff0c77fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0c8101610 0x7ff0c8199dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.087+0000 7ff0c6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0c8101f60 0x7ff0c819a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.087+0000 7ff0c77fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0c8101610 0x7ff0c8199dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.6:43500/0 (socket says 172.21.15.6:43500) 2024-05-20T17:04:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.087+0000 7ff0c77fe700 1 -- 172.21.15.6:0/1450694949 learned_addr learned my addr 172.21.15.6:0/1450694949 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.087+0000 7ff0c7fff700 1 --2- 172.21.15.6:0/1450694949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0c8108180 0x7ff0c819e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.087+0000 7ff0c6ffd700 1 -- 172.21.15.6:0/1450694949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0c8108180 msgr2=0x7ff0c819e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.087+0000 7ff0c6ffd700 1 --2- 172.21.15.6:0/1450694949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0c8108180 0x7ff0c819e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.087+0000 7ff0c6ffd700 1 -- 172.21.15.6:0/1450694949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0c8101610 msgr2=0x7ff0c8199dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.087+0000 7ff0c6ffd700 1 --2- 172.21.15.6:0/1450694949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0c8101610 0x7ff0c8199dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.087+0000 7ff0c6ffd700 1 -- 172.21.15.6:0/1450694949 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c819ebf0 con 0x7ff0c8101f60 2024-05-20T17:04:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.087+0000 7ff0c6ffd700 1 --2- 172.21.15.6:0/1450694949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0c8101f60 0x7ff0c819a370 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0059d0 tx=0x7ff0bc0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.088+0000 7ff0c4ff9700 1 -- 172.21.15.6:0/1450694949 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc027070 con 0x7ff0c8101f60 2024-05-20T17:04:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.088+0000 7ff0cdae7700 1 -- 172.21.15.6:0/1450694949 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c819ee80 con 0x7ff0c8101f60 2024-05-20T17:04:17.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.088+0000 7ff0c4ff9700 1 -- 172.21.15.6:0/1450694949 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff0bc003f10 con 0x7ff0c8101f60 2024-05-20T17:04:17.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.088+0000 7ff0c4ff9700 1 -- 172.21.15.6:0/1450694949 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc022b10 con 0x7ff0c8101f60 2024-05-20T17:04:17.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.088+0000 7ff0cdae7700 1 -- 172.21.15.6:0/1450694949 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c819f330 con 0x7ff0c8101f60 2024-05-20T17:04:17.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.089+0000 7ff0cdae7700 1 -- 172.21.15.6:0/1450694949 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0c8050170 con 0x7ff0c8101f60 2024-05-20T17:04:17.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.091+0000 7ff0c4ff9700 1 -- 172.21.15.6:0/1450694949 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ff0bc02a070 con 0x7ff0c8101f60 2024-05-20T17:04:17.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.092+0000 7ff0c4ff9700 1 --2- 172.21.15.6:0/1450694949 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff0b00a2c20 0x7ff0b00a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:17.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.092+0000 7ff0c77fe700 1 --2- 172.21.15.6:0/1450694949 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff0b00a2c20 0x7ff0b00a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:17.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.092+0000 7ff0c4ff9700 1 -- 172.21.15.6:0/1450694949 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7ff0bc0d0400 con 0x7ff0c8101f60 2024-05-20T17:04:17.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.092+0000 7ff0c77fe700 1 --2- 172.21.15.6:0/1450694949 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff0b00a2c20 0x7ff0b00a5130 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8005950 tx=0x7ff0b8007480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:17.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.095+0000 7ff0c4ff9700 1 -- 172.21.15.6:0/1450694949 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff0bc013070 con 0x7ff0c8101f60 2024-05-20T17:04:17.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.302+0000 7ff0cdae7700 1 -- 172.21.15.6:0/1450694949 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0c802dc60 con 0x7ff0c8101f60 2024-05-20T17:04:17.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.303+0000 7ff0c4ff9700 1 -- 172.21.15.6:0/1450694949 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+18301 (secure 0 0 0) 0x7ff0bc09d890 con 0x7ff0c8101f60 2024-05-20T17:04:17.302 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:04:17.303 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":82,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:04:12.184652+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:04:17.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.305+0000 7ff0cdae7700 1 -- 172.21.15.6:0/1450694949 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff0b00a2c20 msgr2=0x7ff0b00a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:17.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.305+0000 7ff0cdae7700 1 --2- 172.21.15.6:0/1450694949 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff0b00a2c20 0x7ff0b00a5130 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8005950 tx=0x7ff0b8007480 comp rx=0 tx=0).stop 2024-05-20T17:04:17.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.305+0000 7ff0cdae7700 1 -- 172.21.15.6:0/1450694949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0c8101f60 msgr2=0x7ff0c819a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:17.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.305+0000 7ff0cdae7700 1 --2- 172.21.15.6:0/1450694949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0c8101f60 0x7ff0c819a370 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0059d0 tx=0x7ff0bc0057c0 comp rx=0 tx=0).stop 2024-05-20T17:04:17.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.305+0000 7ff0cdae7700 1 -- 172.21.15.6:0/1450694949 shutdown_connections 2024-05-20T17:04:17.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.305+0000 7ff0cdae7700 1 --2- 172.21.15.6:0/1450694949 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff0b00a2c20 0x7ff0b00a5130 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:17.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.305+0000 7ff0cdae7700 1 --2- 172.21.15.6:0/1450694949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0c8108180 0x7ff0c819e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:17.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.305+0000 7ff0cdae7700 1 --2- 172.21.15.6:0/1450694949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0c8101610 0x7ff0c8199dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:17.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.305+0000 7ff0cdae7700 1 --2- 172.21.15.6:0/1450694949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0c8101f60 0x7ff0c819a370 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:17.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.305+0000 7ff0cdae7700 1 -- 172.21.15.6:0/1450694949 >> 172.21.15.6:0/1450694949 conn(0x7ff0c80fd360 msgr2=0x7ff0c81060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:17.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.305+0000 7ff0cdae7700 1 -- 172.21.15.6:0/1450694949 shutdown_connections 2024-05-20T17:04:17.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:17.305+0000 7ff0cdae7700 1 -- 172.21.15.6:0/1450694949 wait complete. 2024-05-20T17:04:17.686 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:17 smithi006 ceph-mon[32486]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:17.686 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:17 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1450694949' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:04:17.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:17 smithi062 ceph-mon[35425]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:17.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:17 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1450694949' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:04:17.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:17 smithi171 ceph-mon[35901]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:17.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:17 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1450694949' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:04:18.008 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:00:12.516679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:04:18.009 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-20T17:04:18.260 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:04:19.762 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:19 smithi006 ceph-mon[32486]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:19.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:19 smithi062 ceph-mon[35425]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:19.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:19 smithi171 ceph-mon[35901]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:20.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.004+0000 7f1c2aa75700 1 -- 172.21.15.6:0/1813772349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c24102340 msgr2=0x7f1c24102750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:20.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.004+0000 7f1c2aa75700 1 --2- 172.21.15.6:0/1813772349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c24102340 0x7f1c24102750 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1c140099c0 tx=0x7f1c14009cd0 comp rx=0 tx=0).stop 2024-05-20T17:04:20.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.005+0000 7f1c2aa75700 1 -- 172.21.15.6:0/1813772349 shutdown_connections 2024-05-20T17:04:20.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.005+0000 7f1c2aa75700 1 --2- 172.21.15.6:0/1813772349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c241075c0 0x7f1c2410ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:20.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.005+0000 7f1c2aa75700 1 --2- 172.21.15.6:0/1813772349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c24102340 0x7f1c24102750 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:20.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.005+0000 7f1c2aa75700 1 --2- 172.21.15.6:0/1813772349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c24106c70 0x7f1c24107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:20.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.005+0000 7f1c2aa75700 1 -- 172.21.15.6:0/1813772349 >> 172.21.15.6:0/1813772349 conn(0x7f1c240fdc70 msgr2=0x7f1c24100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:20.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.005+0000 7f1c2aa75700 1 -- 172.21.15.6:0/1813772349 shutdown_connections 2024-05-20T17:04:20.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.005+0000 7f1c2aa75700 1 -- 172.21.15.6:0/1813772349 wait complete. 2024-05-20T17:04:20.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.005+0000 7f1c2aa75700 1 Processor -- start 2024-05-20T17:04:20.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.006+0000 7f1c2aa75700 1 -- start start 2024-05-20T17:04:20.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.006+0000 7f1c2aa75700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c24102340 0x7f1c24199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:20.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.006+0000 7f1c2aa75700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c24106c70 0x7f1c2419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:20.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.006+0000 7f1c2aa75700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c241075c0 0x7f1c2419e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:20.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.006+0000 7f1c2aa75700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1c241122e0 con 0x7f1c24102340 2024-05-20T17:04:20.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.006+0000 7f1c2aa75700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1c24112160 con 0x7f1c24106c70 2024-05-20T17:04:20.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.006+0000 7f1c2aa75700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1c24112460 con 0x7f1c241075c0 2024-05-20T17:04:20.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.006+0000 7f1c28811700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c24102340 0x7f1c24199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:20.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.006+0000 7f1c28811700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c24102340 0x7f1c24199de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55106/0 (socket says 172.21.15.6:55106) 2024-05-20T17:04:20.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.006+0000 7f1c28811700 1 -- 172.21.15.6:0/3957659276 learned_addr learned my addr 172.21.15.6:0/3957659276 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:20.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.006+0000 7f1c29012700 1 --2- 172.21.15.6:0/3957659276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c241075c0 0x7f1c2419e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:20.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.006+0000 7f1c23fff700 1 --2- 172.21.15.6:0/3957659276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c24106c70 0x7f1c2419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:20.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.006+0000 7f1c28811700 1 -- 172.21.15.6:0/3957659276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c241075c0 msgr2=0x7f1c2419e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:20.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.006+0000 7f1c28811700 1 --2- 172.21.15.6:0/3957659276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c241075c0 0x7f1c2419e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:20.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.006+0000 7f1c28811700 1 -- 172.21.15.6:0/3957659276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c24106c70 msgr2=0x7f1c2419a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:20.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.006+0000 7f1c28811700 1 --2- 172.21.15.6:0/3957659276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c24106c70 0x7f1c2419a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:20.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.006+0000 7f1c28811700 1 -- 172.21.15.6:0/3957659276 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c2419ecb0 con 0x7f1c24102340 2024-05-20T17:04:20.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.006+0000 7f1c23fff700 1 --2- 172.21.15.6:0/3957659276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c24106c70 0x7f1c2419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:04:20.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.007+0000 7f1c28811700 1 --2- 172.21.15.6:0/3957659276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c24102340 0x7f1c24199de0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009fd0 tx=0x7f1c140047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:20.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.007+0000 7f1c21ffb700 1 -- 172.21.15.6:0/3957659276 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14027070 con 0x7f1c24102340 2024-05-20T17:04:20.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.007+0000 7f1c21ffb700 1 -- 172.21.15.6:0/3957659276 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1c14004050 con 0x7f1c24102340 2024-05-20T17:04:20.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.007+0000 7f1c2aa75700 1 -- 172.21.15.6:0/3957659276 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c2419ef40 con 0x7f1c24102340 2024-05-20T17:04:20.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.007+0000 7f1c21ffb700 1 -- 172.21.15.6:0/3957659276 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14022d80 con 0x7f1c24102340 2024-05-20T17:04:20.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.007+0000 7f1c2aa75700 1 -- 172.21.15.6:0/3957659276 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c2419f440 con 0x7f1c24102340 2024-05-20T17:04:20.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.008+0000 7f1c2aa75700 1 -- 172.21.15.6:0/3957659276 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c24050170 con 0x7f1c24102340 2024-05-20T17:04:20.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.010+0000 7f1c21ffb700 1 -- 172.21.15.6:0/3957659276 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f1c1402a070 con 0x7f1c24102340 2024-05-20T17:04:20.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.011+0000 7f1c21ffb700 1 --2- 172.21.15.6:0/3957659276 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1c100a2ca0 0x7f1c100a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:20.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.011+0000 7f1c23fff700 1 --2- 172.21.15.6:0/3957659276 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1c100a2ca0 0x7f1c100a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:20.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.011+0000 7f1c21ffb700 1 -- 172.21.15.6:0/3957659276 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f1c140d0230 con 0x7f1c24102340 2024-05-20T17:04:20.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.012+0000 7f1c23fff700 1 --2- 172.21.15.6:0/3957659276 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1c100a2ca0 0x7f1c100a51b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1c24108a10 tx=0x7f1c0c009570 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:20.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.015+0000 7f1c21ffb700 1 -- 172.21.15.6:0/3957659276 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1c2419f440 con 0x7f1c24102340 2024-05-20T17:04:20.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.216+0000 7f1c2aa75700 1 -- 172.21.15.6:0/3957659276 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1c2402dc60 con 0x7f1c24102340 2024-05-20T17:04:20.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.216+0000 7f1c21ffb700 1 -- 172.21.15.6:0/3957659276 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f1c14013070 con 0x7f1c24102340 2024-05-20T17:04:20.217 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:04:20.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.218+0000 7f1c2aa75700 1 -- 172.21.15.6:0/3957659276 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1c100a2ca0 msgr2=0x7f1c100a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:20.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.218+0000 7f1c2aa75700 1 --2- 172.21.15.6:0/3957659276 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1c100a2ca0 0x7f1c100a51b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1c24108a10 tx=0x7f1c0c009570 comp rx=0 tx=0).stop 2024-05-20T17:04:20.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.218+0000 7f1c2aa75700 1 -- 172.21.15.6:0/3957659276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c24102340 msgr2=0x7f1c24199de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:20.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.218+0000 7f1c2aa75700 1 --2- 172.21.15.6:0/3957659276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c24102340 0x7f1c24199de0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009fd0 tx=0x7f1c140047b0 comp rx=0 tx=0).stop 2024-05-20T17:04:20.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.219+0000 7f1c2aa75700 1 -- 172.21.15.6:0/3957659276 shutdown_connections 2024-05-20T17:04:20.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.219+0000 7f1c2aa75700 1 --2- 172.21.15.6:0/3957659276 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1c100a2ca0 0x7f1c100a51b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:20.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.219+0000 7f1c2aa75700 1 --2- 172.21.15.6:0/3957659276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c241075c0 0x7f1c2419e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:20.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.219+0000 7f1c2aa75700 1 --2- 172.21.15.6:0/3957659276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c24102340 0x7f1c24199de0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:20.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.219+0000 7f1c2aa75700 1 --2- 172.21.15.6:0/3957659276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c24106c70 0x7f1c2419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:20.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.219+0000 7f1c2aa75700 1 -- 172.21.15.6:0/3957659276 >> 172.21.15.6:0/3957659276 conn(0x7f1c240fdc70 msgr2=0x7f1c24074c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:20.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.219+0000 7f1c2aa75700 1 -- 172.21.15.6:0/3957659276 shutdown_connections 2024-05-20T17:04:20.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:20.219+0000 7f1c2aa75700 1 -- 172.21.15.6:0/3957659276 wait complete. 2024-05-20T17:04:20.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:20 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3957659276' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:04:20.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:20 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3957659276' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:04:21.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:20 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3957659276' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:04:21.024 INFO:tasks.cephadm:Adding mds.a on smithi006 2024-05-20T17:04:21.025 INFO:tasks.cephadm:Adding mds.d on smithi006 2024-05-20T17:04:21.025 INFO:tasks.cephadm:Adding mds.g on smithi006 2024-05-20T17:04:21.025 INFO:tasks.cephadm:Adding mds.j on smithi006 2024-05-20T17:04:21.025 INFO:tasks.cephadm:Adding mds.b on smithi062 2024-05-20T17:04:21.025 INFO:tasks.cephadm:Adding mds.e on smithi062 2024-05-20T17:04:21.025 INFO:tasks.cephadm:Adding mds.h on smithi062 2024-05-20T17:04:21.025 INFO:tasks.cephadm:Adding mds.k on smithi062 2024-05-20T17:04:21.025 INFO:tasks.cephadm:Adding mds.c on smithi171 2024-05-20T17:04:21.025 INFO:tasks.cephadm:Adding mds.f on smithi171 2024-05-20T17:04:21.025 INFO:tasks.cephadm:Adding mds.i on smithi171 2024-05-20T17:04:21.025 INFO:tasks.cephadm:Adding mds.l on smithi171 2024-05-20T17:04:21.026 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph orch apply mds all '12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi062=b;smithi062=e;smithi062=h;smithi062=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l' 2024-05-20T17:04:21.276 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:04:21.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:21 smithi006 ceph-mon[32486]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:21.655 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:21 smithi171 ceph-mon[35901]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:22.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:21 smithi062 ceph-mon[35425]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:22.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.904+0000 7f798c7af700 1 -- 172.21.15.171:0/1462610366 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79841020d0 msgr2=0x7f79841024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:22.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.904+0000 7f798c7af700 1 --2- 172.21.15.171:0/1462610366 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79841020d0 0x7f79841024e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7978009990 tx=0x7f7978009ca0 comp rx=0 tx=0).stop 2024-05-20T17:04:22.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.905+0000 7f798c7af700 1 -- 172.21.15.171:0/1462610366 shutdown_connections 2024-05-20T17:04:22.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.905+0000 7f798c7af700 1 --2- 172.21.15.171:0/1462610366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7984103ba0 0x7f798410a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:22.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.905+0000 7f798c7af700 1 --2- 172.21.15.171:0/1462610366 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79841020d0 0x7f79841024e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:22.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.905+0000 7f798c7af700 1 --2- 172.21.15.171:0/1462610366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7984103200 0x7f7984103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:22.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.905+0000 7f798c7af700 1 -- 172.21.15.171:0/1462610366 >> 172.21.15.171:0/1462610366 conn(0x7f79840fd710 msgr2=0x7f79840ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:22.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.905+0000 7f798c7af700 1 -- 172.21.15.171:0/1462610366 shutdown_connections 2024-05-20T17:04:22.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.905+0000 7f798c7af700 1 -- 172.21.15.171:0/1462610366 wait complete. 2024-05-20T17:04:22.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.905+0000 7f798c7af700 1 Processor -- start 2024-05-20T17:04:22.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.905+0000 7f798c7af700 1 -- start start 2024-05-20T17:04:22.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.905+0000 7f798c7af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79841020d0 0x7f7984105e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:22.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f798c7af700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7984103200 0x7f7984104540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:22.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f798c7af700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7984103ba0 0x7f7984104a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:22.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f798c7af700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f798410db90 con 0x7f79841020d0 2024-05-20T17:04:22.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f798c7af700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f798410da10 con 0x7f7984103200 2024-05-20T17:04:22.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f798c7af700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f798410dd10 con 0x7f7984103ba0 2024-05-20T17:04:22.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f798ad4c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7984103ba0 0x7f7984104a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:22.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f798ad4c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7984103ba0 0x7f7984104a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:51104/0 (socket says 172.21.15.171:51104) 2024-05-20T17:04:22.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f798ad4c700 1 -- 172.21.15.171:0/2344236430 learned_addr learned my addr 172.21.15.171:0/2344236430 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T17:04:22.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f7989d4a700 1 --2- 172.21.15.171:0/2344236430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7984103200 0x7f7984104540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:22.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f798a54b700 1 --2- 172.21.15.171:0/2344236430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79841020d0 0x7f7984105e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:22.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f798ad4c700 1 -- 172.21.15.171:0/2344236430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7984103200 msgr2=0x7f7984104540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:22.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f798ad4c700 1 --2- 172.21.15.171:0/2344236430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7984103200 0x7f7984104540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:22.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f798ad4c700 1 -- 172.21.15.171:0/2344236430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79841020d0 msgr2=0x7f7984105e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:22.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f798ad4c700 1 --2- 172.21.15.171:0/2344236430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79841020d0 0x7f7984105e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:22.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f798ad4c700 1 -- 172.21.15.171:0/2344236430 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79841051e0 con 0x7f7984103ba0 2024-05-20T17:04:22.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f798a54b700 1 --2- 172.21.15.171:0/2344236430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79841020d0 0x7f7984105e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:04:22.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f798ad4c700 1 --2- 172.21.15.171:0/2344236430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7984103ba0 0x7f7984104a80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f797c007ee0 tx=0x7f797c00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:22.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f79777fe700 1 -- 172.21.15.171:0/2344236430 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c00dbd0 con 0x7f7984103ba0 2024-05-20T17:04:22.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f79777fe700 1 -- 172.21.15.171:0/2344236430 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f797c00dd70 con 0x7f7984103ba0 2024-05-20T17:04:22.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f798c7af700 1 -- 172.21.15.171:0/2344236430 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79841a3910 con 0x7f7984103ba0 2024-05-20T17:04:22.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f79777fe700 1 -- 172.21.15.171:0/2344236430 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c005a20 con 0x7f7984103ba0 2024-05-20T17:04:22.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.906+0000 7f798c7af700 1 -- 172.21.15.171:0/2344236430 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79841a3da0 con 0x7f7984103ba0 2024-05-20T17:04:22.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.907+0000 7f798c7af700 1 -- 172.21.15.171:0/2344236430 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7984050170 con 0x7f7984103ba0 2024-05-20T17:04:22.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.909+0000 7f79777fe700 1 -- 172.21.15.171:0/2344236430 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f797c01a020 con 0x7f7984103ba0 2024-05-20T17:04:22.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.909+0000 7f79777fe700 1 --2- 172.21.15.171:0/2344236430 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f79700a2c20 0x7f79700a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:22.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.909+0000 7f79777fe700 1 -- 172.21.15.171:0/2344236430 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f797c0cea40 con 0x7f7984103ba0 2024-05-20T17:04:22.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.910+0000 7f798a54b700 1 --2- 172.21.15.171:0/2344236430 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f79700a2c20 0x7f79700a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:22.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.910+0000 7f798a54b700 1 --2- 172.21.15.171:0/2344236430 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f79700a2c20 0x7f79700a5130 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f79780036e0 tx=0x7f7978005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:22.913 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:22.913+0000 7f79777fe700 1 -- 172.21.15.171:0/2344236430 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f797c010070 con 0x7f7984103ba0 2024-05-20T17:04:23.118 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:23.118+0000 7f798c7af700 1 -- 172.21.15.171:0/2344236430 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi062=b;smithi062=e;smithi062=h;smithi062=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l", "target": ["mon-mgr", ""]}) -- 0x7f79840ff8b0 con 0x7f79700a2c20 2024-05-20T17:04:23.127 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:23.127+0000 7f79777fe700 1 -- 172.21.15.171:0/2344236430 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f79840ff8b0 con 0x7f79700a2c20 2024-05-20T17:04:23.127 INFO:teuthology.orchestra.run.smithi171.stdout:Scheduled mds.all update... 2024-05-20T17:04:23.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:23.129+0000 7f798c7af700 1 -- 172.21.15.171:0/2344236430 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f79700a2c20 msgr2=0x7f79700a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:23.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:23.129+0000 7f798c7af700 1 --2- 172.21.15.171:0/2344236430 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f79700a2c20 0x7f79700a5130 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f79780036e0 tx=0x7f7978005fb0 comp rx=0 tx=0).stop 2024-05-20T17:04:23.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:23.129+0000 7f798c7af700 1 -- 172.21.15.171:0/2344236430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7984103ba0 msgr2=0x7f7984104a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:23.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:23.129+0000 7f798c7af700 1 --2- 172.21.15.171:0/2344236430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7984103ba0 0x7f7984104a80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f797c007ee0 tx=0x7f797c00d3b0 comp rx=0 tx=0).stop 2024-05-20T17:04:23.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:23.129+0000 7f798c7af700 1 -- 172.21.15.171:0/2344236430 shutdown_connections 2024-05-20T17:04:23.130 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:23.129+0000 7f798c7af700 1 --2- 172.21.15.171:0/2344236430 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f79700a2c20 0x7f79700a5130 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:23.130 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:23.129+0000 7f798c7af700 1 --2- 172.21.15.171:0/2344236430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7984103ba0 0x7f7984104a80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:23.130 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:23.129+0000 7f798c7af700 1 --2- 172.21.15.171:0/2344236430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79841020d0 0x7f7984105e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:23.130 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:23.129+0000 7f798c7af700 1 --2- 172.21.15.171:0/2344236430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7984103200 0x7f7984104540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:23.130 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:23.129+0000 7f798c7af700 1 -- 172.21.15.171:0/2344236430 >> 172.21.15.171:0/2344236430 conn(0x7f79840fd710 msgr2=0x7f79840ff0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:23.130 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:23.129+0000 7f798c7af700 1 -- 172.21.15.171:0/2344236430 shutdown_connections 2024-05-20T17:04:23.130 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:04:23.129+0000 7f798c7af700 1 -- 172.21.15.171:0/2344236430 wait complete. 2024-05-20T17:04:23.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:23 smithi171 ceph-mon[35901]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:23.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:23 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:23.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:23 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:04:23.867 DEBUG:teuthology.orchestra.run.smithi006:mds.a> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.a.service 2024-05-20T17:04:23.870 DEBUG:teuthology.orchestra.run.smithi006:mds.d> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.d.service 2024-05-20T17:04:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:23 smithi006 ceph-mon[32486]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:23 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:23 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:04:23.881 DEBUG:teuthology.orchestra.run.smithi006:mds.g> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.g.service 2024-05-20T17:04:23.923 DEBUG:teuthology.orchestra.run.smithi006:mds.j> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.j.service 2024-05-20T17:04:23.966 DEBUG:teuthology.orchestra.run.smithi062:mds.b> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.b.service 2024-05-20T17:04:23.969 DEBUG:teuthology.orchestra.run.smithi062:mds.e> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.e.service 2024-05-20T17:04:23.991 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:23 smithi062 ceph-mon[35425]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:23.991 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:23 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:23.991 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:23 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:04:23.992 DEBUG:teuthology.orchestra.run.smithi062:mds.h> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.h.service 2024-05-20T17:04:24.035 DEBUG:teuthology.orchestra.run.smithi062:mds.k> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.k.service 2024-05-20T17:04:24.078 DEBUG:teuthology.orchestra.run.smithi171:mds.c> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.c.service 2024-05-20T17:04:24.081 DEBUG:teuthology.orchestra.run.smithi171:mds.f> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.f.service 2024-05-20T17:04:24.124 DEBUG:teuthology.orchestra.run.smithi171:mds.i> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.i.service 2024-05-20T17:04:24.167 DEBUG:teuthology.orchestra.run.smithi171:mds.l> sudo journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.l.service 2024-05-20T17:04:24.211 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-05-20T17:04:24.212 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:04:24.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.339+0000 7f8c055b1640 1 -- 172.21.15.6:0/2992378469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c00101210 msgr2=0x7f8c0010ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.339+0000 7f8c055b1640 1 --2- 172.21.15.6:0/2992378469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c00101210 0x7f8c0010ac70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009ca0 tx=0x7f8bf802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.339+0000 7f8c055b1640 1 -- 172.21.15.6:0/2992378469 shutdown_connections 2024-05-20T17:04:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.339+0000 7f8c055b1640 1 --2- 172.21.15.6:0/2992378469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c00101210 0x7f8c0010ac70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.339+0000 7f8c055b1640 1 --2- 172.21.15.6:0/2992378469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c00100710 0x7f8c00100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.339+0000 7f8c055b1640 1 --2- 172.21.15.6:0/2992378469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c00104060 0x7f8c00104470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.339+0000 7f8c055b1640 1 -- 172.21.15.6:0/2992378469 >> 172.21.15.6:0/2992378469 conn(0x7f8c000fc330 msgr2=0x7f8c000fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.339+0000 7f8c055b1640 1 -- 172.21.15.6:0/2992378469 shutdown_connections 2024-05-20T17:04:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.339+0000 7f8c055b1640 1 -- 172.21.15.6:0/2992378469 wait complete. 2024-05-20T17:04:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.340+0000 7f8c055b1640 1 Processor -- start 2024-05-20T17:04:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.340+0000 7f8c055b1640 1 -- start start 2024-05-20T17:04:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.340+0000 7f8c055b1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c00100710 0x7f8c001990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.340+0000 7f8c055b1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c00101210 0x7f8c00199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.340+0000 7f8c055b1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c00104060 0x7f8c001a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.340+0000 7f8c055b1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0010e5f0 con 0x7f8c00101210 2024-05-20T17:04:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.340+0000 7f8c055b1640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0010e470 con 0x7f8c00104060 2024-05-20T17:04:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.340+0000 7f8c055b1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0010e770 con 0x7f8c00100710 2024-05-20T17:04:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.340+0000 7f8bf7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c00101210 0x7f8c00199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.340+0000 7f8bf7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c00101210 0x7f8c00199610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36206/0 (socket says 172.21.15.6:36206) 2024-05-20T17:04:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.340+0000 7f8bf7fff640 1 -- 172.21.15.6:0/1903887504 learned_addr learned my addr 172.21.15.6:0/1903887504 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.340+0000 7f8bfeffd640 1 --2- 172.21.15.6:0/1903887504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c00100710 0x7f8c001990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:24.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.340+0000 7f8bff7fe640 1 --2- 172.21.15.6:0/1903887504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c00104060 0x7f8c001a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:24.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.340+0000 7f8bf7fff640 1 -- 172.21.15.6:0/1903887504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c00100710 msgr2=0x7f8c001990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:24.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.340+0000 7f8bf7fff640 1 --2- 172.21.15.6:0/1903887504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c00100710 0x7f8c001990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.340+0000 7f8bf7fff640 1 -- 172.21.15.6:0/1903887504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c00104060 msgr2=0x7f8c001a05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:24.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.340+0000 7f8bf7fff640 1 --2- 172.21.15.6:0/1903887504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c00104060 0x7f8c001a05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.340+0000 7f8bf7fff640 1 -- 172.21.15.6:0/1903887504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c001a0c10 con 0x7f8c00101210 2024-05-20T17:04:24.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.340+0000 7f8bff7fe640 1 --2- 172.21.15.6:0/1903887504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c00104060 0x7f8c001a05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:04:24.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.340+0000 7f8bfeffd640 1 --2- 172.21.15.6:0/1903887504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c00100710 0x7f8c001990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:04:24.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.341+0000 7f8bf7fff640 1 --2- 172.21.15.6:0/1903887504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c00101210 0x7f8c00199610 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8be800d950 tx=0x7f8be800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:24.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.341+0000 7f8bfcff9640 1 -- 172.21.15.6:0/1903887504 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be8017030 con 0x7f8c00101210 2024-05-20T17:04:24.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.341+0000 7f8bfcff9640 1 -- 172.21.15.6:0/1903887504 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8be8004020 con 0x7f8c00101210 2024-05-20T17:04:24.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.341+0000 7f8bfcff9640 1 -- 172.21.15.6:0/1903887504 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be80047a0 con 0x7f8c00101210 2024-05-20T17:04:24.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.341+0000 7f8c055b1640 1 -- 172.21.15.6:0/1903887504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c001a0f00 con 0x7f8c00101210 2024-05-20T17:04:24.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.341+0000 7f8c055b1640 1 -- 172.21.15.6:0/1903887504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c001a13c0 con 0x7f8c00101210 2024-05-20T17:04:24.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.342+0000 7f8c055b1640 1 -- 172.21.15.6:0/1903887504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c00109a00 con 0x7f8c00101210 2024-05-20T17:04:24.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.343+0000 7f8bfcff9640 1 -- 172.21.15.6:0/1903887504 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f8be80041d0 con 0x7f8c00101210 2024-05-20T17:04:24.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.344+0000 7f8bfcff9640 1 --2- 172.21.15.6:0/1903887504 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8bec0a2cb0 0x7f8bec0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:24.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.344+0000 7f8bfeffd640 1 --2- 172.21.15.6:0/1903887504 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8bec0a2cb0 0x7f8bec0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:24.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.344+0000 7f8bfcff9640 1 -- 172.21.15.6:0/1903887504 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f8be80ce6c0 con 0x7f8c00101210 2024-05-20T17:04:24.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.345+0000 7f8bfeffd640 1 --2- 172.21.15.6:0/1903887504 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8bec0a2cb0 0x7f8bec0a51c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8c0006a370 tx=0x7f8bf0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:24.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.349+0000 7f8bfcff9640 1 -- 172.21.15.6:0/1903887504 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8be809ba20 con 0x7f8c00101210 2024-05-20T17:04:24.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.535+0000 7f8c055b1640 1 -- 172.21.15.6:0/1903887504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c00062750 con 0x7f8c00101210 2024-05-20T17:04:24.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.536+0000 7f8bfcff9640 1 -- 172.21.15.6:0/1903887504 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+18301 (secure 0 0 0) 0x7f8be809b320 con 0x7f8c00101210 2024-05-20T17:04:24.537 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:04:24.537 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":82,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:04:12.184652+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:04:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.538+0000 7f8c055b1640 1 -- 172.21.15.6:0/1903887504 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8bec0a2cb0 msgr2=0x7f8bec0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.538+0000 7f8c055b1640 1 --2- 172.21.15.6:0/1903887504 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8bec0a2cb0 0x7f8bec0a51c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8c0006a370 tx=0x7f8bf0005f90 comp rx=0 tx=0).stop 2024-05-20T17:04:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.538+0000 7f8c055b1640 1 -- 172.21.15.6:0/1903887504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c00101210 msgr2=0x7f8c00199610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.538+0000 7f8c055b1640 1 --2- 172.21.15.6:0/1903887504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c00101210 0x7f8c00199610 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8be800d950 tx=0x7f8be800de10 comp rx=0 tx=0).stop 2024-05-20T17:04:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.538+0000 7f8c055b1640 1 -- 172.21.15.6:0/1903887504 shutdown_connections 2024-05-20T17:04:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.538+0000 7f8c055b1640 1 --2- 172.21.15.6:0/1903887504 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8bec0a2cb0 0x7f8bec0a51c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.538+0000 7f8c055b1640 1 --2- 172.21.15.6:0/1903887504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c00104060 0x7f8c001a05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.538+0000 7f8c055b1640 1 --2- 172.21.15.6:0/1903887504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c00101210 0x7f8c00199610 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.538+0000 7f8c055b1640 1 --2- 172.21.15.6:0/1903887504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c00100710 0x7f8c001990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.538+0000 7f8c055b1640 1 -- 172.21.15.6:0/1903887504 >> 172.21.15.6:0/1903887504 conn(0x7f8c000fc330 msgr2=0x7f8c00106bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.538+0000 7f8c055b1640 1 -- 172.21.15.6:0/1903887504 shutdown_connections 2024-05-20T17:04:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.538+0000 7f8c055b1640 1 -- 172.21.15.6:0/1903887504 wait complete. 2024-05-20T17:04:24.551 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:00:12.516679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:04:24.551 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:04:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.669+0000 7ff3025bc640 1 -- 172.21.15.6:0/1725750732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2fc105bf0 msgr2=0x7ff2fc1080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.669+0000 7ff3025bc640 1 --2- 172.21.15.6:0/1725750732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2fc105bf0 0x7ff2fc1080d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009900 tx=0x7ff2f002a410 comp rx=0 tx=0).stop 2024-05-20T17:04:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.669+0000 7ff3025bc640 1 -- 172.21.15.6:0/1725750732 shutdown_connections 2024-05-20T17:04:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.669+0000 7ff3025bc640 1 --2- 172.21.15.6:0/1725750732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2fc108760 0x7ff2fc10ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.669+0000 7ff3025bc640 1 --2- 172.21.15.6:0/1725750732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2fc105bf0 0x7ff2fc1080d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.669+0000 7ff3025bc640 1 --2- 172.21.15.6:0/1725750732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2fc100e60 0x7ff2fc101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.669+0000 7ff3025bc640 1 -- 172.21.15.6:0/1725750732 >> 172.21.15.6:0/1725750732 conn(0x7ff2fc0fc330 msgr2=0x7ff2fc0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.669+0000 7ff3025bc640 1 -- 172.21.15.6:0/1725750732 shutdown_connections 2024-05-20T17:04:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.669+0000 7ff3025bc640 1 -- 172.21.15.6:0/1725750732 wait complete. 2024-05-20T17:04:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.670+0000 7ff3025bc640 1 Processor -- start 2024-05-20T17:04:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.670+0000 7ff3025bc640 1 -- start start 2024-05-20T17:04:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.670+0000 7ff3025bc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2fc100e60 0x7ff2fc199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.670+0000 7ff3025bc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2fc105bf0 0x7ff2fc199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.670+0000 7ff3025bc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2fc108760 0x7ff2fc1a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.670+0000 7ff3025bc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc10e640 con 0x7ff2fc108760 2024-05-20T17:04:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.670+0000 7ff3025bc640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc10e4c0 con 0x7ff2fc105bf0 2024-05-20T17:04:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.670+0000 7ff3025bc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc10e7c0 con 0x7ff2fc100e60 2024-05-20T17:04:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.670+0000 7ff300b59640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2fc108760 0x7ff2fc1a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:24.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.670+0000 7ff300b59640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2fc108760 0x7ff2fc1a06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36224/0 (socket says 172.21.15.6:36224) 2024-05-20T17:04:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.670+0000 7ff300b59640 1 -- 172.21.15.6:0/2941974860 learned_addr learned my addr 172.21.15.6:0/2941974860 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.671+0000 7ff2fb7fe640 1 --2- 172.21.15.6:0/2941974860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2fc105bf0 0x7ff2fc199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.671+0000 7ff2fbfff640 1 --2- 172.21.15.6:0/2941974860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2fc100e60 0x7ff2fc199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.671+0000 7ff300b59640 1 -- 172.21.15.6:0/2941974860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2fc100e60 msgr2=0x7ff2fc199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.671+0000 7ff300b59640 1 --2- 172.21.15.6:0/2941974860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2fc100e60 0x7ff2fc199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.671+0000 7ff300b59640 1 -- 172.21.15.6:0/2941974860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2fc105bf0 msgr2=0x7ff2fc199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.671+0000 7ff300b59640 1 --2- 172.21.15.6:0/2941974860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2fc105bf0 0x7ff2fc199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.671+0000 7ff300b59640 1 -- 172.21.15.6:0/2941974860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2fc1a0d50 con 0x7ff2fc108760 2024-05-20T17:04:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.671+0000 7ff300b59640 1 --2- 172.21.15.6:0/2941974860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2fc108760 0x7ff2fc1a06e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400cad0 tx=0x7ff2f400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.671+0000 7ff2f97fa640 1 -- 172.21.15.6:0/2941974860 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f400ae20 con 0x7ff2fc108760 2024-05-20T17:04:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.671+0000 7ff3025bc640 1 -- 172.21.15.6:0/2941974860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2fc1a0fe0 con 0x7ff2fc108760 2024-05-20T17:04:24.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.671+0000 7ff2f97fa640 1 -- 172.21.15.6:0/2941974860 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff2f4005020 con 0x7ff2fc108760 2024-05-20T17:04:24.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.671+0000 7ff2f97fa640 1 -- 172.21.15.6:0/2941974860 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f400f6b0 con 0x7ff2fc108760 2024-05-20T17:04:24.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.671+0000 7ff3025bc640 1 -- 172.21.15.6:0/2941974860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2fc1a14d0 con 0x7ff2fc108760 2024-05-20T17:04:24.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.672+0000 7ff3025bc640 1 -- 172.21.15.6:0/2941974860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2fc0fde50 con 0x7ff2fc108760 2024-05-20T17:04:24.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.673+0000 7ff2f97fa640 1 -- 172.21.15.6:0/2941974860 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ff2f40051d0 con 0x7ff2fc108760 2024-05-20T17:04:24.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.674+0000 7ff2f97fa640 1 --2- 172.21.15.6:0/2941974860 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff2e40a2b90 0x7ff2e40a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:24.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.674+0000 7ff2fbfff640 1 --2- 172.21.15.6:0/2941974860 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff2e40a2b90 0x7ff2e40a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:24.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.674+0000 7ff2f97fa640 1 -- 172.21.15.6:0/2941974860 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7ff2f40cedd0 con 0x7ff2fc108760 2024-05-20T17:04:24.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.675+0000 7ff2fbfff640 1 --2- 172.21.15.6:0/2941974860 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff2e40a2b90 0x7ff2e40a50a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc06a5a0 tx=0x7ff2ec008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:24.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.679+0000 7ff2f97fa640 1 -- 172.21.15.6:0/2941974860 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff2f4014030 con 0x7ff2fc108760 2024-05-20T17:04:24.862 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:24 smithi171 ceph-mon[35901]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi062=b;smithi062=e;smithi062=h;smithi062=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:04:24.862 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:24 smithi171 ceph-mon[35901]: Saving service mds.all spec with placement smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi062=b;smithi062=e;smithi062=h;smithi062=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l;count:12 2024-05-20T17:04:24.862 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:24 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:24.862 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:24 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:04:24.862 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:24 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:24.862 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:24 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:24.862 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:24 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:24.863 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:24 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:24.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.864+0000 7ff3025bc640 1 -- 172.21.15.6:0/2941974860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff2fc02d4c0 con 0x7ff2fc108760 2024-05-20T17:04:24.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.864+0000 7ff2f97fa640 1 -- 172.21.15.6:0/2941974860 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7ff2f409c130 con 0x7ff2fc108760 2024-05-20T17:04:24.864 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:04:24.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.866+0000 7ff3025bc640 1 -- 172.21.15.6:0/2941974860 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff2e40a2b90 msgr2=0x7ff2e40a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:24.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.866+0000 7ff3025bc640 1 --2- 172.21.15.6:0/2941974860 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff2e40a2b90 0x7ff2e40a50a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc06a5a0 tx=0x7ff2ec008040 comp rx=0 tx=0).stop 2024-05-20T17:04:24.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.866+0000 7ff3025bc640 1 -- 172.21.15.6:0/2941974860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2fc108760 msgr2=0x7ff2fc1a06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:24.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.866+0000 7ff3025bc640 1 --2- 172.21.15.6:0/2941974860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2fc108760 0x7ff2fc1a06e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400cad0 tx=0x7ff2f400cf90 comp rx=0 tx=0).stop 2024-05-20T17:04:24.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.866+0000 7ff3025bc640 1 -- 172.21.15.6:0/2941974860 shutdown_connections 2024-05-20T17:04:24.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.866+0000 7ff3025bc640 1 --2- 172.21.15.6:0/2941974860 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff2e40a2b90 0x7ff2e40a50a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.866+0000 7ff3025bc640 1 --2- 172.21.15.6:0/2941974860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2fc108760 0x7ff2fc1a06e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.866+0000 7ff3025bc640 1 --2- 172.21.15.6:0/2941974860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2fc105bf0 0x7ff2fc199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.866+0000 7ff3025bc640 1 --2- 172.21.15.6:0/2941974860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2fc100e60 0x7ff2fc199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.866+0000 7ff3025bc640 1 -- 172.21.15.6:0/2941974860 >> 172.21.15.6:0/2941974860 conn(0x7ff2fc0fc330 msgr2=0x7ff2fc109720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:24.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.866+0000 7ff3025bc640 1 -- 172.21.15.6:0/2941974860 shutdown_connections 2024-05-20T17:04:24.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.866+0000 7ff3025bc640 1 -- 172.21.15.6:0/2941974860 wait complete. 2024-05-20T17:04:24.877 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:24 smithi006 ceph-mon[32486]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi062=b;smithi062=e;smithi062=h;smithi062=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:04:24.877 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:24 smithi006 ceph-mon[32486]: Saving service mds.all spec with placement smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi062=b;smithi062=e;smithi062=h;smithi062=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l;count:12 2024-05-20T17:04:24.877 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:24 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:24.877 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:24 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:04:24.877 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:24 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:24.877 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:24 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:24.877 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:24 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:24.877 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:24 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:24.879 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:04:24.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.993+0000 7efc054f6640 1 -- 172.21.15.6:0/1996124733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc001019b0 msgr2=0x7efc001026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:24.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.993+0000 7efc054f6640 1 --2- 172.21.15.6:0/1996124733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc001019b0 0x7efc001026b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009900 tx=0x7efbf002a410 comp rx=0 tx=0).stop 2024-05-20T17:04:24.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.993+0000 7efc054f6640 1 -- 172.21.15.6:0/1996124733 shutdown_connections 2024-05-20T17:04:24.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.993+0000 7efc054f6640 1 --2- 172.21.15.6:0/1996124733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc001078f0 0x7efc00109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.993+0000 7efc054f6640 1 --2- 172.21.15.6:0/1996124733 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc00102bf0 0x7efc00103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.994+0000 7efc054f6640 1 --2- 172.21.15.6:0/1996124733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc001019b0 0x7efc001026b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.994+0000 7efc054f6640 1 -- 172.21.15.6:0/1996124733 >> 172.21.15.6:0/1996124733 conn(0x7efc000fcba0 msgr2=0x7efc000ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:24.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.994+0000 7efc054f6640 1 -- 172.21.15.6:0/1996124733 shutdown_connections 2024-05-20T17:04:24.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.994+0000 7efc054f6640 1 -- 172.21.15.6:0/1996124733 wait complete. 2024-05-20T17:04:24.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.994+0000 7efc054f6640 1 Processor -- start 2024-05-20T17:04:24.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.994+0000 7efc054f6640 1 -- start start 2024-05-20T17:04:24.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efc054f6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc001019b0 0x7efc000747f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:24.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efc054f6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc00102bf0 0x7efc0019ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efc054f6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc001078f0 0x7efc001a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efc054f6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efc0010d4e0 con 0x7efc001019b0 2024-05-20T17:04:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efc054f6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efc0010d360 con 0x7efc001078f0 2024-05-20T17:04:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efc054f6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efc0010d660 con 0x7efc00102bf0 2024-05-20T17:04:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efbfeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc001019b0 0x7efc000747f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efbfeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc001019b0 0x7efc000747f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36236/0 (socket says 172.21.15.6:36236) 2024-05-20T17:04:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efbfeffd640 1 -- 172.21.15.6:0/948039227 learned_addr learned my addr 172.21.15.6:0/948039227 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efbfe7fc640 1 --2- 172.21.15.6:0/948039227 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc00102bf0 0x7efc0019ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efbff7fe640 1 --2- 172.21.15.6:0/948039227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc001078f0 0x7efc001a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efbfeffd640 1 -- 172.21.15.6:0/948039227 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc00102bf0 msgr2=0x7efc0019ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efbfeffd640 1 --2- 172.21.15.6:0/948039227 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc00102bf0 0x7efc0019ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efbfeffd640 1 -- 172.21.15.6:0/948039227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc001078f0 msgr2=0x7efc001a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efbfeffd640 1 --2- 172.21.15.6:0/948039227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc001078f0 0x7efc001a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efbfeffd640 1 -- 172.21.15.6:0/948039227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc001a0c40 con 0x7efc001019b0 2024-05-20T17:04:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efbff7fe640 1 --2- 172.21.15.6:0/948039227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc001078f0 0x7efc001a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:04:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efbfeffd640 1 --2- 172.21.15.6:0/948039227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc001019b0 0x7efc000747f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efbf00314e0 tx=0x7efbf0003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efbf7fff640 1 -- 172.21.15.6:0/948039227 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf003f070 con 0x7efc001019b0 2024-05-20T17:04:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efbf7fff640 1 -- 172.21.15.6:0/948039227 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efbf0031e40 con 0x7efc001019b0 2024-05-20T17:04:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efc054f6640 1 -- 172.21.15.6:0/948039227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc001a0ed0 con 0x7efc001019b0 2024-05-20T17:04:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.995+0000 7efbf7fff640 1 -- 172.21.15.6:0/948039227 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf0035030 con 0x7efc001019b0 2024-05-20T17:04:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.996+0000 7efc054f6640 1 -- 172.21.15.6:0/948039227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc001a12d0 con 0x7efc001019b0 2024-05-20T17:04:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.996+0000 7efc054f6640 1 -- 172.21.15.6:0/948039227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc00106700 con 0x7efc001019b0 2024-05-20T17:04:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.999+0000 7efbf7fff640 1 -- 172.21.15.6:0/948039227 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7efbf0042070 con 0x7efc001019b0 2024-05-20T17:04:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.999+0000 7efbf7fff640 1 --2- 172.21.15.6:0/948039227 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7efbec0a2c30 0x7efbec0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.999+0000 7efbfe7fc640 1 --2- 172.21.15.6:0/948039227 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7efbec0a2c30 0x7efbec0a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:24.999+0000 7efbf7fff640 1 -- 172.21.15.6:0/948039227 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7efbf00efa10 con 0x7efc001019b0 2024-05-20T17:04:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:25.000+0000 7efbfe7fc640 1 --2- 172.21.15.6:0/948039227 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7efbec0a2c30 0x7efbec0a5140 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efc00074190 tx=0x7efbe800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:25.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:25.003+0000 7efbf7fff640 1 -- 172.21.15.6:0/948039227 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7efbf003be20 con 0x7efc001019b0 2024-05-20T17:04:25.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:24 smithi062 ceph-mon[35425]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi062=b;smithi062=e;smithi062=h;smithi062=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:04:25.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:24 smithi062 ceph-mon[35425]: Saving service mds.all spec with placement smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi062=b;smithi062=e;smithi062=h;smithi062=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l;count:12 2024-05-20T17:04:25.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:24 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:25.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:24 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:04:25.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:24 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:25.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:24 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:25.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:24 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:25.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:24 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:25.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:25.228+0000 7efc054f6640 1 -- 172.21.15.6:0/948039227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc0002d2a0 con 0x7efc001019b0 2024-05-20T17:04:25.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:25.229+0000 7efbf7fff640 1 -- 172.21.15.6:0/948039227 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7efbf00bce10 con 0x7efc001019b0 2024-05-20T17:04:25.229 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:04:25.229 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-05-20T17:04:25.229 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 1 2024-05-20T17:04:25.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:25.231+0000 7efc054f6640 1 -- 172.21.15.6:0/948039227 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7efbec0a2c30 msgr2=0x7efbec0a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:25.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:25.231+0000 7efc054f6640 1 --2- 172.21.15.6:0/948039227 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7efbec0a2c30 0x7efbec0a5140 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efc00074190 tx=0x7efbe800b410 comp rx=0 tx=0).stop 2024-05-20T17:04:25.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:25.231+0000 7efc054f6640 1 -- 172.21.15.6:0/948039227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc001019b0 msgr2=0x7efc000747f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:25.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:25.231+0000 7efc054f6640 1 --2- 172.21.15.6:0/948039227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc001019b0 0x7efc000747f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efbf00314e0 tx=0x7efbf0003d50 comp rx=0 tx=0).stop 2024-05-20T17:04:25.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:25.231+0000 7efc054f6640 1 -- 172.21.15.6:0/948039227 shutdown_connections 2024-05-20T17:04:25.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:25.231+0000 7efc054f6640 1 --2- 172.21.15.6:0/948039227 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7efbec0a2c30 0x7efbec0a5140 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:25.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:25.231+0000 7efc054f6640 1 --2- 172.21.15.6:0/948039227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc001078f0 0x7efc001a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:25.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:25.231+0000 7efc054f6640 1 --2- 172.21.15.6:0/948039227 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc00102bf0 0x7efc0019ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:25.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:25.231+0000 7efc054f6640 1 --2- 172.21.15.6:0/948039227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc001019b0 0x7efc000747f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:25.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:25.231+0000 7efc054f6640 1 -- 172.21.15.6:0/948039227 >> 172.21.15.6:0/948039227 conn(0x7efc000fcba0 msgr2=0x7efc001038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:25.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:25.231+0000 7efc054f6640 1 -- 172.21.15.6:0/948039227 shutdown_connections 2024-05-20T17:04:25.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:25.231+0000 7efc054f6640 1 -- 172.21.15.6:0/948039227 wait complete. 2024-05-20T17:04:25.850 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:25 smithi171 ceph-mon[35901]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:25.851 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:25 smithi171 ceph-mon[35901]: Deploying daemon mds.l on smithi171 2024-05-20T17:04:25.851 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:25 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1903887504' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:04:25.851 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:25 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2941974860' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:04:25.851 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:25 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/948039227' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:25.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:25 smithi006 ceph-mon[32486]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:25.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:25 smithi006 ceph-mon[32486]: Deploying daemon mds.l on smithi171 2024-05-20T17:04:25.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:25 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1903887504' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:04:25.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:25 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2941974860' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:04:25.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:25 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/948039227' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:26.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:25 smithi062 ceph-mon[35425]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:26.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:25 smithi062 ceph-mon[35425]: Deploying daemon mds.l on smithi171 2024-05-20T17:04:26.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:25 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1903887504' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:04:26.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:25 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2941974860' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:04:26.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:25 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/948039227' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:27.116 INFO:journalctl@ceph.mds.l.smithi171.stdout:May 20 17:04:26 smithi171 systemd[1]: Started Ceph mds.l for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T17:04:27.243 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:04:27.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.373+0000 7fbfea3aa640 1 -- 172.21.15.6:0/3075628987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfe4104120 msgr2=0x7fbfe41022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:27.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.373+0000 7fbfea3aa640 1 --2- 172.21.15.6:0/3075628987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfe4104120 0x7fbfe41022a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4009900 tx=0x7fbfd402a410 comp rx=0 tx=0).stop 2024-05-20T17:04:27.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.373+0000 7fbfea3aa640 1 -- 172.21.15.6:0/3075628987 shutdown_connections 2024-05-20T17:04:27.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.373+0000 7fbfea3aa640 1 --2- 172.21.15.6:0/3075628987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfe4108a20 0x7fbfe410ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:27.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.373+0000 7fbfea3aa640 1 --2- 172.21.15.6:0/3075628987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfe41027e0 0x7fbfe4102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:27.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.373+0000 7fbfea3aa640 1 --2- 172.21.15.6:0/3075628987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfe4104120 0x7fbfe41022a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:27.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.373+0000 7fbfea3aa640 1 -- 172.21.15.6:0/3075628987 >> 172.21.15.6:0/3075628987 conn(0x7fbfe40fdcf0 msgr2=0x7fbfe4100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:27.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.373+0000 7fbfea3aa640 1 -- 172.21.15.6:0/3075628987 shutdown_connections 2024-05-20T17:04:27.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.373+0000 7fbfea3aa640 1 -- 172.21.15.6:0/3075628987 wait complete. 2024-05-20T17:04:27.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.374+0000 7fbfea3aa640 1 Processor -- start 2024-05-20T17:04:27.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.374+0000 7fbfea3aa640 1 -- start start 2024-05-20T17:04:27.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.374+0000 7fbfea3aa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfe41027e0 0x7fbfe4199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:27.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.374+0000 7fbfea3aa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfe4104120 0x7fbfe4199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:27.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.374+0000 7fbfea3aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfe4108a20 0x7fbfe41a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:27.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.374+0000 7fbfea3aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe410e6d0 con 0x7fbfe4108a20 2024-05-20T17:04:27.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.374+0000 7fbfea3aa640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe410e550 con 0x7fbfe41027e0 2024-05-20T17:04:27.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.374+0000 7fbfea3aa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe410e850 con 0x7fbfe4104120 2024-05-20T17:04:27.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.374+0000 7fbfe8947640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfe4108a20 0x7fbfe41a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:27.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.374+0000 7fbfe8947640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfe4108a20 0x7fbfe41a0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36252/0 (socket says 172.21.15.6:36252) 2024-05-20T17:04:27.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.375+0000 7fbfe8947640 1 -- 172.21.15.6:0/875534882 learned_addr learned my addr 172.21.15.6:0/875534882 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:27.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.375+0000 7fbfe3fff640 1 --2- 172.21.15.6:0/875534882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfe41027e0 0x7fbfe4199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:27.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.375+0000 7fbfe37fe640 1 --2- 172.21.15.6:0/875534882 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfe4104120 0x7fbfe4199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:27.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.375+0000 7fbfe8947640 1 -- 172.21.15.6:0/875534882 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfe4104120 msgr2=0x7fbfe4199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:27.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.375+0000 7fbfe8947640 1 --2- 172.21.15.6:0/875534882 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfe4104120 0x7fbfe4199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:27.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.375+0000 7fbfe8947640 1 -- 172.21.15.6:0/875534882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfe41027e0 msgr2=0x7fbfe4199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:27.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.375+0000 7fbfe8947640 1 --2- 172.21.15.6:0/875534882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfe41027e0 0x7fbfe4199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:27.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.375+0000 7fbfe8947640 1 -- 172.21.15.6:0/875534882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe41a0d80 con 0x7fbfe4108a20 2024-05-20T17:04:27.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.375+0000 7fbfe37fe640 1 --2- 172.21.15.6:0/875534882 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfe4104120 0x7fbfe4199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:04:27.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.375+0000 7fbfe8947640 1 --2- 172.21.15.6:0/875534882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfe4108a20 0x7fbfe41a0710 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00cad0 tx=0x7fbfdc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:27.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.375+0000 7fbfe17fa640 1 -- 172.21.15.6:0/875534882 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc00ae20 con 0x7fbfe4108a20 2024-05-20T17:04:27.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.375+0000 7fbfea3aa640 1 -- 172.21.15.6:0/875534882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe41a1070 con 0x7fbfe4108a20 2024-05-20T17:04:27.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.375+0000 7fbfe17fa640 1 -- 172.21.15.6:0/875534882 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbfdc005020 con 0x7fbfe4108a20 2024-05-20T17:04:27.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.375+0000 7fbfe17fa640 1 -- 172.21.15.6:0/875534882 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc00f6b0 con 0x7fbfe4108a20 2024-05-20T17:04:27.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.375+0000 7fbfea3aa640 1 -- 172.21.15.6:0/875534882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe41a15c0 con 0x7fbfe4108a20 2024-05-20T17:04:27.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.376+0000 7fbfea3aa640 1 -- 172.21.15.6:0/875534882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe40691c0 con 0x7fbfe4108a20 2024-05-20T17:04:27.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.378+0000 7fbfe17fa640 1 -- 172.21.15.6:0/875534882 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fbfdc0051d0 con 0x7fbfe4108a20 2024-05-20T17:04:27.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.379+0000 7fbfe17fa640 1 --2- 172.21.15.6:0/875534882 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbfcc0a2c30 0x7fbfcc0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:27.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.379+0000 7fbfe3fff640 1 --2- 172.21.15.6:0/875534882 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbfcc0a2c30 0x7fbfcc0a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:27.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.379+0000 7fbfe17fa640 1 -- 172.21.15.6:0/875534882 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fbfdc0ceff0 con 0x7fbfe4108a20 2024-05-20T17:04:27.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.379+0000 7fbfe3fff640 1 --2- 172.21.15.6:0/875534882 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbfcc0a2c30 0x7fbfcc0a5140 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40314e0 tx=0x7fbfd4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:27.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.383+0000 7fbfe17fa640 1 -- 172.21.15.6:0/875534882 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbfdc014030 con 0x7fbfe4108a20 2024-05-20T17:04:27.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.605+0000 7fbfea3aa640 1 -- 172.21.15.6:0/875534882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbfe4107830 con 0x7fbfe4108a20 2024-05-20T17:04:27.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.606+0000 7fbfe17fa640 1 -- 172.21.15.6:0/875534882 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7fbfdc09c3f0 con 0x7fbfe4108a20 2024-05-20T17:04:27.607 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:04:27.607 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-20T17:04:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 2 2024-05-20T17:04:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.608+0000 7fbfea3aa640 1 -- 172.21.15.6:0/875534882 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbfcc0a2c30 msgr2=0x7fbfcc0a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.608+0000 7fbfea3aa640 1 --2- 172.21.15.6:0/875534882 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbfcc0a2c30 0x7fbfcc0a5140 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40314e0 tx=0x7fbfd4031400 comp rx=0 tx=0).stop 2024-05-20T17:04:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.608+0000 7fbfea3aa640 1 -- 172.21.15.6:0/875534882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfe4108a20 msgr2=0x7fbfe41a0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.608+0000 7fbfea3aa640 1 --2- 172.21.15.6:0/875534882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfe4108a20 0x7fbfe41a0710 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00cad0 tx=0x7fbfdc00cf90 comp rx=0 tx=0).stop 2024-05-20T17:04:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.608+0000 7fbfea3aa640 1 -- 172.21.15.6:0/875534882 shutdown_connections 2024-05-20T17:04:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.608+0000 7fbfea3aa640 1 --2- 172.21.15.6:0/875534882 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbfcc0a2c30 0x7fbfcc0a5140 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.608+0000 7fbfea3aa640 1 --2- 172.21.15.6:0/875534882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfe4108a20 0x7fbfe41a0710 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.608+0000 7fbfea3aa640 1 --2- 172.21.15.6:0/875534882 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfe4104120 0x7fbfe4199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.608+0000 7fbfea3aa640 1 --2- 172.21.15.6:0/875534882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfe41027e0 0x7fbfe4199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.608+0000 7fbfea3aa640 1 -- 172.21.15.6:0/875534882 >> 172.21.15.6:0/875534882 conn(0x7fbfe40fdcf0 msgr2=0x7fbfe4104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.608+0000 7fbfea3aa640 1 -- 172.21.15.6:0/875534882 shutdown_connections 2024-05-20T17:04:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:27.608+0000 7fbfea3aa640 1 -- 172.21.15.6:0/875534882 wait complete. 2024-05-20T17:04:27.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:27 smithi006 ceph-mon[32486]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:27.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:27 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.171:6832/1476847062,v1:172.21.15.171:6833/1476847062] up:boot 2024-05-20T17:04:27.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:27 smithi006 ceph-mon[32486]: fsmap 1 up:standby 2024-05-20T17:04:27.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:27 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-20T17:04:27.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:27 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:27.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:27 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:27.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:27 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:27.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:27 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:27.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:27 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:27.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:27 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:27.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:27 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/875534882' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:27.928 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:27 smithi062 ceph-mon[35425]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:27.929 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:27 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.171:6832/1476847062,v1:172.21.15.171:6833/1476847062] up:boot 2024-05-20T17:04:27.929 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:27 smithi062 ceph-mon[35425]: fsmap 1 up:standby 2024-05-20T17:04:27.929 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:27 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-20T17:04:27.929 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:27 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:27.929 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:27 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:27.929 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:27 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:27.930 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:27 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:27.930 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:27 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:27.930 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:27 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:27.930 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:27 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/875534882' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:28.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:27 smithi171 ceph-mon[35901]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:28.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:27 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.171:6832/1476847062,v1:172.21.15.171:6833/1476847062] up:boot 2024-05-20T17:04:28.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:27 smithi171 ceph-mon[35901]: fsmap 1 up:standby 2024-05-20T17:04:28.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-20T17:04:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:27 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:28.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:27 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/875534882' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:29.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:28 smithi062 ceph-mon[35425]: Deploying daemon mds.k on smithi062 2024-05-20T17:04:29.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:28 smithi171 ceph-mon[35901]: Deploying daemon mds.k on smithi062 2024-05-20T17:04:29.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:28 smithi006 ceph-mon[32486]: Deploying daemon mds.k on smithi062 2024-05-20T17:04:29.506 INFO:journalctl@ceph.mds.k.smithi062.stdout:May 20 17:04:29 smithi062 systemd[1]: Starting Ceph mds.k for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:04:29.620 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:04:29.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.756+0000 7fb88141b640 1 -- 172.21.15.6:0/738329692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb87c1078f0 msgr2=0x7fb87c109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:29.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.756+0000 7fb88141b640 1 --2- 172.21.15.6:0/738329692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb87c1078f0 0x7fb87c109d10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb874009ca0 tx=0x7fb87402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:04:29.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.756+0000 7fb88141b640 1 -- 172.21.15.6:0/738329692 shutdown_connections 2024-05-20T17:04:29.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.756+0000 7fb88141b640 1 --2- 172.21.15.6:0/738329692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb87c1078f0 0x7fb87c109d10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:29.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.756+0000 7fb88141b640 1 --2- 172.21.15.6:0/738329692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c102bf0 0x7fb87c103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:29.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.756+0000 7fb88141b640 1 --2- 172.21.15.6:0/738329692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb87c1019b0 0x7fb87c1026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:29.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.756+0000 7fb88141b640 1 -- 172.21.15.6:0/738329692 >> 172.21.15.6:0/738329692 conn(0x7fb87c0fcba0 msgr2=0x7fb87c0ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:29.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.756+0000 7fb88141b640 1 -- 172.21.15.6:0/738329692 shutdown_connections 2024-05-20T17:04:29.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.756+0000 7fb88141b640 1 -- 172.21.15.6:0/738329692 wait complete. 2024-05-20T17:04:29.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.757+0000 7fb88141b640 1 Processor -- start 2024-05-20T17:04:29.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.757+0000 7fb88141b640 1 -- start start 2024-05-20T17:04:29.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.757+0000 7fb88141b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb87c1019b0 0x7fb87c19b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:29.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.757+0000 7fb88141b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c102bf0 0x7fb87c19b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:29.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.757+0000 7fb88141b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb87c1078f0 0x7fb87c1a27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:29.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.757+0000 7fb88141b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb87c10d580 con 0x7fb87c1078f0 2024-05-20T17:04:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.757+0000 7fb88141b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb87c10d400 con 0x7fb87c1019b0 2024-05-20T17:04:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.757+0000 7fb88141b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb87c10d700 con 0x7fb87c102bf0 2024-05-20T17:04:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.757+0000 7fb87b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb87c1078f0 0x7fb87c1a27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.757+0000 7fb87b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb87c1078f0 0x7fb87c1a27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36280/0 (socket says 172.21.15.6:36280) 2024-05-20T17:04:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.757+0000 7fb87b7fe640 1 -- 172.21.15.6:0/496809907 learned_addr learned my addr 172.21.15.6:0/496809907 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.758+0000 7fb87affd640 1 --2- 172.21.15.6:0/496809907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb87c1019b0 0x7fb87c19b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.758+0000 7fb87a7fc640 1 --2- 172.21.15.6:0/496809907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c102bf0 0x7fb87c19b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.758+0000 7fb87b7fe640 1 -- 172.21.15.6:0/496809907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c102bf0 msgr2=0x7fb87c19b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.758+0000 7fb87b7fe640 1 --2- 172.21.15.6:0/496809907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c102bf0 0x7fb87c19b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.758+0000 7fb87b7fe640 1 -- 172.21.15.6:0/496809907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb87c1019b0 msgr2=0x7fb87c19b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.758+0000 7fb87b7fe640 1 --2- 172.21.15.6:0/496809907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb87c1019b0 0x7fb87c19b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.758+0000 7fb87b7fe640 1 -- 172.21.15.6:0/496809907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb87c1a2e50 con 0x7fb87c1078f0 2024-05-20T17:04:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.758+0000 7fb87a7fc640 1 --2- 172.21.15.6:0/496809907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c102bf0 0x7fb87c19b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:04:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.758+0000 7fb87b7fe640 1 --2- 172.21.15.6:0/496809907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb87c1078f0 0x7fb87c1a27e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb874031040 tx=0x7fb874003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.758+0000 7fb873fff640 1 -- 172.21.15.6:0/496809907 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb874032ec0 con 0x7fb87c1078f0 2024-05-20T17:04:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.758+0000 7fb88141b640 1 -- 172.21.15.6:0/496809907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb87c1a30e0 con 0x7fb87c1078f0 2024-05-20T17:04:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.758+0000 7fb873fff640 1 -- 172.21.15.6:0/496809907 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb8740044f0 con 0x7fb87c1078f0 2024-05-20T17:04:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.758+0000 7fb873fff640 1 -- 172.21.15.6:0/496809907 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb874030cb0 con 0x7fb87c1078f0 2024-05-20T17:04:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.758+0000 7fb88141b640 1 -- 172.21.15.6:0/496809907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb87c1a3680 con 0x7fb87c1078f0 2024-05-20T17:04:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.759+0000 7fb88141b640 1 -- 172.21.15.6:0/496809907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb87c104fe0 con 0x7fb87c1078f0 2024-05-20T17:04:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.761+0000 7fb873fff640 1 -- 172.21.15.6:0/496809907 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fb8740046a0 con 0x7fb87c1078f0 2024-05-20T17:04:29.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.762+0000 7fb873fff640 1 --2- 172.21.15.6:0/496809907 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb8680a2dd0 0x7fb8680a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:29.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.762+0000 7fb87affd640 1 --2- 172.21.15.6:0/496809907 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb8680a2dd0 0x7fb8680a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:29.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.762+0000 7fb873fff640 1 -- 172.21.15.6:0/496809907 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fb8740f0320 con 0x7fb87c1078f0 2024-05-20T17:04:29.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.762+0000 7fb87affd640 1 --2- 172.21.15.6:0/496809907 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb8680a2dd0 0x7fb8680a52e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb87c1025b0 tx=0x7fb86c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:29.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.767+0000 7fb873fff640 1 -- 172.21.15.6:0/496809907 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb8740bd720 con 0x7fb87c1078f0 2024-05-20T17:04:29.771 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:29 smithi062 ceph-mon[35425]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:29.772 INFO:journalctl@ceph.mds.k.smithi062.stdout:May 20 17:04:29 smithi062 podman[64339]: 2024-05-20 17:04:29.409138626 +0000 UTC m=+0.018073090 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:04:29.772 INFO:journalctl@ceph.mds.k.smithi062.stdout:May 20 17:04:29 smithi062 podman[64339]: 2024-05-20 17:04:29.536122293 +0000 UTC m=+0.145056761 container create 8933224ead3cb50a7b8398c4072c4087a6db68b59027167e2e3eb3c8f2f42783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-05-20T17:04:29.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.998+0000 7fb88141b640 1 -- 172.21.15.6:0/496809907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb87c062750 con 0x7fb87c1078f0 2024-05-20T17:04:29.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:29.999+0000 7fb873fff640 1 -- 172.21.15.6:0/496809907 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7fb8740bd020 con 0x7fb87c1078f0 2024-05-20T17:04:29.999 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:04:29.999 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-20T17:04:29.999 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 2 2024-05-20T17:04:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:30.001+0000 7fb88141b640 1 -- 172.21.15.6:0/496809907 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb8680a2dd0 msgr2=0x7fb8680a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:30.001+0000 7fb88141b640 1 --2- 172.21.15.6:0/496809907 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb8680a2dd0 0x7fb8680a52e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb87c1025b0 tx=0x7fb86c005f90 comp rx=0 tx=0).stop 2024-05-20T17:04:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:30.001+0000 7fb88141b640 1 -- 172.21.15.6:0/496809907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb87c1078f0 msgr2=0x7fb87c1a27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:30.001+0000 7fb88141b640 1 --2- 172.21.15.6:0/496809907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb87c1078f0 0x7fb87c1a27e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb874031040 tx=0x7fb874003ba0 comp rx=0 tx=0).stop 2024-05-20T17:04:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:30.001+0000 7fb88141b640 1 -- 172.21.15.6:0/496809907 shutdown_connections 2024-05-20T17:04:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:30.001+0000 7fb88141b640 1 --2- 172.21.15.6:0/496809907 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb8680a2dd0 0x7fb8680a52e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:30.001+0000 7fb88141b640 1 --2- 172.21.15.6:0/496809907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb87c1078f0 0x7fb87c1a27e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:30.001+0000 7fb88141b640 1 --2- 172.21.15.6:0/496809907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c102bf0 0x7fb87c19b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:30.001+0000 7fb88141b640 1 --2- 172.21.15.6:0/496809907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb87c1019b0 0x7fb87c19b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:30.001+0000 7fb88141b640 1 -- 172.21.15.6:0/496809907 >> 172.21.15.6:0/496809907 conn(0x7fb87c0fcba0 msgr2=0x7fb87c0fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:30.001+0000 7fb88141b640 1 -- 172.21.15.6:0/496809907 shutdown_connections 2024-05-20T17:04:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:30.001+0000 7fb88141b640 1 -- 172.21.15.6:0/496809907 wait complete. 2024-05-20T17:04:30.012 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:29 smithi006 ceph-mon[32486]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:30.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:29 smithi171 ceph-mon[35901]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:30.272 INFO:journalctl@ceph.mds.k.smithi062.stdout:May 20 17:04:29 smithi062 podman[64339]: 2024-05-20 17:04:29.807041174 +0000 UTC m=+0.415975624 container init 8933224ead3cb50a7b8398c4072c4087a6db68b59027167e2e3eb3c8f2f42783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-k, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-20T17:04:30.272 INFO:journalctl@ceph.mds.k.smithi062.stdout:May 20 17:04:29 smithi062 podman[64339]: 2024-05-20 17:04:29.810155628 +0000 UTC m=+0.419090078 container start 8933224ead3cb50a7b8398c4072c4087a6db68b59027167e2e3eb3c8f2f42783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, ceph=True, CEPH_POINT_RELEASE=) 2024-05-20T17:04:30.272 INFO:journalctl@ceph.mds.k.smithi062.stdout:May 20 17:04:29 smithi062 ceph-mds[64358]: -- 172.21.15.62:0/825993206 <== mon.2 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d57ae79a40 con 0x55d57aef1a80 2024-05-20T17:04:30.272 INFO:journalctl@ceph.mds.k.smithi062.stdout:May 20 17:04:29 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-k[64354]: starting mds.k at 2024-05-20T17:04:30.273 INFO:journalctl@ceph.mds.k.smithi062.stdout:May 20 17:04:29 smithi062 bash[64339]: 8933224ead3cb50a7b8398c4072c4087a6db68b59027167e2e3eb3c8f2f42783 2024-05-20T17:04:30.273 INFO:journalctl@ceph.mds.k.smithi062.stdout:May 20 17:04:29 smithi062 systemd[1]: Started Ceph mds.k for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T17:04:31.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:30 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:31.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:30 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:31.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:30 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:31.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:30 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:31.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:30 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:31.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:30 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:31.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:30 smithi062 ceph-mon[35425]: Deploying daemon mds.j on smithi006 2024-05-20T17:04:31.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:30 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/496809907' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:31.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:30 smithi062 ceph-mon[35425]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:31.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:30 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] up:boot 2024-05-20T17:04:31.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:30 smithi062 ceph-mon[35425]: fsmap 2 up:standby 2024-05-20T17:04:31.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:30 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-20T17:04:31.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:30 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:31.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:30 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:31.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:30 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:31.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:30 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:31.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:30 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:31.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:30 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:31.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:30 smithi171 ceph-mon[35901]: Deploying daemon mds.j on smithi006 2024-05-20T17:04:31.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:30 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/496809907' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:31.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:30 smithi171 ceph-mon[35901]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:31.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:30 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] up:boot 2024-05-20T17:04:31.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:30 smithi171 ceph-mon[35901]: fsmap 2 up:standby 2024-05-20T17:04:31.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:30 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-20T17:04:31.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:30 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:31.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:30 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:31.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:30 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:31.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:30 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:31.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:30 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:31.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:30 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:31.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:30 smithi006 ceph-mon[32486]: Deploying daemon mds.j on smithi006 2024-05-20T17:04:31.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:30 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/496809907' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:31.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:30 smithi006 ceph-mon[32486]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:31.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:30 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] up:boot 2024-05-20T17:04:31.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:30 smithi006 ceph-mon[32486]: fsmap 2 up:standby 2024-05-20T17:04:31.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:30 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-20T17:04:32.014 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:04:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.288+0000 7ff1b1461640 1 -- 172.21.15.6:0/727273306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1ac1078f0 msgr2=0x7ff1ac109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.288+0000 7ff1b1461640 1 --2- 172.21.15.6:0/727273306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1ac1078f0 0x7ff1ac109d10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009900 tx=0x7ff1a402a410 comp rx=0 tx=0).stop 2024-05-20T17:04:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.288+0000 7ff1b1461640 1 -- 172.21.15.6:0/727273306 shutdown_connections 2024-05-20T17:04:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.288+0000 7ff1b1461640 1 --2- 172.21.15.6:0/727273306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1ac1078f0 0x7ff1ac109d10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.288+0000 7ff1b1461640 1 --2- 172.21.15.6:0/727273306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1ac102bf0 0x7ff1ac103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.288+0000 7ff1b1461640 1 --2- 172.21.15.6:0/727273306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1ac1019b0 0x7ff1ac1026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:32.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.288+0000 7ff1b1461640 1 -- 172.21.15.6:0/727273306 >> 172.21.15.6:0/727273306 conn(0x7ff1ac0fcba0 msgr2=0x7ff1ac0ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:32.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.288+0000 7ff1b1461640 1 -- 172.21.15.6:0/727273306 shutdown_connections 2024-05-20T17:04:32.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.288+0000 7ff1b1461640 1 -- 172.21.15.6:0/727273306 wait complete. 2024-05-20T17:04:32.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.289+0000 7ff1b1461640 1 Processor -- start 2024-05-20T17:04:32.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.289+0000 7ff1b1461640 1 -- start start 2024-05-20T17:04:32.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.290+0000 7ff1b1461640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1ac1019b0 0x7ff1ac19f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:32.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.290+0000 7ff1b1461640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1ac102bf0 0x7ff1ac19fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:32.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.290+0000 7ff1b1461640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1ac1078f0 0x7ff1ac1a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.290+0000 7ff1b1461640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac10c3a0 con 0x7ff1ac102bf0 2024-05-20T17:04:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.290+0000 7ff1b1461640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac10c220 con 0x7ff1ac1019b0 2024-05-20T17:04:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.290+0000 7ff1b1461640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac10c520 con 0x7ff1ac1078f0 2024-05-20T17:04:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.290+0000 7ff1aa7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1ac102bf0 0x7ff1ac19fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.290+0000 7ff1aa7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1ac102bf0 0x7ff1ac19fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38436/0 (socket says 172.21.15.6:38436) 2024-05-20T17:04:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.290+0000 7ff1aa7fc640 1 -- 172.21.15.6:0/4135946956 learned_addr learned my addr 172.21.15.6:0/4135946956 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.290+0000 7ff1ab7fe640 1 --2- 172.21.15.6:0/4135946956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1ac1078f0 0x7ff1ac1a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.290+0000 7ff1aaffd640 1 --2- 172.21.15.6:0/4135946956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1ac1019b0 0x7ff1ac19f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.290+0000 7ff1aa7fc640 1 -- 172.21.15.6:0/4135946956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1ac1078f0 msgr2=0x7ff1ac1a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.290+0000 7ff1aa7fc640 1 --2- 172.21.15.6:0/4135946956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1ac1078f0 0x7ff1ac1a6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.290+0000 7ff1aa7fc640 1 -- 172.21.15.6:0/4135946956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1ac1019b0 msgr2=0x7ff1ac19f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.290+0000 7ff1aa7fc640 1 --2- 172.21.15.6:0/4135946956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1ac1019b0 0x7ff1ac19f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.290+0000 7ff1aa7fc640 1 -- 172.21.15.6:0/4135946956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ac1a7190 con 0x7ff1ac102bf0 2024-05-20T17:04:32.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.290+0000 7ff1aa7fc640 1 --2- 172.21.15.6:0/4135946956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1ac102bf0 0x7ff1ac19fba0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009d50 tx=0x7ff1a000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:32.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.290+0000 7ff193fff640 1 -- 172.21.15.6:0/4135946956 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0003b70 con 0x7ff1ac102bf0 2024-05-20T17:04:32.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.291+0000 7ff193fff640 1 -- 172.21.15.6:0/4135946956 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff1a0003d10 con 0x7ff1ac102bf0 2024-05-20T17:04:32.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.291+0000 7ff1b1461640 1 -- 172.21.15.6:0/4135946956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1ac1a7480 con 0x7ff1ac102bf0 2024-05-20T17:04:32.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.291+0000 7ff193fff640 1 -- 172.21.15.6:0/4135946956 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a00108f0 con 0x7ff1ac102bf0 2024-05-20T17:04:32.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.291+0000 7ff1b1461640 1 -- 172.21.15.6:0/4135946956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1ac1a7a20 con 0x7ff1ac102bf0 2024-05-20T17:04:32.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.292+0000 7ff1b1461640 1 -- 172.21.15.6:0/4135946956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1ac106700 con 0x7ff1ac102bf0 2024-05-20T17:04:32.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.293+0000 7ff193fff640 1 -- 172.21.15.6:0/4135946956 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ff1a0010a90 con 0x7ff1ac102bf0 2024-05-20T17:04:32.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.294+0000 7ff193fff640 1 --2- 172.21.15.6:0/4135946956 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff1940a2cb0 0x7ff1940a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:32.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.294+0000 7ff1aaffd640 1 --2- 172.21.15.6:0/4135946956 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff1940a2cb0 0x7ff1940a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:32.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.295+0000 7ff193fff640 1 -- 172.21.15.6:0/4135946956 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7ff1a00cf260 con 0x7ff1ac102bf0 2024-05-20T17:04:32.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.295+0000 7ff1aaffd640 1 --2- 172.21.15.6:0/4135946956 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff1940a2cb0 0x7ff1940a51c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac1025b0 tx=0x7ff19c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.298+0000 7ff193fff640 1 -- 172.21.15.6:0/4135946956 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff1a009c6f0 con 0x7ff1ac102bf0 2024-05-20T17:04:32.380 INFO:journalctl@ceph.mds.j.smithi006.stdout:May 20 17:04:32 smithi006 systemd[1]: Starting Ceph mds.j for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:04:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.535+0000 7ff1b1461640 1 -- 172.21.15.6:0/4135946956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1ac02d2a0 con 0x7ff1ac102bf0 2024-05-20T17:04:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.536+0000 7ff193fff640 1 -- 172.21.15.6:0/4135946956 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2221 (secure 0 0 0) 0x7ff1a009bff0 con 0x7ff1ac102bf0 2024-05-20T17:04:32.537 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:04:32.537 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-20T17:04:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 3 2024-05-20T17:04:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.538+0000 7ff1b1461640 1 -- 172.21.15.6:0/4135946956 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff1940a2cb0 msgr2=0x7ff1940a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.538+0000 7ff1b1461640 1 --2- 172.21.15.6:0/4135946956 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff1940a2cb0 0x7ff1940a51c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac1025b0 tx=0x7ff19c005f90 comp rx=0 tx=0).stop 2024-05-20T17:04:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.538+0000 7ff1b1461640 1 -- 172.21.15.6:0/4135946956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1ac102bf0 msgr2=0x7ff1ac19fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.538+0000 7ff1b1461640 1 --2- 172.21.15.6:0/4135946956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1ac102bf0 0x7ff1ac19fba0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009d50 tx=0x7ff1a000c6a0 comp rx=0 tx=0).stop 2024-05-20T17:04:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.538+0000 7ff1b1461640 1 -- 172.21.15.6:0/4135946956 shutdown_connections 2024-05-20T17:04:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.538+0000 7ff1b1461640 1 --2- 172.21.15.6:0/4135946956 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff1940a2cb0 0x7ff1940a51c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:32.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.538+0000 7ff1b1461640 1 --2- 172.21.15.6:0/4135946956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1ac1078f0 0x7ff1ac1a6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:32.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.538+0000 7ff1b1461640 1 --2- 172.21.15.6:0/4135946956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1ac102bf0 0x7ff1ac19fba0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:32.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.538+0000 7ff1b1461640 1 --2- 172.21.15.6:0/4135946956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff1ac1019b0 0x7ff1ac19f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:32.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.538+0000 7ff1b1461640 1 -- 172.21.15.6:0/4135946956 >> 172.21.15.6:0/4135946956 conn(0x7ff1ac0fcba0 msgr2=0x7ff1ac1038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:32.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.538+0000 7ff1b1461640 1 -- 172.21.15.6:0/4135946956 shutdown_connections 2024-05-20T17:04:32.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:32.538+0000 7ff1b1461640 1 -- 172.21.15.6:0/4135946956 wait complete. 2024-05-20T17:04:32.723 INFO:journalctl@ceph.mds.j.smithi006.stdout:May 20 17:04:32 smithi006 podman[72585]: 2024-05-20 17:04:32.341324571 +0000 UTC m=+0.022648849 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:04:32.723 INFO:journalctl@ceph.mds.j.smithi006.stdout:May 20 17:04:32 smithi006 podman[72585]: 2024-05-20 17:04:32.468089259 +0000 UTC m=+0.149413528 container create f878d4d3ffd9c8bbdc5f92b2a369336a869d162ea382c95ae2bca1af3a0fb237 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-j, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:04:32.723 INFO:journalctl@ceph.mds.j.smithi006.stdout:May 20 17:04:32 smithi006 podman[72585]: 2024-05-20 17:04:32.723697901 +0000 UTC m=+0.405022179 container init f878d4d3ffd9c8bbdc5f92b2a369336a869d162ea382c95ae2bca1af3a0fb237 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2) 2024-05-20T17:04:33.130 INFO:journalctl@ceph.mds.j.smithi006.stdout:May 20 17:04:32 smithi006 podman[72585]: 2024-05-20 17:04:32.726678414 +0000 UTC m=+0.408002692 container start f878d4d3ffd9c8bbdc5f92b2a369336a869d162ea382c95ae2bca1af3a0fb237 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240514, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_CLEAN=True) 2024-05-20T17:04:33.130 INFO:journalctl@ceph.mds.j.smithi006.stdout:May 20 17:04:32 smithi006 ceph-mds[72607]: -- 172.21.15.6:0/983070156 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557f6a82fa40 con 0x557f6a8a7180 2024-05-20T17:04:33.130 INFO:journalctl@ceph.mds.j.smithi006.stdout:May 20 17:04:32 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-j[72603]: starting mds.j at 2024-05-20T17:04:33.130 INFO:journalctl@ceph.mds.j.smithi006.stdout:May 20 17:04:32 smithi006 bash[72585]: f878d4d3ffd9c8bbdc5f92b2a369336a869d162ea382c95ae2bca1af3a0fb237 2024-05-20T17:04:33.130 INFO:journalctl@ceph.mds.j.smithi006.stdout:May 20 17:04:32 smithi006 systemd[1]: Started Ceph mds.j for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T17:04:33.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:33 smithi062 ceph-mon[35425]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:33.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:33 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/4135946956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:33.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:33 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:33.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:33 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:33.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:33 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:33.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:33 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:33.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:33 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:33.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:33 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:33.532 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:33 smithi006 ceph-mon[32486]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:33.533 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:33 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/4135946956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:33.533 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:33.533 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:33.533 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:33.533 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:33.533 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:33.533 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:33 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:33.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:33 smithi171 ceph-mon[35901]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:33.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:33 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/4135946956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:33.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:33.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:33.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:33.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:33.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:33.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:33 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:34.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:34 smithi062 ceph-mon[35425]: Deploying daemon mds.d on smithi006 2024-05-20T17:04:34.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:34 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.6:6834/1420996362,v1:172.21.15.6:6835/1420996362] up:boot 2024-05-20T17:04:34.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:34 smithi062 ceph-mon[35425]: fsmap 3 up:standby 2024-05-20T17:04:34.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:34 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-20T17:04:34.538 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:34 smithi006 ceph-mon[32486]: Deploying daemon mds.d on smithi006 2024-05-20T17:04:34.538 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:34 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.6:6834/1420996362,v1:172.21.15.6:6835/1420996362] up:boot 2024-05-20T17:04:34.538 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:34 smithi006 ceph-mon[32486]: fsmap 3 up:standby 2024-05-20T17:04:34.538 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:34 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-20T17:04:34.551 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:04:34.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:34 smithi171 ceph-mon[35901]: Deploying daemon mds.d on smithi006 2024-05-20T17:04:34.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:34 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.6:6834/1420996362,v1:172.21.15.6:6835/1420996362] up:boot 2024-05-20T17:04:34.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:34 smithi171 ceph-mon[35901]: fsmap 3 up:standby 2024-05-20T17:04:34.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:34 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-20T17:04:34.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.698+0000 7f2117ea2640 1 -- 172.21.15.6:0/4256040755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2110108f70 msgr2=0x7f2110109380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:34.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.698+0000 7f2117ea2640 1 --2- 172.21.15.6:0/4256040755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2110108f70 0x7f2110109380 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f210c009900 tx=0x7f210c02a410 comp rx=0 tx=0).stop 2024-05-20T17:04:34.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.698+0000 7f2117ea2640 1 -- 172.21.15.6:0/4256040755 shutdown_connections 2024-05-20T17:04:34.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.698+0000 7f2117ea2640 1 --2- 172.21.15.6:0/4256040755 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2110111070 0x7f2110113510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:34.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.698+0000 7f2117ea2640 1 --2- 172.21.15.6:0/4256040755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f211010e710 0x7f2110110b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:34.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.698+0000 7f2117ea2640 1 --2- 172.21.15.6:0/4256040755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2110108f70 0x7f2110109380 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:34.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.698+0000 7f2117ea2640 1 -- 172.21.15.6:0/4256040755 >> 172.21.15.6:0/4256040755 conn(0x7f211006f900 msgr2=0x7f2110071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:34.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.698+0000 7f2117ea2640 1 -- 172.21.15.6:0/4256040755 shutdown_connections 2024-05-20T17:04:34.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.698+0000 7f2117ea2640 1 -- 172.21.15.6:0/4256040755 wait complete. 2024-05-20T17:04:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.699+0000 7f2117ea2640 1 Processor -- start 2024-05-20T17:04:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.699+0000 7f2117ea2640 1 -- start start 2024-05-20T17:04:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.699+0000 7f2117ea2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2110108f70 0x7f21101a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.699+0000 7f2117ea2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f211010e710 0x7f21101a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.699+0000 7f2117ea2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2110111070 0x7f21101a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.699+0000 7f2117ea2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2110116ed0 con 0x7f2110108f70 2024-05-20T17:04:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.699+0000 7f2117ea2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2110116d50 con 0x7f2110111070 2024-05-20T17:04:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.699+0000 7f2117ea2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2110117050 con 0x7f211010e710 2024-05-20T17:04:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.699+0000 7f2115c3e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2110108f70 0x7f21101a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.699+0000 7f2115c3e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2110108f70 0x7f21101a19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38494/0 (socket says 172.21.15.6:38494) 2024-05-20T17:04:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.699+0000 7f2115c3e640 1 -- 172.21.15.6:0/2006922659 learned_addr learned my addr 172.21.15.6:0/2006922659 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.700+0000 7f211543d640 1 --2- 172.21.15.6:0/2006922659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f211010e710 0x7f21101a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.700+0000 7f211643f640 1 --2- 172.21.15.6:0/2006922659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2110111070 0x7f21101a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.700+0000 7f2115c3e640 1 -- 172.21.15.6:0/2006922659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f211010e710 msgr2=0x7f21101a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:34.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.700+0000 7f2115c3e640 1 --2- 172.21.15.6:0/2006922659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f211010e710 0x7f21101a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:34.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.700+0000 7f2115c3e640 1 -- 172.21.15.6:0/2006922659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2110111070 msgr2=0x7f21101a8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:34.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.700+0000 7f2115c3e640 1 --2- 172.21.15.6:0/2006922659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2110111070 0x7f21101a8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:34.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.700+0000 7f2115c3e640 1 -- 172.21.15.6:0/2006922659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21101a9510 con 0x7f2110108f70 2024-05-20T17:04:34.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.700+0000 7f211643f640 1 --2- 172.21.15.6:0/2006922659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2110111070 0x7f21101a8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:04:34.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.700+0000 7f2115c3e640 1 --2- 172.21.15.6:0/2006922659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2110108f70 0x7f21101a19d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f210c0314e0 tx=0x7f210c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:34.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.700+0000 7f2106ffd640 1 -- 172.21.15.6:0/2006922659 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c03f070 con 0x7f2110108f70 2024-05-20T17:04:34.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.700+0000 7f2106ffd640 1 -- 172.21.15.6:0/2006922659 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f210c031c40 con 0x7f2110108f70 2024-05-20T17:04:34.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.700+0000 7f2117ea2640 1 -- 172.21.15.6:0/2006922659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21101a97a0 con 0x7f2110108f70 2024-05-20T17:04:34.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.700+0000 7f2106ffd640 1 -- 172.21.15.6:0/2006922659 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c035030 con 0x7f2110108f70 2024-05-20T17:04:34.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.700+0000 7f2117ea2640 1 -- 172.21.15.6:0/2006922659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21101a9c90 con 0x7f2110108f70 2024-05-20T17:04:34.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.702+0000 7f2117ea2640 1 -- 172.21.15.6:0/2006922659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2110071420 con 0x7f2110108f70 2024-05-20T17:04:34.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.704+0000 7f2106ffd640 1 -- 172.21.15.6:0/2006922659 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f210c042070 con 0x7f2110108f70 2024-05-20T17:04:34.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.705+0000 7f2106ffd640 1 --2- 172.21.15.6:0/2006922659 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f20fc0a2c30 0x7f20fc0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:34.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.705+0000 7f211543d640 1 --2- 172.21.15.6:0/2006922659 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f20fc0a2c30 0x7f20fc0a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:34.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.705+0000 7f2106ffd640 1 -- 172.21.15.6:0/2006922659 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f210c0ef8d0 con 0x7f2110108f70 2024-05-20T17:04:34.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.705+0000 7f211543d640 1 --2- 172.21.15.6:0/2006922659 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f20fc0a2c30 0x7f20fc0a5140 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2100005d00 tx=0x7f2100005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:34.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.710+0000 7f2106ffd640 1 -- 172.21.15.6:0/2006922659 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f210c0bcc30 con 0x7f2110108f70 2024-05-20T17:04:34.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.949+0000 7f2117ea2640 1 -- 172.21.15.6:0/2006922659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f211002d2a0 con 0x7f2110108f70 2024-05-20T17:04:34.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.950+0000 7f2106ffd640 1 -- 172.21.15.6:0/2006922659 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3043 (secure 0 0 0) 0x7f210c0bc530 con 0x7f2110108f70 2024-05-20T17:04:34.950 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:04:34.951 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-20T17:04:34.951 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 4 2024-05-20T17:04:34.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.952+0000 7f2117ea2640 1 -- 172.21.15.6:0/2006922659 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f20fc0a2c30 msgr2=0x7f20fc0a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:34.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.952+0000 7f2117ea2640 1 --2- 172.21.15.6:0/2006922659 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f20fc0a2c30 0x7f20fc0a5140 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2100005d00 tx=0x7f2100005c70 comp rx=0 tx=0).stop 2024-05-20T17:04:34.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.952+0000 7f2117ea2640 1 -- 172.21.15.6:0/2006922659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2110108f70 msgr2=0x7f21101a19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:34.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.952+0000 7f2117ea2640 1 --2- 172.21.15.6:0/2006922659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2110108f70 0x7f21101a19d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f210c0314e0 tx=0x7f210c003c10 comp rx=0 tx=0).stop 2024-05-20T17:04:34.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.952+0000 7f2117ea2640 1 -- 172.21.15.6:0/2006922659 shutdown_connections 2024-05-20T17:04:34.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.952+0000 7f2117ea2640 1 --2- 172.21.15.6:0/2006922659 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f20fc0a2c30 0x7f20fc0a5140 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:34.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.952+0000 7f2117ea2640 1 --2- 172.21.15.6:0/2006922659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2110111070 0x7f21101a8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:34.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.952+0000 7f2117ea2640 1 --2- 172.21.15.6:0/2006922659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f211010e710 0x7f21101a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:34.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.952+0000 7f2117ea2640 1 --2- 172.21.15.6:0/2006922659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2110108f70 0x7f21101a19d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:34.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.952+0000 7f2117ea2640 1 -- 172.21.15.6:0/2006922659 >> 172.21.15.6:0/2006922659 conn(0x7f211006f900 msgr2=0x7f211010f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:34.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.952+0000 7f2117ea2640 1 -- 172.21.15.6:0/2006922659 shutdown_connections 2024-05-20T17:04:34.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:34.952+0000 7f2117ea2640 1 -- 172.21.15.6:0/2006922659 wait complete. 2024-05-20T17:04:35.133 INFO:journalctl@ceph.mds.d.smithi006.stdout:May 20 17:04:35 smithi006 systemd[1]: Starting Ceph mds.d for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:04:35.404 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:35 smithi006 ceph-mon[32486]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:35.404 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:35 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2006922659' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:35.405 INFO:journalctl@ceph.mds.d.smithi006.stdout:May 20 17:04:35 smithi006 podman[72933]: 2024-05-20 17:04:35.172691624 +0000 UTC m=+0.017715381 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:04:35.405 INFO:journalctl@ceph.mds.d.smithi006.stdout:May 20 17:04:35 smithi006 podman[72933]: 2024-05-20 17:04:35.282854504 +0000 UTC m=+0.127878253 container create 7a4a49691aa1bfc3ca5ca9aa9d327d61ad247052b3be7d501d0a786f7760dc93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-d, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-05-20T17:04:35.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:35 smithi062 ceph-mon[35425]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:35.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:35 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2006922659' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:35.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:35 smithi171 ceph-mon[35901]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:35.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:35 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2006922659' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:35.880 INFO:journalctl@ceph.mds.d.smithi006.stdout:May 20 17:04:35 smithi006 podman[72933]: 2024-05-20 17:04:35.519507808 +0000 UTC m=+0.364531566 container init 7a4a49691aa1bfc3ca5ca9aa9d327d61ad247052b3be7d501d0a786f7760dc93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:04:35.880 INFO:journalctl@ceph.mds.d.smithi006.stdout:May 20 17:04:35 smithi006 podman[72933]: 2024-05-20 17:04:35.522775457 +0000 UTC m=+0.367799215 container start 7a4a49691aa1bfc3ca5ca9aa9d327d61ad247052b3be7d501d0a786f7760dc93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-d, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:04:35.880 INFO:journalctl@ceph.mds.d.smithi006.stdout:May 20 17:04:35 smithi006 ceph-mds[72952]: -- 172.21.15.6:0/2665195219 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558195f91a40 con 0x558196009a80 2024-05-20T17:04:35.881 INFO:journalctl@ceph.mds.d.smithi006.stdout:May 20 17:04:35 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-d[72948]: starting mds.d at 2024-05-20T17:04:35.881 INFO:journalctl@ceph.mds.d.smithi006.stdout:May 20 17:04:35 smithi006 bash[72933]: 7a4a49691aa1bfc3ca5ca9aa9d327d61ad247052b3be7d501d0a786f7760dc93 2024-05-20T17:04:35.881 INFO:journalctl@ceph.mds.d.smithi006.stdout:May 20 17:04:35 smithi006 systemd[1]: Started Ceph mds.d for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T17:04:36.965 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:04:37.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:36 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:37.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:36 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:37.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:36 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:37.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:36 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:37.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:36 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:37.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:36 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:37.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:36 smithi062 ceph-mon[35425]: Deploying daemon mds.e on smithi062 2024-05-20T17:04:37.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:36 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.6:6836/1881023641,v1:172.21.15.6:6837/1881023641] up:boot 2024-05-20T17:04:37.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:36 smithi062 ceph-mon[35425]: fsmap 4 up:standby 2024-05-20T17:04:37.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:36 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-20T17:04:37.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.097+0000 7f2eb0656640 1 -- 172.21.15.6:0/1371948502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ea8103d20 msgr2=0x7f2ea8104130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:37.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.097+0000 7f2eb0656640 1 --2- 172.21.15.6:0/1371948502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ea8103d20 0x7f2ea8104130 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009900 tx=0x7f2e9802a410 comp rx=0 tx=0).stop 2024-05-20T17:04:37.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.097+0000 7f2eb0656640 1 -- 172.21.15.6:0/1371948502 shutdown_connections 2024-05-20T17:04:37.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.097+0000 7f2eb0656640 1 --2- 172.21.15.6:0/1371948502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ea8108a20 0x7f2ea810ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:37.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.097+0000 7f2eb0656640 1 --2- 172.21.15.6:0/1371948502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ea8103d20 0x7f2ea8104130 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:37.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.097+0000 7f2eb0656640 1 --2- 172.21.15.6:0/1371948502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ea8102ae0 0x7f2ea81037e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:37.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.097+0000 7f2eb0656640 1 -- 172.21.15.6:0/1371948502 >> 172.21.15.6:0/1371948502 conn(0x7f2ea80fdcf0 msgr2=0x7f2ea8100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:37.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.097+0000 7f2eb0656640 1 -- 172.21.15.6:0/1371948502 shutdown_connections 2024-05-20T17:04:37.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.097+0000 7f2eb0656640 1 -- 172.21.15.6:0/1371948502 wait complete. 2024-05-20T17:04:37.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.098+0000 7f2eb0656640 1 Processor -- start 2024-05-20T17:04:37.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.098+0000 7f2eb0656640 1 -- start start 2024-05-20T17:04:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.098+0000 7f2eb0656640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ea8102ae0 0x7f2ea81991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.098+0000 7f2eb0656640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ea8103d20 0x7f2ea8199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.098+0000 7f2eb0656640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ea8108a20 0x7f2ea81a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.098+0000 7f2eb0656640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea810e650 con 0x7f2ea8102ae0 2024-05-20T17:04:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.098+0000 7f2eb0656640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea810e4d0 con 0x7f2ea8103d20 2024-05-20T17:04:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.098+0000 7f2eb0656640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea810e7d0 con 0x7f2ea8108a20 2024-05-20T17:04:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.098+0000 7f2eae3f2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ea8102ae0 0x7f2ea81991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.098+0000 7f2eae3f2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ea8102ae0 0x7f2ea81991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38530/0 (socket says 172.21.15.6:38530) 2024-05-20T17:04:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.098+0000 7f2eae3f2640 1 -- 172.21.15.6:0/3237129889 learned_addr learned my addr 172.21.15.6:0/3237129889 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.098+0000 7f2eadbf1640 1 --2- 172.21.15.6:0/3237129889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ea8103d20 0x7f2ea8199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.098+0000 7f2eaebf3640 1 --2- 172.21.15.6:0/3237129889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ea8108a20 0x7f2ea81a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.098+0000 7f2eae3f2640 1 -- 172.21.15.6:0/3237129889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ea8108a20 msgr2=0x7f2ea81a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.098+0000 7f2eae3f2640 1 --2- 172.21.15.6:0/3237129889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ea8108a20 0x7f2ea81a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.098+0000 7f2eae3f2640 1 -- 172.21.15.6:0/3237129889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ea8103d20 msgr2=0x7f2ea8199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.098+0000 7f2eae3f2640 1 --2- 172.21.15.6:0/3237129889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ea8103d20 0x7f2ea8199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.098+0000 7f2eae3f2640 1 -- 172.21.15.6:0/3237129889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea81a0d30 con 0x7f2ea8102ae0 2024-05-20T17:04:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.098+0000 7f2eaebf3640 1 --2- 172.21.15.6:0/3237129889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ea8108a20 0x7f2ea81a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:04:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.098+0000 7f2eadbf1640 1 --2- 172.21.15.6:0/3237129889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ea8103d20 0x7f2ea8199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:04:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.099+0000 7f2eae3f2640 1 --2- 172.21.15.6:0/3237129889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ea8102ae0 0x7f2ea81991f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4005d00 tx=0x7f2ea400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.099+0000 7f2e9f7fe640 1 -- 172.21.15.6:0/3237129889 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4017070 con 0x7f2ea8102ae0 2024-05-20T17:04:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.099+0000 7f2e9f7fe640 1 -- 172.21.15.6:0/3237129889 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ea4009c30 con 0x7f2ea8102ae0 2024-05-20T17:04:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.099+0000 7f2e9f7fe640 1 -- 172.21.15.6:0/3237129889 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea400f620 con 0x7f2ea8102ae0 2024-05-20T17:04:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.099+0000 7f2eb0656640 1 -- 172.21.15.6:0/3237129889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea81a0fc0 con 0x7f2ea8102ae0 2024-05-20T17:04:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.099+0000 7f2eb0656640 1 -- 172.21.15.6:0/3237129889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea81a1430 con 0x7f2ea8102ae0 2024-05-20T17:04:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.100+0000 7f2eb0656640 1 -- 172.21.15.6:0/3237129889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ea80691c0 con 0x7f2ea8102ae0 2024-05-20T17:04:37.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.101+0000 7f2e9f7fe640 1 -- 172.21.15.6:0/3237129889 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f2ea401a070 con 0x7f2ea8102ae0 2024-05-20T17:04:37.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.102+0000 7f2e9f7fe640 1 --2- 172.21.15.6:0/3237129889 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2e940a2c30 0x7f2e940a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:37.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.102+0000 7f2eadbf1640 1 --2- 172.21.15.6:0/3237129889 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2e940a2c30 0x7f2e940a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:37.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.102+0000 7f2e9f7fe640 1 -- 172.21.15.6:0/3237129889 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f2ea40ce720 con 0x7f2ea8102ae0 2024-05-20T17:04:37.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.102+0000 7f2eadbf1640 1 --2- 172.21.15.6:0/3237129889 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2e940a2c30 0x7f2e940a5140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e98005ab0 tx=0x7f2e98000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:37.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.107+0000 7f2e9f7fe640 1 -- 172.21.15.6:0/3237129889 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2ea4009de0 con 0x7f2ea8102ae0 2024-05-20T17:04:37.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:36 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:37.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:36 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:37.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:36 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:37.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:36 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:37.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:36 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:37.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:36 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:37.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:36 smithi171 ceph-mon[35901]: Deploying daemon mds.e on smithi062 2024-05-20T17:04:37.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:36 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.6:6836/1881023641,v1:172.21.15.6:6837/1881023641] up:boot 2024-05-20T17:04:37.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:36 smithi171 ceph-mon[35901]: fsmap 4 up:standby 2024-05-20T17:04:37.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:36 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-20T17:04:37.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:36 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:37.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:36 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:37.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:36 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:37.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:36 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:37.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:36 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:37.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:36 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:37.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:36 smithi006 ceph-mon[32486]: Deploying daemon mds.e on smithi062 2024-05-20T17:04:37.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:36 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.6:6836/1881023641,v1:172.21.15.6:6837/1881023641] up:boot 2024-05-20T17:04:37.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:36 smithi006 ceph-mon[32486]: fsmap 4 up:standby 2024-05-20T17:04:37.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:36 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-20T17:04:37.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.331+0000 7f2eb0656640 1 -- 172.21.15.6:0/3237129889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ea8107830 con 0x7f2ea8102ae0 2024-05-20T17:04:37.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.332+0000 7f2e9f7fe640 1 -- 172.21.15.6:0/3237129889 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3865 (secure 0 0 0) 0x7f2ea409ba80 con 0x7f2ea8102ae0 2024-05-20T17:04:37.332 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:04:37.333 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-20T17:04:37.333 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 5 2024-05-20T17:04:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.334+0000 7f2eb0656640 1 -- 172.21.15.6:0/3237129889 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2e940a2c30 msgr2=0x7f2e940a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.334+0000 7f2eb0656640 1 --2- 172.21.15.6:0/3237129889 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2e940a2c30 0x7f2e940a5140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e98005ab0 tx=0x7f2e98000bc0 comp rx=0 tx=0).stop 2024-05-20T17:04:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.334+0000 7f2eb0656640 1 -- 172.21.15.6:0/3237129889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ea8102ae0 msgr2=0x7f2ea81991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.334+0000 7f2eb0656640 1 --2- 172.21.15.6:0/3237129889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ea8102ae0 0x7f2ea81991f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4005d00 tx=0x7f2ea400dde0 comp rx=0 tx=0).stop 2024-05-20T17:04:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.334+0000 7f2eb0656640 1 -- 172.21.15.6:0/3237129889 shutdown_connections 2024-05-20T17:04:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.334+0000 7f2eb0656640 1 --2- 172.21.15.6:0/3237129889 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2e940a2c30 0x7f2e940a5140 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.334+0000 7f2eb0656640 1 --2- 172.21.15.6:0/3237129889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ea8108a20 0x7f2ea81a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.334+0000 7f2eb0656640 1 --2- 172.21.15.6:0/3237129889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ea8103d20 0x7f2ea8199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.334+0000 7f2eb0656640 1 --2- 172.21.15.6:0/3237129889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ea8102ae0 0x7f2ea81991f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.334+0000 7f2eb0656640 1 -- 172.21.15.6:0/3237129889 >> 172.21.15.6:0/3237129889 conn(0x7f2ea80fdcf0 msgr2=0x7f2ea8104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.334+0000 7f2eb0656640 1 -- 172.21.15.6:0/3237129889 shutdown_connections 2024-05-20T17:04:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:37.334+0000 7f2eb0656640 1 -- 172.21.15.6:0/3237129889 wait complete. 2024-05-20T17:04:38.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:37 smithi171 ceph-mon[35901]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:38.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:37 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3237129889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:38.123 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:37 smithi062 ceph-mon[35425]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:38.123 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:37 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3237129889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:38.124 INFO:journalctl@ceph.mds.e.smithi062.stdout:May 20 17:04:38 smithi062 systemd[1]: Starting Ceph mds.e for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:04:38.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:37 smithi006 ceph-mon[32486]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:38.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:37 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3237129889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:38.471 INFO:journalctl@ceph.mds.e.smithi062.stdout:May 20 17:04:38 smithi062 podman[64641]: 2024-05-20 17:04:38.248490792 +0000 UTC m=+0.017996222 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:04:38.471 INFO:journalctl@ceph.mds.e.smithi062.stdout:May 20 17:04:38 smithi062 podman[64641]: 2024-05-20 17:04:38.35265285 +0000 UTC m=+0.122158253 container create 5ef1e1076c9931487c65ca89583116f0582c383033f747bfcfa2745e0f677b9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-e, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240514, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-05-20T17:04:39.022 INFO:journalctl@ceph.mds.e.smithi062.stdout:May 20 17:04:38 smithi062 podman[64641]: 2024-05-20 17:04:38.588803107 +0000 UTC m=+0.358308525 container init 5ef1e1076c9931487c65ca89583116f0582c383033f747bfcfa2745e0f677b9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240514) 2024-05-20T17:04:39.022 INFO:journalctl@ceph.mds.e.smithi062.stdout:May 20 17:04:38 smithi062 podman[64641]: 2024-05-20 17:04:38.591849529 +0000 UTC m=+0.361354940 container start 5ef1e1076c9931487c65ca89583116f0582c383033f747bfcfa2745e0f677b9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5) 2024-05-20T17:04:39.022 INFO:journalctl@ceph.mds.e.smithi062.stdout:May 20 17:04:38 smithi062 ceph-mds[64661]: -- 172.21.15.62:0/1913796375 <== mon.2 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558b3b427a40 con 0x558b3b49f180 2024-05-20T17:04:39.022 INFO:journalctl@ceph.mds.e.smithi062.stdout:May 20 17:04:38 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-e[64657]: starting mds.e at 2024-05-20T17:04:39.023 INFO:journalctl@ceph.mds.e.smithi062.stdout:May 20 17:04:38 smithi062 bash[64641]: 5ef1e1076c9931487c65ca89583116f0582c383033f747bfcfa2745e0f677b9f 2024-05-20T17:04:39.023 INFO:journalctl@ceph.mds.e.smithi062.stdout:May 20 17:04:38 smithi062 systemd[1]: Started Ceph mds.e for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T17:04:39.347 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:04:39.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.476+0000 7f4e297e3640 1 -- 172.21.15.6:0/3396426294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e241019b0 msgr2=0x7f4e241026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:39.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.476+0000 7f4e297e3640 1 --2- 172.21.15.6:0/3396426294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e241019b0 0x7f4e241026b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009900 tx=0x7f4e1402a410 comp rx=0 tx=0).stop 2024-05-20T17:04:39.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.477+0000 7f4e297e3640 1 -- 172.21.15.6:0/3396426294 shutdown_connections 2024-05-20T17:04:39.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.477+0000 7f4e297e3640 1 --2- 172.21.15.6:0/3396426294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e241078f0 0x7f4e24109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:39.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.477+0000 7f4e297e3640 1 --2- 172.21.15.6:0/3396426294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e24102bf0 0x7f4e24103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:39.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.477+0000 7f4e297e3640 1 --2- 172.21.15.6:0/3396426294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e241019b0 0x7f4e241026b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:39.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.477+0000 7f4e297e3640 1 -- 172.21.15.6:0/3396426294 >> 172.21.15.6:0/3396426294 conn(0x7f4e240fcba0 msgr2=0x7f4e240ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:39.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.477+0000 7f4e297e3640 1 -- 172.21.15.6:0/3396426294 shutdown_connections 2024-05-20T17:04:39.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.477+0000 7f4e297e3640 1 -- 172.21.15.6:0/3396426294 wait complete. 2024-05-20T17:04:39.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.477+0000 7f4e297e3640 1 Processor -- start 2024-05-20T17:04:39.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.477+0000 7f4e297e3640 1 -- start start 2024-05-20T17:04:39.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e297e3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e241019b0 0x7f4e24074810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:39.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e297e3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e24102bf0 0x7f4e2419dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:39.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e297e3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e241078f0 0x7f4e241a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:39.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e297e3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2410d490 con 0x7f4e241019b0 2024-05-20T17:04:39.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e297e3640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2410d310 con 0x7f4e241078f0 2024-05-20T17:04:39.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e297e3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2410d610 con 0x7f4e24102bf0 2024-05-20T17:04:39.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e22ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e241019b0 0x7f4e24074810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:39.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e22ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e241019b0 0x7f4e24074810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38546/0 (socket says 172.21.15.6:38546) 2024-05-20T17:04:39.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e22ffd640 1 -- 172.21.15.6:0/262613163 learned_addr learned my addr 172.21.15.6:0/262613163 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:39.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e1bfff640 1 --2- 172.21.15.6:0/262613163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e24102bf0 0x7f4e2419dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:39.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e237fe640 1 --2- 172.21.15.6:0/262613163 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e241078f0 0x7f4e241a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:39.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e22ffd640 1 -- 172.21.15.6:0/262613163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e24102bf0 msgr2=0x7f4e2419dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:39.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e22ffd640 1 --2- 172.21.15.6:0/262613163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e24102bf0 0x7f4e2419dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:39.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e22ffd640 1 -- 172.21.15.6:0/262613163 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e241078f0 msgr2=0x7f4e241a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:39.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e22ffd640 1 --2- 172.21.15.6:0/262613163 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e241078f0 0x7f4e241a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:39.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e22ffd640 1 -- 172.21.15.6:0/262613163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e241a0c50 con 0x7f4e241019b0 2024-05-20T17:04:39.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e237fe640 1 --2- 172.21.15.6:0/262613163 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e241078f0 0x7f4e241a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:04:39.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e22ffd640 1 --2- 172.21.15.6:0/262613163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e241019b0 0x7f4e24074810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4e140314e0 tx=0x7f4e140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:39.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e20ff9640 1 -- 172.21.15.6:0/262613163 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1403f030 con 0x7f4e241019b0 2024-05-20T17:04:39.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e20ff9640 1 -- 172.21.15.6:0/262613163 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e140318f0 con 0x7f4e241019b0 2024-05-20T17:04:39.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e297e3640 1 -- 172.21.15.6:0/262613163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e241a0ee0 con 0x7f4e241019b0 2024-05-20T17:04:39.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.478+0000 7f4e20ff9640 1 -- 172.21.15.6:0/262613163 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e14035070 con 0x7f4e241019b0 2024-05-20T17:04:39.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.479+0000 7f4e297e3640 1 -- 172.21.15.6:0/262613163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e241a1340 con 0x7f4e241019b0 2024-05-20T17:04:39.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.479+0000 7f4e297e3640 1 -- 172.21.15.6:0/262613163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e24106700 con 0x7f4e241019b0 2024-05-20T17:04:39.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.481+0000 7f4e20ff9640 1 -- 172.21.15.6:0/262613163 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f4e14042030 con 0x7f4e241019b0 2024-05-20T17:04:39.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.481+0000 7f4e20ff9640 1 --2- 172.21.15.6:0/262613163 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4e100a2cb0 0x7f4e100a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:39.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.482+0000 7f4e20ff9640 1 -- 172.21.15.6:0/262613163 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f4e140ef450 con 0x7f4e241019b0 2024-05-20T17:04:39.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.482+0000 7f4e1bfff640 1 --2- 172.21.15.6:0/262613163 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4e100a2cb0 0x7f4e100a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:39.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.482+0000 7f4e1bfff640 1 --2- 172.21.15.6:0/262613163 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4e100a2cb0 0x7f4e100a51c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4e240741b0 tx=0x7f4e0c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:39.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.486+0000 7f4e20ff9640 1 -- 172.21.15.6:0/262613163 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4e140bc850 con 0x7f4e241019b0 2024-05-20T17:04:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.709+0000 7f4e297e3640 1 -- 172.21.15.6:0/262613163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e2402d2a0 con 0x7f4e241019b0 2024-05-20T17:04:39.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.710+0000 7f4e20ff9640 1 -- 172.21.15.6:0/262613163 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4684 (secure 0 0 0) 0x7f4e140bc150 con 0x7f4e241019b0 2024-05-20T17:04:39.710 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:04:39.710 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/78063155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":78063155},{"type":"v1","addr":"172.21.15.62:6835","nonce":78063155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-20T17:04:39.711 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 6 2024-05-20T17:04:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.712+0000 7f4e297e3640 1 -- 172.21.15.6:0/262613163 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4e100a2cb0 msgr2=0x7f4e100a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.712+0000 7f4e297e3640 1 --2- 172.21.15.6:0/262613163 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4e100a2cb0 0x7f4e100a51c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4e240741b0 tx=0x7f4e0c005f90 comp rx=0 tx=0).stop 2024-05-20T17:04:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.712+0000 7f4e297e3640 1 -- 172.21.15.6:0/262613163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e241019b0 msgr2=0x7f4e24074810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.712+0000 7f4e297e3640 1 --2- 172.21.15.6:0/262613163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e241019b0 0x7f4e24074810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4e140314e0 tx=0x7f4e140042f0 comp rx=0 tx=0).stop 2024-05-20T17:04:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.712+0000 7f4e297e3640 1 -- 172.21.15.6:0/262613163 shutdown_connections 2024-05-20T17:04:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.712+0000 7f4e297e3640 1 --2- 172.21.15.6:0/262613163 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4e100a2cb0 0x7f4e100a51c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.712+0000 7f4e297e3640 1 --2- 172.21.15.6:0/262613163 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e241078f0 0x7f4e241a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.712+0000 7f4e297e3640 1 --2- 172.21.15.6:0/262613163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e24102bf0 0x7f4e2419dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.712+0000 7f4e297e3640 1 --2- 172.21.15.6:0/262613163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e241019b0 0x7f4e24074810 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.712+0000 7f4e297e3640 1 -- 172.21.15.6:0/262613163 >> 172.21.15.6:0/262613163 conn(0x7f4e240fcba0 msgr2=0x7f4e241038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.712+0000 7f4e297e3640 1 -- 172.21.15.6:0/262613163 shutdown_connections 2024-05-20T17:04:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:39.712+0000 7f4e297e3640 1 -- 172.21.15.6:0/262613163 wait complete. 2024-05-20T17:04:40.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:39 smithi062 ceph-mon[35425]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:40.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:39 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:40.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:39 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:40.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:39 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:40.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:39 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:40.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:39 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:40.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:39 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:40.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:39 smithi062 ceph-mon[35425]: Deploying daemon mds.f on smithi171 2024-05-20T17:04:40.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:39 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] up:boot 2024-05-20T17:04:40.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:39 smithi062 ceph-mon[35425]: fsmap 5 up:standby 2024-05-20T17:04:40.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:39 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-20T17:04:40.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:39 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/262613163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:40.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:39 smithi171 ceph-mon[35901]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:40.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:39 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:40.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:39 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:40.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:39 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:40.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:39 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:40.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:39 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:40.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:39 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:40.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:39 smithi171 ceph-mon[35901]: Deploying daemon mds.f on smithi171 2024-05-20T17:04:40.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:39 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] up:boot 2024-05-20T17:04:40.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:39 smithi171 ceph-mon[35901]: fsmap 5 up:standby 2024-05-20T17:04:40.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:39 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-20T17:04:40.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:39 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/262613163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:40.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:39 smithi006 ceph-mon[32486]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:40.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:39 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:40.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:39 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:40.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:39 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:40.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:39 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:40.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:39 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:40.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:39 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:40.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:39 smithi006 ceph-mon[32486]: Deploying daemon mds.f on smithi171 2024-05-20T17:04:40.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:39 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] up:boot 2024-05-20T17:04:40.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:39 smithi006 ceph-mon[32486]: fsmap 5 up:standby 2024-05-20T17:04:40.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:39 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-20T17:04:40.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:39 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/262613163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:41.116 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 20 17:04:40 smithi171 systemd[1]: Starting Ceph mds.f for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:04:41.435 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 20 17:04:41 smithi171 podman[65559]: 2024-05-20 17:04:41.04802683 +0000 UTC m=+0.017642399 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:04:41.435 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 20 17:04:41 smithi171 podman[65559]: 2024-05-20 17:04:41.19135384 +0000 UTC m=+0.160969410 container create ece7236814011bdc3892e62a7a71588115a9e312bd4b0fd2d4be036ae7e265dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True) 2024-05-20T17:04:41.436 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 20 17:04:41 smithi171 podman[65559]: 2024-05-20 17:04:41.436366097 +0000 UTC m=+0.405981683 container init ece7236814011bdc3892e62a7a71588115a9e312bd4b0fd2d4be036ae7e265dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-f, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-20T17:04:41.725 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:04:41.738 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 20 17:04:41 smithi171 podman[65559]: 2024-05-20 17:04:41.439337887 +0000 UTC m=+0.408953456 container start ece7236814011bdc3892e62a7a71588115a9e312bd4b0fd2d4be036ae7e265dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2) 2024-05-20T17:04:41.738 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 20 17:04:41 smithi171 ceph-mds[65578]: -- 172.21.15.171:0/1610760576 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56053c6a5a40 con 0x56053c71d600 2024-05-20T17:04:41.738 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 20 17:04:41 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-f[65574]: starting mds.f at 2024-05-20T17:04:41.738 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 20 17:04:41 smithi171 bash[65559]: ece7236814011bdc3892e62a7a71588115a9e312bd4b0fd2d4be036ae7e265dd 2024-05-20T17:04:41.738 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 20 17:04:41 smithi171 systemd[1]: Started Ceph mds.f for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T17:04:41.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.855+0000 7f3c8ba44640 1 -- 172.21.15.6:0/1502293816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c84103d20 msgr2=0x7f3c84104130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:41.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.855+0000 7f3c8ba44640 1 --2- 172.21.15.6:0/1502293816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c84103d20 0x7f3c84104130 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3c74009900 tx=0x7f3c7402a410 comp rx=0 tx=0).stop 2024-05-20T17:04:41.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.855+0000 7f3c8ba44640 1 -- 172.21.15.6:0/1502293816 shutdown_connections 2024-05-20T17:04:41.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.855+0000 7f3c8ba44640 1 --2- 172.21.15.6:0/1502293816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84108a20 0x7f3c8410ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:41.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.855+0000 7f3c8ba44640 1 --2- 172.21.15.6:0/1502293816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c84103d20 0x7f3c84104130 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:41.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.855+0000 7f3c8ba44640 1 --2- 172.21.15.6:0/1502293816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c84102ae0 0x7f3c841037e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:41.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.855+0000 7f3c8ba44640 1 -- 172.21.15.6:0/1502293816 >> 172.21.15.6:0/1502293816 conn(0x7f3c840fdcf0 msgr2=0x7f3c84100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:41.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.855+0000 7f3c8ba44640 1 -- 172.21.15.6:0/1502293816 shutdown_connections 2024-05-20T17:04:41.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.855+0000 7f3c8ba44640 1 -- 172.21.15.6:0/1502293816 wait complete. 2024-05-20T17:04:41.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.856+0000 7f3c8ba44640 1 Processor -- start 2024-05-20T17:04:41.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.856+0000 7f3c8ba44640 1 -- start start 2024-05-20T17:04:41.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.856+0000 7f3c8ba44640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84102ae0 0x7f3c84199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:41.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.856+0000 7f3c8ba44640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c84103d20 0x7f3c84199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:41.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.856+0000 7f3c8ba44640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c84108a20 0x7f3c841a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:41.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.856+0000 7f3c8ba44640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8410e5e0 con 0x7f3c84103d20 2024-05-20T17:04:41.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.856+0000 7f3c8ba44640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8410e460 con 0x7f3c84102ae0 2024-05-20T17:04:41.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.856+0000 7f3c8ba44640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8410e760 con 0x7f3c84108a20 2024-05-20T17:04:41.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.856+0000 7f3c88fdf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c84103d20 0x7f3c84199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:41.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.856+0000 7f3c88fdf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c84103d20 0x7f3c84199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59000/0 (socket says 172.21.15.6:59000) 2024-05-20T17:04:41.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.856+0000 7f3c88fdf640 1 -- 172.21.15.6:0/301070993 learned_addr learned my addr 172.21.15.6:0/301070993 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:41.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.856+0000 7f3c89fe1640 1 --2- 172.21.15.6:0/301070993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c84108a20 0x7f3c841a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:41.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.856+0000 7f3c897e0640 1 --2- 172.21.15.6:0/301070993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84102ae0 0x7f3c84199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:41.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.857+0000 7f3c88fdf640 1 -- 172.21.15.6:0/301070993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c84108a20 msgr2=0x7f3c841a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:41.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.857+0000 7f3c88fdf640 1 --2- 172.21.15.6:0/301070993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c84108a20 0x7f3c841a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:41.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.857+0000 7f3c88fdf640 1 -- 172.21.15.6:0/301070993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84102ae0 msgr2=0x7f3c84199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:41.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.857+0000 7f3c88fdf640 1 --2- 172.21.15.6:0/301070993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84102ae0 0x7f3c84199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:41.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.857+0000 7f3c88fdf640 1 -- 172.21.15.6:0/301070993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c841a0c40 con 0x7f3c84103d20 2024-05-20T17:04:41.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.857+0000 7f3c88fdf640 1 --2- 172.21.15.6:0/301070993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c84103d20 0x7f3c84199640 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3c74031440 tx=0x7f3c740043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:41.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.857+0000 7f3c7a7fc640 1 -- 172.21.15.6:0/301070993 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7403f030 con 0x7f3c84103d20 2024-05-20T17:04:41.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.857+0000 7f3c7a7fc640 1 -- 172.21.15.6:0/301070993 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3c74003cb0 con 0x7f3c84103d20 2024-05-20T17:04:41.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.857+0000 7f3c8ba44640 1 -- 172.21.15.6:0/301070993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c841a0ed0 con 0x7f3c84103d20 2024-05-20T17:04:41.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.857+0000 7f3c7a7fc640 1 -- 172.21.15.6:0/301070993 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c74035070 con 0x7f3c84103d20 2024-05-20T17:04:41.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.857+0000 7f3c8ba44640 1 -- 172.21.15.6:0/301070993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c841a12e0 con 0x7f3c84103d20 2024-05-20T17:04:41.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.858+0000 7f3c8ba44640 1 -- 172.21.15.6:0/301070993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c84107830 con 0x7f3c84103d20 2024-05-20T17:04:41.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.860+0000 7f3c7a7fc640 1 -- 172.21.15.6:0/301070993 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f3c74042030 con 0x7f3c84103d20 2024-05-20T17:04:41.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.861+0000 7f3c7a7fc640 1 --2- 172.21.15.6:0/301070993 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3c700a2c30 0x7f3c700a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:41.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.861+0000 7f3c897e0640 1 --2- 172.21.15.6:0/301070993 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3c700a2c30 0x7f3c700a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:41.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.861+0000 7f3c7a7fc640 1 -- 172.21.15.6:0/301070993 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f3c740ef7d0 con 0x7f3c84103d20 2024-05-20T17:04:41.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.861+0000 7f3c897e0640 1 --2- 172.21.15.6:0/301070993 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3c700a2c30 0x7f3c700a5140 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3c80005fd0 tx=0x7f3c8000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:41.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:41.865+0000 7f3c7a7fc640 1 -- 172.21.15.6:0/301070993 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3c740bc560 con 0x7f3c84103d20 2024-05-20T17:04:42.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:41 smithi062 ceph-mon[35425]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:42.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:41 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:42.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:41 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:42.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:41 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:42.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:41 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:42.000 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:41 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:42.001 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:41 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:42.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:42.096+0000 7f3c8ba44640 1 -- 172.21.15.6:0/301070993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c8402d2a0 con 0x7f3c84103d20 2024-05-20T17:04:42.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:42.096+0000 7f3c7a7fc640 1 -- 172.21.15.6:0/301070993 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5512 (secure 0 0 0) 0x7f3c740c0860 con 0x7f3c84103d20 2024-05-20T17:04:42.097 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:04:42.097 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/78063155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":78063155},{"type":"v1","addr":"172.21.15.62:6835","nonce":78063155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1542537621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1542537621},{"type":"v1","addr":"172.21.15.171:6835","nonce":1542537621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-05-20T17:04:42.097 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2024-05-20T17:04:42.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:42.098+0000 7f3c8ba44640 1 -- 172.21.15.6:0/301070993 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3c700a2c30 msgr2=0x7f3c700a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:42.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:42.098+0000 7f3c8ba44640 1 --2- 172.21.15.6:0/301070993 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3c700a2c30 0x7f3c700a5140 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3c80005fd0 tx=0x7f3c8000b410 comp rx=0 tx=0).stop 2024-05-20T17:04:42.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:42.098+0000 7f3c8ba44640 1 -- 172.21.15.6:0/301070993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c84103d20 msgr2=0x7f3c84199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:42.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:42.098+0000 7f3c8ba44640 1 --2- 172.21.15.6:0/301070993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c84103d20 0x7f3c84199640 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3c74031440 tx=0x7f3c740043b0 comp rx=0 tx=0).stop 2024-05-20T17:04:42.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:42.098+0000 7f3c8ba44640 1 -- 172.21.15.6:0/301070993 shutdown_connections 2024-05-20T17:04:42.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:42.098+0000 7f3c8ba44640 1 --2- 172.21.15.6:0/301070993 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3c700a2c30 0x7f3c700a5140 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:42.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:42.098+0000 7f3c8ba44640 1 --2- 172.21.15.6:0/301070993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c84108a20 0x7f3c841a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:42.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:42.098+0000 7f3c8ba44640 1 --2- 172.21.15.6:0/301070993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c84103d20 0x7f3c84199640 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:42.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:42.098+0000 7f3c8ba44640 1 --2- 172.21.15.6:0/301070993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c84102ae0 0x7f3c84199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:42.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:42.098+0000 7f3c8ba44640 1 -- 172.21.15.6:0/301070993 >> 172.21.15.6:0/301070993 conn(0x7f3c840fdcf0 msgr2=0x7f3c84104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:42.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:42.098+0000 7f3c8ba44640 1 -- 172.21.15.6:0/301070993 shutdown_connections 2024-05-20T17:04:42.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:42.098+0000 7f3c8ba44640 1 -- 172.21.15.6:0/301070993 wait complete. 2024-05-20T17:04:42.109 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:41 smithi006 ceph-mon[32486]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:42.109 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:41 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:42.109 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:41 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:42.109 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:41 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:42.109 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:41 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:42.109 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:41 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:42.109 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:41 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:42.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:41 smithi171 ceph-mon[35901]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:42.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:41 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:42.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:41 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:42.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:41 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:42.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:41 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:42.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:41 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:42.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:41 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:42.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:42 smithi171 ceph-mon[35901]: Deploying daemon mds.c on smithi171 2024-05-20T17:04:42.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:42 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] up:boot 2024-05-20T17:04:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:42 smithi171 ceph-mon[35901]: fsmap 6 up:standby 2024-05-20T17:04:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-20T17:04:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:42 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/301070993' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:43.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:42 smithi062 ceph-mon[35425]: Deploying daemon mds.c on smithi171 2024-05-20T17:04:43.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:42 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] up:boot 2024-05-20T17:04:43.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:42 smithi062 ceph-mon[35425]: fsmap 6 up:standby 2024-05-20T17:04:43.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-20T17:04:43.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:42 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/301070993' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:43.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:42 smithi006 ceph-mon[32486]: Deploying daemon mds.c on smithi171 2024-05-20T17:04:43.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:42 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] up:boot 2024-05-20T17:04:43.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:42 smithi006 ceph-mon[32486]: fsmap 6 up:standby 2024-05-20T17:04:43.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-20T17:04:43.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:42 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/301070993' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:43.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:43 smithi171 ceph-mon[35901]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:44.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:43 smithi062 ceph-mon[35425]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:44.111 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:04:44.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:43 smithi006 ceph-mon[32486]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:44.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.240+0000 7fe963c79640 1 -- 172.21.15.6:0/149322856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe95c103cf0 msgr2=0x7fe95c106110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:44.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.240+0000 7fe963c79640 1 --2- 172.21.15.6:0/149322856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe95c103cf0 0x7fe95c106110 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009900 tx=0x7fe94c02a410 comp rx=0 tx=0).stop 2024-05-20T17:04:44.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.240+0000 7fe963c79640 1 -- 172.21.15.6:0/149322856 shutdown_connections 2024-05-20T17:04:44.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.240+0000 7fe963c79640 1 --2- 172.21.15.6:0/149322856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe95c106650 0x7fe95c106a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:44.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.240+0000 7fe963c79640 1 --2- 172.21.15.6:0/149322856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe95c103cf0 0x7fe95c106110 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:44.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.240+0000 7fe963c79640 1 --2- 172.21.15.6:0/149322856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe95c101390 0x7fe95c1037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:44.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.240+0000 7fe963c79640 1 -- 172.21.15.6:0/149322856 >> 172.21.15.6:0/149322856 conn(0x7fe95c0fcba0 msgr2=0x7fe95c0ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:44.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.240+0000 7fe963c79640 1 -- 172.21.15.6:0/149322856 shutdown_connections 2024-05-20T17:04:44.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.240+0000 7fe963c79640 1 -- 172.21.15.6:0/149322856 wait complete. 2024-05-20T17:04:44.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.241+0000 7fe963c79640 1 Processor -- start 2024-05-20T17:04:44.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.241+0000 7fe963c79640 1 -- start start 2024-05-20T17:04:44.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.241+0000 7fe963c79640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe95c101390 0x7fe95c19f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:44.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.241+0000 7fe963c79640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe95c103cf0 0x7fe95c19fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:44.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.241+0000 7fe963c79640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe95c106650 0x7fe95c1a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:44.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.241+0000 7fe963c79640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c114bd0 con 0x7fe95c106650 2024-05-20T17:04:44.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.241+0000 7fe963c79640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c114a50 con 0x7fe95c101390 2024-05-20T17:04:44.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.241+0000 7fe963c79640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c114d50 con 0x7fe95c103cf0 2024-05-20T17:04:44.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.241+0000 7fe962216640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe95c106650 0x7fe95c1a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:44.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.241+0000 7fe961214640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe95c103cf0 0x7fe95c19fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:44.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.241+0000 7fe961214640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe95c103cf0 0x7fe95c19fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:39466/0 (socket says 172.21.15.6:39466) 2024-05-20T17:04:44.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.241+0000 7fe961214640 1 -- 172.21.15.6:0/1972495198 learned_addr learned my addr 172.21.15.6:0/1972495198 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:44.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.241+0000 7fe961a15640 1 --2- 172.21.15.6:0/1972495198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe95c101390 0x7fe95c19f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:44.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.241+0000 7fe962216640 1 -- 172.21.15.6:0/1972495198 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe95c103cf0 msgr2=0x7fe95c19fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:44.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.241+0000 7fe962216640 1 --2- 172.21.15.6:0/1972495198 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe95c103cf0 0x7fe95c19fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:44.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.241+0000 7fe962216640 1 -- 172.21.15.6:0/1972495198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe95c101390 msgr2=0x7fe95c19f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:44.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.241+0000 7fe962216640 1 --2- 172.21.15.6:0/1972495198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe95c101390 0x7fe95c19f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:44.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.241+0000 7fe962216640 1 -- 172.21.15.6:0/1972495198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95c1a7260 con 0x7fe95c106650 2024-05-20T17:04:44.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.242+0000 7fe962216640 1 --2- 172.21.15.6:0/1972495198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe95c106650 0x7fe95c1a6bf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe954005fd0 tx=0x7fe95400dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:44.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.242+0000 7fe952ffd640 1 -- 172.21.15.6:0/1972495198 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954017020 con 0x7fe95c106650 2024-05-20T17:04:44.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.242+0000 7fe952ffd640 1 -- 172.21.15.6:0/1972495198 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe95400bd40 con 0x7fe95c106650 2024-05-20T17:04:44.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.242+0000 7fe963c79640 1 -- 172.21.15.6:0/1972495198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95c1a7550 con 0x7fe95c106650 2024-05-20T17:04:44.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.242+0000 7fe952ffd640 1 -- 172.21.15.6:0/1972495198 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe95400f7b0 con 0x7fe95c106650 2024-05-20T17:04:44.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.242+0000 7fe963c79640 1 -- 172.21.15.6:0/1972495198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe95c1a7aa0 con 0x7fe95c106650 2024-05-20T17:04:44.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.243+0000 7fe963c79640 1 -- 172.21.15.6:0/1972495198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe95c0fe6c0 con 0x7fe95c106650 2024-05-20T17:04:44.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.244+0000 7fe952ffd640 1 -- 172.21.15.6:0/1972495198 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fe95401a020 con 0x7fe95c106650 2024-05-20T17:04:44.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.245+0000 7fe952ffd640 1 --2- 172.21.15.6:0/1972495198 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe9480a2c30 0x7fe9480a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:44.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.245+0000 7fe961a15640 1 --2- 172.21.15.6:0/1972495198 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe9480a2c30 0x7fe9480a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:44.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.245+0000 7fe952ffd640 1 -- 172.21.15.6:0/1972495198 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fe9540cf010 con 0x7fe95c106650 2024-05-20T17:04:44.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.246+0000 7fe961a15640 1 --2- 172.21.15.6:0/1972495198 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe9480a2c30 0x7fe9480a5140 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe95c0747a0 tx=0x7fe958005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:44.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.249+0000 7fe952ffd640 1 -- 172.21.15.6:0/1972495198 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe954021020 con 0x7fe95c106650 2024-05-20T17:04:44.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.473+0000 7fe963c79640 1 -- 172.21.15.6:0/1972495198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe95c02d2a0 con 0x7fe95c106650 2024-05-20T17:04:44.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.473+0000 7fe952ffd640 1 -- 172.21.15.6:0/1972495198 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5512 (secure 0 0 0) 0x7fe95409c410 con 0x7fe95c106650 2024-05-20T17:04:44.474 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:04:44.474 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/78063155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":78063155},{"type":"v1","addr":"172.21.15.62:6835","nonce":78063155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1542537621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1542537621},{"type":"v1","addr":"172.21.15.171:6835","nonce":1542537621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-05-20T17:04:44.474 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2024-05-20T17:04:44.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.475+0000 7fe963c79640 1 -- 172.21.15.6:0/1972495198 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe9480a2c30 msgr2=0x7fe9480a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:44.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.475+0000 7fe963c79640 1 --2- 172.21.15.6:0/1972495198 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe9480a2c30 0x7fe9480a5140 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe95c0747a0 tx=0x7fe958005f90 comp rx=0 tx=0).stop 2024-05-20T17:04:44.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.475+0000 7fe963c79640 1 -- 172.21.15.6:0/1972495198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe95c106650 msgr2=0x7fe95c1a6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:44.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.475+0000 7fe963c79640 1 --2- 172.21.15.6:0/1972495198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe95c106650 0x7fe95c1a6bf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe954005fd0 tx=0x7fe95400dea0 comp rx=0 tx=0).stop 2024-05-20T17:04:44.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.475+0000 7fe963c79640 1 -- 172.21.15.6:0/1972495198 shutdown_connections 2024-05-20T17:04:44.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.475+0000 7fe963c79640 1 --2- 172.21.15.6:0/1972495198 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe9480a2c30 0x7fe9480a5140 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:44.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.475+0000 7fe963c79640 1 --2- 172.21.15.6:0/1972495198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe95c106650 0x7fe95c1a6bf0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:44.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.475+0000 7fe963c79640 1 --2- 172.21.15.6:0/1972495198 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe95c103cf0 0x7fe95c19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.475+0000 7fe963c79640 1 --2- 172.21.15.6:0/1972495198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe95c101390 0x7fe95c19f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.475+0000 7fe963c79640 1 -- 172.21.15.6:0/1972495198 >> 172.21.15.6:0/1972495198 conn(0x7fe95c0fcba0 msgr2=0x7fe95c1021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.476+0000 7fe963c79640 1 -- 172.21.15.6:0/1972495198 shutdown_connections 2024-05-20T17:04:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:44.476+0000 7fe963c79640 1 -- 172.21.15.6:0/1972495198 wait complete. 2024-05-20T17:04:44.616 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 20 17:04:44 smithi171 systemd[1]: Started Ceph mds.c for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T17:04:45.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:45 smithi062 ceph-mon[35425]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:45.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:45 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:45.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:45 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:45.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:45 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:45.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:45 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:45.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:45 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:45.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:45 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:45.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:45 smithi062 ceph-mon[35425]: Deploying daemon mds.h on smithi062 2024-05-20T17:04:45.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:45 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1972495198' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:45.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:45 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.171:6836/732693575,v1:172.21.15.171:6837/732693575] up:boot 2024-05-20T17:04:45.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:45 smithi062 ceph-mon[35425]: fsmap 7 up:standby 2024-05-20T17:04:45.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:45 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-20T17:04:45.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:45 smithi171 ceph-mon[35901]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:45.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:45 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:45.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:45 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:45.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:45 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:45.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:45 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:45.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:45 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:45.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:45 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:45.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:45 smithi171 ceph-mon[35901]: Deploying daemon mds.h on smithi062 2024-05-20T17:04:45.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:45 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1972495198' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:45.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:45 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.171:6836/732693575,v1:172.21.15.171:6837/732693575] up:boot 2024-05-20T17:04:45.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:45 smithi171 ceph-mon[35901]: fsmap 7 up:standby 2024-05-20T17:04:45.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:45 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-20T17:04:45.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:45 smithi006 ceph-mon[32486]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:45.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:45.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:45.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:45.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:45.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:45.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:45.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:45 smithi006 ceph-mon[32486]: Deploying daemon mds.h on smithi062 2024-05-20T17:04:45.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:45 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1972495198' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:45.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:45 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.171:6836/732693575,v1:172.21.15.171:6837/732693575] up:boot 2024-05-20T17:04:45.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:45 smithi006 ceph-mon[32486]: fsmap 7 up:standby 2024-05-20T17:04:45.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:45 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-20T17:04:46.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:04:46.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.617+0000 7fc8e05d5640 1 -- 172.21.15.6:0/2925992154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8d81019b0 msgr2=0x7fc8d81026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.617+0000 7fc8e05d5640 1 --2- 172.21.15.6:0/2925992154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8d81019b0 0x7fc8d81026b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8009900 tx=0x7fc8c802a410 comp rx=0 tx=0).stop 2024-05-20T17:04:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.617+0000 7fc8e05d5640 1 -- 172.21.15.6:0/2925992154 shutdown_connections 2024-05-20T17:04:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.617+0000 7fc8e05d5640 1 --2- 172.21.15.6:0/2925992154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8d81078f0 0x7fc8d8109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.617+0000 7fc8e05d5640 1 --2- 172.21.15.6:0/2925992154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d8102bf0 0x7fc8d8103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.617+0000 7fc8e05d5640 1 --2- 172.21.15.6:0/2925992154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8d81019b0 0x7fc8d81026b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.617+0000 7fc8e05d5640 1 -- 172.21.15.6:0/2925992154 >> 172.21.15.6:0/2925992154 conn(0x7fc8d80fcba0 msgr2=0x7fc8d80ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.617+0000 7fc8e05d5640 1 -- 172.21.15.6:0/2925992154 shutdown_connections 2024-05-20T17:04:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.617+0000 7fc8e05d5640 1 -- 172.21.15.6:0/2925992154 wait complete. 2024-05-20T17:04:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.618+0000 7fc8e05d5640 1 Processor -- start 2024-05-20T17:04:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.618+0000 7fc8e05d5640 1 -- start start 2024-05-20T17:04:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.618+0000 7fc8e05d5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d81019b0 0x7fc8d810c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.618+0000 7fc8e05d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8d8102bf0 0x7fc8d810abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.618+0000 7fc8e05d5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8d81078f0 0x7fc8d810b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.618+0000 7fc8e05d5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d810e5a0 con 0x7fc8d8102bf0 2024-05-20T17:04:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.618+0000 7fc8e05d5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d810e420 con 0x7fc8d81019b0 2024-05-20T17:04:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.618+0000 7fc8e05d5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d810e720 con 0x7fc8d81078f0 2024-05-20T17:04:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.618+0000 7fc8ddb70640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8d8102bf0 0x7fc8d810abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.618+0000 7fc8ddb70640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8d8102bf0 0x7fc8d810abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59038/0 (socket says 172.21.15.6:59038) 2024-05-20T17:04:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.618+0000 7fc8ddb70640 1 -- 172.21.15.6:0/1798385180 learned_addr learned my addr 172.21.15.6:0/1798385180 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.618+0000 7fc8de371640 1 --2- 172.21.15.6:0/1798385180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d81019b0 0x7fc8d810c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.618+0000 7fc8deb72640 1 --2- 172.21.15.6:0/1798385180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8d81078f0 0x7fc8d810b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.618+0000 7fc8ddb70640 1 -- 172.21.15.6:0/1798385180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8d81078f0 msgr2=0x7fc8d810b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.618+0000 7fc8ddb70640 1 --2- 172.21.15.6:0/1798385180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8d81078f0 0x7fc8d810b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.618+0000 7fc8ddb70640 1 -- 172.21.15.6:0/1798385180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d81019b0 msgr2=0x7fc8d810c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.618+0000 7fc8ddb70640 1 --2- 172.21.15.6:0/1798385180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d81019b0 0x7fc8d810c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:46.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.619+0000 7fc8ddb70640 1 -- 172.21.15.6:0/1798385180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d810b820 con 0x7fc8d8102bf0 2024-05-20T17:04:46.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.619+0000 7fc8de371640 1 --2- 172.21.15.6:0/1798385180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d81019b0 0x7fc8d810c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:04:46.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.619+0000 7fc8ddb70640 1 --2- 172.21.15.6:0/1798385180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8d8102bf0 0x7fc8d810abb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400e9f0 tx=0x7fc8d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:46.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.619+0000 7fc8cf7fe640 1 -- 172.21.15.6:0/1798385180 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d400cd80 con 0x7fc8d8102bf0 2024-05-20T17:04:46.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.619+0000 7fc8cf7fe640 1 -- 172.21.15.6:0/1798385180 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc8d40108e0 con 0x7fc8d8102bf0 2024-05-20T17:04:46.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.619+0000 7fc8e05d5640 1 -- 172.21.15.6:0/1798385180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d81a31f0 con 0x7fc8d8102bf0 2024-05-20T17:04:46.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.619+0000 7fc8cf7fe640 1 -- 172.21.15.6:0/1798385180 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4018920 con 0x7fc8d8102bf0 2024-05-20T17:04:46.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.619+0000 7fc8e05d5640 1 -- 172.21.15.6:0/1798385180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d81a36e0 con 0x7fc8d8102bf0 2024-05-20T17:04:46.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.620+0000 7fc8e05d5640 1 -- 172.21.15.6:0/1798385180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d8106700 con 0x7fc8d8102bf0 2024-05-20T17:04:46.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.621+0000 7fc8cf7fe640 1 -- 172.21.15.6:0/1798385180 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc8d4010a90 con 0x7fc8d8102bf0 2024-05-20T17:04:46.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.622+0000 7fc8cf7fe640 1 --2- 172.21.15.6:0/1798385180 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc8c00a2cb0 0x7fc8c00a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:46.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.622+0000 7fc8de371640 1 --2- 172.21.15.6:0/1798385180 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc8c00a2cb0 0x7fc8c00a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:46.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.622+0000 7fc8cf7fe640 1 -- 172.21.15.6:0/1798385180 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fc8d40cf330 con 0x7fc8d8102bf0 2024-05-20T17:04:46.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.623+0000 7fc8de371640 1 --2- 172.21.15.6:0/1798385180 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc8c00a2cb0 0x7fc8c00a51c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80314e0 tx=0x7fc8c8031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:46.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.626+0000 7fc8cf7fe640 1 -- 172.21.15.6:0/1798385180 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc8d409c040 con 0x7fc8d8102bf0 2024-05-20T17:04:46.772 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:04:46 smithi062 systemd[1]: Starting Ceph mds.h for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:04:46.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.869+0000 7fc8e05d5640 1 -- 172.21.15.6:0/1798385180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8d802d2a0 con 0x7fc8d8102bf0 2024-05-20T17:04:46.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.870+0000 7fc8cf7fe640 1 -- 172.21.15.6:0/1798385180 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6337 (secure 0 0 0) 0x7fc8d40a0340 con 0x7fc8d8102bf0 2024-05-20T17:04:46.870 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:04:46.870 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/78063155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":78063155},{"type":"v1","addr":"172.21.15.62:6835","nonce":78063155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1542537621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1542537621},{"type":"v1","addr":"172.21.15.171:6835","nonce":1542537621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24502,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/732693575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":732693575},{"type":"v1","addr":"172.21.15.171:6837","nonce":732693575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-05-20T17:04:46.871 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2024-05-20T17:04:46.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.872+0000 7fc8e05d5640 1 -- 172.21.15.6:0/1798385180 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc8c00a2cb0 msgr2=0x7fc8c00a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:46.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.872+0000 7fc8e05d5640 1 --2- 172.21.15.6:0/1798385180 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc8c00a2cb0 0x7fc8c00a51c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80314e0 tx=0x7fc8c8031400 comp rx=0 tx=0).stop 2024-05-20T17:04:46.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.872+0000 7fc8e05d5640 1 -- 172.21.15.6:0/1798385180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8d8102bf0 msgr2=0x7fc8d810abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:46.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.872+0000 7fc8e05d5640 1 --2- 172.21.15.6:0/1798385180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8d8102bf0 0x7fc8d810abb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400e9f0 tx=0x7fc8d400eeb0 comp rx=0 tx=0).stop 2024-05-20T17:04:46.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.872+0000 7fc8e05d5640 1 -- 172.21.15.6:0/1798385180 shutdown_connections 2024-05-20T17:04:46.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.872+0000 7fc8e05d5640 1 --2- 172.21.15.6:0/1798385180 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc8c00a2cb0 0x7fc8c00a51c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:46.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.872+0000 7fc8e05d5640 1 --2- 172.21.15.6:0/1798385180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8d81078f0 0x7fc8d810b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:46.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.872+0000 7fc8e05d5640 1 --2- 172.21.15.6:0/1798385180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8d8102bf0 0x7fc8d810abb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:46.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.872+0000 7fc8e05d5640 1 --2- 172.21.15.6:0/1798385180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d81019b0 0x7fc8d810c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:46.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.872+0000 7fc8e05d5640 1 -- 172.21.15.6:0/1798385180 >> 172.21.15.6:0/1798385180 conn(0x7fc8d80fcba0 msgr2=0x7fc8d81038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:46.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.872+0000 7fc8e05d5640 1 -- 172.21.15.6:0/1798385180 shutdown_connections 2024-05-20T17:04:46.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:46.872+0000 7fc8e05d5640 1 -- 172.21.15.6:0/1798385180 wait complete. 2024-05-20T17:04:47.186 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:04:46 smithi062 podman[64941]: 2024-05-20 17:04:46.825275289 +0000 UTC m=+0.017569111 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:04:47.186 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:04:46 smithi062 podman[64941]: 2024-05-20 17:04:46.942565461 +0000 UTC m=+0.134859265 container create 9c9396a4e44054ac4135b11bb9b94878311bcb1c3f383253cb549975ec24ec51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-h, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-20T17:04:47.186 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:04:47 smithi062 podman[64941]: 2024-05-20 17:04:47.186919465 +0000 UTC m=+0.379213274 container init 9c9396a4e44054ac4135b11bb9b94878311bcb1c3f383253cb549975ec24ec51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-h, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-20T17:04:47.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:47 smithi062 ceph-mon[35425]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:47.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:47 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1798385180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:47.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:47 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:47.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:47 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:47.522 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:04:47 smithi062 podman[64941]: 2024-05-20 17:04:47.19013913 +0000 UTC m=+0.382432935 container start 9c9396a4e44054ac4135b11bb9b94878311bcb1c3f383253cb549975ec24ec51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True) 2024-05-20T17:04:47.522 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:04:47 smithi062 ceph-mds[64960]: -- 172.21.15.62:0/3401065655 <== mon.2 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55742ad51a40 con 0x55742adc9a80 2024-05-20T17:04:47.523 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:04:47 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-h[64956]: starting mds.h at 2024-05-20T17:04:47.523 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:04:47 smithi062 bash[64941]: 9c9396a4e44054ac4135b11bb9b94878311bcb1c3f383253cb549975ec24ec51 2024-05-20T17:04:47.523 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:04:47 smithi062 systemd[1]: Started Ceph mds.h for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T17:04:47.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:47 smithi171 ceph-mon[35901]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:47.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:47 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1798385180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:47.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:47 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:47.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:47 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:47.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:47 smithi006 ceph-mon[32486]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:47.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:47 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1798385180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:47.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:47 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:47.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:47 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:48.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:48 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.62:6836/1745943929,v1:172.21.15.62:6837/1745943929] up:boot 2024-05-20T17:04:48.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:48 smithi171 ceph-mon[35901]: fsmap 8 up:standby 2024-05-20T17:04:48.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:48 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-20T17:04:48.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:48 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:48.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:48 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:48.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:48 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:48.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:48 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:48.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:48 smithi171 ceph-mon[35901]: Deploying daemon mds.i on smithi171 2024-05-20T17:04:48.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:48 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.62:6836/1745943929,v1:172.21.15.62:6837/1745943929] up:boot 2024-05-20T17:04:48.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:48 smithi062 ceph-mon[35425]: fsmap 8 up:standby 2024-05-20T17:04:48.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:48 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-20T17:04:48.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:48 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:48.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:48 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:48.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:48 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:48.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:48 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:48.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:48 smithi062 ceph-mon[35425]: Deploying daemon mds.i on smithi171 2024-05-20T17:04:48.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:48 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.62:6836/1745943929,v1:172.21.15.62:6837/1745943929] up:boot 2024-05-20T17:04:48.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:48 smithi006 ceph-mon[32486]: fsmap 8 up:standby 2024-05-20T17:04:48.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:48 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-20T17:04:48.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:48 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:48.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:48 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:48.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:48 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:48.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:48 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:48.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:48 smithi006 ceph-mon[32486]: Deploying daemon mds.i on smithi171 2024-05-20T17:04:48.885 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:04:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.014+0000 7f2ab3537640 1 -- 172.21.15.6:0/1800238386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aac1035b0 msgr2=0x7f2aac1059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.014+0000 7f2ab3537640 1 --2- 172.21.15.6:0/1800238386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aac1035b0 0x7f2aac1059d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009900 tx=0x7f2aa802a410 comp rx=0 tx=0).stop 2024-05-20T17:04:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.014+0000 7f2ab3537640 1 -- 172.21.15.6:0/1800238386 shutdown_connections 2024-05-20T17:04:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.014+0000 7f2ab3537640 1 --2- 172.21.15.6:0/1800238386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2aac108870 0x7f2aac10ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.014+0000 7f2ab3537640 1 --2- 172.21.15.6:0/1800238386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2aac105f10 0x7f2aac108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.014+0000 7f2ab3537640 1 --2- 172.21.15.6:0/1800238386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aac1035b0 0x7f2aac1059d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.014+0000 7f2ab3537640 1 -- 172.21.15.6:0/1800238386 >> 172.21.15.6:0/1800238386 conn(0x7f2aac0fcbb0 msgr2=0x7f2aac0ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.014+0000 7f2ab3537640 1 -- 172.21.15.6:0/1800238386 shutdown_connections 2024-05-20T17:04:49.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.014+0000 7f2ab3537640 1 -- 172.21.15.6:0/1800238386 wait complete. 2024-05-20T17:04:49.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.015+0000 7f2ab3537640 1 Processor -- start 2024-05-20T17:04:49.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.015+0000 7f2ab3537640 1 -- start start 2024-05-20T17:04:49.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.015+0000 7f2ab3537640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2aac1035b0 0x7f2aac199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:49.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.015+0000 7f2ab3537640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2aac105f10 0x7f2aac199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:49.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.015+0000 7f2ab3537640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aac108870 0x7f2aac1a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:49.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.015+0000 7f2ab3537640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac10e5c0 con 0x7f2aac108870 2024-05-20T17:04:49.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.015+0000 7f2ab3537640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac10e440 con 0x7f2aac105f10 2024-05-20T17:04:49.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.015+0000 7f2ab3537640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac10e740 con 0x7f2aac1035b0 2024-05-20T17:04:49.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.016+0000 7f2ab1ad4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aac108870 0x7f2aac1a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:49.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.016+0000 7f2ab1ad4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aac108870 0x7f2aac1a0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59060/0 (socket says 172.21.15.6:59060) 2024-05-20T17:04:49.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.016+0000 7f2ab1ad4640 1 -- 172.21.15.6:0/2941490077 learned_addr learned my addr 172.21.15.6:0/2941490077 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:49.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.016+0000 7f2ab0ad2640 1 --2- 172.21.15.6:0/2941490077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2aac105f10 0x7f2aac199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:49.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.016+0000 7f2ab12d3640 1 --2- 172.21.15.6:0/2941490077 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2aac1035b0 0x7f2aac199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:49.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.016+0000 7f2ab1ad4640 1 -- 172.21.15.6:0/2941490077 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2aac1035b0 msgr2=0x7f2aac199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:49.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.016+0000 7f2ab1ad4640 1 --2- 172.21.15.6:0/2941490077 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2aac1035b0 0x7f2aac199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:49.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.016+0000 7f2ab1ad4640 1 -- 172.21.15.6:0/2941490077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2aac105f10 msgr2=0x7f2aac199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:49.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.016+0000 7f2ab1ad4640 1 --2- 172.21.15.6:0/2941490077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2aac105f10 0x7f2aac199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:49.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.016+0000 7f2ab1ad4640 1 -- 172.21.15.6:0/2941490077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aac1a0c70 con 0x7f2aac108870 2024-05-20T17:04:49.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.016+0000 7f2ab1ad4640 1 --2- 172.21.15.6:0/2941490077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aac108870 0x7f2aac1a0600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400e9d0 tx=0x7f2aa400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:49.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.016+0000 7f2aa27fc640 1 -- 172.21.15.6:0/2941490077 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa400cd80 con 0x7f2aac108870 2024-05-20T17:04:49.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.016+0000 7f2aa27fc640 1 -- 172.21.15.6:0/2941490077 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2aa4005020 con 0x7f2aac108870 2024-05-20T17:04:49.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.016+0000 7f2aa27fc640 1 -- 172.21.15.6:0/2941490077 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40116d0 con 0x7f2aac108870 2024-05-20T17:04:49.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.016+0000 7f2ab3537640 1 -- 172.21.15.6:0/2941490077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aac1a0f60 con 0x7f2aac108870 2024-05-20T17:04:49.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.016+0000 7f2ab3537640 1 -- 172.21.15.6:0/2941490077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aac1a1420 con 0x7f2aac108870 2024-05-20T17:04:49.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.017+0000 7f2ab3537640 1 -- 172.21.15.6:0/2941490077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aac0fe6d0 con 0x7f2aac108870 2024-05-20T17:04:49.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.019+0000 7f2aa27fc640 1 -- 172.21.15.6:0/2941490077 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f2aa40051d0 con 0x7f2aac108870 2024-05-20T17:04:49.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.019+0000 7f2aa27fc640 1 --2- 172.21.15.6:0/2941490077 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2a980a2cb0 0x7f2a980a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:49.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.019+0000 7f2ab12d3640 1 --2- 172.21.15.6:0/2941490077 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2a980a2cb0 0x7f2a980a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:49.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.019+0000 7f2aa27fc640 1 -- 172.21.15.6:0/2941490077 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f2aa40cf0b0 con 0x7f2aac108870 2024-05-20T17:04:49.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.020+0000 7f2ab12d3640 1 --2- 172.21.15.6:0/2941490077 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2a980a2cb0 0x7f2a980a51c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8000c00 tx=0x7f2aa8031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:49.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.023+0000 7f2aa27fc640 1 -- 172.21.15.6:0/2941490077 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2aa4016030 con 0x7f2aac108870 2024-05-20T17:04:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.246+0000 7f2ab3537640 1 -- 172.21.15.6:0/2941490077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2aac02d4f0 con 0x7f2aac108870 2024-05-20T17:04:49.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.246+0000 7f2aa27fc640 1 -- 172.21.15.6:0/2941490077 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7162 (secure 0 0 0) 0x7f2aa409c530 con 0x7f2aac108870 2024-05-20T17:04:49.247 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:04:49.247 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/78063155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":78063155},{"type":"v1","addr":"172.21.15.62:6835","nonce":78063155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1542537621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1542537621},{"type":"v1","addr":"172.21.15.171:6835","nonce":1542537621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24502,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/732693575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":732693575},{"type":"v1","addr":"172.21.15.171:6837","nonce":732693575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24509,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/1745943929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1745943929},{"type":"v1","addr":"172.21.15.62:6837","nonce":1745943929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-20T17:04:49.247 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 9 2024-05-20T17:04:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.248+0000 7f2ab3537640 1 -- 172.21.15.6:0/2941490077 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2a980a2cb0 msgr2=0x7f2a980a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.248+0000 7f2ab3537640 1 --2- 172.21.15.6:0/2941490077 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2a980a2cb0 0x7f2a980a51c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8000c00 tx=0x7f2aa8031400 comp rx=0 tx=0).stop 2024-05-20T17:04:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.248+0000 7f2ab3537640 1 -- 172.21.15.6:0/2941490077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aac108870 msgr2=0x7f2aac1a0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.248+0000 7f2ab3537640 1 --2- 172.21.15.6:0/2941490077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aac108870 0x7f2aac1a0600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400e9d0 tx=0x7f2aa400ee90 comp rx=0 tx=0).stop 2024-05-20T17:04:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.249+0000 7f2ab3537640 1 -- 172.21.15.6:0/2941490077 shutdown_connections 2024-05-20T17:04:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.249+0000 7f2ab3537640 1 --2- 172.21.15.6:0/2941490077 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2a980a2cb0 0x7f2a980a51c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:49.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.249+0000 7f2ab3537640 1 --2- 172.21.15.6:0/2941490077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aac108870 0x7f2aac1a0600 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:49.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.249+0000 7f2ab3537640 1 --2- 172.21.15.6:0/2941490077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2aac105f10 0x7f2aac199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:49.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.249+0000 7f2ab3537640 1 --2- 172.21.15.6:0/2941490077 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2aac1035b0 0x7f2aac199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:49.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.249+0000 7f2ab3537640 1 -- 172.21.15.6:0/2941490077 >> 172.21.15.6:0/2941490077 conn(0x7f2aac0fcbb0 msgr2=0x7f2aac1044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:49.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.249+0000 7f2ab3537640 1 -- 172.21.15.6:0/2941490077 shutdown_connections 2024-05-20T17:04:49.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:49.249+0000 7f2ab3537640 1 -- 172.21.15.6:0/2941490077 wait complete. 2024-05-20T17:04:49.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:49 smithi006 ceph-mon[32486]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:49.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:49 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2941490077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:49.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:49 smithi062 ceph-mon[35425]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:49.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:49 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2941490077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:49.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:49 smithi171 ceph-mon[35901]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:49.798 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:49 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2941490077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:49.798 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 20 17:04:49 smithi171 systemd[1]: Starting Ceph mds.i for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:04:50.077 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 20 17:04:49 smithi171 podman[66169]: 2024-05-20 17:04:49.700584635 +0000 UTC m=+0.017198733 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:04:50.077 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 20 17:04:49 smithi171 podman[66169]: 2024-05-20 17:04:49.820517685 +0000 UTC m=+0.137131780 container create 8a73ef594fabea55800b1fb7ed0bb16757037690eb08cbbf6d1e371ef38dd36c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-20T17:04:50.077 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 20 17:04:50 smithi171 podman[66169]: 2024-05-20 17:04:50.040407489 +0000 UTC m=+0.357021572 container init 8a73ef594fabea55800b1fb7ed0bb16757037690eb08cbbf6d1e371ef38dd36c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-i, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5) 2024-05-20T17:04:50.077 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 20 17:04:50 smithi171 podman[66169]: 2024-05-20 17:04:50.043417124 +0000 UTC m=+0.360031222 container start 8a73ef594fabea55800b1fb7ed0bb16757037690eb08cbbf6d1e371ef38dd36c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-i, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-20T17:04:50.366 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 20 17:04:50 smithi171 ceph-mds[66188]: -- 172.21.15.171:0/1545445828 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5640e1c5fa40 con 0x5640e1cd7600 2024-05-20T17:04:50.366 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 20 17:04:50 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-i[66184]: starting mds.i at 2024-05-20T17:04:50.366 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 20 17:04:50 smithi171 bash[66169]: 8a73ef594fabea55800b1fb7ed0bb16757037690eb08cbbf6d1e371ef38dd36c 2024-05-20T17:04:50.366 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 20 17:04:50 smithi171 systemd[1]: Started Ceph mds.i for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T17:04:51.262 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:04:51.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.383+0000 7efdaa6cc640 1 -- 172.21.15.6:0/3324497222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efda4102bf0 msgr2=0x7efda4103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:51.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.383+0000 7efdaa6cc640 1 --2- 172.21.15.6:0/3324497222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efda4102bf0 0x7efda4103000 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efd98009900 tx=0x7efd9802a410 comp rx=0 tx=0).stop 2024-05-20T17:04:51.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.383+0000 7efdaa6cc640 1 -- 172.21.15.6:0/3324497222 shutdown_connections 2024-05-20T17:04:51.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.383+0000 7efdaa6cc640 1 --2- 172.21.15.6:0/3324497222 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efda41078f0 0x7efda4109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:51.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.383+0000 7efdaa6cc640 1 --2- 172.21.15.6:0/3324497222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efda4102bf0 0x7efda4103000 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:51.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.383+0000 7efdaa6cc640 1 --2- 172.21.15.6:0/3324497222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efda41019b0 0x7efda41026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:51.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.383+0000 7efdaa6cc640 1 -- 172.21.15.6:0/3324497222 >> 172.21.15.6:0/3324497222 conn(0x7efda40fcba0 msgr2=0x7efda40ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:51.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.383+0000 7efdaa6cc640 1 -- 172.21.15.6:0/3324497222 shutdown_connections 2024-05-20T17:04:51.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.383+0000 7efdaa6cc640 1 -- 172.21.15.6:0/3324497222 wait complete. 2024-05-20T17:04:51.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.383+0000 7efdaa6cc640 1 Processor -- start 2024-05-20T17:04:51.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.383+0000 7efdaa6cc640 1 -- start start 2024-05-20T17:04:51.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.384+0000 7efdaa6cc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efda41019b0 0x7efda4199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:51.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.384+0000 7efdaa6cc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efda4102bf0 0x7efda4199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:51.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.384+0000 7efdaa6cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efda41078f0 0x7efda41a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:51.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.384+0000 7efdaa6cc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efda410d4b0 con 0x7efda4102bf0 2024-05-20T17:04:51.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.384+0000 7efdaa6cc640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efda410d330 con 0x7efda41078f0 2024-05-20T17:04:51.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.384+0000 7efdaa6cc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efda410d630 con 0x7efda41019b0 2024-05-20T17:04:51.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.384+0000 7efda37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efda4102bf0 0x7efda4199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:51.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.384+0000 7efda37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efda4102bf0 0x7efda4199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36810/0 (socket says 172.21.15.6:36810) 2024-05-20T17:04:51.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.384+0000 7efda37fe640 1 -- 172.21.15.6:0/1070604448 learned_addr learned my addr 172.21.15.6:0/1070604448 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:51.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.384+0000 7efda3fff640 1 --2- 172.21.15.6:0/1070604448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efda41019b0 0x7efda4199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:51.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.384+0000 7efda8c69640 1 --2- 172.21.15.6:0/1070604448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efda41078f0 0x7efda41a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:51.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.384+0000 7efda37fe640 1 -- 172.21.15.6:0/1070604448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efda41019b0 msgr2=0x7efda4199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:51.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.384+0000 7efda37fe640 1 --2- 172.21.15.6:0/1070604448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efda41019b0 0x7efda4199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:51.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.384+0000 7efda37fe640 1 -- 172.21.15.6:0/1070604448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efda41078f0 msgr2=0x7efda41a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.384+0000 7efda37fe640 1 --2- 172.21.15.6:0/1070604448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efda41078f0 0x7efda41a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.384+0000 7efda37fe640 1 -- 172.21.15.6:0/1070604448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda41a0bd0 con 0x7efda4102bf0 2024-05-20T17:04:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.384+0000 7efda3fff640 1 --2- 172.21.15.6:0/1070604448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efda41019b0 0x7efda4199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:04:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.384+0000 7efda8c69640 1 --2- 172.21.15.6:0/1070604448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efda41078f0 0x7efda41a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:04:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.384+0000 7efda37fe640 1 --2- 172.21.15.6:0/1070604448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efda4102bf0 0x7efda4199680 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efd98004770 tx=0x7efd98004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.385+0000 7efda17fa640 1 -- 172.21.15.6:0/1070604448 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9803f030 con 0x7efda4102bf0 2024-05-20T17:04:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.385+0000 7efda17fa640 1 -- 172.21.15.6:0/1070604448 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efd98003aa0 con 0x7efda4102bf0 2024-05-20T17:04:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.385+0000 7efdaa6cc640 1 -- 172.21.15.6:0/1070604448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda41a0e60 con 0x7efda4102bf0 2024-05-20T17:04:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.385+0000 7efda17fa640 1 -- 172.21.15.6:0/1070604448 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98035070 con 0x7efda4102bf0 2024-05-20T17:04:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.385+0000 7efdaa6cc640 1 -- 172.21.15.6:0/1070604448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda41a1270 con 0x7efda4102bf0 2024-05-20T17:04:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.386+0000 7efdaa6cc640 1 -- 172.21.15.6:0/1070604448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efda41a14d0 con 0x7efda4102bf0 2024-05-20T17:04:51.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.387+0000 7efda17fa640 1 -- 172.21.15.6:0/1070604448 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7efd98042030 con 0x7efda4102bf0 2024-05-20T17:04:51.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.388+0000 7efda17fa640 1 --2- 172.21.15.6:0/1070604448 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7efd8c0a2c30 0x7efd8c0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:51.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.388+0000 7efda3fff640 1 --2- 172.21.15.6:0/1070604448 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7efd8c0a2c30 0x7efd8c0a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:51.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.388+0000 7efda17fa640 1 -- 172.21.15.6:0/1070604448 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7efd980efa40 con 0x7efda4102bf0 2024-05-20T17:04:51.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.388+0000 7efda3fff640 1 --2- 172.21.15.6:0/1070604448 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7efd8c0a2c30 0x7efd8c0a5140 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efda41025b0 tx=0x7efd94005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:51.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.391+0000 7efda17fa640 1 -- 172.21.15.6:0/1070604448 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7efd980bce40 con 0x7efda4102bf0 2024-05-20T17:04:51.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:51 smithi062 ceph-mon[35425]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:51.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:51 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:51.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:51 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:51.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:51 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:51.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:51 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:51.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:51 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:51.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:51 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:51.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:51 smithi062 ceph-mon[35425]: Deploying daemon mds.g on smithi006 2024-05-20T17:04:51.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:51 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] up:boot 2024-05-20T17:04:51.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:51 smithi062 ceph-mon[35425]: fsmap 9 up:standby 2024-05-20T17:04:51.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:51 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-20T17:04:51.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:51 smithi171 ceph-mon[35901]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:51.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:51 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:51.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:51 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:51.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:51 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:51.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:51 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:51.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:51 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:51.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:51 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:51.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:51 smithi171 ceph-mon[35901]: Deploying daemon mds.g on smithi006 2024-05-20T17:04:51.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:51 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] up:boot 2024-05-20T17:04:51.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:51 smithi171 ceph-mon[35901]: fsmap 9 up:standby 2024-05-20T17:04:51.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:51 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-20T17:04:51.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.615+0000 7efdaa6cc640 1 -- 172.21.15.6:0/1070604448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efda41a18a0 con 0x7efda4102bf0 2024-05-20T17:04:51.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.615+0000 7efda17fa640 1 -- 172.21.15.6:0/1070604448 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+7992 (secure 0 0 0) 0x7efd980bc740 con 0x7efda4102bf0 2024-05-20T17:04:51.616 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:04:51.616 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/78063155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":78063155},{"type":"v1","addr":"172.21.15.62:6835","nonce":78063155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1542537621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1542537621},{"type":"v1","addr":"172.21.15.171:6835","nonce":1542537621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24502,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/732693575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":732693575},{"type":"v1","addr":"172.21.15.171:6837","nonce":732693575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24509,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/1745943929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1745943929},{"type":"v1","addr":"172.21.15.62:6837","nonce":1745943929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24526,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6839/3246292303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3246292303},{"type":"v1","addr":"172.21.15.171:6839","nonce":3246292303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-05-20T17:04:51.616 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 10 2024-05-20T17:04:51.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.617+0000 7efdaa6cc640 1 -- 172.21.15.6:0/1070604448 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7efd8c0a2c30 msgr2=0x7efd8c0a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:51.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.617+0000 7efdaa6cc640 1 --2- 172.21.15.6:0/1070604448 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7efd8c0a2c30 0x7efd8c0a5140 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efda41025b0 tx=0x7efd94005f90 comp rx=0 tx=0).stop 2024-05-20T17:04:51.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.617+0000 7efdaa6cc640 1 -- 172.21.15.6:0/1070604448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efda4102bf0 msgr2=0x7efda4199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.617+0000 7efdaa6cc640 1 --2- 172.21.15.6:0/1070604448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efda4102bf0 0x7efda4199680 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efd98004770 tx=0x7efd98004270 comp rx=0 tx=0).stop 2024-05-20T17:04:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.617+0000 7efdaa6cc640 1 -- 172.21.15.6:0/1070604448 shutdown_connections 2024-05-20T17:04:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.617+0000 7efdaa6cc640 1 --2- 172.21.15.6:0/1070604448 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7efd8c0a2c30 0x7efd8c0a5140 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.617+0000 7efdaa6cc640 1 --2- 172.21.15.6:0/1070604448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efda41078f0 0x7efda41a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.617+0000 7efdaa6cc640 1 --2- 172.21.15.6:0/1070604448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efda4102bf0 0x7efda4199680 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.617+0000 7efdaa6cc640 1 --2- 172.21.15.6:0/1070604448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efda41019b0 0x7efda4199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.617+0000 7efdaa6cc640 1 -- 172.21.15.6:0/1070604448 >> 172.21.15.6:0/1070604448 conn(0x7efda40fcba0 msgr2=0x7efda4108d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.617+0000 7efdaa6cc640 1 -- 172.21.15.6:0/1070604448 shutdown_connections 2024-05-20T17:04:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:51.617+0000 7efdaa6cc640 1 -- 172.21.15.6:0/1070604448 wait complete. 2024-05-20T17:04:51.628 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:51 smithi006 ceph-mon[32486]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:51.628 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:51 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:51.628 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:51 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:51.628 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:51 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:51.628 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:51 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:51.628 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:51 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:51.628 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:51 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:51.629 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:51 smithi006 ceph-mon[32486]: Deploying daemon mds.g on smithi006 2024-05-20T17:04:51.629 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:51 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] up:boot 2024-05-20T17:04:51.629 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:51 smithi006 ceph-mon[32486]: fsmap 9 up:standby 2024-05-20T17:04:51.629 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:51 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-20T17:04:52.246 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:52 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1070604448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:52.477 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:52 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1070604448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:52.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:52 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1070604448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:52.630 INFO:journalctl@ceph.mds.g.smithi006.stdout:May 20 17:04:52 smithi006 systemd[1]: Starting Ceph mds.g for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:04:52.942 INFO:journalctl@ceph.mds.g.smithi006.stdout:May 20 17:04:52 smithi006 podman[73524]: 2024-05-20 17:04:52.562920996 +0000 UTC m=+0.017966719 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:04:52.942 INFO:journalctl@ceph.mds.g.smithi006.stdout:May 20 17:04:52 smithi006 podman[73524]: 2024-05-20 17:04:52.689457313 +0000 UTC m=+0.144503040 container create 5956235ee2a27b719e3f850ecc554246c2cfb2b0fc1e418adec6aa70dd24faba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-g, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-05-20T17:04:52.942 INFO:journalctl@ceph.mds.g.smithi006.stdout:May 20 17:04:52 smithi006 podman[73524]: 2024-05-20 17:04:52.942276026 +0000 UTC m=+0.397321728 container init 5956235ee2a27b719e3f850ecc554246c2cfb2b0fc1e418adec6aa70dd24faba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-05-20T17:04:53.194 INFO:journalctl@ceph.mds.g.smithi006.stdout:May 20 17:04:52 smithi006 podman[73524]: 2024-05-20 17:04:52.945410383 +0000 UTC m=+0.400456097 container start 5956235ee2a27b719e3f850ecc554246c2cfb2b0fc1e418adec6aa70dd24faba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:04:53.194 INFO:journalctl@ceph.mds.g.smithi006.stdout:May 20 17:04:52 smithi006 ceph-mds[73543]: -- 172.21.15.6:0/42821683 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e419ae5a40 con 0x55e419b5d180 2024-05-20T17:04:53.194 INFO:journalctl@ceph.mds.g.smithi006.stdout:May 20 17:04:52 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-g[73539]: starting mds.g at 2024-05-20T17:04:53.194 INFO:journalctl@ceph.mds.g.smithi006.stdout:May 20 17:04:53 smithi006 bash[73524]: 5956235ee2a27b719e3f850ecc554246c2cfb2b0fc1e418adec6aa70dd24faba 2024-05-20T17:04:53.194 INFO:journalctl@ceph.mds.g.smithi006.stdout:May 20 17:04:53 smithi006 systemd[1]: Started Ceph mds.g for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T17:04:53.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:53 smithi062 ceph-mon[35425]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:53.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:53 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:53.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:53 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:53.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:53 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:53.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:53 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:53.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:53 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:53.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:53 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:53.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:53 smithi171 ceph-mon[35901]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:53.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:53 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:53.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:53 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:53.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:53 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:53.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:53 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:53.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:53 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:53.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:53 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:53.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:53 smithi006 ceph-mon[32486]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:53.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:53 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:53.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:53 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:53.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:53 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:53.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:53 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:53.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:53 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:53.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:53 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:53.631 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:04:53.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.752+0000 7fc69962b640 1 -- 172.21.15.6:0/4059394938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc694102ab0 msgr2=0x7fc6941037b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:53.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.752+0000 7fc69962b640 1 --2- 172.21.15.6:0/4059394938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc694102ab0 0x7fc6941037b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc684009ca0 tx=0x7fc68402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:04:53.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.752+0000 7fc69962b640 1 -- 172.21.15.6:0/4059394938 shutdown_connections 2024-05-20T17:04:53.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.752+0000 7fc69962b640 1 --2- 172.21.15.6:0/4059394938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6941089f0 0x7fc69410ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:53.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.752+0000 7fc69962b640 1 --2- 172.21.15.6:0/4059394938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc694103cf0 0x7fc694104100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:53.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.752+0000 7fc69962b640 1 --2- 172.21.15.6:0/4059394938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc694102ab0 0x7fc6941037b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:53.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.752+0000 7fc69962b640 1 -- 172.21.15.6:0/4059394938 >> 172.21.15.6:0/4059394938 conn(0x7fc6940fdca0 msgr2=0x7fc694100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:53.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.752+0000 7fc69962b640 1 -- 172.21.15.6:0/4059394938 shutdown_connections 2024-05-20T17:04:53.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.752+0000 7fc69962b640 1 -- 172.21.15.6:0/4059394938 wait complete. 2024-05-20T17:04:53.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.753+0000 7fc69962b640 1 Processor -- start 2024-05-20T17:04:53.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.753+0000 7fc69962b640 1 -- start start 2024-05-20T17:04:53.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.753+0000 7fc69962b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc694102ab0 0x7fc6941991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:53.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.753+0000 7fc69962b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc694103cf0 0x7fc6941996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:53.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.753+0000 7fc69962b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6941089f0 0x7fc6941a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:53.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.753+0000 7fc69962b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc69410e610 con 0x7fc694103cf0 2024-05-20T17:04:53.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.753+0000 7fc69962b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc69410e490 con 0x7fc694102ab0 2024-05-20T17:04:53.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.753+0000 7fc69962b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc69410e790 con 0x7fc6941089f0 2024-05-20T17:04:53.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.753+0000 7fc6927fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc694103cf0 0x7fc6941996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:53.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.753+0000 7fc6927fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc694103cf0 0x7fc6941996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36838/0 (socket says 172.21.15.6:36838) 2024-05-20T17:04:53.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.753+0000 7fc6927fc640 1 -- 172.21.15.6:0/3317606202 learned_addr learned my addr 172.21.15.6:0/3317606202 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.753+0000 7fc692ffd640 1 --2- 172.21.15.6:0/3317606202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc694102ab0 0x7fc6941991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.753+0000 7fc6937fe640 1 --2- 172.21.15.6:0/3317606202 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6941089f0 0x7fc6941a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.754+0000 7fc6927fc640 1 -- 172.21.15.6:0/3317606202 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6941089f0 msgr2=0x7fc6941a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.754+0000 7fc6927fc640 1 --2- 172.21.15.6:0/3317606202 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6941089f0 0x7fc6941a0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.754+0000 7fc6927fc640 1 -- 172.21.15.6:0/3317606202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc694102ab0 msgr2=0x7fc6941991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.754+0000 7fc6927fc640 1 --2- 172.21.15.6:0/3317606202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc694102ab0 0x7fc6941991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.754+0000 7fc6927fc640 1 -- 172.21.15.6:0/3317606202 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6941a0cf0 con 0x7fc694103cf0 2024-05-20T17:04:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.754+0000 7fc6927fc640 1 --2- 172.21.15.6:0/3317606202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc694103cf0 0x7fc6941996f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc68800b4a0 tx=0x7fc68800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.754+0000 7fc67bfff640 1 -- 172.21.15.6:0/3317606202 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688014070 con 0x7fc694103cf0 2024-05-20T17:04:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.754+0000 7fc67bfff640 1 -- 172.21.15.6:0/3317606202 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc688010ac0 con 0x7fc694103cf0 2024-05-20T17:04:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.754+0000 7fc69962b640 1 -- 172.21.15.6:0/3317606202 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6941a0fe0 con 0x7fc694103cf0 2024-05-20T17:04:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.754+0000 7fc67bfff640 1 -- 172.21.15.6:0/3317606202 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688017c30 con 0x7fc694103cf0 2024-05-20T17:04:53.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.754+0000 7fc69962b640 1 -- 172.21.15.6:0/3317606202 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6941a1440 con 0x7fc694103cf0 2024-05-20T17:04:53.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.755+0000 7fc69962b640 1 -- 172.21.15.6:0/3317606202 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc694107800 con 0x7fc694103cf0 2024-05-20T17:04:53.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.756+0000 7fc67bfff640 1 -- 172.21.15.6:0/3317606202 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc688017070 con 0x7fc694103cf0 2024-05-20T17:04:53.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.757+0000 7fc67bfff640 1 --2- 172.21.15.6:0/3317606202 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc67c0a2c30 0x7fc67c0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:53.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.757+0000 7fc692ffd640 1 --2- 172.21.15.6:0/3317606202 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc67c0a2c30 0x7fc67c0a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:53.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.757+0000 7fc67bfff640 1 -- 172.21.15.6:0/3317606202 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fc6880ce350 con 0x7fc694103cf0 2024-05-20T17:04:53.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.758+0000 7fc692ffd640 1 --2- 172.21.15.6:0/3317606202 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc67c0a2c30 0x7fc67c0a5140 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc684000f80 tx=0x7fc684031000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:53.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.761+0000 7fc67bfff640 1 -- 172.21.15.6:0/3317606202 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc68809b6b0 con 0x7fc694103cf0 2024-05-20T17:04:53.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.993+0000 7fc69962b640 1 -- 172.21.15.6:0/3317606202 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc69402d2a0 con 0x7fc694103cf0 2024-05-20T17:04:53.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.993+0000 7fc67bfff640 1 -- 172.21.15.6:0/3317606202 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8815 (secure 0 0 0) 0x7fc68809afb0 con 0x7fc694103cf0 2024-05-20T17:04:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:04:53.994 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/3061403904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":3061403904},{"type":"v1","addr":"172.21.15.6:6839","nonce":3061403904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/78063155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":78063155},{"type":"v1","addr":"172.21.15.62:6835","nonce":78063155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1542537621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1542537621},{"type":"v1","addr":"172.21.15.171:6835","nonce":1542537621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24502,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/732693575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":732693575},{"type":"v1","addr":"172.21.15.171:6837","nonce":732693575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24509,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/1745943929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1745943929},{"type":"v1","addr":"172.21.15.62:6837","nonce":1745943929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24526,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6839/3246292303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3246292303},{"type":"v1","addr":"172.21.15.171:6839","nonce":3246292303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-05-20T17:04:53.994 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 11 2024-05-20T17:04:53.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.995+0000 7fc69962b640 1 -- 172.21.15.6:0/3317606202 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc67c0a2c30 msgr2=0x7fc67c0a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:53.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.995+0000 7fc69962b640 1 --2- 172.21.15.6:0/3317606202 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc67c0a2c30 0x7fc67c0a5140 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc684000f80 tx=0x7fc684031000 comp rx=0 tx=0).stop 2024-05-20T17:04:53.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.995+0000 7fc69962b640 1 -- 172.21.15.6:0/3317606202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc694103cf0 msgr2=0x7fc6941996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:53.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.995+0000 7fc69962b640 1 --2- 172.21.15.6:0/3317606202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc694103cf0 0x7fc6941996f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc68800b4a0 tx=0x7fc68800b960 comp rx=0 tx=0).stop 2024-05-20T17:04:53.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.995+0000 7fc69962b640 1 -- 172.21.15.6:0/3317606202 shutdown_connections 2024-05-20T17:04:53.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.995+0000 7fc69962b640 1 --2- 172.21.15.6:0/3317606202 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc67c0a2c30 0x7fc67c0a5140 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:53.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.995+0000 7fc69962b640 1 --2- 172.21.15.6:0/3317606202 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6941089f0 0x7fc6941a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:53.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.995+0000 7fc69962b640 1 --2- 172.21.15.6:0/3317606202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc694103cf0 0x7fc6941996f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:53.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.995+0000 7fc69962b640 1 --2- 172.21.15.6:0/3317606202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc694102ab0 0x7fc6941991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:53.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.995+0000 7fc69962b640 1 -- 172.21.15.6:0/3317606202 >> 172.21.15.6:0/3317606202 conn(0x7fc6940fdca0 msgr2=0x7fc6941049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:53.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.996+0000 7fc69962b640 1 -- 172.21.15.6:0/3317606202 shutdown_connections 2024-05-20T17:04:53.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:53.996+0000 7fc69962b640 1 -- 172.21.15.6:0/3317606202 wait complete. 2024-05-20T17:04:54.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:54 smithi006 ceph-mon[32486]: Deploying daemon mds.a on smithi006 2024-05-20T17:04:54.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:54 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.6:6838/3061403904,v1:172.21.15.6:6839/3061403904] up:boot 2024-05-20T17:04:54.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:54 smithi006 ceph-mon[32486]: fsmap 10 up:standby 2024-05-20T17:04:54.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:54 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-20T17:04:54.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:54 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3317606202' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:54.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:54 smithi062 ceph-mon[35425]: Deploying daemon mds.a on smithi006 2024-05-20T17:04:54.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:54 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.6:6838/3061403904,v1:172.21.15.6:6839/3061403904] up:boot 2024-05-20T17:04:54.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:54 smithi062 ceph-mon[35425]: fsmap 10 up:standby 2024-05-20T17:04:54.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:54 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-20T17:04:54.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:54 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3317606202' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:54.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:54 smithi171 ceph-mon[35901]: Deploying daemon mds.a on smithi006 2024-05-20T17:04:54.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:54 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.6:6838/3061403904,v1:172.21.15.6:6839/3061403904] up:boot 2024-05-20T17:04:54.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:54 smithi171 ceph-mon[35901]: fsmap 10 up:standby 2024-05-20T17:04:54.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:54 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-20T17:04:54.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:54 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3317606202' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:55.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:55 smithi006 ceph-mon[32486]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:55.381 INFO:journalctl@ceph.mds.a.smithi006.stdout:May 20 17:04:55 smithi006 systemd[1]: Starting Ceph mds.a for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:04:55.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:55 smithi062 ceph-mon[35425]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:55.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:55 smithi171 ceph-mon[35901]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:55.799 INFO:journalctl@ceph.mds.a.smithi006.stdout:May 20 17:04:55 smithi006 podman[73875]: 2024-05-20 17:04:55.437884373 +0000 UTC m=+0.017943341 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:04:55.799 INFO:journalctl@ceph.mds.a.smithi006.stdout:May 20 17:04:55 smithi006 podman[73875]: 2024-05-20 17:04:55.67819159 +0000 UTC m=+0.258250577 container create feb726a4fc004a87523fe24ec11510093503362db38200b00b3ccb6f29a15658 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-a, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:04:56.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:04:56.130 INFO:journalctl@ceph.mds.a.smithi006.stdout:May 20 17:04:55 smithi006 podman[73875]: 2024-05-20 17:04:55.923063481 +0000 UTC m=+0.503122439 container init feb726a4fc004a87523fe24ec11510093503362db38200b00b3ccb6f29a15658 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-a, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-20T17:04:56.130 INFO:journalctl@ceph.mds.a.smithi006.stdout:May 20 17:04:55 smithi006 podman[73875]: 2024-05-20 17:04:55.925987168 +0000 UTC m=+0.506046134 container start feb726a4fc004a87523fe24ec11510093503362db38200b00b3ccb6f29a15658 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-a, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-20T17:04:56.130 INFO:journalctl@ceph.mds.a.smithi006.stdout:May 20 17:04:55 smithi006 ceph-mds[73894]: -- 172.21.15.6:0/1013102451 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f9503aba40 con 0x55f950423600 2024-05-20T17:04:56.130 INFO:journalctl@ceph.mds.a.smithi006.stdout:May 20 17:04:55 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-a[73890]: starting mds.a at 2024-05-20T17:04:56.130 INFO:journalctl@ceph.mds.a.smithi006.stdout:May 20 17:04:56 smithi006 bash[73875]: feb726a4fc004a87523fe24ec11510093503362db38200b00b3ccb6f29a15658 2024-05-20T17:04:56.131 INFO:journalctl@ceph.mds.a.smithi006.stdout:May 20 17:04:56 smithi006 systemd[1]: Started Ceph mds.a for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T17:04:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.131+0000 7f35cd60d640 1 -- 172.21.15.6:0/803014722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c8105be0 msgr2=0x7f35c81080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.131+0000 7f35cd60d640 1 --2- 172.21.15.6:0/803014722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c8105be0 0x7f35c81080c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f35bc009900 tx=0x7f35bc02a410 comp rx=0 tx=0).stop 2024-05-20T17:04:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.131+0000 7f35cd60d640 1 -- 172.21.15.6:0/803014722 shutdown_connections 2024-05-20T17:04:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.131+0000 7f35cd60d640 1 --2- 172.21.15.6:0/803014722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35c8108750 0x7f35c810ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.131+0000 7f35cd60d640 1 --2- 172.21.15.6:0/803014722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c8105be0 0x7f35c81080c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.131+0000 7f35cd60d640 1 --2- 172.21.15.6:0/803014722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c81031f0 0x7f35c8105610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.131+0000 7f35cd60d640 1 -- 172.21.15.6:0/803014722 >> 172.21.15.6:0/803014722 conn(0x7f35c80fcbb0 msgr2=0x7f35c80ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.131+0000 7f35cd60d640 1 -- 172.21.15.6:0/803014722 shutdown_connections 2024-05-20T17:04:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.131+0000 7f35cd60d640 1 -- 172.21.15.6:0/803014722 wait complete. 2024-05-20T17:04:56.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.132+0000 7f35cd60d640 1 Processor -- start 2024-05-20T17:04:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.132+0000 7f35cd60d640 1 -- start start 2024-05-20T17:04:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.132+0000 7f35cd60d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c81031f0 0x7f35c8199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.132+0000 7f35cd60d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35c8105be0 0x7f35c8199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.132+0000 7f35cd60d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c8108750 0x7f35c81a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.132+0000 7f35cd60d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f35c810e610 con 0x7f35c81031f0 2024-05-20T17:04:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.132+0000 7f35cd60d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f35c810e490 con 0x7f35c8108750 2024-05-20T17:04:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.132+0000 7f35cd60d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f35c810e790 con 0x7f35c8105be0 2024-05-20T17:04:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.132+0000 7f35c6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c81031f0 0x7f35c8199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.133+0000 7f35c6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c81031f0 0x7f35c8199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36876/0 (socket says 172.21.15.6:36876) 2024-05-20T17:04:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.133+0000 7f35c6ffd640 1 -- 172.21.15.6:0/500265750 learned_addr learned my addr 172.21.15.6:0/500265750 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.133+0000 7f35c77fe640 1 --2- 172.21.15.6:0/500265750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c8108750 0x7f35c81a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.133+0000 7f35c67fc640 1 --2- 172.21.15.6:0/500265750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35c8105be0 0x7f35c8199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.133+0000 7f35c6ffd640 1 -- 172.21.15.6:0/500265750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35c8105be0 msgr2=0x7f35c8199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.133+0000 7f35c6ffd640 1 --2- 172.21.15.6:0/500265750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35c8105be0 0x7f35c8199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.133+0000 7f35c6ffd640 1 -- 172.21.15.6:0/500265750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c8108750 msgr2=0x7f35c81a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.133+0000 7f35c6ffd640 1 --2- 172.21.15.6:0/500265750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c8108750 0x7f35c81a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.133+0000 7f35c6ffd640 1 -- 172.21.15.6:0/500265750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c81a0c70 con 0x7f35c81031f0 2024-05-20T17:04:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.133+0000 7f35c6ffd640 1 --2- 172.21.15.6:0/500265750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c81031f0 0x7f35c8199130 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f35b800d770 tx=0x7f35b800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.133+0000 7f35affff640 1 -- 172.21.15.6:0/500265750 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b8017070 con 0x7f35c81031f0 2024-05-20T17:04:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.133+0000 7f35affff640 1 -- 172.21.15.6:0/500265750 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35b8009c30 con 0x7f35c81031f0 2024-05-20T17:04:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.133+0000 7f35cd60d640 1 -- 172.21.15.6:0/500265750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c81a0f60 con 0x7f35c81031f0 2024-05-20T17:04:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.133+0000 7f35affff640 1 -- 172.21.15.6:0/500265750 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b8003d00 con 0x7f35c81031f0 2024-05-20T17:04:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.133+0000 7f35cd60d640 1 -- 172.21.15.6:0/500265750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c81a1440 con 0x7f35c81031f0 2024-05-20T17:04:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.134+0000 7f35cd60d640 1 -- 172.21.15.6:0/500265750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35c8068340 con 0x7f35c81031f0 2024-05-20T17:04:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.136+0000 7f35affff640 1 -- 172.21.15.6:0/500265750 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f35b8003ea0 con 0x7f35c81031f0 2024-05-20T17:04:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.136+0000 7f35affff640 1 --2- 172.21.15.6:0/500265750 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f35b00a2c30 0x7f35b00a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.136+0000 7f35c67fc640 1 --2- 172.21.15.6:0/500265750 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f35b00a2c30 0x7f35b00a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.137+0000 7f35affff640 1 -- 172.21.15.6:0/500265750 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f35b80ce8e0 con 0x7f35c81031f0 2024-05-20T17:04:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.137+0000 7f35c67fc640 1 --2- 172.21.15.6:0/500265750 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f35b00a2c30 0x7f35b00a5140 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f35bc000c00 tx=0x7f35bc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:56.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.140+0000 7f35affff640 1 -- 172.21.15.6:0/500265750 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f35b809bce0 con 0x7f35c81031f0 2024-05-20T17:04:56.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.366+0000 7f35cd60d640 1 -- 172.21.15.6:0/500265750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35c802d320 con 0x7f35c81031f0 2024-05-20T17:04:56.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.367+0000 7f35affff640 1 -- 172.21.15.6:0/500265750 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9635 (secure 0 0 0) 0x7f35b8009de0 con 0x7f35c81031f0 2024-05-20T17:04:56.367 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:04:56.367 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/3061403904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":3061403904},{"type":"v1","addr":"172.21.15.6:6839","nonce":3061403904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/223306009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":223306009},{"type":"v1","addr":"172.21.15.6:6841","nonce":223306009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/78063155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":78063155},{"type":"v1","addr":"172.21.15.62:6835","nonce":78063155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1542537621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1542537621},{"type":"v1","addr":"172.21.15.171:6835","nonce":1542537621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24502,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/732693575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":732693575},{"type":"v1","addr":"172.21.15.171:6837","nonce":732693575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24509,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/1745943929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1745943929},{"type":"v1","addr":"172.21.15.62:6837","nonce":1745943929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24526,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6839/3246292303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3246292303},{"type":"v1","addr":"172.21.15.171:6839","nonce":3246292303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-05-20T17:04:56.368 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 12 2024-05-20T17:04:56.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.369+0000 7f35cd60d640 1 -- 172.21.15.6:0/500265750 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f35b00a2c30 msgr2=0x7f35b00a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:56.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.369+0000 7f35cd60d640 1 --2- 172.21.15.6:0/500265750 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f35b00a2c30 0x7f35b00a5140 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f35bc000c00 tx=0x7f35bc031400 comp rx=0 tx=0).stop 2024-05-20T17:04:56.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.369+0000 7f35cd60d640 1 -- 172.21.15.6:0/500265750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c81031f0 msgr2=0x7f35c8199130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:56.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.369+0000 7f35cd60d640 1 --2- 172.21.15.6:0/500265750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c81031f0 0x7f35c8199130 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f35b800d770 tx=0x7f35b800dc30 comp rx=0 tx=0).stop 2024-05-20T17:04:56.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.369+0000 7f35cd60d640 1 -- 172.21.15.6:0/500265750 shutdown_connections 2024-05-20T17:04:56.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.369+0000 7f35cd60d640 1 --2- 172.21.15.6:0/500265750 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f35b00a2c30 0x7f35b00a5140 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:56.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.369+0000 7f35cd60d640 1 --2- 172.21.15.6:0/500265750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c8108750 0x7f35c81a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:56.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.369+0000 7f35cd60d640 1 --2- 172.21.15.6:0/500265750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35c8105be0 0x7f35c8199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:56.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.369+0000 7f35cd60d640 1 --2- 172.21.15.6:0/500265750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c81031f0 0x7f35c8199130 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:56.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.369+0000 7f35cd60d640 1 -- 172.21.15.6:0/500265750 >> 172.21.15.6:0/500265750 conn(0x7f35c80fcbb0 msgr2=0x7f35c8103cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:56.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.369+0000 7f35cd60d640 1 -- 172.21.15.6:0/500265750 shutdown_connections 2024-05-20T17:04:56.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:56.369+0000 7f35cd60d640 1 -- 172.21.15.6:0/500265750 wait complete. 2024-05-20T17:04:57.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:57 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:57.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:57 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:57.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:57 smithi171 ceph-mon[35901]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:57.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:57 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:57.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:57 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:57.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:57 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:57.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:57 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:57.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:57 smithi171 ceph-mon[35901]: Deploying daemon mds.b on smithi062 2024-05-20T17:04:57.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:57 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.6:6840/223306009,v1:172.21.15.6:6841/223306009] up:boot 2024-05-20T17:04:57.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:57 smithi171 ceph-mon[35901]: fsmap 11 up:standby 2024-05-20T17:04:57.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:57 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-20T17:04:57.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:57 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/500265750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:57.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:57 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:57.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:57 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:57.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:57 smithi006 ceph-mon[32486]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:57.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:57 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:57.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:57 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:57.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:57 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:57.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:57 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:57.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:57 smithi006 ceph-mon[32486]: Deploying daemon mds.b on smithi062 2024-05-20T17:04:57.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:57 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.6:6840/223306009,v1:172.21.15.6:6841/223306009] up:boot 2024-05-20T17:04:57.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:57 smithi006 ceph-mon[32486]: fsmap 11 up:standby 2024-05-20T17:04:57.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:57 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-20T17:04:57.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:57 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/500265750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:57.436 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:57 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:57.436 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:57 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:57.436 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:57 smithi062 ceph-mon[35425]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:57.436 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:57 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:57.436 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:57 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-20T17:04:57.436 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:57 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-20T17:04:57.436 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:57 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:04:57.436 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:57 smithi062 ceph-mon[35425]: Deploying daemon mds.b on smithi062 2024-05-20T17:04:57.436 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:57 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.6:6840/223306009,v1:172.21.15.6:6841/223306009] up:boot 2024-05-20T17:04:57.436 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:57 smithi062 ceph-mon[35425]: fsmap 11 up:standby 2024-05-20T17:04:57.437 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:57 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-20T17:04:57.437 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:57 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/500265750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:58.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:04:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.512+0000 7f89edd9d640 1 -- 172.21.15.6:0/2876483779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e8108860 msgr2=0x7f89e810ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.512+0000 7f89edd9d640 1 --2- 172.21.15.6:0/2876483779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e8108860 0x7f89e810ac80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009ca0 tx=0x7f89e002a8c0 comp rx=0 tx=0).stop 2024-05-20T17:04:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.512+0000 7f89edd9d640 1 -- 172.21.15.6:0/2876483779 shutdown_connections 2024-05-20T17:04:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.512+0000 7f89edd9d640 1 --2- 172.21.15.6:0/2876483779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e8108860 0x7f89e810ac80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.512+0000 7f89edd9d640 1 --2- 172.21.15.6:0/2876483779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89e8105f00 0x7f89e8108320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.512+0000 7f89edd9d640 1 --2- 172.21.15.6:0/2876483779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89e81035a0 0x7f89e81059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.512+0000 7f89edd9d640 1 -- 172.21.15.6:0/2876483779 >> 172.21.15.6:0/2876483779 conn(0x7f89e80fcba0 msgr2=0x7f89e80ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.512+0000 7f89edd9d640 1 -- 172.21.15.6:0/2876483779 shutdown_connections 2024-05-20T17:04:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.512+0000 7f89edd9d640 1 -- 172.21.15.6:0/2876483779 wait complete. 2024-05-20T17:04:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.513+0000 7f89edd9d640 1 Processor -- start 2024-05-20T17:04:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.513+0000 7f89edd9d640 1 -- start start 2024-05-20T17:04:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.513+0000 7f89edd9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89e81035a0 0x7f89e81029f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.513+0000 7f89edd9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e8105f00 0x7f89e8101090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.513+0000 7f89edd9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89e8108860 0x7f89e81015d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.513+0000 7f89edd9d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f89e810e5e0 con 0x7f89e8105f00 2024-05-20T17:04:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.513+0000 7f89edd9d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f89e810e460 con 0x7f89e81035a0 2024-05-20T17:04:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.513+0000 7f89edd9d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f89e810e760 con 0x7f89e8108860 2024-05-20T17:04:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.513+0000 7f89e6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e8105f00 0x7f89e8101090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.514+0000 7f89e6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e8105f00 0x7f89e8101090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36888/0 (socket says 172.21.15.6:36888) 2024-05-20T17:04:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.514+0000 7f89e6ffd640 1 -- 172.21.15.6:0/233798929 learned_addr learned my addr 172.21.15.6:0/233798929 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:04:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.514+0000 7f89e77fe640 1 --2- 172.21.15.6:0/233798929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89e81035a0 0x7f89e81029f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.514+0000 7f89e7fff640 1 --2- 172.21.15.6:0/233798929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89e8108860 0x7f89e81015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.514+0000 7f89e6ffd640 1 -- 172.21.15.6:0/233798929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89e8108860 msgr2=0x7f89e81015d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.514+0000 7f89e6ffd640 1 --2- 172.21.15.6:0/233798929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89e8108860 0x7f89e81015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.514+0000 7f89e6ffd640 1 -- 172.21.15.6:0/233798929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89e81035a0 msgr2=0x7f89e81029f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.514+0000 7f89e6ffd640 1 --2- 172.21.15.6:0/233798929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89e81035a0 0x7f89e81029f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.514+0000 7f89e6ffd640 1 -- 172.21.15.6:0/233798929 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e8101d00 con 0x7f89e8105f00 2024-05-20T17:04:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.514+0000 7f89e77fe640 1 --2- 172.21.15.6:0/233798929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89e81035a0 0x7f89e81029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:04:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.514+0000 7f89e6ffd640 1 --2- 172.21.15.6:0/233798929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e8105f00 0x7f89e8101090 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00d950 tx=0x7f89dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.514+0000 7f89e4ff9640 1 -- 172.21.15.6:0/233798929 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc017070 con 0x7f89e8105f00 2024-05-20T17:04:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.514+0000 7f89e4ff9640 1 -- 172.21.15.6:0/233798929 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f89dc009c30 con 0x7f89e8105f00 2024-05-20T17:04:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.514+0000 7f89edd9d640 1 -- 172.21.15.6:0/233798929 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e81a31b0 con 0x7f89e8105f00 2024-05-20T17:04:58.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.514+0000 7f89e4ff9640 1 -- 172.21.15.6:0/233798929 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc00f620 con 0x7f89e8105f00 2024-05-20T17:04:58.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.514+0000 7f89edd9d640 1 -- 172.21.15.6:0/233798929 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e81a36a0 con 0x7f89e8105f00 2024-05-20T17:04:58.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.515+0000 7f89edd9d640 1 -- 172.21.15.6:0/233798929 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e80fe6c0 con 0x7f89e8105f00 2024-05-20T17:04:58.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.517+0000 7f89e4ff9640 1 -- 172.21.15.6:0/233798929 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f89dc0109a0 con 0x7f89e8105f00 2024-05-20T17:04:58.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.517+0000 7f89e4ff9640 1 --2- 172.21.15.6:0/233798929 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f89d00a2cb0 0x7f89d00a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:04:58.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.517+0000 7f89e77fe640 1 --2- 172.21.15.6:0/233798929 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f89d00a2cb0 0x7f89d00a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:04:58.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.518+0000 7f89e4ff9640 1 -- 172.21.15.6:0/233798929 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f89dc0ce7c0 con 0x7f89e8105f00 2024-05-20T17:04:58.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.518+0000 7f89e77fe640 1 --2- 172.21.15.6:0/233798929 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f89d00a2cb0 0x7f89d00a51c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f89e80699d0 tx=0x7f89d8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:04:58.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.521+0000 7f89e4ff9640 1 -- 172.21.15.6:0/233798929 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f89dc009de0 con 0x7f89e8105f00 2024-05-20T17:04:58.522 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:04:58 smithi062 systemd[1]: Starting Ceph mds.b for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:04:58.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.746+0000 7f89edd9d640 1 -- 172.21.15.6:0/233798929 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89e802d2a0 con 0x7f89e8105f00 2024-05-20T17:04:58.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.747+0000 7f89e4ff9640 1 -- 172.21.15.6:0/233798929 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9635 (secure 0 0 0) 0x7f89dc09bc40 con 0x7f89e8105f00 2024-05-20T17:04:58.747 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:04:58.747 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/3061403904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":3061403904},{"type":"v1","addr":"172.21.15.6:6839","nonce":3061403904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/223306009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":223306009},{"type":"v1","addr":"172.21.15.6:6841","nonce":223306009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/78063155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":78063155},{"type":"v1","addr":"172.21.15.62:6835","nonce":78063155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1542537621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1542537621},{"type":"v1","addr":"172.21.15.171:6835","nonce":1542537621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24502,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/732693575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":732693575},{"type":"v1","addr":"172.21.15.171:6837","nonce":732693575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24509,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/1745943929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1745943929},{"type":"v1","addr":"172.21.15.62:6837","nonce":1745943929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24526,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6839/3246292303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3246292303},{"type":"v1","addr":"172.21.15.171:6839","nonce":3246292303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-05-20T17:04:58.748 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 12 2024-05-20T17:04:58.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.749+0000 7f89edd9d640 1 -- 172.21.15.6:0/233798929 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f89d00a2cb0 msgr2=0x7f89d00a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:58.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.749+0000 7f89edd9d640 1 --2- 172.21.15.6:0/233798929 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f89d00a2cb0 0x7f89d00a51c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f89e80699d0 tx=0x7f89d8005f90 comp rx=0 tx=0).stop 2024-05-20T17:04:58.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.749+0000 7f89edd9d640 1 -- 172.21.15.6:0/233798929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e8105f00 msgr2=0x7f89e8101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:04:58.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.749+0000 7f89edd9d640 1 --2- 172.21.15.6:0/233798929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e8105f00 0x7f89e8101090 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00d950 tx=0x7f89dc00de10 comp rx=0 tx=0).stop 2024-05-20T17:04:58.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.749+0000 7f89edd9d640 1 -- 172.21.15.6:0/233798929 shutdown_connections 2024-05-20T17:04:58.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.749+0000 7f89edd9d640 1 --2- 172.21.15.6:0/233798929 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f89d00a2cb0 0x7f89d00a51c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:58.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.749+0000 7f89edd9d640 1 --2- 172.21.15.6:0/233798929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89e8108860 0x7f89e81015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:58.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.749+0000 7f89edd9d640 1 --2- 172.21.15.6:0/233798929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e8105f00 0x7f89e8101090 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:58.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.749+0000 7f89edd9d640 1 --2- 172.21.15.6:0/233798929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89e81035a0 0x7f89e81029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:04:58.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.749+0000 7f89edd9d640 1 -- 172.21.15.6:0/233798929 >> 172.21.15.6:0/233798929 conn(0x7f89e80fcba0 msgr2=0x7f89e8104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:04:58.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.749+0000 7f89edd9d640 1 -- 172.21.15.6:0/233798929 shutdown_connections 2024-05-20T17:04:58.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:04:58.749+0000 7f89edd9d640 1 -- 172.21.15.6:0/233798929 wait complete. 2024-05-20T17:04:58.801 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:04:58 smithi062 podman[65245]: 2024-05-20 17:04:58.441655811 +0000 UTC m=+0.018365815 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:04:58.801 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:04:58 smithi062 podman[65245]: 2024-05-20 17:04:58.566259592 +0000 UTC m=+0.142969636 container create 4886ecbb7714e4d8106504e44280daf035956a11394ad62010542a9e4a2b49f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-b, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:04:59.062 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:04:58 smithi062 podman[65245]: 2024-05-20 17:04:58.802095294 +0000 UTC m=+0.378805286 container init 4886ecbb7714e4d8106504e44280daf035956a11394ad62010542a9e4a2b49f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-b, org.label-schema.build-date=20240514, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-05-20T17:04:59.063 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:04:58 smithi062 podman[65245]: 2024-05-20 17:04:58.804990536 +0000 UTC m=+0.381700535 container start 4886ecbb7714e4d8106504e44280daf035956a11394ad62010542a9e4a2b49f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514) 2024-05-20T17:04:59.063 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:04:58 smithi062 ceph-mds[65264]: -- 172.21.15.62:0/713019982 <== mon.2 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561437d89a40 con 0x561437e01a80 2024-05-20T17:04:59.063 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:04:58 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-b[65260]: starting mds.b at 2024-05-20T17:04:59.063 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:04:58 smithi062 bash[65245]: 4886ecbb7714e4d8106504e44280daf035956a11394ad62010542a9e4a2b49f8 2024-05-20T17:04:59.063 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:04:58 smithi062 systemd[1]: Started Ceph mds.b for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T17:04:59.333 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:59 smithi062 ceph-mon[35425]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:59.333 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:59 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/233798929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:59.333 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:59 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:59.333 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:59 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:59.333 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:59 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:59.333 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:59 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:59.333 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:04:59 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:59.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:59 smithi171 ceph-mon[35901]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:59.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:59 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/233798929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:59.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:59 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:59.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:59 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:59.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:59 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:59.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:59 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:59.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:04:59 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:59.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:59 smithi006 ceph-mon[32486]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:04:59.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:59 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/233798929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:04:59.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:59.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:59.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:59.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:04:59.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:04:59 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:00.342 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:00 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] up:boot 2024-05-20T17:05:00.342 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:00 smithi062 ceph-mon[35425]: fsmap 12 up:standby 2024-05-20T17:05:00.342 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:00 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-20T17:05:00.342 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:00 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:05:00.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:00 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] up:boot 2024-05-20T17:05:00.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:00 smithi171 ceph-mon[35901]: fsmap 12 up:standby 2024-05-20T17:05:00.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:00 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-20T17:05:00.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:00 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:05:00.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:00 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] up:boot 2024-05-20T17:05:00.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:00 smithi006 ceph-mon[32486]: fsmap 12 up:standby 2024-05-20T17:05:00.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:00 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-20T17:05:00.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:00 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:05:00.761 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:05:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.889+0000 7f688baa2640 1 -- 172.21.15.6:0/2978826947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6884102c00 msgr2=0x7f6884103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.889+0000 7f688baa2640 1 --2- 172.21.15.6:0/2978826947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6884102c00 0x7f6884103010 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6874009900 tx=0x7f687402a410 comp rx=0 tx=0).stop 2024-05-20T17:05:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.889+0000 7f688baa2640 1 -- 172.21.15.6:0/2978826947 shutdown_connections 2024-05-20T17:05:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.889+0000 7f688baa2640 1 --2- 172.21.15.6:0/2978826947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6884107900 0x7f6884109d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.889+0000 7f688baa2640 1 --2- 172.21.15.6:0/2978826947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6884102c00 0x7f6884103010 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.889+0000 7f688baa2640 1 --2- 172.21.15.6:0/2978826947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68841019c0 0x7f68841026c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.889+0000 7f688baa2640 1 -- 172.21.15.6:0/2978826947 >> 172.21.15.6:0/2978826947 conn(0x7f68840fcbb0 msgr2=0x7f68840ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.889+0000 7f688baa2640 1 -- 172.21.15.6:0/2978826947 shutdown_connections 2024-05-20T17:05:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.889+0000 7f688baa2640 1 -- 172.21.15.6:0/2978826947 wait complete. 2024-05-20T17:05:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.889+0000 7f688baa2640 1 Processor -- start 2024-05-20T17:05:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.890+0000 7f688baa2640 1 -- start start 2024-05-20T17:05:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.890+0000 7f688baa2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68841019c0 0x7f688419b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.890+0000 7f688baa2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6884102c00 0x7f688419b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.890+0000 7f688baa2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6884107900 0x7f68841a27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.890+0000 7f688baa2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f688410e5f0 con 0x7f6884102c00 2024-05-20T17:05:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.890+0000 7f688baa2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f688410e470 con 0x7f6884107900 2024-05-20T17:05:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.890+0000 7f688baa2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f688410e770 con 0x7f68841019c0 2024-05-20T17:05:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.890+0000 7f688903d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6884102c00 0x7f688419b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.890+0000 7f688903d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6884102c00 0x7f688419b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60602/0 (socket says 172.21.15.6:60602) 2024-05-20T17:05:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.890+0000 7f688903d640 1 -- 172.21.15.6:0/1539965541 learned_addr learned my addr 172.21.15.6:0/1539965541 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.890+0000 7f688983e640 1 --2- 172.21.15.6:0/1539965541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68841019c0 0x7f688419b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.890+0000 7f688a03f640 1 --2- 172.21.15.6:0/1539965541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6884107900 0x7f68841a27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.890+0000 7f688903d640 1 -- 172.21.15.6:0/1539965541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68841019c0 msgr2=0x7f688419b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.890+0000 7f688903d640 1 --2- 172.21.15.6:0/1539965541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68841019c0 0x7f688419b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.890+0000 7f688903d640 1 -- 172.21.15.6:0/1539965541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6884107900 msgr2=0x7f68841a27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.890+0000 7f688903d640 1 --2- 172.21.15.6:0/1539965541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6884107900 0x7f68841a27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.890+0000 7f688903d640 1 -- 172.21.15.6:0/1539965541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68841a2e60 con 0x7f6884102c00 2024-05-20T17:05:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.890+0000 7f688983e640 1 --2- 172.21.15.6:0/1539965541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68841019c0 0x7f688419b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:05:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.890+0000 7f688903d640 1 --2- 172.21.15.6:0/1539965541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6884102c00 0x7f688419b860 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6874004770 tx=0x7f6874004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.891+0000 7f687affd640 1 -- 172.21.15.6:0/1539965541 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687403f030 con 0x7f6884102c00 2024-05-20T17:05:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.891+0000 7f687affd640 1 -- 172.21.15.6:0/1539965541 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6874003aa0 con 0x7f6884102c00 2024-05-20T17:05:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.891+0000 7f688baa2640 1 -- 172.21.15.6:0/1539965541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68841a30f0 con 0x7f6884102c00 2024-05-20T17:05:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.891+0000 7f687affd640 1 -- 172.21.15.6:0/1539965541 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6874035070 con 0x7f6884102c00 2024-05-20T17:05:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.891+0000 7f688baa2640 1 -- 172.21.15.6:0/1539965541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68841a35e0 con 0x7f6884102c00 2024-05-20T17:05:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.892+0000 7f688baa2640 1 -- 172.21.15.6:0/1539965541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68841a3900 con 0x7f6884102c00 2024-05-20T17:05:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.893+0000 7f687affd640 1 -- 172.21.15.6:0/1539965541 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f6874042030 con 0x7f6884102c00 2024-05-20T17:05:00.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.895+0000 7f687affd640 1 --2- 172.21.15.6:0/1539965541 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f68700a2c30 0x7f68700a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:00.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.895+0000 7f687affd640 1 -- 172.21.15.6:0/1539965541 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f68740ef050 con 0x7f6884102c00 2024-05-20T17:05:00.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.895+0000 7f688983e640 1 --2- 172.21.15.6:0/1539965541 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f68700a2c30 0x7f68700a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:00.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.895+0000 7f688983e640 1 --2- 172.21.15.6:0/1539965541 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f68700a2c30 0x7f68700a5140 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f68841025c0 tx=0x7f6880005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:00.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:00.900+0000 7f687affd640 1 -- 172.21.15.6:0/1539965541 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f68740bbe00 con 0x7f6884102c00 2024-05-20T17:05:01.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.130+0000 7f688baa2640 1 -- 172.21.15.6:0/1539965541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68841a3ad0 con 0x7f6884102c00 2024-05-20T17:05:01.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.131+0000 7f687affd640 1 -- 172.21.15.6:0/1539965541 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10461 (secure 0 0 0) 0x7f68740c0100 con 0x7f6884102c00 2024-05-20T17:05:01.131 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:05:01.131 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/3061403904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":3061403904},{"type":"v1","addr":"172.21.15.6:6839","nonce":3061403904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/223306009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":223306009},{"type":"v1","addr":"172.21.15.6:6841","nonce":223306009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/78063155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":78063155},{"type":"v1","addr":"172.21.15.62:6835","nonce":78063155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1542537621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1542537621},{"type":"v1","addr":"172.21.15.171:6835","nonce":1542537621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24502,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/732693575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":732693575},{"type":"v1","addr":"172.21.15.171:6837","nonce":732693575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24509,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/1745943929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1745943929},{"type":"v1","addr":"172.21.15.62:6837","nonce":1745943929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24526,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6839/3246292303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3246292303},{"type":"v1","addr":"172.21.15.171:6839","nonce":3246292303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/3023093487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3023093487},{"type":"v1","addr":"172.21.15.62:6839","nonce":3023093487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-05-20T17:05:01.132 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 13 2024-05-20T17:05:01.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.133+0000 7f688baa2640 1 -- 172.21.15.6:0/1539965541 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f68700a2c30 msgr2=0x7f68700a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:01.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.133+0000 7f688baa2640 1 --2- 172.21.15.6:0/1539965541 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f68700a2c30 0x7f68700a5140 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f68841025c0 tx=0x7f6880005f90 comp rx=0 tx=0).stop 2024-05-20T17:05:01.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.133+0000 7f688baa2640 1 -- 172.21.15.6:0/1539965541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6884102c00 msgr2=0x7f688419b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:01.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.133+0000 7f688baa2640 1 --2- 172.21.15.6:0/1539965541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6884102c00 0x7f688419b860 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6874004770 tx=0x7f6874004270 comp rx=0 tx=0).stop 2024-05-20T17:05:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.133+0000 7f688baa2640 1 -- 172.21.15.6:0/1539965541 shutdown_connections 2024-05-20T17:05:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.133+0000 7f688baa2640 1 --2- 172.21.15.6:0/1539965541 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f68700a2c30 0x7f68700a5140 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.133+0000 7f688baa2640 1 --2- 172.21.15.6:0/1539965541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6884107900 0x7f68841a27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.133+0000 7f688baa2640 1 --2- 172.21.15.6:0/1539965541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6884102c00 0x7f688419b860 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.133+0000 7f688baa2640 1 --2- 172.21.15.6:0/1539965541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68841019c0 0x7f688419b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.133+0000 7f688baa2640 1 -- 172.21.15.6:0/1539965541 >> 172.21.15.6:0/1539965541 conn(0x7f68840fcbb0 msgr2=0x7f68840fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.133+0000 7f688baa2640 1 -- 172.21.15.6:0/1539965541 shutdown_connections 2024-05-20T17:05:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.133+0000 7f688baa2640 1 -- 172.21.15.6:0/1539965541 wait complete. 2024-05-20T17:05:01.145 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:05:01.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.260+0000 7f17a6e7a640 1 -- 172.21.15.6:0/2453050424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a0107910 msgr2=0x7f17a0109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:01.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.260+0000 7f17a6e7a640 1 --2- 172.21.15.6:0/2453050424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a0107910 0x7f17a0109d30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1798009ca0 tx=0x7f179802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.260+0000 7f17a6e7a640 1 -- 172.21.15.6:0/2453050424 shutdown_connections 2024-05-20T17:05:01.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.260+0000 7f17a6e7a640 1 --2- 172.21.15.6:0/2453050424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a0107910 0x7f17a0109d30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.260+0000 7f17a6e7a640 1 --2- 172.21.15.6:0/2453050424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17a0102c10 0x7f17a0103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.260+0000 7f17a6e7a640 1 --2- 172.21.15.6:0/2453050424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17a01019d0 0x7f17a01026d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.260+0000 7f17a6e7a640 1 -- 172.21.15.6:0/2453050424 >> 172.21.15.6:0/2453050424 conn(0x7f17a00fcbe0 msgr2=0x7f17a00ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:01.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.261+0000 7f17a6e7a640 1 -- 172.21.15.6:0/2453050424 shutdown_connections 2024-05-20T17:05:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.261+0000 7f17a6e7a640 1 -- 172.21.15.6:0/2453050424 wait complete. 2024-05-20T17:05:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.261+0000 7f17a6e7a640 1 Processor -- start 2024-05-20T17:05:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.261+0000 7f17a6e7a640 1 -- start start 2024-05-20T17:05:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.261+0000 7f17a6e7a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17a01019d0 0x7f17a01991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.261+0000 7f17a6e7a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17a0102c10 0x7f17a0199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.261+0000 7f17a6e7a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a0107910 0x7f17a01a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.261+0000 7f17a6e7a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f17a010d530 con 0x7f17a0107910 2024-05-20T17:05:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.261+0000 7f17a6e7a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f17a010d3b0 con 0x7f17a0102c10 2024-05-20T17:05:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.261+0000 7f17a6e7a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f17a010d6b0 con 0x7f17a01019d0 2024-05-20T17:05:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.262+0000 7f17a5417640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a0107910 0x7f17a01a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.262+0000 7f179ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17a0102c10 0x7f17a0199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.262+0000 7f17a5417640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a0107910 0x7f17a01a0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60610/0 (socket says 172.21.15.6:60610) 2024-05-20T17:05:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.262+0000 7f17a5417640 1 -- 172.21.15.6:0/3694459801 learned_addr learned my addr 172.21.15.6:0/3694459801 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.262+0000 7f17a4c16640 1 --2- 172.21.15.6:0/3694459801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17a01019d0 0x7f17a01991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.262+0000 7f179ffff640 1 -- 172.21.15.6:0/3694459801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17a01019d0 msgr2=0x7f17a01991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.262+0000 7f179ffff640 1 --2- 172.21.15.6:0/3694459801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17a01019d0 0x7f17a01991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.262+0000 7f179ffff640 1 -- 172.21.15.6:0/3694459801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a0107910 msgr2=0x7f17a01a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.262+0000 7f179ffff640 1 --2- 172.21.15.6:0/3694459801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a0107910 0x7f17a01a0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.262+0000 7f179ffff640 1 -- 172.21.15.6:0/3694459801 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a01a0cb0 con 0x7f17a0102c10 2024-05-20T17:05:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.262+0000 7f17a4c16640 1 --2- 172.21.15.6:0/3694459801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17a01019d0 0x7f17a01991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:05:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.262+0000 7f17a5417640 1 --2- 172.21.15.6:0/3694459801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a0107910 0x7f17a01a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:05:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.262+0000 7f179ffff640 1 --2- 172.21.15.6:0/3694459801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17a0102c10 0x7f17a0199700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f178800e9f0 tx=0x7f178800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.262+0000 7f179dffb640 1 -- 172.21.15.6:0/3694459801 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178800ccc0 con 0x7f17a0102c10 2024-05-20T17:05:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.262+0000 7f179dffb640 1 -- 172.21.15.6:0/3694459801 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f17880108e0 con 0x7f17a0102c10 2024-05-20T17:05:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.262+0000 7f17a6e7a640 1 -- 172.21.15.6:0/3694459801 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a01a0fa0 con 0x7f17a0102c10 2024-05-20T17:05:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.262+0000 7f179dffb640 1 -- 172.21.15.6:0/3694459801 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1788018880 con 0x7f17a0102c10 2024-05-20T17:05:01.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.263+0000 7f17a6e7a640 1 -- 172.21.15.6:0/3694459801 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a01a1460 con 0x7f17a0102c10 2024-05-20T17:05:01.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.264+0000 7f17a6e7a640 1 -- 172.21.15.6:0/3694459801 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a01a16c0 con 0x7f17a0102c10 2024-05-20T17:05:01.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.265+0000 7f179dffb640 1 -- 172.21.15.6:0/3694459801 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f1788010430 con 0x7f17a0102c10 2024-05-20T17:05:01.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.266+0000 7f179dffb640 1 --2- 172.21.15.6:0/3694459801 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f178c0a2cb0 0x7f178c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:01.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.266+0000 7f179dffb640 1 -- 172.21.15.6:0/3694459801 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f17880ceed0 con 0x7f17a0102c10 2024-05-20T17:05:01.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.266+0000 7f17a4c16640 1 --2- 172.21.15.6:0/3694459801 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f178c0a2cb0 0x7f178c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:01.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.266+0000 7f17a4c16640 1 --2- 172.21.15.6:0/3694459801 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f178c0a2cb0 0x7f178c0a51c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f17a01025d0 tx=0x7f1790005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:01.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.271+0000 7f179dffb640 1 -- 172.21.15.6:0/3694459801 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f178809bc20 con 0x7f17a0102c10 2024-05-20T17:05:01.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.458+0000 7f17a6e7a640 1 -- 172.21.15.6:0/3694459801 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17a01a19b0 con 0x7f17a0102c10 2024-05-20T17:05:01.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.459+0000 7f179dffb640 1 -- 172.21.15.6:0/3694459801 <== mon.2 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+18301 (secure 0 0 0) 0x7f1788086020 con 0x7f17a0102c10 2024-05-20T17:05:01.460 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:05:01.460 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":82,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:04:12.184652+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:05:01.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.462+0000 7f17a6e7a640 1 -- 172.21.15.6:0/3694459801 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f178c0a2cb0 msgr2=0x7f178c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:01.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.462+0000 7f17a6e7a640 1 --2- 172.21.15.6:0/3694459801 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f178c0a2cb0 0x7f178c0a51c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f17a01025d0 tx=0x7f1790005f90 comp rx=0 tx=0).stop 2024-05-20T17:05:01.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.462+0000 7f17a6e7a640 1 -- 172.21.15.6:0/3694459801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17a0102c10 msgr2=0x7f17a0199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:01.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.462+0000 7f17a6e7a640 1 --2- 172.21.15.6:0/3694459801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17a0102c10 0x7f17a0199700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f178800e9f0 tx=0x7f178800eeb0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.462+0000 7f17a6e7a640 1 -- 172.21.15.6:0/3694459801 shutdown_connections 2024-05-20T17:05:01.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.462+0000 7f17a6e7a640 1 --2- 172.21.15.6:0/3694459801 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f178c0a2cb0 0x7f178c0a51c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.462+0000 7f17a6e7a640 1 --2- 172.21.15.6:0/3694459801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a0107910 0x7f17a01a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.462+0000 7f17a6e7a640 1 --2- 172.21.15.6:0/3694459801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17a0102c10 0x7f17a0199700 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.462+0000 7f17a6e7a640 1 --2- 172.21.15.6:0/3694459801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17a01019d0 0x7f17a01991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.462+0000 7f17a6e7a640 1 -- 172.21.15.6:0/3694459801 >> 172.21.15.6:0/3694459801 conn(0x7f17a00fcbe0 msgr2=0x7f17a0073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:01.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.462+0000 7f17a6e7a640 1 -- 172.21.15.6:0/3694459801 shutdown_connections 2024-05-20T17:05:01.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.462+0000 7f17a6e7a640 1 -- 172.21.15.6:0/3694459801 wait complete. 2024-05-20T17:05:01.477 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:00:12.516679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:05:01.477 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:05:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.595+0000 7f739d709640 1 -- 172.21.15.6:0/1208801444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7398107900 msgr2=0x7f7398109d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.595+0000 7f739d709640 1 --2- 172.21.15.6:0/1208801444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7398107900 0x7f7398109d20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7390009ca0 tx=0x7f739002a8c0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.595+0000 7f739d709640 1 -- 172.21.15.6:0/1208801444 shutdown_connections 2024-05-20T17:05:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.595+0000 7f739d709640 1 --2- 172.21.15.6:0/1208801444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7398107900 0x7f7398109d20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.595+0000 7f739d709640 1 --2- 172.21.15.6:0/1208801444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7398102c00 0x7f7398103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.595+0000 7f739d709640 1 --2- 172.21.15.6:0/1208801444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73981019c0 0x7f73981026c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.595+0000 7f739d709640 1 -- 172.21.15.6:0/1208801444 >> 172.21.15.6:0/1208801444 conn(0x7f73980fcbb0 msgr2=0x7f73980ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.595+0000 7f739d709640 1 -- 172.21.15.6:0/1208801444 shutdown_connections 2024-05-20T17:05:01.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.595+0000 7f739d709640 1 -- 172.21.15.6:0/1208801444 wait complete. 2024-05-20T17:05:01.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.596+0000 7f739d709640 1 Processor -- start 2024-05-20T17:05:01.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.596+0000 7f739d709640 1 -- start start 2024-05-20T17:05:01.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.596+0000 7f739d709640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73981019c0 0x7f73981980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:01.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.596+0000 7f739d709640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7398102c00 0x7f73981985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:01.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.596+0000 7f739d709640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7398107900 0x7f739819f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:01.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.597+0000 7f739d709640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f739810d4d0 con 0x7f7398102c00 2024-05-20T17:05:01.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.597+0000 7f739d709640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f739810d350 con 0x7f73981019c0 2024-05-20T17:05:01.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.597+0000 7f739d709640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f739810d650 con 0x7f7398107900 2024-05-20T17:05:01.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.597+0000 7f73967fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7398102c00 0x7f73981985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:01.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.597+0000 7f73967fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7398102c00 0x7f73981985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60628/0 (socket says 172.21.15.6:60628) 2024-05-20T17:05:01.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.597+0000 7f7396ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73981019c0 0x7f73981980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:01.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.597+0000 7f73967fc640 1 -- 172.21.15.6:0/112164731 learned_addr learned my addr 172.21.15.6:0/112164731 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:01.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.597+0000 7f73977fe640 1 --2- 172.21.15.6:0/112164731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7398107900 0x7f739819f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:01.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.597+0000 7f73967fc640 1 -- 172.21.15.6:0/112164731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7398107900 msgr2=0x7f739819f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:01.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.597+0000 7f73967fc640 1 --2- 172.21.15.6:0/112164731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7398107900 0x7f739819f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.597+0000 7f73967fc640 1 -- 172.21.15.6:0/112164731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73981019c0 msgr2=0x7f73981980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:01.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.597+0000 7f73967fc640 1 --2- 172.21.15.6:0/112164731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73981019c0 0x7f73981980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.597+0000 7f73967fc640 1 -- 172.21.15.6:0/112164731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739819fbe0 con 0x7f7398102c00 2024-05-20T17:05:01.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.597+0000 7f7396ffd640 1 --2- 172.21.15.6:0/112164731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73981019c0 0x7f73981980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:05:01.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.597+0000 7f73967fc640 1 --2- 172.21.15.6:0/112164731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7398102c00 0x7f73981985e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f738000e9f0 tx=0x7f738000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:01.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.597+0000 7f738ffff640 1 -- 172.21.15.6:0/112164731 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738000cd80 con 0x7f7398102c00 2024-05-20T17:05:01.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.597+0000 7f738ffff640 1 -- 172.21.15.6:0/112164731 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73800108e0 con 0x7f7398102c00 2024-05-20T17:05:01.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.597+0000 7f739d709640 1 -- 172.21.15.6:0/112164731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f739819fed0 con 0x7f7398102c00 2024-05-20T17:05:01.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.597+0000 7f738ffff640 1 -- 172.21.15.6:0/112164731 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7380018920 con 0x7f7398102c00 2024-05-20T17:05:01.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.597+0000 7f739d709640 1 -- 172.21.15.6:0/112164731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73981a0390 con 0x7f7398102c00 2024-05-20T17:05:01.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.599+0000 7f739d709640 1 -- 172.21.15.6:0/112164731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7398106710 con 0x7f7398102c00 2024-05-20T17:05:01.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.600+0000 7f738ffff640 1 -- 172.21.15.6:0/112164731 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f7380010a90 con 0x7f7398102c00 2024-05-20T17:05:01.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.601+0000 7f738ffff640 1 --2- 172.21.15.6:0/112164731 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f73840a2c10 0x7f73840a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:01.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.601+0000 7f738ffff640 1 -- 172.21.15.6:0/112164731 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f73800cf350 con 0x7f7398102c00 2024-05-20T17:05:01.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.601+0000 7f7396ffd640 1 --2- 172.21.15.6:0/112164731 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f73840a2c10 0x7f73840a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:01.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.601+0000 7f7396ffd640 1 --2- 172.21.15.6:0/112164731 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f73840a2c10 0x7f73840a5120 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f73981025c0 tx=0x7f7388005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:01.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.609+0000 7f738ffff640 1 -- 172.21.15.6:0/112164731 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f738009c060 con 0x7f7398102c00 2024-05-20T17:05:01.802 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:01 smithi006 ceph-mon[32486]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:05:01.802 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:01 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:01.802 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:01 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:01.803 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:01 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:01.803 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:01 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:01.803 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:01 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:01.803 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:01 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:01.803 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:01 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:05:01.803 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:01 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:05:01.803 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:01 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:01.803 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:01 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1539965541' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:05:01.803 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:01 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:05:01.803 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:01 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3694459801' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:01.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.812+0000 7f739d709640 1 -- 172.21.15.6:0/112164731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7398062750 con 0x7f7398102c00 2024-05-20T17:05:01.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.812+0000 7f738ffff640 1 -- 172.21.15.6:0/112164731 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f73800a0360 con 0x7f7398102c00 2024-05-20T17:05:01.813 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:05:01.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.814+0000 7f739d709640 1 -- 172.21.15.6:0/112164731 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f73840a2c10 msgr2=0x7f73840a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:01.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.814+0000 7f739d709640 1 --2- 172.21.15.6:0/112164731 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f73840a2c10 0x7f73840a5120 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f73981025c0 tx=0x7f7388005f90 comp rx=0 tx=0).stop 2024-05-20T17:05:01.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.814+0000 7f739d709640 1 -- 172.21.15.6:0/112164731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7398102c00 msgr2=0x7f73981985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:01.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.814+0000 7f739d709640 1 --2- 172.21.15.6:0/112164731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7398102c00 0x7f73981985e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f738000e9f0 tx=0x7f738000eeb0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.814+0000 7f739d709640 1 -- 172.21.15.6:0/112164731 shutdown_connections 2024-05-20T17:05:01.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.814+0000 7f739d709640 1 --2- 172.21.15.6:0/112164731 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f73840a2c10 0x7f73840a5120 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.814+0000 7f739d709640 1 --2- 172.21.15.6:0/112164731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7398107900 0x7f739819f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.814+0000 7f739d709640 1 --2- 172.21.15.6:0/112164731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7398102c00 0x7f73981985e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.814+0000 7f739d709640 1 --2- 172.21.15.6:0/112164731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73981019c0 0x7f73981980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.814+0000 7f739d709640 1 -- 172.21.15.6:0/112164731 >> 172.21.15.6:0/112164731 conn(0x7f73980fcbb0 msgr2=0x7f73981038e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:01.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.815+0000 7f739d709640 1 -- 172.21.15.6:0/112164731 shutdown_connections 2024-05-20T17:05:01.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.815+0000 7f739d709640 1 -- 172.21.15.6:0/112164731 wait complete. 2024-05-20T17:05:01.828 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-20T17:05:01.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.945+0000 7fa211eeb640 1 -- 172.21.15.6:0/3045694660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa20c105f10 msgr2=0x7fa20c108330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:01.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.945+0000 7fa211eeb640 1 --2- 172.21.15.6:0/3045694660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa20c105f10 0x7fa20c108330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa200009900 tx=0x7fa20002a410 comp rx=0 tx=0).stop 2024-05-20T17:05:01.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.945+0000 7fa211eeb640 1 -- 172.21.15.6:0/3045694660 shutdown_connections 2024-05-20T17:05:01.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.945+0000 7fa211eeb640 1 --2- 172.21.15.6:0/3045694660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa20c108870 0x7fa20c10ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.945+0000 7fa211eeb640 1 --2- 172.21.15.6:0/3045694660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa20c105f10 0x7fa20c108330 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.945+0000 7fa211eeb640 1 --2- 172.21.15.6:0/3045694660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa20c1035b0 0x7fa20c1059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.945+0000 7fa211eeb640 1 -- 172.21.15.6:0/3045694660 >> 172.21.15.6:0/3045694660 conn(0x7fa20c0fcbb0 msgr2=0x7fa20c0ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:01.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.945+0000 7fa211eeb640 1 -- 172.21.15.6:0/3045694660 shutdown_connections 2024-05-20T17:05:01.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.945+0000 7fa211eeb640 1 -- 172.21.15.6:0/3045694660 wait complete. 2024-05-20T17:05:01.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.945+0000 7fa211eeb640 1 Processor -- start 2024-05-20T17:05:01.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.946+0000 7fa211eeb640 1 -- start start 2024-05-20T17:05:01.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.946+0000 7fa211eeb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa20c1035b0 0x7fa20c199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.946+0000 7fa211eeb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa20c105f10 0x7fa20c1996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.946+0000 7fa211eeb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa20c108870 0x7fa20c1a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.946+0000 7fa211eeb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa20c10e620 con 0x7fa20c1035b0 2024-05-20T17:05:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.946+0000 7fa211eeb640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa20c10e4a0 con 0x7fa20c105f10 2024-05-20T17:05:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.946+0000 7fa211eeb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa20c10e7a0 con 0x7fa20c108870 2024-05-20T17:05:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.946+0000 7fa20b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa20c1035b0 0x7fa20c199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.946+0000 7fa20b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa20c1035b0 0x7fa20c199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60648/0 (socket says 172.21.15.6:60648) 2024-05-20T17:05:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.946+0000 7fa20b7fe640 1 -- 172.21.15.6:0/2836694824 learned_addr learned my addr 172.21.15.6:0/2836694824 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.946+0000 7fa20bfff640 1 --2- 172.21.15.6:0/2836694824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa20c108870 0x7fa20c1a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.946+0000 7fa20affd640 1 --2- 172.21.15.6:0/2836694824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa20c105f10 0x7fa20c1996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.946+0000 7fa20b7fe640 1 -- 172.21.15.6:0/2836694824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa20c108870 msgr2=0x7fa20c1a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.946+0000 7fa20b7fe640 1 --2- 172.21.15.6:0/2836694824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa20c108870 0x7fa20c1a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.946+0000 7fa20b7fe640 1 -- 172.21.15.6:0/2836694824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa20c105f10 msgr2=0x7fa20c1996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.946+0000 7fa20b7fe640 1 --2- 172.21.15.6:0/2836694824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa20c105f10 0x7fa20c1996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.946+0000 7fa20b7fe640 1 -- 172.21.15.6:0/2836694824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20c1a0bf0 con 0x7fa20c1035b0 2024-05-20T17:05:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.946+0000 7fa20bfff640 1 --2- 172.21.15.6:0/2836694824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa20c108870 0x7fa20c1a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:05:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.946+0000 7fa20b7fe640 1 --2- 172.21.15.6:0/2836694824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa20c1035b0 0x7fa20c199160 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00ccb0 tx=0x7fa1fc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.947+0000 7fa208ff9640 1 -- 172.21.15.6:0/2836694824 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc00ce60 con 0x7fa20c1035b0 2024-05-20T17:05:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.947+0000 7fa208ff9640 1 -- 172.21.15.6:0/2836694824 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa1fc00fb00 con 0x7fa20c1035b0 2024-05-20T17:05:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.947+0000 7fa211eeb640 1 -- 172.21.15.6:0/2836694824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa20c1a0ee0 con 0x7fa20c1035b0 2024-05-20T17:05:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.947+0000 7fa208ff9640 1 -- 172.21.15.6:0/2836694824 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc018bb0 con 0x7fa20c1035b0 2024-05-20T17:05:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.947+0000 7fa211eeb640 1 -- 172.21.15.6:0/2836694824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa20c1a1340 con 0x7fa20c1035b0 2024-05-20T17:05:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.948+0000 7fa211eeb640 1 -- 172.21.15.6:0/2836694824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa20c068340 con 0x7fa20c1035b0 2024-05-20T17:05:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.949+0000 7fa208ff9640 1 -- 172.21.15.6:0/2836694824 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fa1fc00f650 con 0x7fa20c1035b0 2024-05-20T17:05:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.950+0000 7fa208ff9640 1 --2- 172.21.15.6:0/2836694824 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa1f40a2c30 0x7fa1f40a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.951+0000 7fa20affd640 1 --2- 172.21.15.6:0/2836694824 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa1f40a2c30 0x7fa1f40a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.951+0000 7fa208ff9640 1 -- 172.21.15.6:0/2836694824 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fa1fc0cf3b0 con 0x7fa20c1035b0 2024-05-20T17:05:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.951+0000 7fa20affd640 1 --2- 172.21.15.6:0/2836694824 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa1f40a2c30 0x7fa1f40a5140 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa200006010 tx=0x7fa200031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:01.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:01.954+0000 7fa208ff9640 1 -- 172.21.15.6:0/2836694824 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa1fc014030 con 0x7fa20c1035b0 2024-05-20T17:05:02.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:01 smithi171 ceph-mon[35901]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:05:02.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:01 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:02.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:01 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:02.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:01 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:02.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:01 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:02.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:01 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:02.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:01 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:02.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:01 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:05:02.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:01 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:05:02.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:01 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:02.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:01 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1539965541' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:05:02.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:01 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:05:02.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:01 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3694459801' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:02.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.144+0000 7fa211eeb640 1 -- 172.21.15.6:0/2836694824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa20c0fe720 con 0x7fa20c1035b0 2024-05-20T17:05:02.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.145+0000 7fa208ff9640 1 -- 172.21.15.6:0/2836694824 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) ==== 84+0+65 (secure 0 0 0) 0x7fa20c0fe720 con 0x7fa20c1035b0 2024-05-20T17:05:02.145 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:05:02.145 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-05-20T17:05:02.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:05:02.145 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2024-05-20T17:05:02.145 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2024-05-20T17:05:02.146 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:05:02.146 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-05-20T17:05:02.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.148+0000 7fa211eeb640 1 -- 172.21.15.6:0/2836694824 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa1f40a2c30 msgr2=0x7fa1f40a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:02.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.148+0000 7fa211eeb640 1 --2- 172.21.15.6:0/2836694824 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa1f40a2c30 0x7fa1f40a5140 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa200006010 tx=0x7fa200031400 comp rx=0 tx=0).stop 2024-05-20T17:05:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.148+0000 7fa211eeb640 1 -- 172.21.15.6:0/2836694824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa20c1035b0 msgr2=0x7fa20c199160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.148+0000 7fa211eeb640 1 --2- 172.21.15.6:0/2836694824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa20c1035b0 0x7fa20c199160 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00ccb0 tx=0x7fa1fc00a620 comp rx=0 tx=0).stop 2024-05-20T17:05:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.148+0000 7fa211eeb640 1 -- 172.21.15.6:0/2836694824 shutdown_connections 2024-05-20T17:05:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.148+0000 7fa211eeb640 1 --2- 172.21.15.6:0/2836694824 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa1f40a2c30 0x7fa1f40a5140 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.148+0000 7fa211eeb640 1 --2- 172.21.15.6:0/2836694824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa20c108870 0x7fa20c1a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.148+0000 7fa211eeb640 1 --2- 172.21.15.6:0/2836694824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa20c105f10 0x7fa20c1996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.148+0000 7fa211eeb640 1 --2- 172.21.15.6:0/2836694824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa20c1035b0 0x7fa20c199160 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.148+0000 7fa211eeb640 1 -- 172.21.15.6:0/2836694824 >> 172.21.15.6:0/2836694824 conn(0x7fa20c0fcbb0 msgr2=0x7fa20c104180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.148+0000 7fa211eeb640 1 -- 172.21.15.6:0/2836694824 shutdown_connections 2024-05-20T17:05:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.148+0000 7fa211eeb640 1 -- 172.21.15.6:0/2836694824 wait complete. 2024-05-20T17:05:02.165 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-20T17:05:02.165 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-20T17:05:02.178 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:01 smithi062 ceph-mon[35425]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:05:02.178 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:01 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:02.178 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:01 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:02.178 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:01 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:02.178 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:01 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:02.178 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:01 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:02.178 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:01 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:02.178 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:01 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:05:02.178 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:01 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:05:02.178 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:01 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:02.178 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:01 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1539965541' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:05:02.179 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:01 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:05:02.179 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:01 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3694459801' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:02.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.284+0000 7f0e939ea640 1 -- 172.21.15.6:0/634569675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e8c101370 msgr2=0x7f0e8c103790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:02.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.284+0000 7f0e939ea640 1 --2- 172.21.15.6:0/634569675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e8c101370 0x7f0e8c103790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0e88009900 tx=0x7f0e8802a410 comp rx=0 tx=0).stop 2024-05-20T17:05:02.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.285+0000 7f0e939ea640 1 -- 172.21.15.6:0/634569675 shutdown_connections 2024-05-20T17:05:02.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.285+0000 7f0e939ea640 1 --2- 172.21.15.6:0/634569675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e8c106630 0x7f0e8c106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:02.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.285+0000 7f0e939ea640 1 --2- 172.21.15.6:0/634569675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e8c103cd0 0x7f0e8c1060f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:02.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.285+0000 7f0e939ea640 1 --2- 172.21.15.6:0/634569675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e8c101370 0x7f0e8c103790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:02.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.285+0000 7f0e939ea640 1 -- 172.21.15.6:0/634569675 >> 172.21.15.6:0/634569675 conn(0x7f0e8c0fcb80 msgr2=0x7f0e8c0ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:02.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.285+0000 7f0e939ea640 1 -- 172.21.15.6:0/634569675 shutdown_connections 2024-05-20T17:05:02.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.285+0000 7f0e939ea640 1 -- 172.21.15.6:0/634569675 wait complete. 2024-05-20T17:05:02.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.285+0000 7f0e939ea640 1 Processor -- start 2024-05-20T17:05:02.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.285+0000 7f0e939ea640 1 -- start start 2024-05-20T17:05:02.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e939ea640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e8c101370 0x7f0e8c19f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:02.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e939ea640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e8c103cd0 0x7f0e8c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:02.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e939ea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e8c106630 0x7f0e8c1a6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:02.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e939ea640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c114bb0 con 0x7f0e8c106630 2024-05-20T17:05:02.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e939ea640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c114a30 con 0x7f0e8c103cd0 2024-05-20T17:05:02.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e939ea640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c114d30 con 0x7f0e8c101370 2024-05-20T17:05:02.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e91f87640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e8c106630 0x7f0e8c1a6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:02.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e91f87640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e8c106630 0x7f0e8c1a6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60660/0 (socket says 172.21.15.6:60660) 2024-05-20T17:05:02.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e91f87640 1 -- 172.21.15.6:0/333070443 learned_addr learned my addr 172.21.15.6:0/333070443 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:02.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e90f85640 1 --2- 172.21.15.6:0/333070443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e8c103cd0 0x7f0e8c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:02.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e91786640 1 --2- 172.21.15.6:0/333070443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e8c101370 0x7f0e8c19f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:02.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e91f87640 1 -- 172.21.15.6:0/333070443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e8c101370 msgr2=0x7f0e8c19f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:02.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e91f87640 1 --2- 172.21.15.6:0/333070443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e8c101370 0x7f0e8c19f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:02.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e91f87640 1 -- 172.21.15.6:0/333070443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e8c103cd0 msgr2=0x7f0e8c19fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:02.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e91f87640 1 --2- 172.21.15.6:0/333070443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e8c103cd0 0x7f0e8c19fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:02.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e91f87640 1 -- 172.21.15.6:0/333070443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e8c1a7310 con 0x7f0e8c106630 2024-05-20T17:05:02.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e91f87640 1 --2- 172.21.15.6:0/333070443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e8c106630 0x7f0e8c1a6ca0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400dac0 tx=0x7f0e8400df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:02.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e827fc640 1 -- 172.21.15.6:0/333070443 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e84017070 con 0x7f0e8c106630 2024-05-20T17:05:02.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e827fc640 1 -- 172.21.15.6:0/333070443 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e8400be30 con 0x7f0e8c106630 2024-05-20T17:05:02.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e939ea640 1 -- 172.21.15.6:0/333070443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e8c1a7600 con 0x7f0e8c106630 2024-05-20T17:05:02.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e827fc640 1 -- 172.21.15.6:0/333070443 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8400f820 con 0x7f0e8c106630 2024-05-20T17:05:02.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.286+0000 7f0e939ea640 1 -- 172.21.15.6:0/333070443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e8c1a7b50 con 0x7f0e8c106630 2024-05-20T17:05:02.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.287+0000 7f0e939ea640 1 -- 172.21.15.6:0/333070443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e8c0fe6a0 con 0x7f0e8c106630 2024-05-20T17:05:02.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.289+0000 7f0e827fc640 1 -- 172.21.15.6:0/333070443 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f0e84004a40 con 0x7f0e8c106630 2024-05-20T17:05:02.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.289+0000 7f0e827fc640 1 --2- 172.21.15.6:0/333070443 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0e780a2c10 0x7f0e780a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:02.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.290+0000 7f0e91786640 1 --2- 172.21.15.6:0/333070443 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0e780a2c10 0x7f0e780a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:02.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.290+0000 7f0e827fc640 1 -- 172.21.15.6:0/333070443 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f0e840ce9c0 con 0x7f0e8c106630 2024-05-20T17:05:02.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.290+0000 7f0e91786640 1 --2- 172.21.15.6:0/333070443 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0e780a2c10 0x7f0e780a5120 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0e88005ab0 tx=0x7f0e88031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.293+0000 7f0e827fc640 1 -- 172.21.15.6:0/333070443 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0e8409b7f0 con 0x7f0e8c106630 2024-05-20T17:05:02.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:02.481+0000 7f0e939ea640 1 -- 172.21.15.6:0/333070443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0e8c02d2a0 con 0x7f0e8c106630 2024-05-20T17:05:03.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.071+0000 7f0e827fc640 1 -- 172.21.15.6:0/333070443 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) ==== 138+0+0 (secure 0 0 0) 0x7f0e8409faf0 con 0x7f0e8c106630 2024-05-20T17:05:03.071 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2024-05-20T17:05:03.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.074+0000 7f0e939ea640 1 -- 172.21.15.6:0/333070443 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0e780a2c10 msgr2=0x7f0e780a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:03.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.074+0000 7f0e939ea640 1 --2- 172.21.15.6:0/333070443 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0e780a2c10 0x7f0e780a5120 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0e88005ab0 tx=0x7f0e88031400 comp rx=0 tx=0).stop 2024-05-20T17:05:03.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.074+0000 7f0e939ea640 1 -- 172.21.15.6:0/333070443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e8c106630 msgr2=0x7f0e8c1a6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:03.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.074+0000 7f0e939ea640 1 --2- 172.21.15.6:0/333070443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e8c106630 0x7f0e8c1a6ca0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400dac0 tx=0x7f0e8400df80 comp rx=0 tx=0).stop 2024-05-20T17:05:03.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.074+0000 7f0e939ea640 1 -- 172.21.15.6:0/333070443 shutdown_connections 2024-05-20T17:05:03.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.074+0000 7f0e939ea640 1 --2- 172.21.15.6:0/333070443 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0e780a2c10 0x7f0e780a5120 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:03.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.074+0000 7f0e939ea640 1 --2- 172.21.15.6:0/333070443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e8c106630 0x7f0e8c1a6ca0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:03.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.074+0000 7f0e939ea640 1 --2- 172.21.15.6:0/333070443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e8c103cd0 0x7f0e8c19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:03.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.074+0000 7f0e939ea640 1 --2- 172.21.15.6:0/333070443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e8c101370 0x7f0e8c19f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:03.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.074+0000 7f0e939ea640 1 -- 172.21.15.6:0/333070443 >> 172.21.15.6:0/333070443 conn(0x7f0e8c0fcb80 msgr2=0x7f0e8c102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:03.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.074+0000 7f0e939ea640 1 -- 172.21.15.6:0/333070443 shutdown_connections 2024-05-20T17:05:03.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.074+0000 7f0e939ea640 1 -- 172.21.15.6:0/333070443 wait complete. 2024-05-20T17:05:03.090 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-20T17:05:03.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.211+0000 7fc8529f5640 1 -- 172.21.15.6:0/666544967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc84c101980 msgr2=0x7fc84c102680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:03.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.211+0000 7fc8529f5640 1 --2- 172.21.15.6:0/666544967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc84c101980 0x7fc84c102680 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009900 tx=0x7fc83c02a410 comp rx=0 tx=0).stop 2024-05-20T17:05:03.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.211+0000 7fc8529f5640 1 -- 172.21.15.6:0/666544967 shutdown_connections 2024-05-20T17:05:03.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.211+0000 7fc8529f5640 1 --2- 172.21.15.6:0/666544967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc84c1078c0 0x7fc84c109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:03.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.211+0000 7fc8529f5640 1 --2- 172.21.15.6:0/666544967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc84c102bc0 0x7fc84c102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:03.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.211+0000 7fc8529f5640 1 --2- 172.21.15.6:0/666544967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc84c101980 0x7fc84c102680 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:03.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.211+0000 7fc8529f5640 1 -- 172.21.15.6:0/666544967 >> 172.21.15.6:0/666544967 conn(0x7fc84c0fcb70 msgr2=0x7fc84c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:03.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.211+0000 7fc8529f5640 1 -- 172.21.15.6:0/666544967 shutdown_connections 2024-05-20T17:05:03.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.211+0000 7fc8529f5640 1 -- 172.21.15.6:0/666544967 wait complete. 2024-05-20T17:05:03.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.212+0000 7fc8529f5640 1 Processor -- start 2024-05-20T17:05:03.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.212+0000 7fc8529f5640 1 -- start start 2024-05-20T17:05:03.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.212+0000 7fc8529f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc84c101980 0x7fc84c199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:03.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.212+0000 7fc8529f5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc84c102bc0 0x7fc84c1996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:03.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.212+0000 7fc8529f5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc84c1078c0 0x7fc84c1a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:03.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.212+0000 7fc8529f5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c10e610 con 0x7fc84c1078c0 2024-05-20T17:05:03.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.212+0000 7fc8529f5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c10e490 con 0x7fc84c101980 2024-05-20T17:05:03.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.212+0000 7fc8529f5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c10e790 con 0x7fc84c102bc0 2024-05-20T17:05:03.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.212+0000 7fc850f92640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc84c1078c0 0x7fc84c1a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:03.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.213+0000 7fc850f92640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc84c1078c0 0x7fc84c1a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60686/0 (socket says 172.21.15.6:60686) 2024-05-20T17:05:03.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.213+0000 7fc850f92640 1 -- 172.21.15.6:0/1604309641 learned_addr learned my addr 172.21.15.6:0/1604309641 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:03.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.213+0000 7fc84b7fe640 1 --2- 172.21.15.6:0/1604309641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc84c102bc0 0x7fc84c1996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:03.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.213+0000 7fc84bfff640 1 --2- 172.21.15.6:0/1604309641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc84c101980 0x7fc84c199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:03.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.213+0000 7fc850f92640 1 -- 172.21.15.6:0/1604309641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc84c102bc0 msgr2=0x7fc84c1996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:03.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.213+0000 7fc850f92640 1 --2- 172.21.15.6:0/1604309641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc84c102bc0 0x7fc84c1996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:03.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.213+0000 7fc850f92640 1 -- 172.21.15.6:0/1604309641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc84c101980 msgr2=0x7fc84c199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:03.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.213+0000 7fc850f92640 1 --2- 172.21.15.6:0/1604309641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc84c101980 0x7fc84c199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:03.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.213+0000 7fc850f92640 1 -- 172.21.15.6:0/1604309641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84c1a0ca0 con 0x7fc84c1078c0 2024-05-20T17:05:03.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.213+0000 7fc850f92640 1 --2- 172.21.15.6:0/1604309641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc84c1078c0 0x7fc84c1a0630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc84400eaa0 tx=0x7fc84400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:03.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.213+0000 7fc8497fa640 1 -- 172.21.15.6:0/1604309641 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84400cdb0 con 0x7fc84c1078c0 2024-05-20T17:05:03.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.213+0000 7fc8497fa640 1 -- 172.21.15.6:0/1604309641 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc844005020 con 0x7fc84c1078c0 2024-05-20T17:05:03.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.213+0000 7fc8529f5640 1 -- 172.21.15.6:0/1604309641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc84c1a0f90 con 0x7fc84c1078c0 2024-05-20T17:05:03.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.213+0000 7fc8497fa640 1 -- 172.21.15.6:0/1604309641 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8440116d0 con 0x7fc84c1078c0 2024-05-20T17:05:03.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.213+0000 7fc8529f5640 1 -- 172.21.15.6:0/1604309641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc84c1a13a0 con 0x7fc84c1078c0 2024-05-20T17:05:03.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.214+0000 7fc8529f5640 1 -- 172.21.15.6:0/1604309641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc84c1066d0 con 0x7fc84c1078c0 2024-05-20T17:05:03.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.216+0000 7fc8497fa640 1 -- 172.21.15.6:0/1604309641 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc8440051d0 con 0x7fc84c1078c0 2024-05-20T17:05:03.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.216+0000 7fc8497fa640 1 --2- 172.21.15.6:0/1604309641 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc8340a2b90 0x7fc8340a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:03.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.217+0000 7fc8497fa640 1 -- 172.21.15.6:0/1604309641 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7497+0+0 (secure 0 0 0) 0x7fc8440cf1f0 con 0x7fc84c1078c0 2024-05-20T17:05:03.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.217+0000 7fc84bfff640 1 --2- 172.21.15.6:0/1604309641 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc8340a2b90 0x7fc8340a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:03.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.217+0000 7fc84bfff640 1 --2- 172.21.15.6:0/1604309641 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc8340a2b90 0x7fc8340a50a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc83c02a930 tx=0x7fc83c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:03.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.220+0000 7fc8497fa640 1 -- 172.21.15.6:0/1604309641 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc844016030 con 0x7fc84c1078c0 2024-05-20T17:05:03.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:02 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/112164731' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:05:03.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:02 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:03.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:02 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2836694824' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-20T17:05:03.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:02 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/112164731' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:05:03.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:02 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:03.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:02 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2836694824' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-20T17:05:03.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:02 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/112164731' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:05:03.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:02 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:03.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:02 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2836694824' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-20T17:05:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:03.405+0000 7fc8529f5640 1 -- 172.21.15.6:0/1604309641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fc84c02d2a0 con 0x7fc84c1078c0 2024-05-20T17:05:04.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.073+0000 7fc8497fa640 1 -- 172.21.15.6:0/1604309641 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v84) ==== 171+0+0 (secure 0 0 0) 0x7fc84409be30 con 0x7fc84c1078c0 2024-05-20T17:05:04.073 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2024-05-20T17:05:04.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.075+0000 7fc8529f5640 1 -- 172.21.15.6:0/1604309641 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc8340a2b90 msgr2=0x7fc8340a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:04.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.075+0000 7fc8529f5640 1 --2- 172.21.15.6:0/1604309641 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc8340a2b90 0x7fc8340a50a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc83c02a930 tx=0x7fc83c031400 comp rx=0 tx=0).stop 2024-05-20T17:05:04.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.075+0000 7fc8529f5640 1 -- 172.21.15.6:0/1604309641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc84c1078c0 msgr2=0x7fc84c1a0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:04.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.075+0000 7fc8529f5640 1 --2- 172.21.15.6:0/1604309641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc84c1078c0 0x7fc84c1a0630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc84400eaa0 tx=0x7fc84400ef60 comp rx=0 tx=0).stop 2024-05-20T17:05:04.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.076+0000 7fc8529f5640 1 -- 172.21.15.6:0/1604309641 shutdown_connections 2024-05-20T17:05:04.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.076+0000 7fc8529f5640 1 --2- 172.21.15.6:0/1604309641 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc8340a2b90 0x7fc8340a50a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:04.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.076+0000 7fc8529f5640 1 --2- 172.21.15.6:0/1604309641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc84c1078c0 0x7fc84c1a0630 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:04.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.076+0000 7fc8529f5640 1 --2- 172.21.15.6:0/1604309641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc84c102bc0 0x7fc84c1996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:04.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.076+0000 7fc8529f5640 1 --2- 172.21.15.6:0/1604309641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc84c101980 0x7fc84c199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:04.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.076+0000 7fc8529f5640 1 -- 172.21.15.6:0/1604309641 >> 172.21.15.6:0/1604309641 conn(0x7fc84c0fcb70 msgr2=0x7fc84c1038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:04.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.076+0000 7fc8529f5640 1 -- 172.21.15.6:0/1604309641 shutdown_connections 2024-05-20T17:05:04.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.076+0000 7fc8529f5640 1 -- 172.21.15.6:0/1604309641 wait complete. 2024-05-20T17:05:04.097 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-20T17:05:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.218+0000 7fa3b5e06640 1 -- 172.21.15.6:0/2391254007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3b0108830 msgr2=0x7fa3b010ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.218+0000 7fa3b5e06640 1 --2- 172.21.15.6:0/2391254007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3b0108830 0x7fa3b010ac50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009ca0 tx=0x7fa3a802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:05:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.218+0000 7fa3b5e06640 1 -- 172.21.15.6:0/2391254007 shutdown_connections 2024-05-20T17:05:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.218+0000 7fa3b5e06640 1 --2- 172.21.15.6:0/2391254007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3b0108830 0x7fa3b010ac50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.218+0000 7fa3b5e06640 1 --2- 172.21.15.6:0/2391254007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3b0105ed0 0x7fa3b01082f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.218+0000 7fa3b5e06640 1 --2- 172.21.15.6:0/2391254007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3b0103570 0x7fa3b0105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.218+0000 7fa3b5e06640 1 -- 172.21.15.6:0/2391254007 >> 172.21.15.6:0/2391254007 conn(0x7fa3b00fcb70 msgr2=0x7fa3b00ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.218+0000 7fa3b5e06640 1 -- 172.21.15.6:0/2391254007 shutdown_connections 2024-05-20T17:05:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.218+0000 7fa3b5e06640 1 -- 172.21.15.6:0/2391254007 wait complete. 2024-05-20T17:05:04.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.219+0000 7fa3b5e06640 1 Processor -- start 2024-05-20T17:05:04.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.219+0000 7fa3b5e06640 1 -- start start 2024-05-20T17:05:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.219+0000 7fa3b5e06640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3b0103570 0x7fa3b0199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.219+0000 7fa3b5e06640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3b0105ed0 0x7fa3b0199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.219+0000 7fa3b5e06640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3b0108830 0x7fa3b01a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.219+0000 7fa3b5e06640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b010e590 con 0x7fa3b0105ed0 2024-05-20T17:05:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.219+0000 7fa3b5e06640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b010e410 con 0x7fa3b0103570 2024-05-20T17:05:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.219+0000 7fa3b5e06640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b010e710 con 0x7fa3b0108830 2024-05-20T17:05:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.219+0000 7fa3aeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3b0105ed0 0x7fa3b0199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.219+0000 7fa3aeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3b0105ed0 0x7fa3b0199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60712/0 (socket says 172.21.15.6:60712) 2024-05-20T17:05:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.219+0000 7fa3aeffd640 1 -- 172.21.15.6:0/161747196 learned_addr learned my addr 172.21.15.6:0/161747196 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.219+0000 7fa3af7fe640 1 --2- 172.21.15.6:0/161747196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3b0103570 0x7fa3b0199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.219+0000 7fa3affff640 1 --2- 172.21.15.6:0/161747196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3b0108830 0x7fa3b01a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.219+0000 7fa3aeffd640 1 -- 172.21.15.6:0/161747196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3b0108830 msgr2=0x7fa3b01a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.219+0000 7fa3aeffd640 1 --2- 172.21.15.6:0/161747196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3b0108830 0x7fa3b01a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.219+0000 7fa3aeffd640 1 -- 172.21.15.6:0/161747196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3b0103570 msgr2=0x7fa3b0199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.219+0000 7fa3aeffd640 1 --2- 172.21.15.6:0/161747196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3b0103570 0x7fa3b0199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.219+0000 7fa3aeffd640 1 -- 172.21.15.6:0/161747196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b01a0c80 con 0x7fa3b0105ed0 2024-05-20T17:05:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.219+0000 7fa3af7fe640 1 --2- 172.21.15.6:0/161747196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3b0103570 0x7fa3b0199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:05:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.220+0000 7fa3aeffd640 1 --2- 172.21.15.6:0/161747196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3b0105ed0 0x7fa3b0199680 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa39800d950 tx=0x7fa39800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.220+0000 7fa3acff9640 1 -- 172.21.15.6:0/161747196 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa398017030 con 0x7fa3b0105ed0 2024-05-20T17:05:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.220+0000 7fa3b5e06640 1 -- 172.21.15.6:0/161747196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b01a0f70 con 0x7fa3b0105ed0 2024-05-20T17:05:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.220+0000 7fa3acff9640 1 -- 172.21.15.6:0/161747196 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa398004020 con 0x7fa3b0105ed0 2024-05-20T17:05:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.220+0000 7fa3acff9640 1 -- 172.21.15.6:0/161747196 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3980047a0 con 0x7fa3b0105ed0 2024-05-20T17:05:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.220+0000 7fa3b5e06640 1 -- 172.21.15.6:0/161747196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b01a13e0 con 0x7fa3b0105ed0 2024-05-20T17:05:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.221+0000 7fa3b5e06640 1 -- 172.21.15.6:0/161747196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b00fe690 con 0x7fa3b0105ed0 2024-05-20T17:05:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.223+0000 7fa3acff9640 1 -- 172.21.15.6:0/161747196 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fa3980041d0 con 0x7fa3b0105ed0 2024-05-20T17:05:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.224+0000 7fa3acff9640 1 --2- 172.21.15.6:0/161747196 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa39c0a2b90 0x7fa39c0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.224+0000 7fa3af7fe640 1 --2- 172.21.15.6:0/161747196 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa39c0a2b90 0x7fa39c0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.224+0000 7fa3acff9640 1 -- 172.21.15.6:0/161747196 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7879+0+0 (secure 0 0 0) 0x7fa3980cf080 con 0x7fa3b0105ed0 2024-05-20T17:05:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.224+0000 7fa3af7fe640 1 --2- 172.21.15.6:0/161747196 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa39c0a2b90 0x7fa39c0a50a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0005d00 tx=0x7fa3a0005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:04.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.228+0000 7fa3acff9640 1 -- 172.21.15.6:0/161747196 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa39809c0f0 con 0x7fa3b0105ed0 2024-05-20T17:05:04.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:03 smithi062 ceph-mon[35425]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:05:04.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:03 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/333070443' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-20T17:05:04.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:03 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:03 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:03 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:03 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:03 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:03 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:03 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:05:04.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:03 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:05:04.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:03 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:03 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/333070443' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-20T17:05:04.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:03 smithi062 ceph-mon[35425]: osdmap e83: 12 total, 12 up, 12 in 2024-05-20T17:05:04.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:03 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1604309641' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-20T17:05:04.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:03 smithi171 ceph-mon[35901]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:05:04.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:03 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/333070443' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-20T17:05:04.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:03 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:03 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:03 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:03 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:03 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:03 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:03 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:05:04.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:03 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:05:04.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:03 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:03 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/333070443' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-20T17:05:04.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:03 smithi171 ceph-mon[35901]: osdmap e83: 12 total, 12 up, 12 in 2024-05-20T17:05:04.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:03 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1604309641' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-20T17:05:04.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:03 smithi006 ceph-mon[32486]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:05:04.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:03 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/333070443' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-20T17:05:04.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:03 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:03 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:03 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:03 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:03 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:03 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:03 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:05:04.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:03 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:05:04.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:03 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:05:04.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:03 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/333070443' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-20T17:05:04.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:03 smithi006 ceph-mon[32486]: osdmap e83: 12 total, 12 up, 12 in 2024-05-20T17:05:04.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:03 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1604309641' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-20T17:05:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:04.453+0000 7fa3b5e06640 1 -- 172.21.15.6:0/161747196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa3b002d2a0 con 0x7fa3b0105ed0 2024-05-20T17:05:05.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.075+0000 7fa3acff9640 1 -- 172.21.15.6:0/161747196 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fa39809b9f0 con 0x7fa3b0105ed0 2024-05-20T17:05:05.075 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 2 and data pool 3 2024-05-20T17:05:05.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.078+0000 7fa3b5e06640 1 -- 172.21.15.6:0/161747196 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa39c0a2b90 msgr2=0x7fa39c0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:05.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.078+0000 7fa3b5e06640 1 --2- 172.21.15.6:0/161747196 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa39c0a2b90 0x7fa39c0a50a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0005d00 tx=0x7fa3a0005c70 comp rx=0 tx=0).stop 2024-05-20T17:05:05.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.078+0000 7fa3b5e06640 1 -- 172.21.15.6:0/161747196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3b0105ed0 msgr2=0x7fa3b0199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:05.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.078+0000 7fa3b5e06640 1 --2- 172.21.15.6:0/161747196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3b0105ed0 0x7fa3b0199680 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa39800d950 tx=0x7fa39800de10 comp rx=0 tx=0).stop 2024-05-20T17:05:05.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.079+0000 7fa3b5e06640 1 -- 172.21.15.6:0/161747196 shutdown_connections 2024-05-20T17:05:05.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.079+0000 7fa3b5e06640 1 --2- 172.21.15.6:0/161747196 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa39c0a2b90 0x7fa39c0a50a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:05.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.079+0000 7fa3b5e06640 1 --2- 172.21.15.6:0/161747196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3b0108830 0x7fa3b01a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:05.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.079+0000 7fa3b5e06640 1 --2- 172.21.15.6:0/161747196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3b0105ed0 0x7fa3b0199680 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:05.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.079+0000 7fa3b5e06640 1 --2- 172.21.15.6:0/161747196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3b0103570 0x7fa3b0199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:05.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.079+0000 7fa3b5e06640 1 -- 172.21.15.6:0/161747196 >> 172.21.15.6:0/161747196 conn(0x7fa3b00fcb70 msgr2=0x7fa3b0104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:05.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.079+0000 7fa3b5e06640 1 -- 172.21.15.6:0/161747196 shutdown_connections 2024-05-20T17:05:05.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.079+0000 7fa3b5e06640 1 -- 172.21.15.6:0/161747196 wait complete. 2024-05-20T17:05:05.103 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-20T17:05:05.103 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-20T17:05:05.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.234+0000 7fdc35302640 1 -- 172.21.15.6:0/2520066458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc30100710 msgr2=0x7fdc30100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:05.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.234+0000 7fdc35302640 1 --2- 172.21.15.6:0/2520066458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc30100710 0x7fdc30100b80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009900 tx=0x7fdc1802a410 comp rx=0 tx=0).stop 2024-05-20T17:05:05.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.234+0000 7fdc35302640 1 -- 172.21.15.6:0/2520066458 shutdown_connections 2024-05-20T17:05:05.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.234+0000 7fdc35302640 1 --2- 172.21.15.6:0/2520066458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc30101210 0x7fdc3010ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:05.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.234+0000 7fdc35302640 1 --2- 172.21.15.6:0/2520066458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc30100710 0x7fdc30100b80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:05.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.234+0000 7fdc35302640 1 --2- 172.21.15.6:0/2520066458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc30104060 0x7fdc30104470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:05.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.234+0000 7fdc35302640 1 -- 172.21.15.6:0/2520066458 >> 172.21.15.6:0/2520066458 conn(0x7fdc300fc330 msgr2=0x7fdc300fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:05.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.234+0000 7fdc35302640 1 -- 172.21.15.6:0/2520066458 shutdown_connections 2024-05-20T17:05:05.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.234+0000 7fdc35302640 1 -- 172.21.15.6:0/2520066458 wait complete. 2024-05-20T17:05:05.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.235+0000 7fdc35302640 1 Processor -- start 2024-05-20T17:05:05.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.235+0000 7fdc35302640 1 -- start start 2024-05-20T17:05:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.235+0000 7fdc35302640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc30100710 0x7fdc30199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.235+0000 7fdc35302640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc30101210 0x7fdc301997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.235+0000 7fdc35302640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc30104060 0x7fdc301a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.235+0000 7fdc35302640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3010e5f0 con 0x7fdc30101210 2024-05-20T17:05:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.235+0000 7fdc35302640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3010e470 con 0x7fdc30104060 2024-05-20T17:05:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.235+0000 7fdc35302640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3010e770 con 0x7fdc30100710 2024-05-20T17:05:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.235+0000 7fdc267fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc30101210 0x7fdc301997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.235+0000 7fdc267fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc30101210 0x7fdc301997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60722/0 (socket says 172.21.15.6:60722) 2024-05-20T17:05:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.235+0000 7fdc267fc640 1 -- 172.21.15.6:0/894113916 learned_addr learned my addr 172.21.15.6:0/894113916 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.235+0000 7fdc2effd640 1 --2- 172.21.15.6:0/894113916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc30100710 0x7fdc30199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.236+0000 7fdc2f7fe640 1 --2- 172.21.15.6:0/894113916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc30104060 0x7fdc301a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.236+0000 7fdc267fc640 1 -- 172.21.15.6:0/894113916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc30100710 msgr2=0x7fdc30199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.236+0000 7fdc267fc640 1 --2- 172.21.15.6:0/894113916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc30100710 0x7fdc30199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.236+0000 7fdc267fc640 1 -- 172.21.15.6:0/894113916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc30104060 msgr2=0x7fdc301a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.236+0000 7fdc267fc640 1 --2- 172.21.15.6:0/894113916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc30104060 0x7fdc301a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.236+0000 7fdc267fc640 1 -- 172.21.15.6:0/894113916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc301a0d30 con 0x7fdc30101210 2024-05-20T17:05:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.236+0000 7fdc267fc640 1 --2- 172.21.15.6:0/894113916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc30101210 0x7fdc301997a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009230 tx=0x7fdc180043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.236+0000 7fdc2cff9640 1 -- 172.21.15.6:0/894113916 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1803f030 con 0x7fdc30101210 2024-05-20T17:05:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.236+0000 7fdc2cff9640 1 -- 172.21.15.6:0/894113916 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdc18003800 con 0x7fdc30101210 2024-05-20T17:05:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.236+0000 7fdc35302640 1 -- 172.21.15.6:0/894113916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc301a0fc0 con 0x7fdc30101210 2024-05-20T17:05:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.236+0000 7fdc2cff9640 1 -- 172.21.15.6:0/894113916 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc18035070 con 0x7fdc30101210 2024-05-20T17:05:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.236+0000 7fdc35302640 1 -- 172.21.15.6:0/894113916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc301a1420 con 0x7fdc30101210 2024-05-20T17:05:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.237+0000 7fdc35302640 1 -- 172.21.15.6:0/894113916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc301079f0 con 0x7fdc30101210 2024-05-20T17:05:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.238+0000 7fdc2cff9640 1 -- 172.21.15.6:0/894113916 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fdc18003c90 con 0x7fdc30101210 2024-05-20T17:05:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.239+0000 7fdc2cff9640 1 --2- 172.21.15.6:0/894113916 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdc1c0a2c10 0x7fdc1c0a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.239+0000 7fdc2cff9640 1 -- 172.21.15.6:0/894113916 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fdc180efc90 con 0x7fdc30101210 2024-05-20T17:05:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.239+0000 7fdc2effd640 1 --2- 172.21.15.6:0/894113916 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdc1c0a2c10 0x7fdc1c0a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.240+0000 7fdc2effd640 1 --2- 172.21.15.6:0/894113916 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdc1c0a2c10 0x7fdc1c0a5120 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdc200058c0 tx=0x7fdc2000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:05.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.243+0000 7fdc2cff9640 1 -- 172.21.15.6:0/894113916 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fdc180bcd40 con 0x7fdc30101210 2024-05-20T17:05:05.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:05 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1604309641' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-20T17:05:05.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:05 smithi171 ceph-mon[35901]: osdmap e84: 12 total, 12 up, 12 in 2024-05-20T17:05:05.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:05 smithi171 ceph-mon[35901]: pgmap v295: 97 pgs: 6 creating+peering, 90 unknown, 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:05:05.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:05 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/161747196' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-20T17:05:05.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:05 smithi171 ceph-mon[35901]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-20T17:05:05.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:05 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1604309641' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-20T17:05:05.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:05 smithi006 ceph-mon[32486]: osdmap e84: 12 total, 12 up, 12 in 2024-05-20T17:05:05.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:05 smithi006 ceph-mon[32486]: pgmap v295: 97 pgs: 6 creating+peering, 90 unknown, 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:05:05.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:05 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/161747196' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-20T17:05:05.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:05 smithi006 ceph-mon[32486]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-20T17:05:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:05.436+0000 7fdc35302640 1 -- 172.21.15.6:0/894113916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fdc3002d2a0 con 0x7fdc30101210 2024-05-20T17:05:05.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:05 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1604309641' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-20T17:05:05.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:05 smithi062 ceph-mon[35425]: osdmap e84: 12 total, 12 up, 12 in 2024-05-20T17:05:05.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:05 smithi062 ceph-mon[35425]: pgmap v295: 97 pgs: 6 creating+peering, 90 unknown, 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:05:05.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:05 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/161747196' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-20T17:05:05.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:05 smithi062 ceph-mon[35425]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-20T17:05:06.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.077+0000 7fdc2cff9640 1 -- 172.21.15.6:0/894113916 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v86) ==== 157+0+0 (secure 0 0 0) 0x7fdc180b8030 con 0x7fdc30101210 2024-05-20T17:05:06.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.081+0000 7fdc35302640 1 -- 172.21.15.6:0/894113916 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdc1c0a2c10 msgr2=0x7fdc1c0a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:06.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.081+0000 7fdc35302640 1 --2- 172.21.15.6:0/894113916 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdc1c0a2c10 0x7fdc1c0a5120 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdc200058c0 tx=0x7fdc2000a2d0 comp rx=0 tx=0).stop 2024-05-20T17:05:06.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.081+0000 7fdc35302640 1 -- 172.21.15.6:0/894113916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc30101210 msgr2=0x7fdc301997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:06.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.081+0000 7fdc35302640 1 --2- 172.21.15.6:0/894113916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc30101210 0x7fdc301997a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009230 tx=0x7fdc180043b0 comp rx=0 tx=0).stop 2024-05-20T17:05:06.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.081+0000 7fdc35302640 1 -- 172.21.15.6:0/894113916 shutdown_connections 2024-05-20T17:05:06.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.081+0000 7fdc35302640 1 --2- 172.21.15.6:0/894113916 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdc1c0a2c10 0x7fdc1c0a5120 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:06.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.081+0000 7fdc35302640 1 --2- 172.21.15.6:0/894113916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc30104060 0x7fdc301a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:06.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.081+0000 7fdc35302640 1 --2- 172.21.15.6:0/894113916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc30101210 0x7fdc301997a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:06.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.081+0000 7fdc35302640 1 --2- 172.21.15.6:0/894113916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc30100710 0x7fdc30199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:06.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.081+0000 7fdc35302640 1 -- 172.21.15.6:0/894113916 >> 172.21.15.6:0/894113916 conn(0x7fdc300fc330 msgr2=0x7fdc30104bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:06.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.081+0000 7fdc35302640 1 -- 172.21.15.6:0/894113916 shutdown_connections 2024-05-20T17:05:06.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.081+0000 7fdc35302640 1 -- 172.21.15.6:0/894113916 wait complete. 2024-05-20T17:05:06.096 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-20T17:05:06.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.225+0000 7f5916806640 1 -- 172.21.15.6:0/3407443414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5910100710 msgr2=0x7f5910100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:06.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.225+0000 7f5916806640 1 --2- 172.21.15.6:0/3407443414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5910100710 0x7f5910100b80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5904009900 tx=0x7f590402a410 comp rx=0 tx=0).stop 2024-05-20T17:05:06.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.225+0000 7f5916806640 1 -- 172.21.15.6:0/3407443414 shutdown_connections 2024-05-20T17:05:06.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.225+0000 7f5916806640 1 --2- 172.21.15.6:0/3407443414 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5910101210 0x7f591010ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:06.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.225+0000 7f5916806640 1 --2- 172.21.15.6:0/3407443414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5910100710 0x7f5910100b80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.225+0000 7f5916806640 1 --2- 172.21.15.6:0/3407443414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5910104060 0x7f5910104470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.225+0000 7f5916806640 1 -- 172.21.15.6:0/3407443414 >> 172.21.15.6:0/3407443414 conn(0x7f59100fc330 msgr2=0x7f59100fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.225+0000 7f5916806640 1 -- 172.21.15.6:0/3407443414 shutdown_connections 2024-05-20T17:05:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.225+0000 7f5916806640 1 -- 172.21.15.6:0/3407443414 wait complete. 2024-05-20T17:05:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.226+0000 7f5916806640 1 Processor -- start 2024-05-20T17:05:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.226+0000 7f5916806640 1 -- start start 2024-05-20T17:05:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.226+0000 7f5916806640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5910100710 0x7f5910103210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.226+0000 7f5916806640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5910101210 0x7f59101018b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.226+0000 7f5916806640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5910104060 0x7f5910101df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.227+0000 7f5916806640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f591010e5f0 con 0x7f5910100710 2024-05-20T17:05:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.227+0000 7f5916806640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f591010e470 con 0x7f5910101210 2024-05-20T17:05:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.227+0000 7f5916806640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f591010e770 con 0x7f5910104060 2024-05-20T17:05:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.227+0000 7f590ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5910100710 0x7f5910103210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.227+0000 7f590ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5910100710 0x7f5910103210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60744/0 (socket says 172.21.15.6:60744) 2024-05-20T17:05:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.227+0000 7f590ffff640 1 -- 172.21.15.6:0/1400097955 learned_addr learned my addr 172.21.15.6:0/1400097955 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.227+0000 7f590f7fe640 1 --2- 172.21.15.6:0/1400097955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5910101210 0x7f59101018b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.227+0000 7f5914da3640 1 --2- 172.21.15.6:0/1400097955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5910104060 0x7f5910101df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.227+0000 7f590ffff640 1 -- 172.21.15.6:0/1400097955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5910104060 msgr2=0x7f5910101df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.227+0000 7f590ffff640 1 --2- 172.21.15.6:0/1400097955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5910104060 0x7f5910101df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.227+0000 7f590ffff640 1 -- 172.21.15.6:0/1400097955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5910101210 msgr2=0x7f59101018b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.227+0000 7f590ffff640 1 --2- 172.21.15.6:0/1400097955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5910101210 0x7f59101018b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.227+0000 7f590ffff640 1 -- 172.21.15.6:0/1400097955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5910102520 con 0x7f5910100710 2024-05-20T17:05:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.227+0000 7f5914da3640 1 --2- 172.21.15.6:0/1400097955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5910104060 0x7f5910101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:05:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.227+0000 7f590ffff640 1 --2- 172.21.15.6:0/1400097955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5910100710 0x7f5910103210 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f590000d740 tx=0x7f590000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.227+0000 7f590d7fa640 1 -- 172.21.15.6:0/1400097955 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5900017070 con 0x7f5910100710 2024-05-20T17:05:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.227+0000 7f590d7fa640 1 -- 172.21.15.6:0/1400097955 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f590000de50 con 0x7f5910100710 2024-05-20T17:05:06.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.227+0000 7f5916806640 1 -- 172.21.15.6:0/1400097955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59101a3260 con 0x7f5910100710 2024-05-20T17:05:06.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.227+0000 7f590d7fa640 1 -- 172.21.15.6:0/1400097955 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5900003cc0 con 0x7f5910100710 2024-05-20T17:05:06.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.227+0000 7f5916806640 1 -- 172.21.15.6:0/1400097955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59101a3750 con 0x7f5910100710 2024-05-20T17:05:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.228+0000 7f5916806640 1 -- 172.21.15.6:0/1400097955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59101079f0 con 0x7f5910100710 2024-05-20T17:05:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.230+0000 7f590d7fa640 1 -- 172.21.15.6:0/1400097955 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f5900003e60 con 0x7f5910100710 2024-05-20T17:05:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.231+0000 7f590d7fa640 1 --2- 172.21.15.6:0/1400097955 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f58f80a2c10 0x7f58f80a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.231+0000 7f590f7fe640 1 --2- 172.21.15.6:0/1400097955 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f58f80a2c10 0x7f58f80a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.231+0000 7f590d7fa640 1 -- 172.21.15.6:0/1400097955 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8277+0+0 (secure 0 0 0) 0x7f59000ceec0 con 0x7f5910100710 2024-05-20T17:05:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.231+0000 7f590f7fe640 1 --2- 172.21.15.6:0/1400097955 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f58f80a2c10 0x7f58f80a5120 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5904000c00 tx=0x7f5904031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.235+0000 7f590d7fa640 1 -- 172.21.15.6:0/1400097955 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f590009be10 con 0x7f5910100710 2024-05-20T17:05:06.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:06 smithi171 ceph-mon[35901]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T17:05:06.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:06 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/161747196' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-20T17:05:06.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:06 smithi171 ceph-mon[35901]: osdmap e85: 12 total, 12 up, 12 in 2024-05-20T17:05:06.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:06 smithi171 ceph-mon[35901]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-20T17:05:06.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:06 smithi171 ceph-mon[35901]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-20T17:05:06.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:06 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/894113916' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T17:05:06.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:06 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/894113916' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-20T17:05:06.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:06 smithi171 ceph-mon[35901]: osdmap e86: 12 total, 12 up, 12 in 2024-05-20T17:05:06.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:06 smithi006 ceph-mon[32486]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T17:05:06.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:06 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/161747196' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-20T17:05:06.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:06 smithi006 ceph-mon[32486]: osdmap e85: 12 total, 12 up, 12 in 2024-05-20T17:05:06.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:06 smithi006 ceph-mon[32486]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-20T17:05:06.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:06 smithi006 ceph-mon[32486]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-20T17:05:06.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:06 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/894113916' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T17:05:06.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:06 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/894113916' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-20T17:05:06.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:06 smithi006 ceph-mon[32486]: osdmap e86: 12 total, 12 up, 12 in 2024-05-20T17:05:06.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:06.420+0000 7f5916806640 1 -- 172.21.15.6:0/1400097955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f591002d2a0 con 0x7f5910100710 2024-05-20T17:05:06.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:06 smithi062 ceph-mon[35425]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-20T17:05:06.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:06 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/161747196' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-20T17:05:06.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:06 smithi062 ceph-mon[35425]: osdmap e85: 12 total, 12 up, 12 in 2024-05-20T17:05:06.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:06 smithi062 ceph-mon[35425]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-20T17:05:06.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:06 smithi062 ceph-mon[35425]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-20T17:05:06.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:06 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/894113916' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-20T17:05:06.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:06 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/894113916' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-20T17:05:06.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:06 smithi062 ceph-mon[35425]: osdmap e86: 12 total, 12 up, 12 in 2024-05-20T17:05:07.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:07 smithi171 ceph-mon[35901]: pgmap v298: 97 pgs: 14 creating+peering, 63 unknown, 20 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 5 op/s 2024-05-20T17:05:07.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:07 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] up:active 2024-05-20T17:05:07.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:07 smithi171 ceph-mon[35901]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:05:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:07 smithi171 ceph-mon[35901]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:05:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:07 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1400097955' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-20T17:05:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:07 smithi171 ceph-mon[35901]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-20T17:05:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:07 smithi171 ceph-mon[35901]: Cluster is now healthy 2024-05-20T17:05:07.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:07 smithi006 ceph-mon[32486]: pgmap v298: 97 pgs: 14 creating+peering, 63 unknown, 20 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 5 op/s 2024-05-20T17:05:07.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:07 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] up:active 2024-05-20T17:05:07.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:07 smithi006 ceph-mon[32486]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:05:07.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:07 smithi006 ceph-mon[32486]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:05:07.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:07 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1400097955' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-20T17:05:07.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:07 smithi006 ceph-mon[32486]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-20T17:05:07.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:07 smithi006 ceph-mon[32486]: Cluster is now healthy 2024-05-20T17:05:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:07 smithi062 ceph-mon[35425]: pgmap v298: 97 pgs: 14 creating+peering, 63 unknown, 20 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 5 op/s 2024-05-20T17:05:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:07 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] up:active 2024-05-20T17:05:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:07 smithi062 ceph-mon[35425]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:05:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:07 smithi062 ceph-mon[35425]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:05:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:07 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1400097955' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-20T17:05:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:07 smithi062 ceph-mon[35425]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-20T17:05:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:07 smithi062 ceph-mon[35425]: Cluster is now healthy 2024-05-20T17:05:08.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.105+0000 7f590d7fa640 1 -- 172.21.15.6:0/1400097955 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v88) ==== 228+0+0 (secure 0 0 0) 0x7f590009b710 con 0x7f5910100710 2024-05-20T17:05:08.106 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data_ec' created 2024-05-20T17:05:08.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.109+0000 7f5916806640 1 -- 172.21.15.6:0/1400097955 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f58f80a2c10 msgr2=0x7f58f80a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:08.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.109+0000 7f5916806640 1 --2- 172.21.15.6:0/1400097955 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f58f80a2c10 0x7f58f80a5120 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5904000c00 tx=0x7f5904031400 comp rx=0 tx=0).stop 2024-05-20T17:05:08.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.109+0000 7f5916806640 1 -- 172.21.15.6:0/1400097955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5910100710 msgr2=0x7f5910103210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:08.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.109+0000 7f5916806640 1 --2- 172.21.15.6:0/1400097955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5910100710 0x7f5910103210 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f590000d740 tx=0x7f590000dc00 comp rx=0 tx=0).stop 2024-05-20T17:05:08.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.109+0000 7f5916806640 1 -- 172.21.15.6:0/1400097955 shutdown_connections 2024-05-20T17:05:08.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.109+0000 7f5916806640 1 --2- 172.21.15.6:0/1400097955 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f58f80a2c10 0x7f58f80a5120 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:08.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.109+0000 7f5916806640 1 --2- 172.21.15.6:0/1400097955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5910104060 0x7f5910101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:08.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.109+0000 7f5916806640 1 --2- 172.21.15.6:0/1400097955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5910101210 0x7f59101018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:08.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.109+0000 7f5916806640 1 --2- 172.21.15.6:0/1400097955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5910100710 0x7f5910103210 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:08.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.109+0000 7f5916806640 1 -- 172.21.15.6:0/1400097955 >> 172.21.15.6:0/1400097955 conn(0x7f59100fc330 msgr2=0x7f5910104bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:08.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.109+0000 7f5916806640 1 -- 172.21.15.6:0/1400097955 shutdown_connections 2024-05-20T17:05:08.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.109+0000 7f5916806640 1 -- 172.21.15.6:0/1400097955 wait complete. 2024-05-20T17:05:08.129 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-20T17:05:08.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.254+0000 7f84e7302640 1 -- 172.21.15.6:0/1221710953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e0103580 msgr2=0x7f84e01059a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:08.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.254+0000 7f84e7302640 1 --2- 172.21.15.6:0/1221710953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e0103580 0x7f84e01059a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009900 tx=0x7f84dc02a410 comp rx=0 tx=0).stop 2024-05-20T17:05:08.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.254+0000 7f84e7302640 1 -- 172.21.15.6:0/1221710953 shutdown_connections 2024-05-20T17:05:08.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.255+0000 7f84e7302640 1 --2- 172.21.15.6:0/1221710953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e0108840 0x7f84e010ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:08.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.255+0000 7f84e7302640 1 --2- 172.21.15.6:0/1221710953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84e0105ee0 0x7f84e0108300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:08.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.255+0000 7f84e7302640 1 --2- 172.21.15.6:0/1221710953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e0103580 0x7f84e01059a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:08.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.255+0000 7f84e7302640 1 -- 172.21.15.6:0/1221710953 >> 172.21.15.6:0/1221710953 conn(0x7f84e00fcb80 msgr2=0x7f84e00ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:08.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.255+0000 7f84e7302640 1 -- 172.21.15.6:0/1221710953 shutdown_connections 2024-05-20T17:05:08.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.255+0000 7f84e7302640 1 -- 172.21.15.6:0/1221710953 wait complete. 2024-05-20T17:05:08.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.255+0000 7f84e7302640 1 Processor -- start 2024-05-20T17:05:08.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.255+0000 7f84e7302640 1 -- start start 2024-05-20T17:05:08.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.255+0000 7f84e7302640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84e0103580 0x7f84e0199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:08.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.255+0000 7f84e7302640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e0105ee0 0x7f84e0199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:08.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.255+0000 7f84e7302640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e0108840 0x7f84e01a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:08.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.255+0000 7f84e7302640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f84e010e590 con 0x7f84e0105ee0 2024-05-20T17:05:08.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.255+0000 7f84e7302640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f84e010e410 con 0x7f84e0108840 2024-05-20T17:05:08.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.255+0000 7f84e7302640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f84e010e710 con 0x7f84e0103580 2024-05-20T17:05:08.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.256+0000 7f84e489d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e0105ee0 0x7f84e0199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.256+0000 7f84e489d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e0105ee0 0x7f84e0199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60770/0 (socket says 172.21.15.6:60770) 2024-05-20T17:05:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.256+0000 7f84e489d640 1 -- 172.21.15.6:0/1106299352 learned_addr learned my addr 172.21.15.6:0/1106299352 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.256+0000 7f84e589f640 1 --2- 172.21.15.6:0/1106299352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e0108840 0x7f84e01a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.256+0000 7f84e509e640 1 --2- 172.21.15.6:0/1106299352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84e0103580 0x7f84e0199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.256+0000 7f84e489d640 1 -- 172.21.15.6:0/1106299352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84e0103580 msgr2=0x7f84e0199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.256+0000 7f84e489d640 1 --2- 172.21.15.6:0/1106299352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84e0103580 0x7f84e0199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.256+0000 7f84e489d640 1 -- 172.21.15.6:0/1106299352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e0108840 msgr2=0x7f84e01a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.256+0000 7f84e489d640 1 --2- 172.21.15.6:0/1106299352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e0108840 0x7f84e01a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.256+0000 7f84e489d640 1 -- 172.21.15.6:0/1106299352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e01a0c90 con 0x7f84e0105ee0 2024-05-20T17:05:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.256+0000 7f84e489d640 1 --2- 172.21.15.6:0/1106299352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e0105ee0 0x7f84e0199740 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f84d400d770 tx=0x7f84d400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.256+0000 7f84d27fc640 1 -- 172.21.15.6:0/1106299352 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4017070 con 0x7f84e0105ee0 2024-05-20T17:05:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.256+0000 7f84d27fc640 1 -- 172.21.15.6:0/1106299352 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f84d40054d0 con 0x7f84e0105ee0 2024-05-20T17:05:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.256+0000 7f84d27fc640 1 -- 172.21.15.6:0/1106299352 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4004cf0 con 0x7f84e0105ee0 2024-05-20T17:05:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.256+0000 7f84e7302640 1 -- 172.21.15.6:0/1106299352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e01a0f80 con 0x7f84e0105ee0 2024-05-20T17:05:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.256+0000 7f84e7302640 1 -- 172.21.15.6:0/1106299352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e01a13f0 con 0x7f84e0105ee0 2024-05-20T17:05:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.257+0000 7f84e7302640 1 -- 172.21.15.6:0/1106299352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e00fe6a0 con 0x7f84e0105ee0 2024-05-20T17:05:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.259+0000 7f84d27fc640 1 -- 172.21.15.6:0/1106299352 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f84d4004e90 con 0x7f84e0105ee0 2024-05-20T17:05:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.259+0000 7f84d27fc640 1 --2- 172.21.15.6:0/1106299352 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f84cc0a2c10 0x7f84cc0a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.260+0000 7f84e509e640 1 --2- 172.21.15.6:0/1106299352 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f84cc0a2c10 0x7f84cc0a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.260+0000 7f84d27fc640 1 -- 172.21.15.6:0/1106299352 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8770+0+0 (secure 0 0 0) 0x7f84d40cf1a0 con 0x7f84e0105ee0 2024-05-20T17:05:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.260+0000 7f84e509e640 1 --2- 172.21.15.6:0/1106299352 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f84cc0a2c10 0x7f84cc0a5120 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f84dc000c00 tx=0x7f84dc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:08.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.264+0000 7f84d27fc640 1 -- 172.21.15.6:0/1106299352 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f84d409bf00 con 0x7f84e0105ee0 2024-05-20T17:05:08.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:08.466+0000 7f84e7302640 1 -- 172.21.15.6:0/1106299352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f84e00627f0 con 0x7f84e0105ee0 2024-05-20T17:05:08.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:08 smithi171 ceph-mon[35901]: osdmap e87: 12 total, 12 up, 12 in 2024-05-20T17:05:08.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:08 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1400097955' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-20T17:05:08.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:08 smithi171 ceph-mon[35901]: osdmap e88: 12 total, 12 up, 12 in 2024-05-20T17:05:08.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:08 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1106299352' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-20T17:05:08.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:08 smithi006 ceph-mon[32486]: osdmap e87: 12 total, 12 up, 12 in 2024-05-20T17:05:08.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:08 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1400097955' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-20T17:05:08.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:08 smithi006 ceph-mon[32486]: osdmap e88: 12 total, 12 up, 12 in 2024-05-20T17:05:08.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:08 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1106299352' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-20T17:05:09.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:08 smithi062 ceph-mon[35425]: osdmap e87: 12 total, 12 up, 12 in 2024-05-20T17:05:09.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:08 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1400097955' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-20T17:05:09.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:08 smithi062 ceph-mon[35425]: osdmap e88: 12 total, 12 up, 12 in 2024-05-20T17:05:09.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:08 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1106299352' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-20T17:05:09.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.107+0000 7f84d27fc640 1 -- 172.21.15.6:0/1106299352 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v89) ==== 169+0+0 (secure 0 0 0) 0x7f84d409b800 con 0x7f84e0105ee0 2024-05-20T17:05:09.108 INFO:teuthology.orchestra.run.smithi006.stderr:set pool 4 allow_ec_overwrites to true 2024-05-20T17:05:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.111+0000 7f84e7302640 1 -- 172.21.15.6:0/1106299352 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f84cc0a2c10 msgr2=0x7f84cc0a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.111+0000 7f84e7302640 1 --2- 172.21.15.6:0/1106299352 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f84cc0a2c10 0x7f84cc0a5120 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f84dc000c00 tx=0x7f84dc031400 comp rx=0 tx=0).stop 2024-05-20T17:05:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.111+0000 7f84e7302640 1 -- 172.21.15.6:0/1106299352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e0105ee0 msgr2=0x7f84e0199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.111+0000 7f84e7302640 1 --2- 172.21.15.6:0/1106299352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e0105ee0 0x7f84e0199740 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f84d400d770 tx=0x7f84d400dc30 comp rx=0 tx=0).stop 2024-05-20T17:05:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.111+0000 7f84e7302640 1 -- 172.21.15.6:0/1106299352 shutdown_connections 2024-05-20T17:05:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.111+0000 7f84e7302640 1 --2- 172.21.15.6:0/1106299352 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f84cc0a2c10 0x7f84cc0a5120 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.111+0000 7f84e7302640 1 --2- 172.21.15.6:0/1106299352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e0108840 0x7f84e01a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.111+0000 7f84e7302640 1 --2- 172.21.15.6:0/1106299352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e0105ee0 0x7f84e0199740 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.111+0000 7f84e7302640 1 --2- 172.21.15.6:0/1106299352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84e0103580 0x7f84e0199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.111+0000 7f84e7302640 1 -- 172.21.15.6:0/1106299352 >> 172.21.15.6:0/1106299352 conn(0x7f84e00fcb80 msgr2=0x7f84e0104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.112+0000 7f84e7302640 1 -- 172.21.15.6:0/1106299352 shutdown_connections 2024-05-20T17:05:09.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.112+0000 7f84e7302640 1 -- 172.21.15.6:0/1106299352 wait complete. 2024-05-20T17:05:09.135 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-20T17:05:09.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.259+0000 7f4efb408640 1 -- 172.21.15.6:0/189406532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef4105ed0 msgr2=0x7f4ef41082f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:09.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.259+0000 7f4efb408640 1 --2- 172.21.15.6:0/189406532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef4105ed0 0x7f4ef41082f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4009900 tx=0x7f4ee402a410 comp rx=0 tx=0).stop 2024-05-20T17:05:09.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.259+0000 7f4efb408640 1 -- 172.21.15.6:0/189406532 shutdown_connections 2024-05-20T17:05:09.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.259+0000 7f4efb408640 1 --2- 172.21.15.6:0/189406532 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ef4108830 0x7f4ef410ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:09.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.259+0000 7f4efb408640 1 --2- 172.21.15.6:0/189406532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef4105ed0 0x7f4ef41082f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:09.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.259+0000 7f4efb408640 1 --2- 172.21.15.6:0/189406532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ef4103570 0x7f4ef4105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:09.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.259+0000 7f4efb408640 1 -- 172.21.15.6:0/189406532 >> 172.21.15.6:0/189406532 conn(0x7f4ef40fcb70 msgr2=0x7f4ef40ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:09.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.259+0000 7f4efb408640 1 -- 172.21.15.6:0/189406532 shutdown_connections 2024-05-20T17:05:09.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.259+0000 7f4efb408640 1 -- 172.21.15.6:0/189406532 wait complete. 2024-05-20T17:05:09.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.260+0000 7f4efb408640 1 Processor -- start 2024-05-20T17:05:09.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.260+0000 7f4efb408640 1 -- start start 2024-05-20T17:05:09.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.260+0000 7f4efb408640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef4103570 0x7f4ef41991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:09.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.260+0000 7f4efb408640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ef4105ed0 0x7f4ef4199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:09.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.260+0000 7f4efb408640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ef4108830 0x7f4ef41a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:09.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.260+0000 7f4efb408640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef410e590 con 0x7f4ef4103570 2024-05-20T17:05:09.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.260+0000 7f4efb408640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef410e410 con 0x7f4ef4108830 2024-05-20T17:05:09.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.260+0000 7f4efb408640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef410e710 con 0x7f4ef4105ed0 2024-05-20T17:05:09.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.260+0000 7f4ef91a4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef4103570 0x7f4ef41991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:09.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.260+0000 7f4ef91a4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef4103570 0x7f4ef41991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60784/0 (socket says 172.21.15.6:60784) 2024-05-20T17:05:09.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.260+0000 7f4ef91a4640 1 -- 172.21.15.6:0/1894292223 learned_addr learned my addr 172.21.15.6:0/1894292223 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:09.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.260+0000 7f4ef89a3640 1 --2- 172.21.15.6:0/1894292223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ef4105ed0 0x7f4ef4199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:09.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.260+0000 7f4ef99a5640 1 --2- 172.21.15.6:0/1894292223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ef4108830 0x7f4ef41a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:09.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.260+0000 7f4ef91a4640 1 -- 172.21.15.6:0/1894292223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ef4105ed0 msgr2=0x7f4ef4199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:09.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.260+0000 7f4ef91a4640 1 --2- 172.21.15.6:0/1894292223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ef4105ed0 0x7f4ef4199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:09.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.260+0000 7f4ef91a4640 1 -- 172.21.15.6:0/1894292223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ef4108830 msgr2=0x7f4ef41a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:09.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.260+0000 7f4ef91a4640 1 --2- 172.21.15.6:0/1894292223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ef4108830 0x7f4ef41a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:09.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.260+0000 7f4ef91a4640 1 -- 172.21.15.6:0/1894292223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef41a0d30 con 0x7f4ef4103570 2024-05-20T17:05:09.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.260+0000 7f4ef99a5640 1 --2- 172.21.15.6:0/1894292223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ef4108830 0x7f4ef41a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:05:09.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.260+0000 7f4ef91a4640 1 --2- 172.21.15.6:0/1894292223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef4103570 0x7f4ef41991f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4ef000e9c0 tx=0x7f4ef000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:09.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.261+0000 7f4eea7fc640 1 -- 172.21.15.6:0/1894292223 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef000cd80 con 0x7f4ef4103570 2024-05-20T17:05:09.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.261+0000 7f4eea7fc640 1 -- 172.21.15.6:0/1894292223 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ef00054d0 con 0x7f4ef4103570 2024-05-20T17:05:09.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.261+0000 7f4efb408640 1 -- 172.21.15.6:0/1894292223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef41a0fc0 con 0x7f4ef4103570 2024-05-20T17:05:09.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.261+0000 7f4eea7fc640 1 -- 172.21.15.6:0/1894292223 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0010430 con 0x7f4ef4103570 2024-05-20T17:05:09.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.261+0000 7f4efb408640 1 -- 172.21.15.6:0/1894292223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef41a1480 con 0x7f4ef4103570 2024-05-20T17:05:09.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.262+0000 7f4efb408640 1 -- 172.21.15.6:0/1894292223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ef40fe690 con 0x7f4ef4103570 2024-05-20T17:05:09.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.263+0000 7f4eea7fc640 1 -- 172.21.15.6:0/1894292223 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f4ef0004fb0 con 0x7f4ef4103570 2024-05-20T17:05:09.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.264+0000 7f4eea7fc640 1 --2- 172.21.15.6:0/1894292223 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4ee00a2b90 0x7f4ee00a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:09.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.264+0000 7f4ef89a3640 1 --2- 172.21.15.6:0/1894292223 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4ee00a2b90 0x7f4ee00a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:09.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.264+0000 7f4eea7fc640 1 -- 172.21.15.6:0/1894292223 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8770+0+0 (secure 0 0 0) 0x7f4ef00cf9f0 con 0x7f4ef4103570 2024-05-20T17:05:09.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.265+0000 7f4ef89a3640 1 --2- 172.21.15.6:0/1894292223 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4ee00a2b90 0x7f4ee00a50a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4000c00 tx=0x7f4ee4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:09.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.268+0000 7f4eea7fc640 1 -- 172.21.15.6:0/1894292223 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4ef0053850 con 0x7f4ef4103570 2024-05-20T17:05:09.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:09.493+0000 7f4efb408640 1 -- 172.21.15.6:0/1894292223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f4ef402d2a0 con 0x7f4ef4103570 2024-05-20T17:05:09.522 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:05:09 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-b[65260]: 2024-05-20T17:05:09.147+0000 7f23d9816700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-20T17:05:09.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:09 smithi171 ceph-mon[35901]: pgmap v300: 97 pgs: 14 creating+peering, 12 unknown, 71 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 9 op/s 2024-05-20T17:05:09.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:09 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1106299352' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-20T17:05:09.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:09 smithi171 ceph-mon[35901]: osdmap e89: 12 total, 12 up, 12 in 2024-05-20T17:05:09.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:09 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1894292223' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-20T17:05:09.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:09 smithi006 ceph-mon[32486]: pgmap v300: 97 pgs: 14 creating+peering, 12 unknown, 71 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 9 op/s 2024-05-20T17:05:09.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:09 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1106299352' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-20T17:05:09.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:09 smithi006 ceph-mon[32486]: osdmap e89: 12 total, 12 up, 12 in 2024-05-20T17:05:09.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:09 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1894292223' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-20T17:05:10.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:09 smithi062 ceph-mon[35425]: pgmap v300: 97 pgs: 14 creating+peering, 12 unknown, 71 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 9 op/s 2024-05-20T17:05:10.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:09 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1106299352' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-20T17:05:10.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:09 smithi062 ceph-mon[35425]: osdmap e89: 12 total, 12 up, 12 in 2024-05-20T17:05:10.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:09 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1894292223' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-20T17:05:10.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.109+0000 7f4eea7fc640 1 -- 172.21.15.6:0/1894292223 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f4ef009c730 con 0x7f4ef4103570 2024-05-20T17:05:10.110 INFO:teuthology.orchestra.run.smithi006.stderr:added data pool 4 to fsmap 2024-05-20T17:05:10.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.112+0000 7f4efb408640 1 -- 172.21.15.6:0/1894292223 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4ee00a2b90 msgr2=0x7f4ee00a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:10.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.112+0000 7f4efb408640 1 --2- 172.21.15.6:0/1894292223 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4ee00a2b90 0x7f4ee00a50a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4000c00 tx=0x7f4ee4031400 comp rx=0 tx=0).stop 2024-05-20T17:05:10.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.112+0000 7f4efb408640 1 -- 172.21.15.6:0/1894292223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef4103570 msgr2=0x7f4ef41991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:10.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.112+0000 7f4efb408640 1 --2- 172.21.15.6:0/1894292223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef4103570 0x7f4ef41991f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4ef000e9c0 tx=0x7f4ef000ee80 comp rx=0 tx=0).stop 2024-05-20T17:05:10.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.112+0000 7f4efb408640 1 -- 172.21.15.6:0/1894292223 shutdown_connections 2024-05-20T17:05:10.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.112+0000 7f4efb408640 1 --2- 172.21.15.6:0/1894292223 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4ee00a2b90 0x7f4ee00a50a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.112+0000 7f4efb408640 1 --2- 172.21.15.6:0/1894292223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ef4108830 0x7f4ef41a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.112+0000 7f4efb408640 1 --2- 172.21.15.6:0/1894292223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ef4105ed0 0x7f4ef4199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.112+0000 7f4efb408640 1 --2- 172.21.15.6:0/1894292223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef4103570 0x7f4ef41991f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.112+0000 7f4efb408640 1 -- 172.21.15.6:0/1894292223 >> 172.21.15.6:0/1894292223 conn(0x7f4ef40fcb70 msgr2=0x7f4ef4105550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:10.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.112+0000 7f4efb408640 1 -- 172.21.15.6:0/1894292223 shutdown_connections 2024-05-20T17:05:10.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.112+0000 7f4efb408640 1 -- 172.21.15.6:0/1894292223 wait complete. 2024-05-20T17:05:10.127 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:05:10.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.248+0000 7f500137e640 1 -- 172.21.15.6:0/2256782190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ffc1078f0 msgr2=0x7f4ffc109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.248+0000 7f500137e640 1 --2- 172.21.15.6:0/2256782190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ffc1078f0 0x7f4ffc109d10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009900 tx=0x7f4ff402a410 comp rx=0 tx=0).stop 2024-05-20T17:05:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.248+0000 7f500137e640 1 -- 172.21.15.6:0/2256782190 shutdown_connections 2024-05-20T17:05:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.248+0000 7f500137e640 1 --2- 172.21.15.6:0/2256782190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ffc1078f0 0x7f4ffc109d10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.248+0000 7f500137e640 1 --2- 172.21.15.6:0/2256782190 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ffc102bf0 0x7f4ffc103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.248+0000 7f500137e640 1 --2- 172.21.15.6:0/2256782190 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc1019b0 0x7f4ffc1026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.248+0000 7f500137e640 1 -- 172.21.15.6:0/2256782190 >> 172.21.15.6:0/2256782190 conn(0x7f4ffc0fcba0 msgr2=0x7f4ffc0ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.248+0000 7f500137e640 1 -- 172.21.15.6:0/2256782190 shutdown_connections 2024-05-20T17:05:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.248+0000 7f500137e640 1 -- 172.21.15.6:0/2256782190 wait complete. 2024-05-20T17:05:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.249+0000 7f500137e640 1 Processor -- start 2024-05-20T17:05:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.249+0000 7f500137e640 1 -- start start 2024-05-20T17:05:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.249+0000 7f500137e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ffc1019b0 0x7f4ffc199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.249+0000 7f500137e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ffc102bf0 0x7f4ffc1995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.249+0000 7f500137e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc1078f0 0x7f4ffc1a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.249+0000 7f500137e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4ffc10d4c0 con 0x7f4ffc1019b0 2024-05-20T17:05:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.249+0000 7f500137e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4ffc10d340 con 0x7f4ffc1078f0 2024-05-20T17:05:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.249+0000 7f500137e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4ffc10d640 con 0x7f4ffc102bf0 2024-05-20T17:05:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.249+0000 7f4ffaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ffc1019b0 0x7f4ffc199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.249+0000 7f4ffaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ffc1019b0 0x7f4ffc199060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60796/0 (socket says 172.21.15.6:60796) 2024-05-20T17:05:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.249+0000 7f4ffaffd640 1 -- 172.21.15.6:0/3242110705 learned_addr learned my addr 172.21.15.6:0/3242110705 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.249+0000 7f4ffa7fc640 1 --2- 172.21.15.6:0/3242110705 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ffc102bf0 0x7f4ffc1995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:10.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.250+0000 7f4ffb7fe640 1 --2- 172.21.15.6:0/3242110705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc1078f0 0x7f4ffc1a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:10.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.250+0000 7f4ffaffd640 1 -- 172.21.15.6:0/3242110705 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ffc102bf0 msgr2=0x7f4ffc1995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:10.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.250+0000 7f4ffaffd640 1 --2- 172.21.15.6:0/3242110705 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ffc102bf0 0x7f4ffc1995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.250+0000 7f4ffaffd640 1 -- 172.21.15.6:0/3242110705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc1078f0 msgr2=0x7f4ffc1a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:10.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.250+0000 7f4ffaffd640 1 --2- 172.21.15.6:0/3242110705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc1078f0 0x7f4ffc1a0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.250+0000 7f4ffaffd640 1 -- 172.21.15.6:0/3242110705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ffc1a0af0 con 0x7f4ffc1019b0 2024-05-20T17:05:10.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.250+0000 7f4ffb7fe640 1 --2- 172.21.15.6:0/3242110705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc1078f0 0x7f4ffc1a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:05:10.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.250+0000 7f4ffaffd640 1 --2- 172.21.15.6:0/3242110705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ffc1019b0 0x7f4ffc199060 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00e9f0 tx=0x7f4fec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:10.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.250+0000 7f4fe3fff640 1 -- 172.21.15.6:0/3242110705 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec00ccc0 con 0x7f4ffc1019b0 2024-05-20T17:05:10.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.250+0000 7f4fe3fff640 1 -- 172.21.15.6:0/3242110705 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4fec0035f0 con 0x7f4ffc1019b0 2024-05-20T17:05:10.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.250+0000 7f500137e640 1 -- 172.21.15.6:0/3242110705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ffc1a0de0 con 0x7f4ffc1019b0 2024-05-20T17:05:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.250+0000 7f4fe3fff640 1 -- 172.21.15.6:0/3242110705 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec00ce60 con 0x7f4ffc1019b0 2024-05-20T17:05:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.250+0000 7f500137e640 1 -- 172.21.15.6:0/3242110705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ffc1a1240 con 0x7f4ffc1019b0 2024-05-20T17:05:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.251+0000 7f500137e640 1 -- 172.21.15.6:0/3242110705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ffc068d70 con 0x7f4ffc1019b0 2024-05-20T17:05:10.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.252+0000 7f4fe3fff640 1 -- 172.21.15.6:0/3242110705 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f4fec004000 con 0x7f4ffc1019b0 2024-05-20T17:05:10.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.253+0000 7f4fe3fff640 1 --2- 172.21.15.6:0/3242110705 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4fe40a2c30 0x7f4fe40a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:10.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.254+0000 7f4ffa7fc640 1 --2- 172.21.15.6:0/3242110705 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4fe40a2c30 0x7f4fe40a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:10.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.254+0000 7f4fe3fff640 1 -- 172.21.15.6:0/3242110705 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f4fec0cf7a0 con 0x7f4ffc1019b0 2024-05-20T17:05:10.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.254+0000 7f4ffa7fc640 1 --2- 172.21.15.6:0/3242110705 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4fe40a2c30 0x7f4fe40a5140 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0007350 tx=0x7f4ff00072e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:10.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.257+0000 7f4fe3fff640 1 -- 172.21.15.6:0/3242110705 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4fec0042f0 con 0x7f4ffc1019b0 2024-05-20T17:05:10.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.479+0000 7f500137e640 1 -- 172.21.15.6:0/3242110705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ffc107040 con 0x7f4ffc1019b0 2024-05-20T17:05:10.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.480+0000 7f4fe3fff640 1 -- 172.21.15.6:0/3242110705 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11779 (secure 0 0 0) 0x7f4ffc107040 con 0x7f4ffc1019b0 2024-05-20T17:05:10.480 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:05:10.481 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/3061403904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":3061403904},{"type":"v1","addr":"172.21.15.6:6839","nonce":3061403904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/223306009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":223306009},{"type":"v1","addr":"172.21.15.6:6841","nonce":223306009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/78063155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":78063155},{"type":"v1","addr":"172.21.15.62:6835","nonce":78063155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1542537621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1542537621},{"type":"v1","addr":"172.21.15.171:6835","nonce":1542537621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24502,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/732693575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":732693575},{"type":"v1","addr":"172.21.15.171:6837","nonce":732693575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24509,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/1745943929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1745943929},{"type":"v1","addr":"172.21.15.62:6837","nonce":1745943929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24526,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6839/3246292303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3246292303},{"type":"v1","addr":"172.21.15.171:6839","nonce":3246292303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:05:04.455743+0000","modified":"2024-05-20T17:05:09.495753+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24548},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24548":{"gid":24548,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6839/3023093487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3023093487},{"type":"v1","addr":"172.21.15.62:6839","nonce":3023093487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24548,"qdb_cluster":[24548]},"id":1}]} 2024-05-20T17:05:10.481 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2024-05-20T17:05:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.482+0000 7f500137e640 1 -- 172.21.15.6:0/3242110705 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4fe40a2c30 msgr2=0x7f4fe40a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.482+0000 7f500137e640 1 --2- 172.21.15.6:0/3242110705 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4fe40a2c30 0x7f4fe40a5140 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0007350 tx=0x7f4ff00072e0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.482+0000 7f500137e640 1 -- 172.21.15.6:0/3242110705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ffc1019b0 msgr2=0x7f4ffc199060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.482+0000 7f500137e640 1 --2- 172.21.15.6:0/3242110705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ffc1019b0 0x7f4ffc199060 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00e9f0 tx=0x7f4fec00eeb0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.482+0000 7f500137e640 1 -- 172.21.15.6:0/3242110705 shutdown_connections 2024-05-20T17:05:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.482+0000 7f500137e640 1 --2- 172.21.15.6:0/3242110705 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4fe40a2c30 0x7f4fe40a5140 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.482+0000 7f500137e640 1 --2- 172.21.15.6:0/3242110705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc1078f0 0x7f4ffc1a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.482+0000 7f500137e640 1 --2- 172.21.15.6:0/3242110705 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ffc102bf0 0x7f4ffc1995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.482+0000 7f500137e640 1 --2- 172.21.15.6:0/3242110705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ffc1019b0 0x7f4ffc199060 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.482+0000 7f500137e640 1 -- 172.21.15.6:0/3242110705 >> 172.21.15.6:0/3242110705 conn(0x7f4ffc0fcba0 msgr2=0x7f4ffc100050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.482+0000 7f500137e640 1 -- 172.21.15.6:0/3242110705 shutdown_connections 2024-05-20T17:05:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.482+0000 7f500137e640 1 -- 172.21.15.6:0/3242110705 wait complete. 2024-05-20T17:05:10.494 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:05:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.609+0000 7fd6fa538640 1 -- 172.21.15.6:0/359941348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f4103650 msgr2=0x7fd6f4109da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.609+0000 7fd6fa538640 1 --2- 172.21.15.6:0/359941348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f4103650 0x7fd6f4109da0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009ca0 tx=0x7fd6ec02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.609+0000 7fd6fa538640 1 -- 172.21.15.6:0/359941348 shutdown_connections 2024-05-20T17:05:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.609+0000 7fd6fa538640 1 --2- 172.21.15.6:0/359941348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f4103650 0x7fd6f4109da0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.609+0000 7fd6fa538640 1 --2- 172.21.15.6:0/359941348 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6f4102af0 0x7fd6f4102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.609+0000 7fd6fa538640 1 --2- 172.21.15.6:0/359941348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6f4101f90 0x7fd6f41023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.609+0000 7fd6fa538640 1 -- 172.21.15.6:0/359941348 >> 172.21.15.6:0/359941348 conn(0x7fd6f40fc330 msgr2=0x7fd6f40fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.609+0000 7fd6fa538640 1 -- 172.21.15.6:0/359941348 shutdown_connections 2024-05-20T17:05:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.609+0000 7fd6fa538640 1 -- 172.21.15.6:0/359941348 wait complete. 2024-05-20T17:05:10.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.610+0000 7fd6fa538640 1 Processor -- start 2024-05-20T17:05:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.610+0000 7fd6fa538640 1 -- start start 2024-05-20T17:05:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.610+0000 7fd6fa538640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6f4101f90 0x7fd6f4101250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.610+0000 7fd6fa538640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6f4102af0 0x7fd6f419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.610+0000 7fd6fa538640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f419e120 0x7fd6f41a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.610+0000 7fd6fa538640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f410d750 con 0x7fd6f419e120 2024-05-20T17:05:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.610+0000 7fd6fa538640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f410d5d0 con 0x7fd6f4102af0 2024-05-20T17:05:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.610+0000 7fd6fa538640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f410d8d0 con 0x7fd6f4101f90 2024-05-20T17:05:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.610+0000 7fd6f8ad5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f419e120 0x7fd6f41a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.610+0000 7fd6f8ad5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f419e120 0x7fd6f41a0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60820/0 (socket says 172.21.15.6:60820) 2024-05-20T17:05:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.610+0000 7fd6f8ad5640 1 -- 172.21.15.6:0/963850735 learned_addr learned my addr 172.21.15.6:0/963850735 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.610+0000 7fd6f3fff640 1 --2- 172.21.15.6:0/963850735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6f4101f90 0x7fd6f4101250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.610+0000 7fd6ebfff640 1 --2- 172.21.15.6:0/963850735 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6f4102af0 0x7fd6f419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:10.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.611+0000 7fd6f8ad5640 1 -- 172.21.15.6:0/963850735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6f4101f90 msgr2=0x7fd6f4101250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.611+0000 7fd6f8ad5640 1 --2- 172.21.15.6:0/963850735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6f4101f90 0x7fd6f4101250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.611+0000 7fd6f8ad5640 1 -- 172.21.15.6:0/963850735 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6f4102af0 msgr2=0x7fd6f419dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.611+0000 7fd6f8ad5640 1 --2- 172.21.15.6:0/963850735 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6f4102af0 0x7fd6f419dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.611+0000 7fd6f8ad5640 1 -- 172.21.15.6:0/963850735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f41a0d80 con 0x7fd6f419e120 2024-05-20T17:05:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.611+0000 7fd6f8ad5640 1 --2- 172.21.15.6:0/963850735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f419e120 0x7fd6f41a0560 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec031040 tx=0x7fd6ec003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.611+0000 7fd6f1ffb640 1 -- 172.21.15.6:0/963850735 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec032ec0 con 0x7fd6f419e120 2024-05-20T17:05:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.611+0000 7fd6f1ffb640 1 -- 172.21.15.6:0/963850735 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd6ec0044f0 con 0x7fd6f419e120 2024-05-20T17:05:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.611+0000 7fd6fa538640 1 -- 172.21.15.6:0/963850735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f41a1010 con 0x7fd6f419e120 2024-05-20T17:05:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.611+0000 7fd6f1ffb640 1 -- 172.21.15.6:0/963850735 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec030d40 con 0x7fd6f419e120 2024-05-20T17:05:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.611+0000 7fd6fa538640 1 -- 172.21.15.6:0/963850735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f41a1560 con 0x7fd6f419e120 2024-05-20T17:05:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.612+0000 7fd6fa538640 1 -- 172.21.15.6:0/963850735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f406a450 con 0x7fd6f419e120 2024-05-20T17:05:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.614+0000 7fd6f1ffb640 1 -- 172.21.15.6:0/963850735 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fd6ec0046a0 con 0x7fd6f419e120 2024-05-20T17:05:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.615+0000 7fd6f1ffb640 1 --2- 172.21.15.6:0/963850735 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd6e00a2dd0 0x7fd6e00a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.615+0000 7fd6f3fff640 1 --2- 172.21.15.6:0/963850735 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd6e00a2dd0 0x7fd6e00a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.615+0000 7fd6f1ffb640 1 -- 172.21.15.6:0/963850735 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fd6ec0f09d0 con 0x7fd6f419e120 2024-05-20T17:05:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.615+0000 7fd6f3fff640 1 --2- 172.21.15.6:0/963850735 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd6e00a2dd0 0x7fd6e00a52e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd6f41029f0 tx=0x7fd6e400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.619+0000 7fd6f1ffb640 1 -- 172.21.15.6:0/963850735 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd6ec0bd6f0 con 0x7fd6f419e120 2024-05-20T17:05:10.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:10 smithi062 ceph-mon[35425]: osdmap e90: 12 total, 12 up, 12 in 2024-05-20T17:05:10.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:10 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1894292223' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-20T17:05:10.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:10 smithi062 ceph-mon[35425]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:05:10.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:10 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3242110705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:05:10.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.804+0000 7fd6fa538640 1 -- 172.21.15.6:0/963850735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd6f402d5c0 con 0x7fd6f419e120 2024-05-20T17:05:10.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.806+0000 7fd6f1ffb640 1 -- 172.21.15.6:0/963850735 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+23973 (secure 0 0 0) 0x7fd6ec0bcff0 con 0x7fd6f419e120 2024-05-20T17:05:10.807 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:05:10.807 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":90,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:05:09.495505+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:05:02.947896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:05:03.842231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:05:07.551471+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:05:10.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.808+0000 7fd6fa538640 1 -- 172.21.15.6:0/963850735 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd6e00a2dd0 msgr2=0x7fd6e00a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:10.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.808+0000 7fd6fa538640 1 --2- 172.21.15.6:0/963850735 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd6e00a2dd0 0x7fd6e00a52e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd6f41029f0 tx=0x7fd6e400b390 comp rx=0 tx=0).stop 2024-05-20T17:05:10.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.808+0000 7fd6fa538640 1 -- 172.21.15.6:0/963850735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f419e120 msgr2=0x7fd6f41a0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:10.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.808+0000 7fd6fa538640 1 --2- 172.21.15.6:0/963850735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f419e120 0x7fd6f41a0560 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec031040 tx=0x7fd6ec003ba0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.808+0000 7fd6fa538640 1 -- 172.21.15.6:0/963850735 shutdown_connections 2024-05-20T17:05:10.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.808+0000 7fd6fa538640 1 --2- 172.21.15.6:0/963850735 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd6e00a2dd0 0x7fd6e00a52e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.808+0000 7fd6fa538640 1 --2- 172.21.15.6:0/963850735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6f419e120 0x7fd6f41a0560 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.808+0000 7fd6fa538640 1 --2- 172.21.15.6:0/963850735 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6f4102af0 0x7fd6f419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.808+0000 7fd6fa538640 1 --2- 172.21.15.6:0/963850735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6f4101f90 0x7fd6f4101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.808+0000 7fd6fa538640 1 -- 172.21.15.6:0/963850735 >> 172.21.15.6:0/963850735 conn(0x7fd6f40fc330 msgr2=0x7fd6f4105c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:10.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.809+0000 7fd6fa538640 1 -- 172.21.15.6:0/963850735 shutdown_connections 2024-05-20T17:05:10.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.809+0000 7fd6fa538640 1 -- 172.21.15.6:0/963850735 wait complete. 2024-05-20T17:05:10.819 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:10 smithi006 ceph-mon[32486]: osdmap e90: 12 total, 12 up, 12 in 2024-05-20T17:05:10.819 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:10 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1894292223' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-20T17:05:10.819 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:10 smithi006 ceph-mon[32486]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:05:10.819 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:10 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3242110705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:05:10.821 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:05:10.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:10 smithi171 ceph-mon[35901]: osdmap e90: 12 total, 12 up, 12 in 2024-05-20T17:05:10.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:10 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1894292223' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-20T17:05:10.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:10 smithi171 ceph-mon[35901]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:05:10.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:10 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3242110705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:05:10.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.935+0000 7f4e6af2f640 1 -- 172.21.15.6:0/2200239909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e64102bf0 msgr2=0x7f4e64103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:10.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.935+0000 7f4e6af2f640 1 --2- 172.21.15.6:0/2200239909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e64102bf0 0x7f4e64103000 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009900 tx=0x7f4e5002a410 comp rx=0 tx=0).stop 2024-05-20T17:05:10.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.936+0000 7f4e6af2f640 1 -- 172.21.15.6:0/2200239909 shutdown_connections 2024-05-20T17:05:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.936+0000 7f4e6af2f640 1 --2- 172.21.15.6:0/2200239909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e641078f0 0x7f4e64109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.936+0000 7f4e6af2f640 1 --2- 172.21.15.6:0/2200239909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e64102bf0 0x7f4e64103000 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.936+0000 7f4e6af2f640 1 --2- 172.21.15.6:0/2200239909 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e641019b0 0x7f4e641026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.936+0000 7f4e6af2f640 1 -- 172.21.15.6:0/2200239909 >> 172.21.15.6:0/2200239909 conn(0x7f4e640fcba0 msgr2=0x7f4e640ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.936+0000 7f4e6af2f640 1 -- 172.21.15.6:0/2200239909 shutdown_connections 2024-05-20T17:05:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.936+0000 7f4e6af2f640 1 -- 172.21.15.6:0/2200239909 wait complete. 2024-05-20T17:05:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.936+0000 7f4e6af2f640 1 Processor -- start 2024-05-20T17:05:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.936+0000 7f4e6af2f640 1 -- start start 2024-05-20T17:05:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.936+0000 7f4e6af2f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e641019b0 0x7f4e640747f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.937+0000 7f4e6af2f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e64102bf0 0x7f4e641a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.937+0000 7f4e6af2f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e641078f0 0x7f4e641a2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.937+0000 7f4e6af2f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6410d4d0 con 0x7f4e641019b0 2024-05-20T17:05:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.937+0000 7f4e6af2f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6410d350 con 0x7f4e641078f0 2024-05-20T17:05:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.937+0000 7f4e6af2f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6410d650 con 0x7f4e64102bf0 2024-05-20T17:05:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.937+0000 7f4e68ccb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e641019b0 0x7f4e640747f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.937+0000 7f4e68ccb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e641019b0 0x7f4e640747f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40138/0 (socket says 172.21.15.6:40138) 2024-05-20T17:05:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.937+0000 7f4e68ccb640 1 -- 172.21.15.6:0/1745224866 learned_addr learned my addr 172.21.15.6:0/1745224866 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.937+0000 7f4e63fff640 1 --2- 172.21.15.6:0/1745224866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e64102bf0 0x7f4e641a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.937+0000 7f4e694cc640 1 --2- 172.21.15.6:0/1745224866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e641078f0 0x7f4e641a2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.937+0000 7f4e68ccb640 1 -- 172.21.15.6:0/1745224866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e64102bf0 msgr2=0x7f4e641a02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.937+0000 7f4e68ccb640 1 --2- 172.21.15.6:0/1745224866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e64102bf0 0x7f4e641a02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.937+0000 7f4e68ccb640 1 -- 172.21.15.6:0/1745224866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e641078f0 msgr2=0x7f4e641a2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.937+0000 7f4e68ccb640 1 --2- 172.21.15.6:0/1745224866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e641078f0 0x7f4e641a2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.937+0000 7f4e68ccb640 1 -- 172.21.15.6:0/1745224866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e641a2e80 con 0x7f4e641019b0 2024-05-20T17:05:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.937+0000 7f4e68ccb640 1 --2- 172.21.15.6:0/1745224866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e641019b0 0x7f4e640747f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800e9f0 tx=0x7f4e5800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.937+0000 7f4e61ffb640 1 -- 172.21.15.6:0/1745224866 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5800ccc0 con 0x7f4e641019b0 2024-05-20T17:05:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.937+0000 7f4e61ffb640 1 -- 172.21.15.6:0/1745224866 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e580035f0 con 0x7f4e641019b0 2024-05-20T17:05:10.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.937+0000 7f4e6af2f640 1 -- 172.21.15.6:0/1745224866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e641a3170 con 0x7f4e641019b0 2024-05-20T17:05:10.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.937+0000 7f4e61ffb640 1 -- 172.21.15.6:0/1745224866 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5800ce60 con 0x7f4e641019b0 2024-05-20T17:05:10.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.938+0000 7f4e6af2f640 1 -- 172.21.15.6:0/1745224866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e641a36c0 con 0x7f4e641019b0 2024-05-20T17:05:10.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.939+0000 7f4e6af2f640 1 -- 172.21.15.6:0/1745224866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e64106700 con 0x7f4e641019b0 2024-05-20T17:05:10.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.940+0000 7f4e61ffb640 1 -- 172.21.15.6:0/1745224866 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f4e58004000 con 0x7f4e641019b0 2024-05-20T17:05:10.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.941+0000 7f4e61ffb640 1 --2- 172.21.15.6:0/1745224866 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4e540a2cb0 0x7f4e540a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:10.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.941+0000 7f4e63fff640 1 --2- 172.21.15.6:0/1745224866 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4e540a2cb0 0x7f4e540a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:10.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.941+0000 7f4e61ffb640 1 -- 172.21.15.6:0/1745224866 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f4e580cf5a0 con 0x7f4e641019b0 2024-05-20T17:05:10.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.941+0000 7f4e63fff640 1 --2- 172.21.15.6:0/1745224866 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4e540a2cb0 0x7f4e540a51c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4e64074190 tx=0x7f4e50031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:10.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:10.946+0000 7f4e61ffb640 1 -- 172.21.15.6:0/1745224866 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4e5809c260 con 0x7f4e641019b0 2024-05-20T17:05:11.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.133+0000 7f4e6af2f640 1 -- 172.21.15.6:0/1745224866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e64062750 con 0x7f4e641019b0 2024-05-20T17:05:11.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.134+0000 7f4e61ffb640 1 -- 172.21.15.6:0/1745224866 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+23973 (secure 0 0 0) 0x7f4e5809bb60 con 0x7f4e641019b0 2024-05-20T17:05:11.135 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:05:11.135 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":90,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:05:09.495505+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:05:02.947896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:05:03.842231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:05:07.551471+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:05:11.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.136+0000 7f4e6af2f640 1 -- 172.21.15.6:0/1745224866 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4e540a2cb0 msgr2=0x7f4e540a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:11.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.136+0000 7f4e6af2f640 1 --2- 172.21.15.6:0/1745224866 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4e540a2cb0 0x7f4e540a51c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4e64074190 tx=0x7f4e50031400 comp rx=0 tx=0).stop 2024-05-20T17:05:11.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.136+0000 7f4e6af2f640 1 -- 172.21.15.6:0/1745224866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e641019b0 msgr2=0x7f4e640747f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:11.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.136+0000 7f4e6af2f640 1 --2- 172.21.15.6:0/1745224866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e641019b0 0x7f4e640747f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800e9f0 tx=0x7f4e5800eeb0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.137+0000 7f4e6af2f640 1 -- 172.21.15.6:0/1745224866 shutdown_connections 2024-05-20T17:05:11.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.137+0000 7f4e6af2f640 1 --2- 172.21.15.6:0/1745224866 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4e540a2cb0 0x7f4e540a51c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.137+0000 7f4e6af2f640 1 --2- 172.21.15.6:0/1745224866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e641078f0 0x7f4e641a2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.137+0000 7f4e6af2f640 1 --2- 172.21.15.6:0/1745224866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e64102bf0 0x7f4e641a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.137+0000 7f4e6af2f640 1 --2- 172.21.15.6:0/1745224866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e641019b0 0x7f4e640747f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.137+0000 7f4e6af2f640 1 -- 172.21.15.6:0/1745224866 >> 172.21.15.6:0/1745224866 conn(0x7f4e640fcba0 msgr2=0x7f4e641038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:11.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.137+0000 7f4e6af2f640 1 -- 172.21.15.6:0/1745224866 shutdown_connections 2024-05-20T17:05:11.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.137+0000 7f4e6af2f640 1 -- 172.21.15.6:0/1745224866 wait complete. 2024-05-20T17:05:11.167 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:05:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.281+0000 7f5e00b57640 1 -- 172.21.15.6:0/2711789700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dfc102bf0 msgr2=0x7f5dfc103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.281+0000 7f5e00b57640 1 --2- 172.21.15.6:0/2711789700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dfc102bf0 0x7f5dfc103000 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009900 tx=0x7f5de402a410 comp rx=0 tx=0).stop 2024-05-20T17:05:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.281+0000 7f5e00b57640 1 -- 172.21.15.6:0/2711789700 shutdown_connections 2024-05-20T17:05:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.281+0000 7f5e00b57640 1 --2- 172.21.15.6:0/2711789700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dfc1078f0 0x7f5dfc109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.281+0000 7f5e00b57640 1 --2- 172.21.15.6:0/2711789700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dfc102bf0 0x7f5dfc103000 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.281+0000 7f5e00b57640 1 --2- 172.21.15.6:0/2711789700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dfc1019b0 0x7f5dfc1026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.281+0000 7f5e00b57640 1 -- 172.21.15.6:0/2711789700 >> 172.21.15.6:0/2711789700 conn(0x7f5dfc0fcba0 msgr2=0x7f5dfc0ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.281+0000 7f5e00b57640 1 -- 172.21.15.6:0/2711789700 shutdown_connections 2024-05-20T17:05:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.281+0000 7f5e00b57640 1 -- 172.21.15.6:0/2711789700 wait complete. 2024-05-20T17:05:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.282+0000 7f5e00b57640 1 Processor -- start 2024-05-20T17:05:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.282+0000 7f5e00b57640 1 -- start start 2024-05-20T17:05:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.282+0000 7f5e00b57640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dfc1019b0 0x7f5dfc198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.282+0000 7f5e00b57640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dfc102bf0 0x7f5dfc198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.282+0000 7f5e00b57640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dfc1078f0 0x7f5dfc19f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.282+0000 7f5e00b57640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc10d4b0 con 0x7f5dfc1078f0 2024-05-20T17:05:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.282+0000 7f5e00b57640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc10d330 con 0x7f5dfc102bf0 2024-05-20T17:05:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.282+0000 7f5e00b57640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc10d630 con 0x7f5dfc1019b0 2024-05-20T17:05:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.282+0000 7f5dfad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dfc1078f0 0x7f5dfc19f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.282+0000 7f5dfad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dfc1078f0 0x7f5dfc19f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40160/0 (socket says 172.21.15.6:40160) 2024-05-20T17:05:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.282+0000 7f5dfad9d640 1 -- 172.21.15.6:0/891630899 learned_addr learned my addr 172.21.15.6:0/891630899 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.282+0000 7f5dfa59c640 1 --2- 172.21.15.6:0/891630899 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dfc1019b0 0x7f5dfc198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.283+0000 7f5df9d9b640 1 --2- 172.21.15.6:0/891630899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dfc102bf0 0x7f5dfc198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.283+0000 7f5dfad9d640 1 -- 172.21.15.6:0/891630899 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dfc1019b0 msgr2=0x7f5dfc198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.283+0000 7f5dfad9d640 1 --2- 172.21.15.6:0/891630899 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dfc1019b0 0x7f5dfc198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.283+0000 7f5dfad9d640 1 -- 172.21.15.6:0/891630899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dfc102bf0 msgr2=0x7f5dfc198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.283+0000 7f5dfad9d640 1 --2- 172.21.15.6:0/891630899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dfc102bf0 0x7f5dfc198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.283+0000 7f5dfad9d640 1 -- 172.21.15.6:0/891630899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dfc19fab0 con 0x7f5dfc1078f0 2024-05-20T17:05:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.283+0000 7f5dfad9d640 1 --2- 172.21.15.6:0/891630899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dfc1078f0 0x7f5dfc19f4f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5df400cce0 tx=0x7f5df400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.283+0000 7f5df37fe640 1 -- 172.21.15.6:0/891630899 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df400f450 con 0x7f5dfc1078f0 2024-05-20T17:05:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.283+0000 7f5e00b57640 1 -- 172.21.15.6:0/891630899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dfc19fda0 con 0x7f5dfc1078f0 2024-05-20T17:05:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.283+0000 7f5df37fe640 1 -- 172.21.15.6:0/891630899 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5df400faa0 con 0x7f5dfc1078f0 2024-05-20T17:05:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.283+0000 7f5df37fe640 1 -- 172.21.15.6:0/891630899 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df4018b70 con 0x7f5dfc1078f0 2024-05-20T17:05:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.283+0000 7f5e00b57640 1 -- 172.21.15.6:0/891630899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dfc1a0210 con 0x7f5dfc1078f0 2024-05-20T17:05:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.284+0000 7f5e00b57640 1 -- 172.21.15.6:0/891630899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dfc106700 con 0x7f5dfc1078f0 2024-05-20T17:05:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.286+0000 7f5df37fe640 1 -- 172.21.15.6:0/891630899 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f5df4018d10 con 0x7f5dfc1078f0 2024-05-20T17:05:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.287+0000 7f5df37fe640 1 --2- 172.21.15.6:0/891630899 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5de80a2c30 0x7f5de80a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.287+0000 7f5dfa59c640 1 --2- 172.21.15.6:0/891630899 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5de80a2c30 0x7f5de80a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.287+0000 7f5df37fe640 1 -- 172.21.15.6:0/891630899 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f5df40cf6f0 con 0x7f5dfc1078f0 2024-05-20T17:05:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.288+0000 7f5dfa59c640 1 --2- 172.21.15.6:0/891630899 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5de80a2c30 0x7f5de80a5140 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc1025b0 tx=0x7f5dec00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:11.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.291+0000 7f5df37fe640 1 -- 172.21.15.6:0/891630899 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5df4014030 con 0x7f5dfc1078f0 2024-05-20T17:05:11.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.514+0000 7f5e00b57640 1 -- 172.21.15.6:0/891630899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5dfc02d4f0 con 0x7f5dfc1078f0 2024-05-20T17:05:11.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.515+0000 7f5df37fe640 1 -- 172.21.15.6:0/891630899 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11779 (secure 0 0 0) 0x7f5df409c440 con 0x7f5dfc1078f0 2024-05-20T17:05:11.515 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:05:11.515 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/3061403904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":3061403904},{"type":"v1","addr":"172.21.15.6:6839","nonce":3061403904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/223306009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":223306009},{"type":"v1","addr":"172.21.15.6:6841","nonce":223306009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/78063155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":78063155},{"type":"v1","addr":"172.21.15.62:6835","nonce":78063155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24484,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1542537621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1542537621},{"type":"v1","addr":"172.21.15.171:6835","nonce":1542537621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24502,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/732693575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":732693575},{"type":"v1","addr":"172.21.15.171:6837","nonce":732693575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24509,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/1745943929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1745943929},{"type":"v1","addr":"172.21.15.62:6837","nonce":1745943929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24526,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6839/3246292303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3246292303},{"type":"v1","addr":"172.21.15.171:6839","nonce":3246292303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:05:04.455743+0000","modified":"2024-05-20T17:05:09.495753+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24548},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24548":{"gid":24548,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6839/3023093487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3023093487},{"type":"v1","addr":"172.21.15.62:6839","nonce":3023093487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24548,"qdb_cluster":[24548]},"id":1}]} 2024-05-20T17:05:11.516 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2024-05-20T17:05:11.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.517+0000 7f5e00b57640 1 -- 172.21.15.6:0/891630899 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5de80a2c30 msgr2=0x7f5de80a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:11.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.517+0000 7f5e00b57640 1 --2- 172.21.15.6:0/891630899 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5de80a2c30 0x7f5de80a5140 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc1025b0 tx=0x7f5dec00b390 comp rx=0 tx=0).stop 2024-05-20T17:05:11.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.517+0000 7f5e00b57640 1 -- 172.21.15.6:0/891630899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dfc1078f0 msgr2=0x7f5dfc19f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:11.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.517+0000 7f5e00b57640 1 --2- 172.21.15.6:0/891630899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dfc1078f0 0x7f5dfc19f4f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5df400cce0 tx=0x7f5df400a620 comp rx=0 tx=0).stop 2024-05-20T17:05:11.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.517+0000 7f5e00b57640 1 -- 172.21.15.6:0/891630899 shutdown_connections 2024-05-20T17:05:11.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.517+0000 7f5e00b57640 1 --2- 172.21.15.6:0/891630899 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5de80a2c30 0x7f5de80a5140 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.517+0000 7f5e00b57640 1 --2- 172.21.15.6:0/891630899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dfc1078f0 0x7f5dfc19f4f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.517+0000 7f5e00b57640 1 --2- 172.21.15.6:0/891630899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5dfc102bf0 0x7f5dfc198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.517+0000 7f5e00b57640 1 --2- 172.21.15.6:0/891630899 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dfc1019b0 0x7f5dfc198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.517+0000 7f5e00b57640 1 -- 172.21.15.6:0/891630899 >> 172.21.15.6:0/891630899 conn(0x7f5dfc0fcba0 msgr2=0x7f5dfc1038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:11.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.517+0000 7f5e00b57640 1 -- 172.21.15.6:0/891630899 shutdown_connections 2024-05-20T17:05:11.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.517+0000 7f5e00b57640 1 -- 172.21.15.6:0/891630899 wait complete. 2024-05-20T17:05:11.529 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:05:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.644+0000 7f4df1606640 1 -- 172.21.15.6:0/1447330709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dec108a20 msgr2=0x7f4dec10ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.644+0000 7f4df1606640 1 --2- 172.21.15.6:0/1447330709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dec108a20 0x7f4dec10ae40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009ca0 tx=0x7f4de402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.644+0000 7f4df1606640 1 -- 172.21.15.6:0/1447330709 shutdown_connections 2024-05-20T17:05:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.644+0000 7f4df1606640 1 --2- 172.21.15.6:0/1447330709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dec108a20 0x7f4dec10ae40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.644+0000 7f4df1606640 1 --2- 172.21.15.6:0/1447330709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dec1027e0 0x7f4dec102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.644+0000 7f4df1606640 1 --2- 172.21.15.6:0/1447330709 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dec104120 0x7f4dec1022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.644+0000 7f4df1606640 1 -- 172.21.15.6:0/1447330709 >> 172.21.15.6:0/1447330709 conn(0x7f4dec0fdcf0 msgr2=0x7f4dec100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:11.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.644+0000 7f4df1606640 1 -- 172.21.15.6:0/1447330709 shutdown_connections 2024-05-20T17:05:11.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.645+0000 7f4df1606640 1 -- 172.21.15.6:0/1447330709 wait complete. 2024-05-20T17:05:11.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.645+0000 7f4df1606640 1 Processor -- start 2024-05-20T17:05:11.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.645+0000 7f4df1606640 1 -- start start 2024-05-20T17:05:11.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.645+0000 7f4df1606640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dec1027e0 0x7f4dec1991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:11.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.645+0000 7f4df1606640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dec104120 0x7f4dec199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:11.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.645+0000 7f4df1606640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dec108a20 0x7f4dec1a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:11.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.645+0000 7f4df1606640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec10e750 con 0x7f4dec108a20 2024-05-20T17:05:11.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.645+0000 7f4df1606640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec10e5d0 con 0x7f4dec1027e0 2024-05-20T17:05:11.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.645+0000 7f4df1606640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec10e8d0 con 0x7f4dec104120 2024-05-20T17:05:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.646+0000 7f4deb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dec108a20 0x7f4dec1a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.646+0000 7f4deb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dec108a20 0x7f4dec1a0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40176/0 (socket says 172.21.15.6:40176) 2024-05-20T17:05:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.646+0000 7f4deb7fe640 1 -- 172.21.15.6:0/778744246 learned_addr learned my addr 172.21.15.6:0/778744246 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.646+0000 7f4deaffd640 1 --2- 172.21.15.6:0/778744246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dec1027e0 0x7f4dec1991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.646+0000 7f4de3fff640 1 --2- 172.21.15.6:0/778744246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dec104120 0x7f4dec199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.646+0000 7f4deb7fe640 1 -- 172.21.15.6:0/778744246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dec104120 msgr2=0x7f4dec199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.646+0000 7f4deb7fe640 1 --2- 172.21.15.6:0/778744246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dec104120 0x7f4dec199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.646+0000 7f4deb7fe640 1 -- 172.21.15.6:0/778744246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dec1027e0 msgr2=0x7f4dec1991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.646+0000 7f4deb7fe640 1 --2- 172.21.15.6:0/778744246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dec1027e0 0x7f4dec1991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.646+0000 7f4deb7fe640 1 -- 172.21.15.6:0/778744246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dec1a0c50 con 0x7f4dec108a20 2024-05-20T17:05:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.646+0000 7f4deb7fe640 1 --2- 172.21.15.6:0/778744246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dec108a20 0x7f4dec1a0690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4de4031040 tx=0x7f4de4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.646+0000 7f4de8ff9640 1 -- 172.21.15.6:0/778744246 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de4032ec0 con 0x7f4dec108a20 2024-05-20T17:05:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.646+0000 7f4de8ff9640 1 -- 172.21.15.6:0/778744246 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4de40044f0 con 0x7f4dec108a20 2024-05-20T17:05:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.646+0000 7f4df1606640 1 -- 172.21.15.6:0/778744246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dec1a0ee0 con 0x7f4dec108a20 2024-05-20T17:05:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.646+0000 7f4de8ff9640 1 -- 172.21.15.6:0/778744246 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de4030d40 con 0x7f4dec108a20 2024-05-20T17:05:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.646+0000 7f4df1606640 1 -- 172.21.15.6:0/778744246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dec1a13a0 con 0x7f4dec108a20 2024-05-20T17:05:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.648+0000 7f4df1606640 1 -- 172.21.15.6:0/778744246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dec0691c0 con 0x7f4dec108a20 2024-05-20T17:05:11.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.650+0000 7f4de8ff9640 1 -- 172.21.15.6:0/778744246 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f4de40046a0 con 0x7f4dec108a20 2024-05-20T17:05:11.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.650+0000 7f4de8ff9640 1 --2- 172.21.15.6:0/778744246 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4dd80a2e50 0x7f4dd80a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:11.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.650+0000 7f4deaffd640 1 --2- 172.21.15.6:0/778744246 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4dd80a2e50 0x7f4dd80a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:11.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.650+0000 7f4de8ff9640 1 -- 172.21.15.6:0/778744246 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f4de40f0a50 con 0x7f4dec108a20 2024-05-20T17:05:11.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.651+0000 7f4deaffd640 1 --2- 172.21.15.6:0/778744246 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4dd80a2e50 0x7f4dd80a5360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4dec1036e0 tx=0x7f4ddc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:11.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.654+0000 7f4de8ff9640 1 -- 172.21.15.6:0/778744246 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4de40bd770 con 0x7f4dec108a20 2024-05-20T17:05:11.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.841+0000 7f4df1606640 1 -- 172.21.15.6:0/778744246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4dec062750 con 0x7f4dec108a20 2024-05-20T17:05:11.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.843+0000 7f4de8ff9640 1 -- 172.21.15.6:0/778744246 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+23973 (secure 0 0 0) 0x7f4de40bd070 con 0x7f4dec108a20 2024-05-20T17:05:11.843 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:05:11.844 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":90,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:05:09.495505+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:05:02.947896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:05:03.842231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:05:07.551471+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:05:11.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.845+0000 7f4df1606640 1 -- 172.21.15.6:0/778744246 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4dd80a2e50 msgr2=0x7f4dd80a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:11.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.845+0000 7f4df1606640 1 --2- 172.21.15.6:0/778744246 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4dd80a2e50 0x7f4dd80a5360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4dec1036e0 tx=0x7f4ddc005f90 comp rx=0 tx=0).stop 2024-05-20T17:05:11.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.845+0000 7f4df1606640 1 -- 172.21.15.6:0/778744246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dec108a20 msgr2=0x7f4dec1a0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:11.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.845+0000 7f4df1606640 1 --2- 172.21.15.6:0/778744246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dec108a20 0x7f4dec1a0690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4de4031040 tx=0x7f4de4003ba0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.845+0000 7f4df1606640 1 -- 172.21.15.6:0/778744246 shutdown_connections 2024-05-20T17:05:11.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.845+0000 7f4df1606640 1 --2- 172.21.15.6:0/778744246 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4dd80a2e50 0x7f4dd80a5360 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.845+0000 7f4df1606640 1 --2- 172.21.15.6:0/778744246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dec108a20 0x7f4dec1a0690 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.845+0000 7f4df1606640 1 --2- 172.21.15.6:0/778744246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dec104120 0x7f4dec199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.845+0000 7f4df1606640 1 --2- 172.21.15.6:0/778744246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dec1027e0 0x7f4dec1991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.845+0000 7f4df1606640 1 -- 172.21.15.6:0/778744246 >> 172.21.15.6:0/778744246 conn(0x7f4dec0fdcf0 msgr2=0x7f4dec100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:11.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.845+0000 7f4df1606640 1 -- 172.21.15.6:0/778744246 shutdown_connections 2024-05-20T17:05:11.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.845+0000 7f4df1606640 1 -- 172.21.15.6:0/778744246 wait complete. 2024-05-20T17:05:11.856 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:11 smithi006 ceph-mon[32486]: pgmap v304: 129 pgs: 1 creating+peering, 29 unknown, 99 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-05-20T17:05:11.856 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:11 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/963850735' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:11.856 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:11 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1745224866' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:11.856 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:11 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/891630899' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:05:11.857 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-20T17:05:04.455743+0000', 'modified': '2024-05-20T17:05:09.495753+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24548}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24548': {'gid': 24548, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6839/3023093487', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6838', 'nonce': 3023093487}, {'type': 'v1', 'addr': '172.21.15.62:6839', 'nonce': 3023093487}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24548, 'qdb_cluster': [24548]} 2024-05-20T17:05:11.857 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-20T17:05:11.858 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-20T17:05:11.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:11 smithi171 ceph-mon[35901]: pgmap v304: 129 pgs: 1 creating+peering, 29 unknown, 99 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-05-20T17:05:11.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:11 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/963850735' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:11.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:11 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1745224866' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:11.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:11 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/891630899' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:05:11.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.974+0000 7f7f2cee7640 1 -- 172.21.15.6:0/18252659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f28101980 msgr2=0x7f7f28102680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:11.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.974+0000 7f7f2cee7640 1 --2- 172.21.15.6:0/18252659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f28101980 0x7f7f28102680 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009ca0 tx=0x7f7f1802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.974+0000 7f7f2cee7640 1 -- 172.21.15.6:0/18252659 shutdown_connections 2024-05-20T17:05:11.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.974+0000 7f7f2cee7640 1 --2- 172.21.15.6:0/18252659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f281078c0 0x7f7f28109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.974+0000 7f7f2cee7640 1 --2- 172.21.15.6:0/18252659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f28102bc0 0x7f7f28102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.974+0000 7f7f2cee7640 1 --2- 172.21.15.6:0/18252659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f28101980 0x7f7f28102680 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.974+0000 7f7f2cee7640 1 -- 172.21.15.6:0/18252659 >> 172.21.15.6:0/18252659 conn(0x7f7f280fcb70 msgr2=0x7f7f280ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:11.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.974+0000 7f7f2cee7640 1 -- 172.21.15.6:0/18252659 shutdown_connections 2024-05-20T17:05:11.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.974+0000 7f7f2cee7640 1 -- 172.21.15.6:0/18252659 wait complete. 2024-05-20T17:05:11.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.975+0000 7f7f2cee7640 1 Processor -- start 2024-05-20T17:05:11.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.975+0000 7f7f2cee7640 1 -- start start 2024-05-20T17:05:11.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.975+0000 7f7f2cee7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f28101980 0x7f7f28199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:11.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.975+0000 7f7f2cee7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f28102bc0 0x7f7f28199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:11.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.975+0000 7f7f2cee7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f281078c0 0x7f7f281a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:11.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.975+0000 7f7f2cee7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2810e5b0 con 0x7f7f281078c0 2024-05-20T17:05:11.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.975+0000 7f7f2cee7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2810e430 con 0x7f7f28101980 2024-05-20T17:05:11.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.975+0000 7f7f2cee7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2810e730 con 0x7f7f28102bc0 2024-05-20T17:05:11.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.975+0000 7f7f26d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f281078c0 0x7f7f281a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:11.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.975+0000 7f7f26d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f281078c0 0x7f7f281a0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40196/0 (socket says 172.21.15.6:40196) 2024-05-20T17:05:11.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.975+0000 7f7f26d9d640 1 -- 172.21.15.6:0/3712049733 learned_addr learned my addr 172.21.15.6:0/3712049733 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:11.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.976+0000 7f7f2659c640 1 --2- 172.21.15.6:0/3712049733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f28101980 0x7f7f28199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:11.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.976+0000 7f7f25d9b640 1 --2- 172.21.15.6:0/3712049733 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f28102bc0 0x7f7f28199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:11.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.976+0000 7f7f26d9d640 1 -- 172.21.15.6:0/3712049733 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f28102bc0 msgr2=0x7f7f28199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:11.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.976+0000 7f7f26d9d640 1 --2- 172.21.15.6:0/3712049733 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f28102bc0 0x7f7f28199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.976+0000 7f7f26d9d640 1 -- 172.21.15.6:0/3712049733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f28101980 msgr2=0x7f7f28199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:11.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.976+0000 7f7f26d9d640 1 --2- 172.21.15.6:0/3712049733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f28101980 0x7f7f28199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.976+0000 7f7f26d9d640 1 -- 172.21.15.6:0/3712049733 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f281a0cd0 con 0x7f7f281078c0 2024-05-20T17:05:11.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.976+0000 7f7f26d9d640 1 --2- 172.21.15.6:0/3712049733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f281078c0 0x7f7f281a0660 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000d750 tx=0x7f7f2000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:11.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.976+0000 7f7f177fe640 1 -- 172.21.15.6:0/3712049733 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f20017070 con 0x7f7f281078c0 2024-05-20T17:05:11.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.976+0000 7f7f177fe640 1 -- 172.21.15.6:0/3712049733 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f200054d0 con 0x7f7f281078c0 2024-05-20T17:05:11.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.976+0000 7f7f177fe640 1 -- 172.21.15.6:0/3712049733 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f20004c60 con 0x7f7f281078c0 2024-05-20T17:05:11.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.976+0000 7f7f2cee7640 1 -- 172.21.15.6:0/3712049733 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f281a0fc0 con 0x7f7f281078c0 2024-05-20T17:05:11.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.976+0000 7f7f2cee7640 1 -- 172.21.15.6:0/3712049733 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f281a13d0 con 0x7f7f281078c0 2024-05-20T17:05:11.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.979+0000 7f7f33d81740 1 Processor -- start 2024-05-20T17:05:11.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.979+0000 7f7f177fe640 1 -- 172.21.15.6:0/3712049733 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f7f20004e00 con 0x7f7f281078c0 2024-05-20T17:05:11.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.980+0000 7f7f33d81740 1 -- start start 2024-05-20T17:05:11.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.980+0000 7f7f33d81740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c31270 0x560c02fd5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:11.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.980+0000 7f7f33d81740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560c02c083b0 0x560c02fd5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:11.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.980+0000 7f7f33d81740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c10590 0x560c02fdcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:11.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.980+0000 7f7f33d81740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560c02f354d0 con 0x560c02c10590 2024-05-20T17:05:11.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.980+0000 7f7f33d81740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560c02edd3e0 con 0x560c02c31270 2024-05-20T17:05:11.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.980+0000 7f7f33d81740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560c02f31490 con 0x560c02c083b0 2024-05-20T17:05:11.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.980+0000 7f7f25d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c10590 0x560c02fdcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:11.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.980+0000 7f7f25d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c10590 0x560c02fdcd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40212/0 (socket says 172.21.15.6:40212) 2024-05-20T17:05:11.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.980+0000 7f7f25d9b640 1 -- 172.21.15.6:0/1738616678 learned_addr learned my addr 172.21.15.6:0/1738616678 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:11.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.980+0000 7f7f25d9b640 1 --2- 172.21.15.6:0/1738616678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c31270 0x560c02fd5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:11.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.980+0000 7f7f2659c640 1 --2- 172.21.15.6:0/1738616678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560c02c083b0 0x560c02fd5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:11.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.980+0000 7f7f177fe640 1 --2- 172.21.15.6:0/3712049733 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7f100a2c10 0x7f7f100a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:11.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.980+0000 7f7f25d9b640 1 -- 172.21.15.6:0/1738616678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560c02c083b0 msgr2=0x560c02fd5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:05:11.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.980+0000 7f7f25d9b640 1 --2- 172.21.15.6:0/1738616678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560c02c083b0 0x560c02fd5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.980+0000 7f7f25d9b640 1 -- 172.21.15.6:0/1738616678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c31270 msgr2=0x560c02fd5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:05:11.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.980+0000 7f7f25d9b640 1 --2- 172.21.15.6:0/1738616678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c31270 0x560c02fd5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.980+0000 7f7f25d9b640 1 -- 172.21.15.6:0/1738616678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c02c492d0 con 0x560c02c10590 2024-05-20T17:05:11.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.980+0000 7f7f2659c640 1 --2- 172.21.15.6:0/1738616678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560c02c083b0 0x560c02fd5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:05:11.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.980+0000 7f7f26d9d640 1 --2- 172.21.15.6:0/3712049733 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7f100a2c10 0x7f7f100a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:11.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.981+0000 7f7f177fe640 1 -- 172.21.15.6:0/3712049733 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f7f200cec30 con 0x7f7f281078c0 2024-05-20T17:05:11.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.981+0000 7f7f25d9b640 1 --2- 172.21.15.6:0/1738616678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c10590 0x560c02fdcd00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c0149a0 tx=0x7f7f1c00c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1a4188d92172b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:11.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.981+0000 7f7f14ff9640 1 -- 172.21.15.6:0/1738616678 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c0142d0 con 0x560c02c10590 2024-05-20T17:05:11.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.981+0000 7f7f14ff9640 1 -- 172.21.15.6:0/1738616678 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f1c0054d0 con 0x560c02c10590 2024-05-20T17:05:11.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.981+0000 7f7f14ff9640 1 -- 172.21.15.6:0/1738616678 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c004db0 con 0x560c02c10590 2024-05-20T17:05:11.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.982+0000 7f7f33d81740 1 -- 172.21.15.6:0/1738616678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c10590 msgr2=0x560c02fdcd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:11.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.982+0000 7f7f26d9d640 1 --2- 172.21.15.6:0/3712049733 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7f100a2c10 0x7f7f100a5120 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000d720 tx=0x7f7f20090730 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:11.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.982+0000 7f7f33d81740 1 --2- 172.21.15.6:0/1738616678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c10590 0x560c02fdcd00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c0149a0 tx=0x7f7f1c00c4f0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.982+0000 7f7f33d81740 1 -- 172.21.15.6:0/1738616678 shutdown_connections 2024-05-20T17:05:11.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.982+0000 7f7f33d81740 1 --2- 172.21.15.6:0/1738616678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c10590 0x560c02fdcd00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.982+0000 7f7f33d81740 1 --2- 172.21.15.6:0/1738616678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560c02c083b0 0x560c02fd5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.982+0000 7f7f33d81740 1 --2- 172.21.15.6:0/1738616678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c31270 0x560c02fd5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.982+0000 7f7f33d81740 1 -- 172.21.15.6:0/1738616678 >> 172.21.15.6:0/1738616678 conn(0x560c02c253c0 msgr2=0x560c02fcce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:11.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.982+0000 7f7f33d81740 1 -- 172.21.15.6:0/1738616678 shutdown_connections 2024-05-20T17:05:11.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.982+0000 7f7f33d81740 1 -- 172.21.15.6:0/1738616678 wait complete. 2024-05-20T17:05:11.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.982+0000 7f7f33d81740 1 -- start start 2024-05-20T17:05:11.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.982+0000 7f7f33d81740 1 Processor -- start 2024-05-20T17:05:11.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f33d81740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c083b0 0x560c02fdf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:11.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f33d81740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c10590 0x560c02fdfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f33d81740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560c02c31270 0x560c02fe6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f33d81740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560c02fdd750 con 0x560c02c083b0 2024-05-20T17:05:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f33d81740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560c02ef08e0 con 0x560c02c10590 2024-05-20T17:05:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f33d81740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560c02fdd8d0 con 0x560c02c31270 2024-05-20T17:05:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f33d81740 10 client.0 _ll_register_callbacks cb 0x560c02ebd9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:05:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f25d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c083b0 0x560c02fdf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f25d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c083b0 0x560c02fdf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40218/0 (socket says 172.21.15.6:40218) 2024-05-20T17:05:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f25d9b640 1 -- 172.21.15.6:0/3383089546 learned_addr learned my addr 172.21.15.6:0/3383089546 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f2659c640 1 --2- 172.21.15.6:0/3383089546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c10590 0x560c02fdfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f25d9b640 1 -- 172.21.15.6:0/3383089546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560c02c31270 msgr2=0x560c02fe6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:05:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f25d9b640 1 --2- 172.21.15.6:0/3383089546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560c02c31270 0x560c02fe6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f25d9b640 1 -- 172.21.15.6:0/3383089546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c10590 msgr2=0x560c02fdfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:05:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f25d9b640 1 --2- 172.21.15.6:0/3383089546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c10590 0x560c02fdfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f25d9b640 1 -- 172.21.15.6:0/3383089546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c02d136b0 con 0x560c02c083b0 2024-05-20T17:05:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f25d9b640 1 --2- 172.21.15.6:0/3383089546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c083b0 0x560c02fdf700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00c820 tx=0x7f7f1c005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee6272ab495c88f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:05:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f0dffb640 1 -- 172.21.15.6:0/3383089546 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c004b30 con 0x560c02c083b0 2024-05-20T17:05:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f0dffb640 1 -- 172.21.15.6:0/3383089546 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f7f1c004cd0 con 0x560c02c083b0 2024-05-20T17:05:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.983+0000 7f7f33d81740 1 -- 172.21.15.6:0/3383089546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f1c0054d0 con 0x560c02c083b0 2024-05-20T17:05:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.984+0000 7f7f0dffb640 1 -- 172.21.15.6:0/3383089546 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f7f1c00f760 con 0x560c02c083b0 2024-05-20T17:05:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.984+0000 7f7f33d81740 10 client.14769 fetch_fsmap learned FSMap version 17 2024-05-20T17:05:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.984+0000 7f7f33d81740 1 -- 172.21.15.6:0/3383089546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x560c02fe9a60 con 0x560c02c083b0 2024-05-20T17:05:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.984+0000 7f7f0dffb640 1 -- 172.21.15.6:0/3383089546 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f1c0054d0 con 0x560c02c083b0 2024-05-20T17:05:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.984+0000 7f7f0dffb640 1 -- 172.21.15.6:0/3383089546 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7f7f1c020880 con 0x560c02c083b0 2024-05-20T17:05:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.984+0000 7f7f33d81740 10 client.14769 fetch_fsmap finished waiting for FSMap version 17 2024-05-20T17:05:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.984+0000 7f7f33d81740 10 client.14769 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-20T17:05:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.984+0000 7f7f33d81740 20 client.14769 populate_metadata read hostname 'smithi006' 2024-05-20T17:05:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.984+0000 7f7f33d81740 1 --2- 172.21.15.6:0/3383089546 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x560c02befe40 0x560c02fed140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.984+0000 7f7f33d81740 4 client.14769 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:05:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.984+0000 7f7f33d81740 1 -- 172.21.15.6:0/3383089546 --> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c02f42c00 con 0x560c02befe40 2024-05-20T17:05:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.984+0000 7f7f2659c640 1 --2- 172.21.15.6:0/3383089546 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x560c02befe40 0x560c02fed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.985+0000 7f7f0dffb640 10 client.14769 ms_handle_connect on v2:172.21.15.62:6838/3023093487 2024-05-20T17:05:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.985+0000 7f7f2659c640 1 --2- 172.21.15.6:0/3383089546 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x560c02befe40 0x560c02fed140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0942b93fd246929 server_cookie=16f6bb95655012ec in_seq=0 out_seq=0 2024-05-20T17:05:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.986+0000 7f7f0dffb640 1 -- 172.21.15.6:0/3383089546 <== mds.0 v2:172.21.15.62:6838/3023093487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560c02f42c00 con 0x560c02befe40 2024-05-20T17:05:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.986+0000 7f7f0dffb640 10 client.14769 handle_command_reply: tid=0 2024-05-20T17:05:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.986+0000 7f7f33d81740 1 client.14769 shutdown 2024-05-20T17:05:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.986+0000 7f7f33d81740 1 -- 172.21.15.6:0/3383089546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c083b0 msgr2=0x560c02fdf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.986+0000 7f7f33d81740 1 --2- 172.21.15.6:0/3383089546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c083b0 0x560c02fdf700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00c820 tx=0x7f7f1c005710 comp rx=0 tx=0).stop 2024-05-20T17:05:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.986+0000 7f7f33d81740 1 -- 172.21.15.6:0/3383089546 shutdown_connections 2024-05-20T17:05:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.986+0000 7f7f33d81740 1 --2- 172.21.15.6:0/3383089546 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x560c02befe40 0x560c02fed140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.986+0000 7f7f33d81740 1 --2- 172.21.15.6:0/3383089546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560c02c31270 0x560c02fe6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.986+0000 7f7f33d81740 1 --2- 172.21.15.6:0/3383089546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c10590 0x560c02fdfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.986+0000 7f7f0dffb640 0 client.14769 ms_handle_reset on v2:172.21.15.62:6838/3023093487 2024-05-20T17:05:11.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.986+0000 7f7f33d81740 1 --2- 172.21.15.6:0/3383089546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c083b0 0x560c02fdf700 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:11.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.986+0000 7f7f33d81740 1 -- 172.21.15.6:0/3383089546 >> 172.21.15.6:0/3383089546 conn(0x560c02c253c0 msgr2=0x560c02fcbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:11.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.986+0000 7f7f33d81740 1 -- 172.21.15.6:0/3383089546 shutdown_connections 2024-05-20T17:05:11.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.986+0000 7f7f33d81740 1 -- 172.21.15.6:0/3383089546 wait complete. 2024-05-20T17:05:11.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:11.986+0000 7f7f33d81740 20 client.14769 trim_cache size 0 max 16384 2024-05-20T17:05:12.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.004+0000 7f7f33d81740 1 Processor -- start 2024-05-20T17:05:12.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.004+0000 7f7f33d81740 1 -- start start 2024-05-20T17:05:12.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.005+0000 7f7f33d81740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560c02befe40 0x560c02fdd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:12.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.005+0000 7f7f33d81740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c083b0 0x560c02fe70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:12.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.005+0000 7f7f33d81740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c10590 0x560c02fcc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:12.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.005+0000 7f7f33d81740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560c02feb480 con 0x560c02c083b0 2024-05-20T17:05:12.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.005+0000 7f7f33d81740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560c02febb50 con 0x560c02c10590 2024-05-20T17:05:12.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.005+0000 7f7f33d81740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560c02fec220 con 0x560c02befe40 2024-05-20T17:05:12.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.005+0000 7f7f2659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c083b0 0x560c02fe70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:12.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.005+0000 7f7f2659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c083b0 0x560c02fe70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40222/0 (socket says 172.21.15.6:40222) 2024-05-20T17:05:12.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.005+0000 7f7f2659c640 1 -- 172.21.15.6:0/184466379 learned_addr learned my addr 172.21.15.6:0/184466379 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:12.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.005+0000 7f7f25d9b640 1 --2- 172.21.15.6:0/184466379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c10590 0x560c02fcc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:12.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.005+0000 7f7f2659c640 1 -- 172.21.15.6:0/184466379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560c02befe40 msgr2=0x560c02fdd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:05:12.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.005+0000 7f7f2659c640 1 --2- 172.21.15.6:0/184466379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560c02befe40 0x560c02fdd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:12.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.005+0000 7f7f2659c640 1 -- 172.21.15.6:0/184466379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c10590 msgr2=0x560c02fcc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:05:12.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.005+0000 7f7f2659c640 1 --2- 172.21.15.6:0/184466379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c10590 0x560c02fcc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:12.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.005+0000 7f7f2659c640 1 -- 172.21.15.6:0/184466379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c02fdced0 con 0x560c02c083b0 2024-05-20T17:05:12.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.005+0000 7f7f25d9b640 1 --2- 172.21.15.6:0/184466379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c10590 0x560c02fcc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:05:12.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.005+0000 7f7f2659c640 1 --2- 172.21.15.6:0/184466379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c083b0 0x560c02fe70c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7f180096c0 tx=0x7f7f180317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b24334dded9f5b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:12.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.005+0000 7f7f0ffff640 1 -- 172.21.15.6:0/184466379 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f18031d40 con 0x560c02c083b0 2024-05-20T17:05:12.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.005+0000 7f7f0ffff640 1 -- 172.21.15.6:0/184466379 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f18036040 con 0x560c02c083b0 2024-05-20T17:05:12.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.005+0000 7f7f0ffff640 1 -- 172.21.15.6:0/184466379 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f180045d0 con 0x560c02c083b0 2024-05-20T17:05:12.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.006+0000 7f7f33d81740 1 -- 172.21.15.6:0/184466379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c083b0 msgr2=0x560c02fe70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:12.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.006+0000 7f7f33d81740 1 --2- 172.21.15.6:0/184466379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c083b0 0x560c02fe70c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7f180096c0 tx=0x7f7f180317e0 comp rx=0 tx=0).stop 2024-05-20T17:05:12.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.006+0000 7f7f33d81740 1 -- 172.21.15.6:0/184466379 shutdown_connections 2024-05-20T17:05:12.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.006+0000 7f7f33d81740 1 --2- 172.21.15.6:0/184466379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c10590 0x560c02fcc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:12.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.006+0000 7f7f33d81740 1 --2- 172.21.15.6:0/184466379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02c083b0 0x560c02fe70c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:12.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.006+0000 7f7f33d81740 1 --2- 172.21.15.6:0/184466379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560c02befe40 0x560c02fdd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:12.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.006+0000 7f7f33d81740 1 -- 172.21.15.6:0/184466379 >> 172.21.15.6:0/184466379 conn(0x560c02c253c0 msgr2=0x560c02fd8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:12.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.006+0000 7f7f33d81740 1 -- 172.21.15.6:0/184466379 shutdown_connections 2024-05-20T17:05:12.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.006+0000 7f7f33d81740 1 -- 172.21.15.6:0/184466379 wait complete. 2024-05-20T17:05:12.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f33d81740 1 -- start start 2024-05-20T17:05:12.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f33d81740 1 Processor -- start 2024-05-20T17:05:12.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f33d81740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02befe40 0x560c02fe13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:12.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f33d81740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c083b0 0x560c02fe1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:12.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f33d81740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560c02c10590 0x560c02fe4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:12.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f33d81740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560c02fecfc0 con 0x560c02befe40 2024-05-20T17:05:12.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f33d81740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560c02fec8f0 con 0x560c02c083b0 2024-05-20T17:05:12.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f33d81740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560c02fed690 con 0x560c02c10590 2024-05-20T17:05:12.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f33d81740 10 client.0 _ll_register_callbacks cb 0x7f7f1c00cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:05:12.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f25d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02befe40 0x560c02fe13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:12.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f25d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02befe40 0x560c02fe13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40238/0 (socket says 172.21.15.6:40238) 2024-05-20T17:05:12.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f25d9b640 1 -- 172.21.15.6:0/4258118172 learned_addr learned my addr 172.21.15.6:0/4258118172 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:12.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f25d9b640 1 --2- 172.21.15.6:0/4258118172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560c02c10590 0x560c02fe4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:12.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f2659c640 1 --2- 172.21.15.6:0/4258118172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c083b0 0x560c02fe1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:12.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f25d9b640 1 -- 172.21.15.6:0/4258118172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560c02c10590 msgr2=0x560c02fe4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:05:12.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f25d9b640 1 --2- 172.21.15.6:0/4258118172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560c02c10590 0x560c02fe4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:12.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f25d9b640 1 -- 172.21.15.6:0/4258118172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c083b0 msgr2=0x560c02fe1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:05:12.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f25d9b640 1 --2- 172.21.15.6:0/4258118172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c083b0 0x560c02fe1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:12.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f25d9b640 1 -- 172.21.15.6:0/4258118172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c02fe4dc0 con 0x560c02befe40 2024-05-20T17:05:12.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f25d9b640 1 --2- 172.21.15.6:0/4258118172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02befe40 0x560c02fe13f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c000c00 tx=0x7f7f1c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1bc5d1604538d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:12.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.007+0000 7f7f0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:05:12.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.008+0000 7f7f0dffb640 1 -- 172.21.15.6:0/4258118172 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c00cc70 con 0x560c02befe40 2024-05-20T17:05:12.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.008+0000 7f7f0dffb640 1 -- 172.21.15.6:0/4258118172 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f7f1c0204c0 con 0x560c02befe40 2024-05-20T17:05:12.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.008+0000 7f7f33d81740 1 -- 172.21.15.6:0/4258118172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f18036040 con 0x560c02befe40 2024-05-20T17:05:12.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.008+0000 7f7f0dffb640 1 -- 172.21.15.6:0/4258118172 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f7f1c0206c0 con 0x560c02befe40 2024-05-20T17:05:12.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.008+0000 7f7f33d81740 10 client.14775 fetch_fsmap learned FSMap version 17 2024-05-20T17:05:12.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.008+0000 7f7f33d81740 1 -- 172.21.15.6:0/4258118172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x560c02fe6020 con 0x560c02befe40 2024-05-20T17:05:12.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.008+0000 7f7f0dffb640 1 -- 172.21.15.6:0/4258118172 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f18036040 con 0x560c02befe40 2024-05-20T17:05:12.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.008+0000 7f7f0dffb640 1 -- 172.21.15.6:0/4258118172 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7f7f1c004680 con 0x560c02befe40 2024-05-20T17:05:12.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.008+0000 7f7f33d81740 10 client.14775 fetch_fsmap finished waiting for FSMap version 17 2024-05-20T17:05:12.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.008+0000 7f7f33d81740 10 client.14775 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-20T17:05:12.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.008+0000 7f7f33d81740 20 client.14775 populate_metadata read hostname 'smithi006' 2024-05-20T17:05:12.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.008+0000 7f7f33d81740 1 --2- 172.21.15.6:0/4258118172 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x560c02c31270 0x560c030590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:12.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.008+0000 7f7f33d81740 4 client.14775 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:05:12.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.008+0000 7f7f33d81740 1 -- 172.21.15.6:0/4258118172 --> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] -- command(tid 0: {"prefix": "status"}) -- 0x560c02f3cf50 con 0x560c02c31270 2024-05-20T17:05:12.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.009+0000 7f7f2659c640 1 --2- 172.21.15.6:0/4258118172 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x560c02c31270 0x560c030590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:12.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.009+0000 7f7f2659c640 1 --2- 172.21.15.6:0/4258118172 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x560c02c31270 0x560c030590b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b522648cf5677b8 server_cookie=ab3e0a99bf5e59b6 in_seq=0 out_seq=0 2024-05-20T17:05:12.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.009+0000 7f7f0dffb640 10 client.14775 ms_handle_connect on v2:172.21.15.62:6838/3023093487 2024-05-20T17:05:12.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.009+0000 7f7f0dffb640 1 -- 172.21.15.6:0/4258118172 <== mds.0 v2:172.21.15.62:6838/3023093487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560c02f3cf50 con 0x560c02c31270 2024-05-20T17:05:12.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.009+0000 7f7f0dffb640 10 client.14775 handle_command_reply: tid=0 2024-05-20T17:05:12.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.009+0000 7f7f33d81740 1 client.14775 shutdown 2024-05-20T17:05:12.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.009+0000 7f7f33d81740 1 -- 172.21.15.6:0/4258118172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02befe40 msgr2=0x560c02fe13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:12.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.009+0000 7f7f33d81740 1 --2- 172.21.15.6:0/4258118172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02befe40 0x560c02fe13f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c000c00 tx=0x7f7f1c001e50 comp rx=0 tx=0).stop 2024-05-20T17:05:12.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.009+0000 7f7f33d81740 1 -- 172.21.15.6:0/4258118172 shutdown_connections 2024-05-20T17:05:12.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.009+0000 7f7f33d81740 1 --2- 172.21.15.6:0/4258118172 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x560c02c31270 0x560c030590b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:12.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.009+0000 7f7f33d81740 1 --2- 172.21.15.6:0/4258118172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560c02c10590 0x560c02fe4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:12.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.009+0000 7f7f33d81740 1 --2- 172.21.15.6:0/4258118172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c02c083b0 0x560c02fe1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:12.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.009+0000 7f7f0dffb640 0 client.14775 ms_handle_reset on v2:172.21.15.62:6838/3023093487 2024-05-20T17:05:12.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.009+0000 7f7f33d81740 1 --2- 172.21.15.6:0/4258118172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c02befe40 0x560c02fe13f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:12.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.009+0000 7f7f33d81740 1 -- 172.21.15.6:0/4258118172 >> 172.21.15.6:0/4258118172 conn(0x560c02c253c0 msgr2=0x560c02fcc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:12.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.009+0000 7f7f33d81740 1 -- 172.21.15.6:0/4258118172 shutdown_connections 2024-05-20T17:05:12.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.009+0000 7f7f33d81740 1 -- 172.21.15.6:0/4258118172 wait complete. 2024-05-20T17:05:12.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.010+0000 7f7f33d81740 20 client.14775 trim_cache size 0 max 16384 2024-05-20T17:05:12.017 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:05:12.017 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c726c954-16c9-11ef-bc9a-c7b262605968", 2024-05-20T17:05:12.017 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-05-20T17:05:12.018 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24548, 2024-05-20T17:05:12.018 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T17:05:12.018 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T17:05:12.018 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T17:05:12.018 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 6.9323907489999996, 2024-05-20T17:05:12.018 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 17, 2024-05-20T17:05:12.018 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 90, 2024-05-20T17:05:12.018 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 90, 2024-05-20T17:05:12.018 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 13.168232056000001 2024-05-20T17:05:12.018 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:05:12.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.010+0000 7f7f2cee7640 1 -- 172.21.15.6:0/3712049733 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7f100a2c10 msgr2=0x7f7f100a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:12.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.010+0000 7f7f2cee7640 1 --2- 172.21.15.6:0/3712049733 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7f100a2c10 0x7f7f100a5120 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000d720 tx=0x7f7f20090730 comp rx=0 tx=0).stop 2024-05-20T17:05:12.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.010+0000 7f7f2cee7640 1 -- 172.21.15.6:0/3712049733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f281078c0 msgr2=0x7f7f281a0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:12.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.010+0000 7f7f2cee7640 1 --2- 172.21.15.6:0/3712049733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f281078c0 0x7f7f281a0660 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000d750 tx=0x7f7f2000dc10 comp rx=0 tx=0).stop 2024-05-20T17:05:12.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.010+0000 7f7f2cee7640 1 -- 172.21.15.6:0/3712049733 shutdown_connections 2024-05-20T17:05:12.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.010+0000 7f7f2cee7640 1 --2- 172.21.15.6:0/3712049733 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7f100a2c10 0x7f7f100a5120 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:12.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.010+0000 7f7f2cee7640 1 --2- 172.21.15.6:0/3712049733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f281078c0 0x7f7f281a0660 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:12.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.010+0000 7f7f2cee7640 1 --2- 172.21.15.6:0/3712049733 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f28102bc0 0x7f7f28199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:12.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.010+0000 7f7f2cee7640 1 --2- 172.21.15.6:0/3712049733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f28101980 0x7f7f28199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:12.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.010+0000 7f7f2cee7640 1 -- 172.21.15.6:0/3712049733 >> 172.21.15.6:0/3712049733 conn(0x7f7f280fcb70 msgr2=0x7f7f281038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:12.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.010+0000 7f7f2cee7640 1 -- 172.21.15.6:0/3712049733 shutdown_connections 2024-05-20T17:05:12.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:12.010+0000 7f7f2cee7640 1 -- 172.21.15.6:0/3712049733 wait complete. 2024-05-20T17:05:12.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:11 smithi062 ceph-mon[35425]: pgmap v304: 129 pgs: 1 creating+peering, 29 unknown, 99 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-05-20T17:05:12.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:11 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/963850735' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:12.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:11 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1745224866' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:12.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:11 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/891630899' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:05:12.023 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-20T17:05:12.023 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-20T17:05:12.024 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph fs ls 2024-05-20T17:05:12.274 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:05:12.778 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:12 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/778744246' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:12.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:12 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/778744246' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:13.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:12 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/778744246' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:13.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:13 smithi006 ceph-mon[32486]: pgmap v305: 129 pgs: 1 creating+peering, 10 unknown, 118 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 823 B/s wr, 2 op/s 2024-05-20T17:05:13.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:13 smithi171 ceph-mon[35901]: pgmap v305: 129 pgs: 1 creating+peering, 10 unknown, 118 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 823 B/s wr, 2 op/s 2024-05-20T17:05:14.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:13 smithi062 ceph-mon[35425]: pgmap v305: 129 pgs: 1 creating+peering, 10 unknown, 118 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 823 B/s wr, 2 op/s 2024-05-20T17:05:14.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.399+0000 7f35cdb79700 1 -- 172.21.15.6:0/2835783093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c8102340 msgr2=0x7f35c8102750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:14.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.399+0000 7f35cdb79700 1 --2- 172.21.15.6:0/2835783093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c8102340 0x7f35c8102750 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f35b80099c0 tx=0x7f35b8009cd0 comp rx=0 tx=0).stop 2024-05-20T17:05:14.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.399+0000 7f35cdb79700 1 -- 172.21.15.6:0/2835783093 shutdown_connections 2024-05-20T17:05:14.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.399+0000 7f35cdb79700 1 --2- 172.21.15.6:0/2835783093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c81075c0 0x7f35c810ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:14.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.399+0000 7f35cdb79700 1 --2- 172.21.15.6:0/2835783093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c8102340 0x7f35c8102750 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:14.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.399+0000 7f35cdb79700 1 --2- 172.21.15.6:0/2835783093 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35c8106c70 0x7f35c8107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:14.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.399+0000 7f35cdb79700 1 -- 172.21.15.6:0/2835783093 >> 172.21.15.6:0/2835783093 conn(0x7f35c80fdc40 msgr2=0x7f35c8100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:14.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.399+0000 7f35cdb79700 1 -- 172.21.15.6:0/2835783093 shutdown_connections 2024-05-20T17:05:14.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.399+0000 7f35cdb79700 1 -- 172.21.15.6:0/2835783093 wait complete. 2024-05-20T17:05:14.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.399+0000 7f35cdb79700 1 Processor -- start 2024-05-20T17:05:14.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.400+0000 7f35cdb79700 1 -- start start 2024-05-20T17:05:14.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.400+0000 7f35cdb79700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35c8102340 0x7f35c80fe120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:14.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.400+0000 7f35cdb79700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c8106c70 0x7f35c80fe660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:14.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.400+0000 7f35cdb79700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c81075c0 0x7f35c80feba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:14.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.400+0000 7f35cdb79700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f35c81121f0 con 0x7f35c8106c70 2024-05-20T17:05:14.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.400+0000 7f35cdb79700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f35c8112070 con 0x7f35c81075c0 2024-05-20T17:05:14.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.400+0000 7f35cdb79700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f35c8112370 con 0x7f35c8102340 2024-05-20T17:05:14.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.400+0000 7f35c6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c8106c70 0x7f35c80fe660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:14.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.400+0000 7f35c6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c8106c70 0x7f35c80fe660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40254/0 (socket says 172.21.15.6:40254) 2024-05-20T17:05:14.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.400+0000 7f35c6ffd700 1 -- 172.21.15.6:0/751263509 learned_addr learned my addr 172.21.15.6:0/751263509 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:14.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.400+0000 7f35c77fe700 1 --2- 172.21.15.6:0/751263509 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35c8102340 0x7f35c80fe120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.400+0000 7f35c7fff700 1 --2- 172.21.15.6:0/751263509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c81075c0 0x7f35c80feba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.401+0000 7f35c6ffd700 1 -- 172.21.15.6:0/751263509 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35c8102340 msgr2=0x7f35c80fe120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.401+0000 7f35c6ffd700 1 --2- 172.21.15.6:0/751263509 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35c8102340 0x7f35c80fe120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.401+0000 7f35c6ffd700 1 -- 172.21.15.6:0/751263509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c81075c0 msgr2=0x7f35c80feba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.401+0000 7f35c6ffd700 1 --2- 172.21.15.6:0/751263509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c81075c0 0x7f35c80feba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.401+0000 7f35c6ffd700 1 -- 172.21.15.6:0/751263509 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c81a8030 con 0x7f35c8106c70 2024-05-20T17:05:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.401+0000 7f35c6ffd700 1 --2- 172.21.15.6:0/751263509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c8106c70 0x7f35c80fe660 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00c8f0 tx=0x7f35bc00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.401+0000 7f35c4ff9700 1 -- 172.21.15.6:0/751263509 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc007940 con 0x7f35c8106c70 2024-05-20T17:05:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.401+0000 7f35c4ff9700 1 -- 172.21.15.6:0/751263509 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35bc00f450 con 0x7f35c8106c70 2024-05-20T17:05:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.401+0000 7f35cdb79700 1 -- 172.21.15.6:0/751263509 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c81a8320 con 0x7f35c8106c70 2024-05-20T17:05:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.401+0000 7f35c4ff9700 1 -- 172.21.15.6:0/751263509 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc018660 con 0x7f35c8106c70 2024-05-20T17:05:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.401+0000 7f35cdb79700 1 -- 172.21.15.6:0/751263509 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c81a8860 con 0x7f35c8106c70 2024-05-20T17:05:14.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.402+0000 7f35cdb79700 1 -- 172.21.15.6:0/751263509 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35c8050170 con 0x7f35c8106c70 2024-05-20T17:05:14.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.404+0000 7f35c4ff9700 1 -- 172.21.15.6:0/751263509 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f35bc007ae0 con 0x7f35c8106c70 2024-05-20T17:05:14.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.405+0000 7f35c4ff9700 1 --2- 172.21.15.6:0/751263509 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f35b00a2c20 0x7f35b00a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:14.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.405+0000 7f35c77fe700 1 --2- 172.21.15.6:0/751263509 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f35b00a2c20 0x7f35b00a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:14.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.405+0000 7f35c4ff9700 1 -- 172.21.15.6:0/751263509 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f35bc0cf260 con 0x7f35c8106c70 2024-05-20T17:05:14.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.405+0000 7f35c77fe700 1 --2- 172.21.15.6:0/751263509 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f35b00a2c20 0x7f35b00a5130 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f35b8000c00 tx=0x7f35b8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:14.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.409+0000 7f35c4ff9700 1 -- 172.21.15.6:0/751263509 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f35bc014030 con 0x7f35c8106c70 2024-05-20T17:05:14.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.665+0000 7f35cdb79700 1 -- 172.21.15.6:0/751263509 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f35c802dc60 con 0x7f35c8106c70 2024-05-20T17:05:14.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.665+0000 7f35c4ff9700 1 -- 172.21.15.6:0/751263509 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f35bc09bfb0 con 0x7f35c8106c70 2024-05-20T17:05:14.666 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-20T17:05:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.668+0000 7f35cdb79700 1 -- 172.21.15.6:0/751263509 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f35b00a2c20 msgr2=0x7f35b00a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.668+0000 7f35cdb79700 1 --2- 172.21.15.6:0/751263509 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f35b00a2c20 0x7f35b00a5130 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f35b8000c00 tx=0x7f35b8005fb0 comp rx=0 tx=0).stop 2024-05-20T17:05:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.668+0000 7f35cdb79700 1 -- 172.21.15.6:0/751263509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c8106c70 msgr2=0x7f35c80fe660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.668+0000 7f35cdb79700 1 --2- 172.21.15.6:0/751263509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c8106c70 0x7f35c80fe660 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00c8f0 tx=0x7f35bc00cc00 comp rx=0 tx=0).stop 2024-05-20T17:05:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.668+0000 7f35cdb79700 1 -- 172.21.15.6:0/751263509 shutdown_connections 2024-05-20T17:05:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.668+0000 7f35cdb79700 1 --2- 172.21.15.6:0/751263509 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f35b00a2c20 0x7f35b00a5130 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.668+0000 7f35cdb79700 1 --2- 172.21.15.6:0/751263509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c81075c0 0x7f35c80feba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.668+0000 7f35cdb79700 1 --2- 172.21.15.6:0/751263509 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35c8102340 0x7f35c80fe120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.668+0000 7f35cdb79700 1 --2- 172.21.15.6:0/751263509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c8106c70 0x7f35c80fe660 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.668+0000 7f35cdb79700 1 -- 172.21.15.6:0/751263509 >> 172.21.15.6:0/751263509 conn(0x7f35c80fdc40 msgr2=0x7f35c8105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.668+0000 7f35cdb79700 1 -- 172.21.15.6:0/751263509 shutdown_connections 2024-05-20T17:05:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:14.668+0000 7f35cdb79700 1 -- 172.21.15.6:0/751263509 wait complete. 2024-05-20T17:05:15.446 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T17:05:15.446 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T17:05:15.446 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-05-20T17:05:15.446 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-20T17:05:15.447 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-20T17:05:15.447 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T17:05:15.447 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-20T17:05:15.447 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T17:05:15.447 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-20T17:05:15.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:05:15.447 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-05-20T17:05:15.466 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:05:15.466 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:05:15.466 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:05:15.466 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:05:15.467 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-05-20T17:05:15.467 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:05:15.467 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:05:15.467 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:05:15.467 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-05-20T17:05:15.467 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:05:15.467 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:05:15.467 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-05-20T17:05:15.467 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T17:05:15.467 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:05:15.467 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-05-20T17:05:15.467 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-20T17:05:15.468 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42189sec preferred_lft 42189sec 2024-05-20T17:05:15.468 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link noprefixroute 2024-05-20T17:05:15.468 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:05:15.468 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:05:15.468 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:05:15.468 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-05-20T17:05:15.469 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-20T17:05:15.469 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:05:15.469 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:05:15.469 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2024-05-20T17:05:15.469 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2024-05-20T17:05:15.469 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2024-05-20T17:05:15.469 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-20T17:05:15.469 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:05:15.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:05:15.661 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:15 smithi006 ceph-mon[32486]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-05-20T17:05:15.662 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:15 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/751263509' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-20T17:05:15.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:05:15.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:05:15.683 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T17:05:15.710 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-05-20T17:05:15.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:05:15.711 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-05-20T17:05:15.785 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-05-20T17:05:15.785 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T17:05:15.785 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-20T17:05:15.786 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-20T17:05:15.786 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T17:05:15.786 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:05:15.786 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:05:15.786 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-20T17:05:15.786 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-20T17:05:15.786 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-20T17:05:15.786 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:05:15.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:15 smithi171 ceph-mon[35901]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-05-20T17:05:15.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:15 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/751263509' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-20T17:05:15.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:05:16.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:15 smithi062 ceph-mon[35425]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-05-20T17:05:16.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:15 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/751263509' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-20T17:05:16.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:05:16.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:05:16.066 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T17:05:16.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:05:16.082 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2024-05-20T17:05:16.138 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:05:16.139 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:05:16.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-20T17:05:16.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-20T17:05:16.139 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:05:16.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:05:16.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:05:16.260 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-20T17:05:16.260 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:05:16.260 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:05:16.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-20T17:05:16.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-20T17:05:16.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-20T17:05:16.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-20T17:05:16.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-20T17:05:16.261 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:05:16.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:05:16.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:05:16.394 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:05:16.394 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:05:16.395 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-05-20T17:05:16.395 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2024-05-20T17:05:16.395 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:05:16.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:05:16.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:05:16.474 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-20T17:05:16.474 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:05:16.475 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-20T17:05:16.490 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-20T17:05:16.490 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:05:16.490 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-20T17:05:16.546 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-05-20T17:05:16.613 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-05-20T17:05:16.670 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-05-20T17:05:16.670 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-05-20T17:05:16.670 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-05-20T17:05:16.670 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-05-20T17:05:16.670 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-05-20T17:05:16.670 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-05-20T17:05:16.670 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-05-20T17:05:16.670 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-05-20T17:05:16.671 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-05-20T17:05:16.671 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-05-20T17:05:16.671 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-05-20T17:05:16.671 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-05-20T17:05:16.671 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-20T17:05:16.671 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-05-20T17:05:16.671 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-05-20T17:05:16.671 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-05-20T17:05:16.671 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-05-20T17:05:16.671 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-20T17:05:16.671 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-05-20T17:05:16.671 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-05-20T17:05:16.671 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-05-20T17:05:16.672 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-20T17:05:16.672 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-05-20T17:05:16.673 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-05-20T17:05:16.673 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-05-20T17:05:16.673 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay 2024-05-20T17:05:16.673 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/32f03f88c96e7887135ea74e814046280b29fb0cc3583d4ece450916f219076a/merged 2024-05-20T17:05:16.673 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/49c2dd137ecfc953826d652db0a09c838873f42137a2e0a4a0009507683b40cf/merged 2024-05-20T17:05:16.673 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/0 2024-05-20T17:05:16.673 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-20T17:05:16.673 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/6fca35794a9b08fc390d4b4ae84ed83ce0b4406b5effc29a0c402882c2b8d41c/merged 2024-05-20T17:05:16.674 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/8a28c64f6a68a1db76a504dca11c94bb0ca496092db4ef1dbf9c88175ff3fb88/merged 2024-05-20T17:05:16.674 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/5186fe97cd2bdd234edb4876a1a987bcecdf2bc257533922ec6ff80118a7f418/merged 2024-05-20T17:05:16.674 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/26ef61cbcca17a005bed75e09586da508b359627d5a422c0301ceef172b620c0/merged 2024-05-20T17:05:16.674 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/67fc8e1a13e778e97f5336a63a0f434b22d4fd770209f325c6baaafa50ba0c50/merged 2024-05-20T17:05:16.674 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/b586cdd5df2370b8c5089033b8cadeed0396bc2117e2abe2e7b606b467c48328/merged 2024-05-20T17:05:16.674 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/fbc005a16374e329e6f223c6f8139dafa17f5c205281f2550d37e6d8dbdf9628/merged 2024-05-20T17:05:16.674 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/6679033fd5a613663917a094ad5970582eff45f011a84332d0b250886e0a53b9/merged 2024-05-20T17:05:16.674 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-05-20T17:05:16.674 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-20T17:05:16.674 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-20T17:05:16.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:05:16.675 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-05-20T17:05:16.726 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-20T17:05:16.726 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-20T17:05:16.768 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-05-20T17:05:16.794 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-05-20T17:05:16.850 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-05-20T17:05:16.851 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-05-20T17:05:16.851 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-05-20T17:05:16.851 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-05-20T17:05:16.851 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-05-20T17:05:16.851 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-05-20T17:05:16.851 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-05-20T17:05:16.851 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-05-20T17:05:16.851 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-05-20T17:05:16.851 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-05-20T17:05:16.851 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-05-20T17:05:16.851 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-05-20T17:05:16.851 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-20T17:05:16.852 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-05-20T17:05:16.852 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-05-20T17:05:16.852 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-05-20T17:05:16.852 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-05-20T17:05:16.852 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-20T17:05:16.852 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-05-20T17:05:16.852 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-05-20T17:05:16.852 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-05-20T17:05:16.852 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-20T17:05:16.852 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-05-20T17:05:16.852 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-05-20T17:05:16.852 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-05-20T17:05:16.852 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay 2024-05-20T17:05:16.852 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/32f03f88c96e7887135ea74e814046280b29fb0cc3583d4ece450916f219076a/merged 2024-05-20T17:05:16.853 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/49c2dd137ecfc953826d652db0a09c838873f42137a2e0a4a0009507683b40cf/merged 2024-05-20T17:05:16.853 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/0 2024-05-20T17:05:16.853 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-20T17:05:16.853 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/6fca35794a9b08fc390d4b4ae84ed83ce0b4406b5effc29a0c402882c2b8d41c/merged 2024-05-20T17:05:16.853 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/8a28c64f6a68a1db76a504dca11c94bb0ca496092db4ef1dbf9c88175ff3fb88/merged 2024-05-20T17:05:16.853 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/5186fe97cd2bdd234edb4876a1a987bcecdf2bc257533922ec6ff80118a7f418/merged 2024-05-20T17:05:16.853 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/26ef61cbcca17a005bed75e09586da508b359627d5a422c0301ceef172b620c0/merged 2024-05-20T17:05:16.853 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/67fc8e1a13e778e97f5336a63a0f434b22d4fd770209f325c6baaafa50ba0c50/merged 2024-05-20T17:05:16.853 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/b586cdd5df2370b8c5089033b8cadeed0396bc2117e2abe2e7b606b467c48328/merged 2024-05-20T17:05:16.853 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/fbc005a16374e329e6f223c6f8139dafa17f5c205281f2550d37e6d8dbdf9628/merged 2024-05-20T17:05:16.853 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/6679033fd5a613663917a094ad5970582eff45f011a84332d0b250886e0a53b9/merged 2024-05-20T17:05:16.853 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-05-20T17:05:16.853 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-20T17:05:16.854 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-20T17:05:16.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:05:16.854 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-05-20T17:05:16.904 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:2024-05-20T17:05:16.903+0000 7fd514a0d480 -1 init, newargv = 0x7fd5040046a0 newargc=15 2024-05-20T17:05:16.904 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:ceph-fuse[76047]: starting ceph client 2024-05-20T17:05:16.911 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:ceph-fuse[76047]: starting fuse 2024-05-20T17:05:17.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:17 smithi171 ceph-mon[35901]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 385 B/s wr, 0 op/s 2024-05-20T17:05:17.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:17 smithi006 ceph-mon[32486]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 385 B/s wr, 0 op/s 2024-05-20T17:05:18.009 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-05-20T17:05:18.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:17 smithi062 ceph-mon[35425]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 385 B/s wr, 0 op/s 2024-05-20T17:05:18.043 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-05-20T17:05:18.102 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-05-20T17:05:18.102 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-05-20T17:05:18.102 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-05-20T17:05:18.103 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-05-20T17:05:18.103 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-05-20T17:05:18.103 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-05-20T17:05:18.103 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-05-20T17:05:18.103 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-05-20T17:05:18.103 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-05-20T17:05:18.103 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-05-20T17:05:18.103 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-05-20T17:05:18.103 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-05-20T17:05:18.103 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-20T17:05:18.103 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-05-20T17:05:18.103 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-05-20T17:05:18.103 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-05-20T17:05:18.104 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-05-20T17:05:18.104 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-20T17:05:18.104 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-05-20T17:05:18.104 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-05-20T17:05:18.104 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-05-20T17:05:18.104 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-20T17:05:18.104 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-05-20T17:05:18.104 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-05-20T17:05:18.104 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-05-20T17:05:18.104 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay 2024-05-20T17:05:18.104 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/32f03f88c96e7887135ea74e814046280b29fb0cc3583d4ece450916f219076a/merged 2024-05-20T17:05:18.104 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/49c2dd137ecfc953826d652db0a09c838873f42137a2e0a4a0009507683b40cf/merged 2024-05-20T17:05:18.104 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/0 2024-05-20T17:05:18.104 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-20T17:05:18.105 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/6fca35794a9b08fc390d4b4ae84ed83ce0b4406b5effc29a0c402882c2b8d41c/merged 2024-05-20T17:05:18.105 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/8a28c64f6a68a1db76a504dca11c94bb0ca496092db4ef1dbf9c88175ff3fb88/merged 2024-05-20T17:05:18.105 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/5186fe97cd2bdd234edb4876a1a987bcecdf2bc257533922ec6ff80118a7f418/merged 2024-05-20T17:05:18.105 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/26ef61cbcca17a005bed75e09586da508b359627d5a422c0301ceef172b620c0/merged 2024-05-20T17:05:18.105 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/67fc8e1a13e778e97f5336a63a0f434b22d4fd770209f325c6baaafa50ba0c50/merged 2024-05-20T17:05:18.105 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/b586cdd5df2370b8c5089033b8cadeed0396bc2117e2abe2e7b606b467c48328/merged 2024-05-20T17:05:18.105 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/fbc005a16374e329e6f223c6f8139dafa17f5c205281f2550d37e6d8dbdf9628/merged 2024-05-20T17:05:18.105 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/6679033fd5a613663917a094ad5970582eff45f011a84332d0b250886e0a53b9/merged 2024-05-20T17:05:18.105 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-05-20T17:05:18.105 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-20T17:05:18.105 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-20T17:05:18.105 INFO:teuthology.orchestra.run.smithi006.stdout:/home/ubuntu/cephtest/mnt.admin 2024-05-20T17:05:18.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:05:18.106 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-05-20T17:05:18.161 INFO:teuthology.orchestra.run.smithi006.stdout:119 2024-05-20T17:05:18.161 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [119] 2024-05-20T17:05:18.162 DEBUG:teuthology.orchestra.run.smithi006:> sudo stdin-killer -- python3 -c ' 2024-05-20T17:05:18.162 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2024-05-20T17:05:18.162 DEBUG:teuthology.orchestra.run.smithi006:> import re 2024-05-20T17:05:18.162 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-05-20T17:05:18.162 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2024-05-20T17:05:18.162 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:05:18.162 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2024-05-20T17:05:18.162 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-20T17:05:18.162 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2024-05-20T17:05:18.162 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-20T17:05:18.162 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:05:18.162 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2024-05-20T17:05:18.163 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2024-05-20T17:05:18.163 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2024-05-20T17:05:18.163 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2024-05-20T17:05:18.163 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:05:18.163 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2024-05-20T17:05:18.163 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-20T17:05:18.163 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-20T17:05:18.163 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-20T17:05:18.163 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2024-05-20T17:05:18.163 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2024-05-20T17:05:18.163 DEBUG:teuthology.orchestra.run.smithi006:> return f 2024-05-20T17:05:18.163 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-20T17:05:18.163 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:05:18.163 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.admin")) 2024-05-20T17:05:18.163 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-05-20T17:05:18.290 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.admin.76047.asok 2024-05-20T17:05:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:05:18.302 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.76047.asok 2024-05-20T17:05:18.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:05:18.302 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.76047.asok status 2024-05-20T17:05:18.452 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:05:18.453 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2024-05-20T17:05:18.453 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "d2b507c724ef6c8295ee0a35d185cdab167fd61d", 2024-05-20T17:05:18.453 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 19.0.0-2744-gd2b507c7 (d2b507c724ef6c8295ee0a35d185cdab167fd61d) squid (dev)", 2024-05-20T17:05:18.453 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "admin", 2024-05-20T17:05:18.453 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2024-05-20T17:05:18.453 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-20T17:05:18.453 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "76047", 2024-05-20T17:05:18.453 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2024-05-20T17:05:18.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:05:18.453 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2024-05-20T17:05:18.454 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2024-05-20T17:05:18.454 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 14787, 2024-05-20T17:05:18.454 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2024-05-20T17:05:18.454 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2024-05-20T17:05:18.454 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:05:18.454 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 14787 2024-05-20T17:05:18.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:05:18.454 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-05-20T17:05:18.454 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-05-20T17:05:18.454 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-05-20T17:05:18.454 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 388166072 2024-05-20T17:05:18.454 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:05:18.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:05:18.455 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-05-20T17:05:18.455 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-05-20T17:05:18.455 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-05-20T17:05:18.455 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 388166072 2024-05-20T17:05:18.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:05:18.455 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.14787 192.168.0.1:0/388166072", 2024-05-20T17:05:18.455 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/388166072", 2024-05-20T17:05:18.455 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2024-05-20T17:05:18.455 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 17, 2024-05-20T17:05:18.455 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 90, 2024-05-20T17:05:18.455 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2024-05-20T17:05:18.455 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2024-05-20T17:05:18.455 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2024-05-20T17:05:18.456 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:05:18.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:05:18.461 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2024-05-20T17:05:18.462 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-20T17:05:18.478 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2024-05-20T17:05:18.478 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-20T17:05:18.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:05:18.479 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-20T17:05:18.546 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-20T17:05:18.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:05:18.658 INFO:teuthology.orchestra.run.smithi006.stdout:# file: . 2024-05-20T17:05:18.658 INFO:teuthology.orchestra.run.smithi006.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-20T17:05:18.659 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:05:18.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:05:18.665 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:05:18.665 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:05:18.683 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:05:18.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.837+0000 7f45fa6b6640 1 -- 172.21.15.6:0/85830300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45f41078f0 msgr2=0x7f45f4109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:18.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.837+0000 7f45fa6b6640 1 --2- 172.21.15.6:0/85830300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45f41078f0 0x7f45f4109d10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009ca0 tx=0x7f45ec02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:05:18.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.838+0000 7f45fa6b6640 1 -- 172.21.15.6:0/85830300 shutdown_connections 2024-05-20T17:05:18.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.838+0000 7f45fa6b6640 1 --2- 172.21.15.6:0/85830300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45f41078f0 0x7f45f4109d10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:18.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.838+0000 7f45fa6b6640 1 --2- 172.21.15.6:0/85830300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45f4102bf0 0x7f45f4103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:18.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.838+0000 7f45fa6b6640 1 --2- 172.21.15.6:0/85830300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f41019b0 0x7f45f41026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:18.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.838+0000 7f45fa6b6640 1 -- 172.21.15.6:0/85830300 >> 172.21.15.6:0/85830300 conn(0x7f45f40fcba0 msgr2=0x7f45f40ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:18.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.838+0000 7f45fa6b6640 1 -- 172.21.15.6:0/85830300 shutdown_connections 2024-05-20T17:05:18.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.838+0000 7f45fa6b6640 1 -- 172.21.15.6:0/85830300 wait complete. 2024-05-20T17:05:18.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.838+0000 7f45fa6b6640 1 Processor -- start 2024-05-20T17:05:18.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.838+0000 7f45fa6b6640 1 -- start start 2024-05-20T17:05:18.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.839+0000 7f45fa6b6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45f41019b0 0x7f45f40747f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:18.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.839+0000 7f45fa6b6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f4102bf0 0x7f45f419de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:18.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.839+0000 7f45fa6b6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45f41078f0 0x7f45f41a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:18.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.839+0000 7f45fa6b6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f45f410d4e0 con 0x7f45f41078f0 2024-05-20T17:05:18.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.839+0000 7f45fa6b6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f45f410d360 con 0x7f45f4102bf0 2024-05-20T17:05:18.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.839+0000 7f45fa6b6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f45f410d660 con 0x7f45f41019b0 2024-05-20T17:05:18.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.839+0000 7f45f8c53640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45f41078f0 0x7f45f41a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:18.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.839+0000 7f45f8c53640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45f41078f0 0x7f45f41a0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40274/0 (socket says 172.21.15.6:40274) 2024-05-20T17:05:18.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.839+0000 7f45f8c53640 1 -- 172.21.15.6:0/2044328050 learned_addr learned my addr 172.21.15.6:0/2044328050 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:18.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.839+0000 7f45f37fe640 1 --2- 172.21.15.6:0/2044328050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f4102bf0 0x7f45f419de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:18.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.839+0000 7f45f3fff640 1 --2- 172.21.15.6:0/2044328050 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45f41019b0 0x7f45f40747f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:18.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.839+0000 7f45f8c53640 1 -- 172.21.15.6:0/2044328050 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45f41019b0 msgr2=0x7f45f40747f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:18.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.839+0000 7f45f8c53640 1 --2- 172.21.15.6:0/2044328050 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45f41019b0 0x7f45f40747f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:18.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.839+0000 7f45f8c53640 1 -- 172.21.15.6:0/2044328050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f4102bf0 msgr2=0x7f45f419de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:18.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.839+0000 7f45f8c53640 1 --2- 172.21.15.6:0/2044328050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f4102bf0 0x7f45f419de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:18.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.839+0000 7f45f8c53640 1 -- 172.21.15.6:0/2044328050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f41a0bb0 con 0x7f45f41078f0 2024-05-20T17:05:18.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.839+0000 7f45f8c53640 1 --2- 172.21.15.6:0/2044328050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45f41078f0 0x7f45f41a0390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009dc0 tx=0x7f45ec009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:18.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.840+0000 7f45f17fa640 1 -- 172.21.15.6:0/2044328050 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec003cb0 con 0x7f45f41078f0 2024-05-20T17:05:18.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.840+0000 7f45f17fa640 1 -- 172.21.15.6:0/2044328050 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f45ec003e50 con 0x7f45f41078f0 2024-05-20T17:05:18.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.840+0000 7f45f17fa640 1 -- 172.21.15.6:0/2044328050 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec030a80 con 0x7f45f41078f0 2024-05-20T17:05:18.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.840+0000 7f45fa6b6640 1 -- 172.21.15.6:0/2044328050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f41a0e40 con 0x7f45f41078f0 2024-05-20T17:05:18.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.840+0000 7f45fa6b6640 1 -- 172.21.15.6:0/2044328050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f41a1300 con 0x7f45f41078f0 2024-05-20T17:05:18.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.841+0000 7f45fa6b6640 1 -- 172.21.15.6:0/2044328050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f4106700 con 0x7f45f41078f0 2024-05-20T17:05:18.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.843+0000 7f45f17fa640 1 -- 172.21.15.6:0/2044328050 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f45ec004680 con 0x7f45f41078f0 2024-05-20T17:05:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.844+0000 7f45f17fa640 1 --2- 172.21.15.6:0/2044328050 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f45dc0a2cb0 0x7f45dc0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.844+0000 7f45f3fff640 1 --2- 172.21.15.6:0/2044328050 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f45dc0a2cb0 0x7f45dc0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.844+0000 7f45f17fa640 1 -- 172.21.15.6:0/2044328050 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f45ec0f08c0 con 0x7f45f41078f0 2024-05-20T17:05:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.844+0000 7f45f3fff640 1 --2- 172.21.15.6:0/2044328050 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f45dc0a2cb0 0x7f45dc0a51c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f45f41025b0 tx=0x7f45e4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:18.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:18.848+0000 7f45f17fa640 1 -- 172.21.15.6:0/2044328050 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f45ec0bd580 con 0x7f45f41078f0 2024-05-20T17:05:19.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.035+0000 7f45fa6b6640 1 -- 172.21.15.6:0/2044328050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45f402d470 con 0x7f45f41078f0 2024-05-20T17:05:19.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.036+0000 7f45f17fa640 1 -- 172.21.15.6:0/2044328050 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+23973 (secure 0 0 0) 0x7f45ec0bce80 con 0x7f45f41078f0 2024-05-20T17:05:19.037 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:05:19.037 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":90,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:05:09.495505+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:05:02.947896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:05:03.842231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:05:07.551471+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:05:19.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.039+0000 7f45fa6b6640 1 -- 172.21.15.6:0/2044328050 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f45dc0a2cb0 msgr2=0x7f45dc0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:19.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.039+0000 7f45fa6b6640 1 --2- 172.21.15.6:0/2044328050 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f45dc0a2cb0 0x7f45dc0a51c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f45f41025b0 tx=0x7f45e4005f90 comp rx=0 tx=0).stop 2024-05-20T17:05:19.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.039+0000 7f45fa6b6640 1 -- 172.21.15.6:0/2044328050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45f41078f0 msgr2=0x7f45f41a0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:19.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.039+0000 7f45fa6b6640 1 --2- 172.21.15.6:0/2044328050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45f41078f0 0x7f45f41a0390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009dc0 tx=0x7f45ec009800 comp rx=0 tx=0).stop 2024-05-20T17:05:19.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.039+0000 7f45fa6b6640 1 -- 172.21.15.6:0/2044328050 shutdown_connections 2024-05-20T17:05:19.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.039+0000 7f45fa6b6640 1 --2- 172.21.15.6:0/2044328050 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f45dc0a2cb0 0x7f45dc0a51c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.039+0000 7f45fa6b6640 1 --2- 172.21.15.6:0/2044328050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45f41078f0 0x7f45f41a0390 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.039+0000 7f45fa6b6640 1 --2- 172.21.15.6:0/2044328050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45f4102bf0 0x7f45f419de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.039+0000 7f45fa6b6640 1 --2- 172.21.15.6:0/2044328050 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45f41019b0 0x7f45f40747f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.039+0000 7f45fa6b6640 1 -- 172.21.15.6:0/2044328050 >> 172.21.15.6:0/2044328050 conn(0x7f45f40fcba0 msgr2=0x7f45f41038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:19.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.039+0000 7f45fa6b6640 1 -- 172.21.15.6:0/2044328050 shutdown_connections 2024-05-20T17:05:19.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.039+0000 7f45fa6b6640 1 -- 172.21.15.6:0/2044328050 wait complete. 2024-05-20T17:05:19.051 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:00:12.516679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:05:02.947896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:05:03.842231+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:05:07.551471+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:05:19.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:05:19.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.169+0000 7f70e47e3640 1 -- 172.21.15.6:0/2476340935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70dc108a20 msgr2=0x7f70dc10ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:19.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.169+0000 7f70e47e3640 1 --2- 172.21.15.6:0/2476340935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70dc108a20 0x7f70dc10ae40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009ca0 tx=0x7f70d402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.169+0000 7f70e47e3640 1 -- 172.21.15.6:0/2476340935 shutdown_connections 2024-05-20T17:05:19.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.169+0000 7f70e47e3640 1 --2- 172.21.15.6:0/2476340935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70dc108a20 0x7f70dc10ae40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.169+0000 7f70e47e3640 1 --2- 172.21.15.6:0/2476340935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f70dc103d20 0x7f70dc104130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.169+0000 7f70e47e3640 1 --2- 172.21.15.6:0/2476340935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70dc102ae0 0x7f70dc1037e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.169+0000 7f70e47e3640 1 -- 172.21.15.6:0/2476340935 >> 172.21.15.6:0/2476340935 conn(0x7f70dc0fdcf0 msgr2=0x7f70dc100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.169+0000 7f70e47e3640 1 -- 172.21.15.6:0/2476340935 shutdown_connections 2024-05-20T17:05:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.169+0000 7f70e47e3640 1 -- 172.21.15.6:0/2476340935 wait complete. 2024-05-20T17:05:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.169+0000 7f70e47e3640 1 Processor -- start 2024-05-20T17:05:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.169+0000 7f70e47e3640 1 -- start start 2024-05-20T17:05:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.170+0000 7f70e47e3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70dc102ae0 0x7f70dc199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.170+0000 7f70e47e3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70dc103d20 0x7f70dc199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.170+0000 7f70e47e3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f70dc108a20 0x7f70dc1a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.170+0000 7f70e47e3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f70dc10e610 con 0x7f70dc103d20 2024-05-20T17:05:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.170+0000 7f70e47e3640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f70dc10e490 con 0x7f70dc102ae0 2024-05-20T17:05:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.170+0000 7f70e47e3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f70dc10e790 con 0x7f70dc108a20 2024-05-20T17:05:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.170+0000 7f70e1d7e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70dc103d20 0x7f70dc199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.170+0000 7f70e1d7e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70dc103d20 0x7f70dc199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40284/0 (socket says 172.21.15.6:40284) 2024-05-20T17:05:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.170+0000 7f70e1d7e640 1 -- 172.21.15.6:0/3841008304 learned_addr learned my addr 172.21.15.6:0/3841008304 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.170+0000 7f70e257f640 1 --2- 172.21.15.6:0/3841008304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70dc102ae0 0x7f70dc199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.170+0000 7f70e2d80640 1 --2- 172.21.15.6:0/3841008304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f70dc108a20 0x7f70dc1a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.170+0000 7f70e1d7e640 1 -- 172.21.15.6:0/3841008304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f70dc108a20 msgr2=0x7f70dc1a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.170+0000 7f70e1d7e640 1 --2- 172.21.15.6:0/3841008304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f70dc108a20 0x7f70dc1a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.170+0000 7f70e1d7e640 1 -- 172.21.15.6:0/3841008304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70dc102ae0 msgr2=0x7f70dc199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.170+0000 7f70e1d7e640 1 --2- 172.21.15.6:0/3841008304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70dc102ae0 0x7f70dc199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.170+0000 7f70e1d7e640 1 -- 172.21.15.6:0/3841008304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70dc1a0c90 con 0x7f70dc103d20 2024-05-20T17:05:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.170+0000 7f70e1d7e640 1 --2- 172.21.15.6:0/3841008304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70dc103d20 0x7f70dc199690 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f70cc00e9f0 tx=0x7f70cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:19.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.170+0000 7f70d37fe640 1 -- 172.21.15.6:0/3841008304 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70cc00cd80 con 0x7f70dc103d20 2024-05-20T17:05:19.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.171+0000 7f70d37fe640 1 -- 172.21.15.6:0/3841008304 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f70cc0054d0 con 0x7f70dc103d20 2024-05-20T17:05:19.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.171+0000 7f70e47e3640 1 -- 172.21.15.6:0/3841008304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70dc1a0f80 con 0x7f70dc103d20 2024-05-20T17:05:19.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.171+0000 7f70d37fe640 1 -- 172.21.15.6:0/3841008304 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70cc010490 con 0x7f70dc103d20 2024-05-20T17:05:19.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.171+0000 7f70e47e3640 1 -- 172.21.15.6:0/3841008304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70dc1a13f0 con 0x7f70dc103d20 2024-05-20T17:05:19.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.172+0000 7f70e47e3640 1 -- 172.21.15.6:0/3841008304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70dc107830 con 0x7f70dc103d20 2024-05-20T17:05:19.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.173+0000 7f70d37fe640 1 -- 172.21.15.6:0/3841008304 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f70cc005000 con 0x7f70dc103d20 2024-05-20T17:05:19.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.173+0000 7f70d37fe640 1 --2- 172.21.15.6:0/3841008304 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f70c80a2c10 0x7f70c80a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:19.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.174+0000 7f70d37fe640 1 -- 172.21.15.6:0/3841008304 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f70cc0cf850 con 0x7f70dc103d20 2024-05-20T17:05:19.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.174+0000 7f70e257f640 1 --2- 172.21.15.6:0/3841008304 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f70c80a2c10 0x7f70c80a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:19.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.174+0000 7f70e257f640 1 --2- 172.21.15.6:0/3841008304 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f70c80a2c10 0x7f70c80a5120 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f70dc1036e0 tx=0x7f70d800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:19.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.177+0000 7f70d37fe640 1 -- 172.21.15.6:0/3841008304 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f70cc053850 con 0x7f70dc103d20 2024-05-20T17:05:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.360+0000 7f70e47e3640 1 -- 172.21.15.6:0/3841008304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f70dc02d4f0 con 0x7f70dc103d20 2024-05-20T17:05:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.360+0000 7f70d37fe640 1 -- 172.21.15.6:0/3841008304 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f70cc0052f0 con 0x7f70dc103d20 2024-05-20T17:05:19.361 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:05:19.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.362+0000 7f70e47e3640 1 -- 172.21.15.6:0/3841008304 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f70c80a2c10 msgr2=0x7f70c80a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:19.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.362+0000 7f70e47e3640 1 --2- 172.21.15.6:0/3841008304 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f70c80a2c10 0x7f70c80a5120 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f70dc1036e0 tx=0x7f70d800b390 comp rx=0 tx=0).stop 2024-05-20T17:05:19.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.362+0000 7f70e47e3640 1 -- 172.21.15.6:0/3841008304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70dc103d20 msgr2=0x7f70dc199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:19.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.362+0000 7f70e47e3640 1 --2- 172.21.15.6:0/3841008304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70dc103d20 0x7f70dc199690 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f70cc00e9f0 tx=0x7f70cc00edf0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.362+0000 7f70e47e3640 1 -- 172.21.15.6:0/3841008304 shutdown_connections 2024-05-20T17:05:19.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.362+0000 7f70e47e3640 1 --2- 172.21.15.6:0/3841008304 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f70c80a2c10 0x7f70c80a5120 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.362+0000 7f70e47e3640 1 --2- 172.21.15.6:0/3841008304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f70dc108a20 0x7f70dc1a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.362+0000 7f70e47e3640 1 --2- 172.21.15.6:0/3841008304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70dc103d20 0x7f70dc199690 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.362+0000 7f70e47e3640 1 --2- 172.21.15.6:0/3841008304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70dc102ae0 0x7f70dc199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.362+0000 7f70e47e3640 1 -- 172.21.15.6:0/3841008304 >> 172.21.15.6:0/3841008304 conn(0x7f70dc0fdcf0 msgr2=0x7f70dc104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:19.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.363+0000 7f70e47e3640 1 -- 172.21.15.6:0/3841008304 shutdown_connections 2024-05-20T17:05:19.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.363+0000 7f70e47e3640 1 -- 172.21.15.6:0/3841008304 wait complete. 2024-05-20T17:05:19.374 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:05:19.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.491+0000 7f074cb7e640 1 -- 172.21.15.6:0/4141494132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0748100de0 msgr2=0x7f07481011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:19.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.491+0000 7f074cb7e640 1 --2- 172.21.15.6:0/4141494132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0748100de0 0x7f07481011f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0738009900 tx=0x7f073802a410 comp rx=0 tx=0).stop 2024-05-20T17:05:19.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.492+0000 7f074cb7e640 1 -- 172.21.15.6:0/4141494132 shutdown_connections 2024-05-20T17:05:19.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.492+0000 7f074cb7e640 1 --2- 172.21.15.6:0/4141494132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0748108730 0x7f074810ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.492+0000 7f074cb7e640 1 --2- 172.21.15.6:0/4141494132 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0748105bc0 0x7f07481080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.492+0000 7f074cb7e640 1 --2- 172.21.15.6:0/4141494132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0748100de0 0x7f07481011f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.492+0000 7f074cb7e640 1 -- 172.21.15.6:0/4141494132 >> 172.21.15.6:0/4141494132 conn(0x7f07480fc330 msgr2=0x7f07480fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:19.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.492+0000 7f074cb7e640 1 -- 172.21.15.6:0/4141494132 shutdown_connections 2024-05-20T17:05:19.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.492+0000 7f074cb7e640 1 -- 172.21.15.6:0/4141494132 wait complete. 2024-05-20T17:05:19.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.492+0000 7f074cb7e640 1 Processor -- start 2024-05-20T17:05:19.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.492+0000 7f074cb7e640 1 -- start start 2024-05-20T17:05:19.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.493+0000 7f074cb7e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0748100de0 0x7f07481991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:19.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.493+0000 7f074cb7e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0748105bc0 0x7f07481996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:19.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.493+0000 7f074cb7e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0748108730 0x7f07481a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:19.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.493+0000 7f074cb7e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f074810e570 con 0x7f0748100de0 2024-05-20T17:05:19.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.493+0000 7f074cb7e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f074810e3f0 con 0x7f0748108730 2024-05-20T17:05:19.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.493+0000 7f074cb7e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f074810e6f0 con 0x7f0748105bc0 2024-05-20T17:05:19.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.493+0000 7f074659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0748100de0 0x7f07481991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:19.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.493+0000 7f074659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0748100de0 0x7f07481991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40296/0 (socket says 172.21.15.6:40296) 2024-05-20T17:05:19.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.493+0000 7f074659c640 1 -- 172.21.15.6:0/1480608837 learned_addr learned my addr 172.21.15.6:0/1480608837 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:19.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.493+0000 7f0746d9d640 1 --2- 172.21.15.6:0/1480608837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0748108730 0x7f07481a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:19.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.493+0000 7f0745d9b640 1 --2- 172.21.15.6:0/1480608837 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0748105bc0 0x7f07481996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:19.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.493+0000 7f074659c640 1 -- 172.21.15.6:0/1480608837 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0748105bc0 msgr2=0x7f07481996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:19.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.493+0000 7f074659c640 1 --2- 172.21.15.6:0/1480608837 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0748105bc0 0x7f07481996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.493+0000 7f074659c640 1 -- 172.21.15.6:0/1480608837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0748108730 msgr2=0x7f07481a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:19.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.493+0000 7f074659c640 1 --2- 172.21.15.6:0/1480608837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0748108730 0x7f07481a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.493+0000 7f074659c640 1 -- 172.21.15.6:0/1480608837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07481a0ce0 con 0x7f0748100de0 2024-05-20T17:05:19.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.493+0000 7f0745d9b640 1 --2- 172.21.15.6:0/1480608837 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0748105bc0 0x7f07481996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:05:19.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.493+0000 7f0746d9d640 1 --2- 172.21.15.6:0/1480608837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0748108730 0x7f07481a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:05:19.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.493+0000 7f074659c640 1 --2- 172.21.15.6:0/1480608837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0748100de0 0x7f07481991a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f07380314e0 tx=0x7f0738031a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:19.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.494+0000 7f07377fe640 1 -- 172.21.15.6:0/1480608837 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073803f030 con 0x7f0748100de0 2024-05-20T17:05:19.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.494+0000 7f07377fe640 1 -- 172.21.15.6:0/1480608837 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0738003aa0 con 0x7f0748100de0 2024-05-20T17:05:19.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.494+0000 7f07377fe640 1 -- 172.21.15.6:0/1480608837 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738035070 con 0x7f0748100de0 2024-05-20T17:05:19.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.494+0000 7f074cb7e640 1 -- 172.21.15.6:0/1480608837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07481a0f70 con 0x7f0748100de0 2024-05-20T17:05:19.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.494+0000 7f074cb7e640 1 -- 172.21.15.6:0/1480608837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07481a13d0 con 0x7f0748100de0 2024-05-20T17:05:19.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.495+0000 7f074cb7e640 1 -- 172.21.15.6:0/1480608837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07480fde50 con 0x7f0748100de0 2024-05-20T17:05:19.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.496+0000 7f07377fe640 1 -- 172.21.15.6:0/1480608837 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f0738042030 con 0x7f0748100de0 2024-05-20T17:05:19.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.497+0000 7f07377fe640 1 --2- 172.21.15.6:0/1480608837 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f07300a2c10 0x7f07300a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:19.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.497+0000 7f0745d9b640 1 --2- 172.21.15.6:0/1480608837 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f07300a2c10 0x7f07300a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:19.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.497+0000 7f07377fe640 1 -- 172.21.15.6:0/1480608837 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f07380efc40 con 0x7f0748100de0 2024-05-20T17:05:19.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.497+0000 7f0745d9b640 1 --2- 172.21.15.6:0/1480608837 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f07300a2c10 0x7f07300a5120 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f073c005d00 tx=0x7f073c005ef0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:19.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.500+0000 7f07377fe640 1 -- 172.21.15.6:0/1480608837 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f07380bc960 con 0x7f0748100de0 2024-05-20T17:05:19.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:19 smithi006 ceph-mon[32486]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:05:19.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:19 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2044328050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:19.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:19 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3841008304' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:05:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.686+0000 7f074cb7e640 1 -- 172.21.15.6:0/1480608837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f074802d430 con 0x7f0748100de0 2024-05-20T17:05:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.686+0000 7f07377fe640 1 -- 172.21.15.6:0/1480608837 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7f07380bc260 con 0x7f0748100de0 2024-05-20T17:05:19.687 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:05:19.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.688+0000 7f074cb7e640 1 -- 172.21.15.6:0/1480608837 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f07300a2c10 msgr2=0x7f07300a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:19.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.688+0000 7f074cb7e640 1 --2- 172.21.15.6:0/1480608837 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f07300a2c10 0x7f07300a5120 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f073c005d00 tx=0x7f073c005ef0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.688+0000 7f074cb7e640 1 -- 172.21.15.6:0/1480608837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0748100de0 msgr2=0x7f07481991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:19.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.688+0000 7f074cb7e640 1 --2- 172.21.15.6:0/1480608837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0748100de0 0x7f07481991a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f07380314e0 tx=0x7f0738031a30 comp rx=0 tx=0).stop 2024-05-20T17:05:19.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.688+0000 7f074cb7e640 1 -- 172.21.15.6:0/1480608837 shutdown_connections 2024-05-20T17:05:19.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.688+0000 7f074cb7e640 1 --2- 172.21.15.6:0/1480608837 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f07300a2c10 0x7f07300a5120 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.688+0000 7f074cb7e640 1 --2- 172.21.15.6:0/1480608837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0748108730 0x7f07481a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.688+0000 7f074cb7e640 1 --2- 172.21.15.6:0/1480608837 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0748105bc0 0x7f07481996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.688+0000 7f074cb7e640 1 --2- 172.21.15.6:0/1480608837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0748100de0 0x7f07481991a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.688+0000 7f074cb7e640 1 -- 172.21.15.6:0/1480608837 >> 172.21.15.6:0/1480608837 conn(0x7f07480fc330 msgr2=0x7f0748106cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:19.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.688+0000 7f074cb7e640 1 -- 172.21.15.6:0/1480608837 shutdown_connections 2024-05-20T17:05:19.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.688+0000 7f074cb7e640 1 -- 172.21.15.6:0/1480608837 wait complete. 2024-05-20T17:05:19.700 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:05:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.817+0000 7fcb49cfe640 1 -- 172.21.15.6:0/944683343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb44104120 msgr2=0x7fcb441022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.817+0000 7fcb49cfe640 1 --2- 172.21.15.6:0/944683343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb44104120 0x7fcb441022a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009900 tx=0x7fcb3402a410 comp rx=0 tx=0).stop 2024-05-20T17:05:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.817+0000 7fcb49cfe640 1 -- 172.21.15.6:0/944683343 shutdown_connections 2024-05-20T17:05:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.817+0000 7fcb49cfe640 1 --2- 172.21.15.6:0/944683343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb44108a20 0x7fcb4410ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.817+0000 7fcb49cfe640 1 --2- 172.21.15.6:0/944683343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb441027e0 0x7fcb44102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.817+0000 7fcb49cfe640 1 --2- 172.21.15.6:0/944683343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb44104120 0x7fcb441022a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.817+0000 7fcb49cfe640 1 -- 172.21.15.6:0/944683343 >> 172.21.15.6:0/944683343 conn(0x7fcb440fdcf0 msgr2=0x7fcb44100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.817+0000 7fcb49cfe640 1 -- 172.21.15.6:0/944683343 shutdown_connections 2024-05-20T17:05:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.817+0000 7fcb49cfe640 1 -- 172.21.15.6:0/944683343 wait complete. 2024-05-20T17:05:19.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.818+0000 7fcb49cfe640 1 Processor -- start 2024-05-20T17:05:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.818+0000 7fcb49cfe640 1 -- start start 2024-05-20T17:05:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.818+0000 7fcb49cfe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb441027e0 0x7fcb44199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.818+0000 7fcb49cfe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb44104120 0x7fcb441997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.818+0000 7fcb49cfe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb44108a20 0x7fcb441a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.818+0000 7fcb49cfe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4410e6d0 con 0x7fcb44104120 2024-05-20T17:05:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.818+0000 7fcb49cfe640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4410e550 con 0x7fcb44108a20 2024-05-20T17:05:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.818+0000 7fcb49cfe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4410e850 con 0x7fcb441027e0 2024-05-20T17:05:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.818+0000 7fcb42ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb44104120 0x7fcb441997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.818+0000 7fcb42ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb44104120 0x7fcb441997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40310/0 (socket says 172.21.15.6:40310) 2024-05-20T17:05:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.818+0000 7fcb42ffd640 1 -- 172.21.15.6:0/2633167485 learned_addr learned my addr 172.21.15.6:0/2633167485 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.819+0000 7fcb43fff640 1 --2- 172.21.15.6:0/2633167485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb44108a20 0x7fcb441a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.819+0000 7fcb437fe640 1 --2- 172.21.15.6:0/2633167485 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb441027e0 0x7fcb44199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.819+0000 7fcb42ffd640 1 -- 172.21.15.6:0/2633167485 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb441027e0 msgr2=0x7fcb44199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.819+0000 7fcb42ffd640 1 --2- 172.21.15.6:0/2633167485 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb441027e0 0x7fcb44199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.819+0000 7fcb42ffd640 1 -- 172.21.15.6:0/2633167485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb44108a20 msgr2=0x7fcb441a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.819+0000 7fcb42ffd640 1 --2- 172.21.15.6:0/2633167485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb44108a20 0x7fcb441a0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.819+0000 7fcb42ffd640 1 -- 172.21.15.6:0/2633167485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb441a0dd0 con 0x7fcb44104120 2024-05-20T17:05:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.819+0000 7fcb437fe640 1 --2- 172.21.15.6:0/2633167485 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb441027e0 0x7fcb44199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:05:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.819+0000 7fcb42ffd640 1 --2- 172.21.15.6:0/2633167485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb44104120 0x7fcb441997d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcb3800c890 tx=0x7fcb3800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.819+0000 7fcb40ff9640 1 -- 172.21.15.6:0/2633167485 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38004220 con 0x7fcb44104120 2024-05-20T17:05:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.819+0000 7fcb40ff9640 1 -- 172.21.15.6:0/2633167485 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb380043c0 con 0x7fcb44104120 2024-05-20T17:05:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.819+0000 7fcb49cfe640 1 -- 172.21.15.6:0/2633167485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb441a10c0 con 0x7fcb44104120 2024-05-20T17:05:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.819+0000 7fcb40ff9640 1 -- 172.21.15.6:0/2633167485 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38004a00 con 0x7fcb44104120 2024-05-20T17:05:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.819+0000 7fcb49cfe640 1 -- 172.21.15.6:0/2633167485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb441a1610 con 0x7fcb44104120 2024-05-20T17:05:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.820+0000 7fcb49cfe640 1 -- 172.21.15.6:0/2633167485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb440691c0 con 0x7fcb44104120 2024-05-20T17:05:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.821+0000 7fcb40ff9640 1 -- 172.21.15.6:0/2633167485 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fcb38004ba0 con 0x7fcb44104120 2024-05-20T17:05:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.823+0000 7fcb40ff9640 1 --2- 172.21.15.6:0/2633167485 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fcb2c0a2b90 0x7fcb2c0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.823+0000 7fcb437fe640 1 --2- 172.21.15.6:0/2633167485 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fcb2c0a2b90 0x7fcb2c0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.823+0000 7fcb40ff9640 1 -- 172.21.15.6:0/2633167485 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fcb380cef40 con 0x7fcb44104120 2024-05-20T17:05:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.823+0000 7fcb437fe640 1 --2- 172.21.15.6:0/2633167485 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fcb2c0a2b90 0x7fcb2c0a50a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcb34006010 tx=0x7fcb34000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:19.828+0000 7fcb40ff9640 1 -- 172.21.15.6:0/2633167485 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcb38014030 con 0x7fcb44104120 2024-05-20T17:05:19.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:19 smithi171 ceph-mon[35901]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:05:19.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:19 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2044328050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:19.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:19 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3841008304' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:05:20.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.012+0000 7fcb49cfe640 1 -- 172.21.15.6:0/2633167485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcb44062750 con 0x7fcb44104120 2024-05-20T17:05:20.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.013+0000 7fcb40ff9640 1 -- 172.21.15.6:0/2633167485 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7fcb3809bc60 con 0x7fcb44104120 2024-05-20T17:05:20.013 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:05:20.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.015+0000 7fcb49cfe640 1 -- 172.21.15.6:0/2633167485 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fcb2c0a2b90 msgr2=0x7fcb2c0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:20.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.015+0000 7fcb49cfe640 1 --2- 172.21.15.6:0/2633167485 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fcb2c0a2b90 0x7fcb2c0a50a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcb34006010 tx=0x7fcb34000bc0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.015+0000 7fcb49cfe640 1 -- 172.21.15.6:0/2633167485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb44104120 msgr2=0x7fcb441997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:20.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.015+0000 7fcb49cfe640 1 --2- 172.21.15.6:0/2633167485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb44104120 0x7fcb441997d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcb3800c890 tx=0x7fcb3800cd50 comp rx=0 tx=0).stop 2024-05-20T17:05:20.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.015+0000 7fcb49cfe640 1 -- 172.21.15.6:0/2633167485 shutdown_connections 2024-05-20T17:05:20.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.015+0000 7fcb49cfe640 1 --2- 172.21.15.6:0/2633167485 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fcb2c0a2b90 0x7fcb2c0a50a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.015+0000 7fcb49cfe640 1 --2- 172.21.15.6:0/2633167485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb44108a20 0x7fcb441a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.015+0000 7fcb49cfe640 1 --2- 172.21.15.6:0/2633167485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb44104120 0x7fcb441997d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.015+0000 7fcb49cfe640 1 --2- 172.21.15.6:0/2633167485 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb441027e0 0x7fcb44199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.015+0000 7fcb49cfe640 1 -- 172.21.15.6:0/2633167485 >> 172.21.15.6:0/2633167485 conn(0x7fcb440fdcf0 msgr2=0x7fcb44104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:20.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.015+0000 7fcb49cfe640 1 -- 172.21.15.6:0/2633167485 shutdown_connections 2024-05-20T17:05:20.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.015+0000 7fcb49cfe640 1 -- 172.21.15.6:0/2633167485 wait complete. 2024-05-20T17:05:20.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:19 smithi062 ceph-mon[35425]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:05:20.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:19 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2044328050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:20.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:19 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3841008304' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:05:20.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:05:20.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.147+0000 7f83ab2d3640 1 -- 172.21.15.6:0/3063989716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a41078d0 msgr2=0x7f83a4109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:20.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.147+0000 7f83ab2d3640 1 --2- 172.21.15.6:0/3063989716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a41078d0 0x7f83a4109cf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8394009ca0 tx=0x7f839402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.147+0000 7f83ab2d3640 1 -- 172.21.15.6:0/3063989716 shutdown_connections 2024-05-20T17:05:20.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.147+0000 7f83ab2d3640 1 --2- 172.21.15.6:0/3063989716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a41078d0 0x7f83a4109cf0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.147+0000 7f83ab2d3640 1 --2- 172.21.15.6:0/3063989716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83a4102bd0 0x7f83a4102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.147+0000 7f83ab2d3640 1 --2- 172.21.15.6:0/3063989716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83a4101990 0x7f83a4102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.147+0000 7f83ab2d3640 1 -- 172.21.15.6:0/3063989716 >> 172.21.15.6:0/3063989716 conn(0x7f83a40fcba0 msgr2=0x7f83a40ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.147+0000 7f83ab2d3640 1 -- 172.21.15.6:0/3063989716 shutdown_connections 2024-05-20T17:05:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.147+0000 7f83ab2d3640 1 -- 172.21.15.6:0/3063989716 wait complete. 2024-05-20T17:05:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.148+0000 7f83ab2d3640 1 Processor -- start 2024-05-20T17:05:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.148+0000 7f83ab2d3640 1 -- start start 2024-05-20T17:05:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.148+0000 7f83ab2d3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83a4101990 0x7f83a4198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.148+0000 7f83ab2d3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83a4102bd0 0x7f83a4198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.148+0000 7f83ab2d3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a41078d0 0x7f83a419f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.148+0000 7f83ab2d3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f83a410d4a0 con 0x7f83a41078d0 2024-05-20T17:05:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.148+0000 7f83ab2d3640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f83a410d320 con 0x7f83a4101990 2024-05-20T17:05:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.148+0000 7f83ab2d3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f83a410d620 con 0x7f83a4102bd0 2024-05-20T17:05:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.148+0000 7f83a9870640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a41078d0 0x7f83a419f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.148+0000 7f83a9870640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a41078d0 0x7f83a419f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40334/0 (socket says 172.21.15.6:40334) 2024-05-20T17:05:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.148+0000 7f83a9870640 1 -- 172.21.15.6:0/831253280 learned_addr learned my addr 172.21.15.6:0/831253280 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.148+0000 7f83a906f640 1 --2- 172.21.15.6:0/831253280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83a4101990 0x7f83a4198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.148+0000 7f83a886e640 1 --2- 172.21.15.6:0/831253280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83a4102bd0 0x7f83a4198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.148+0000 7f83a9870640 1 -- 172.21.15.6:0/831253280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83a4102bd0 msgr2=0x7f83a4198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.148+0000 7f83a9870640 1 --2- 172.21.15.6:0/831253280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83a4102bd0 0x7f83a4198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.148+0000 7f83a9870640 1 -- 172.21.15.6:0/831253280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83a4101990 msgr2=0x7f83a4198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.148+0000 7f83a9870640 1 --2- 172.21.15.6:0/831253280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83a4101990 0x7f83a4198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.148+0000 7f83a9870640 1 -- 172.21.15.6:0/831253280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a419fb80 con 0x7f83a41078d0 2024-05-20T17:05:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.149+0000 7f83a9870640 1 --2- 172.21.15.6:0/831253280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a41078d0 0x7f83a419f510 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8394009dc0 tx=0x7f8394003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.149+0000 7f83a27fc640 1 -- 172.21.15.6:0/831253280 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394004040 con 0x7f83a41078d0 2024-05-20T17:05:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.149+0000 7f83a27fc640 1 -- 172.21.15.6:0/831253280 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8394004690 con 0x7f83a41078d0 2024-05-20T17:05:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.149+0000 7f83a27fc640 1 -- 172.21.15.6:0/831253280 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394030c70 con 0x7f83a41078d0 2024-05-20T17:05:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.149+0000 7f83ab2d3640 1 -- 172.21.15.6:0/831253280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a419fe10 con 0x7f83a41078d0 2024-05-20T17:05:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.149+0000 7f83ab2d3640 1 -- 172.21.15.6:0/831253280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a41a02d0 con 0x7f83a41078d0 2024-05-20T17:05:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.150+0000 7f83ab2d3640 1 -- 172.21.15.6:0/831253280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83a41066e0 con 0x7f83a41078d0 2024-05-20T17:05:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.152+0000 7f83a27fc640 1 -- 172.21.15.6:0/831253280 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f83940041e0 con 0x7f83a41078d0 2024-05-20T17:05:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.153+0000 7f83a27fc640 1 --2- 172.21.15.6:0/831253280 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f838c0a2c10 0x7f838c0a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.153+0000 7f83a906f640 1 --2- 172.21.15.6:0/831253280 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f838c0a2c10 0x7f838c0a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.153+0000 7f83a27fc640 1 -- 172.21.15.6:0/831253280 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f83940f0ba0 con 0x7f83a41078d0 2024-05-20T17:05:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.153+0000 7f83a906f640 1 --2- 172.21.15.6:0/831253280 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f838c0a2c10 0x7f838c0a5120 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f83a4102590 tx=0x7f839c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:20.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.157+0000 7f83a27fc640 1 -- 172.21.15.6:0/831253280 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f83940bd860 con 0x7f83a41078d0 2024-05-20T17:05:20.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.342+0000 7f83ab2d3640 1 -- 172.21.15.6:0/831253280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f83a402d4f0 con 0x7f83a41078d0 2024-05-20T17:05:20.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.342+0000 7f83a27fc640 1 -- 172.21.15.6:0/831253280 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) ==== 103+0+11 (secure 0 0 0) 0x7f83940bd160 con 0x7f83a41078d0 2024-05-20T17:05:20.343 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:05:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.344+0000 7f83ab2d3640 1 -- 172.21.15.6:0/831253280 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f838c0a2c10 msgr2=0x7f838c0a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.344+0000 7f83ab2d3640 1 --2- 172.21.15.6:0/831253280 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f838c0a2c10 0x7f838c0a5120 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f83a4102590 tx=0x7f839c00b390 comp rx=0 tx=0).stop 2024-05-20T17:05:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.344+0000 7f83ab2d3640 1 -- 172.21.15.6:0/831253280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a41078d0 msgr2=0x7f83a419f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.344+0000 7f83ab2d3640 1 --2- 172.21.15.6:0/831253280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a41078d0 0x7f83a419f510 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8394009dc0 tx=0x7f8394003ba0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.344+0000 7f83ab2d3640 1 -- 172.21.15.6:0/831253280 shutdown_connections 2024-05-20T17:05:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.344+0000 7f83ab2d3640 1 --2- 172.21.15.6:0/831253280 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f838c0a2c10 0x7f838c0a5120 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.344+0000 7f83ab2d3640 1 --2- 172.21.15.6:0/831253280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a41078d0 0x7f83a419f510 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.344+0000 7f83ab2d3640 1 --2- 172.21.15.6:0/831253280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83a4102bd0 0x7f83a4198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.344+0000 7f83ab2d3640 1 --2- 172.21.15.6:0/831253280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83a4101990 0x7f83a4198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.344+0000 7f83ab2d3640 1 -- 172.21.15.6:0/831253280 >> 172.21.15.6:0/831253280 conn(0x7f83a40fcba0 msgr2=0x7f83a41038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:20.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.344+0000 7f83ab2d3640 1 -- 172.21.15.6:0/831253280 shutdown_connections 2024-05-20T17:05:20.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.344+0000 7f83ab2d3640 1 -- 172.21.15.6:0/831253280 wait complete. 2024-05-20T17:05:20.357 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:05:20.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.472+0000 7f63d9e22640 1 -- 172.21.15.6:0/608027387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63d4103cf0 msgr2=0x7f63d4104100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:20.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.472+0000 7f63d9e22640 1 --2- 172.21.15.6:0/608027387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63d4103cf0 0x7f63d4104100 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f63bc009900 tx=0x7f63bc02a410 comp rx=0 tx=0).stop 2024-05-20T17:05:20.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.472+0000 7f63d9e22640 1 -- 172.21.15.6:0/608027387 shutdown_connections 2024-05-20T17:05:20.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.472+0000 7f63d9e22640 1 --2- 172.21.15.6:0/608027387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63d41089f0 0x7f63d410ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.472+0000 7f63d9e22640 1 --2- 172.21.15.6:0/608027387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63d4103cf0 0x7f63d4104100 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.472+0000 7f63d9e22640 1 --2- 172.21.15.6:0/608027387 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63d4102ab0 0x7f63d41037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.472+0000 7f63d9e22640 1 -- 172.21.15.6:0/608027387 >> 172.21.15.6:0/608027387 conn(0x7f63d40fdca0 msgr2=0x7f63d4100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:20.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.472+0000 7f63d9e22640 1 -- 172.21.15.6:0/608027387 shutdown_connections 2024-05-20T17:05:20.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.472+0000 7f63d9e22640 1 -- 172.21.15.6:0/608027387 wait complete. 2024-05-20T17:05:20.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.472+0000 7f63d9e22640 1 Processor -- start 2024-05-20T17:05:20.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.473+0000 7f63d9e22640 1 -- start start 2024-05-20T17:05:20.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.473+0000 7f63d9e22640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63d4102ab0 0x7f63d4199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.473+0000 7f63d9e22640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63d4103cf0 0x7f63d41996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.473+0000 7f63d9e22640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63d41089f0 0x7f63d41a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.473+0000 7f63d9e22640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f63d410e620 con 0x7f63d4102ab0 2024-05-20T17:05:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.473+0000 7f63d9e22640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f63d410e4a0 con 0x7f63d41089f0 2024-05-20T17:05:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.473+0000 7f63d9e22640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f63d410e7a0 con 0x7f63d4103cf0 2024-05-20T17:05:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.473+0000 7f63d37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63d4102ab0 0x7f63d4199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.473+0000 7f63d37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63d4102ab0 0x7f63d4199190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40348/0 (socket says 172.21.15.6:40348) 2024-05-20T17:05:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.473+0000 7f63d37fe640 1 -- 172.21.15.6:0/3939923771 learned_addr learned my addr 172.21.15.6:0/3939923771 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.473+0000 7f63d2ffd640 1 --2- 172.21.15.6:0/3939923771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63d4103cf0 0x7f63d41996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.473+0000 7f63d37fe640 1 -- 172.21.15.6:0/3939923771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63d4103cf0 msgr2=0x7f63d41996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.473+0000 7f63d37fe640 1 --2- 172.21.15.6:0/3939923771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63d4103cf0 0x7f63d41996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.473+0000 7f63d37fe640 1 -- 172.21.15.6:0/3939923771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63d41089f0 msgr2=0x7f63d41a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.473+0000 7f63d3fff640 1 --2- 172.21.15.6:0/3939923771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63d41089f0 0x7f63d41a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.473+0000 7f63d37fe640 1 --2- 172.21.15.6:0/3939923771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63d41089f0 0x7f63d41a0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.473+0000 7f63d37fe640 1 -- 172.21.15.6:0/3939923771 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d41a0cd0 con 0x7f63d4102ab0 2024-05-20T17:05:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.474+0000 7f63d37fe640 1 --2- 172.21.15.6:0/3939923771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63d4102ab0 0x7f63d4199190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f63c400ead0 tx=0x7f63c400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.474+0000 7f63d0ff9640 1 -- 172.21.15.6:0/3939923771 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c400cde0 con 0x7f63d4102ab0 2024-05-20T17:05:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.474+0000 7f63d0ff9640 1 -- 172.21.15.6:0/3939923771 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63c4003e20 con 0x7f63d4102ab0 2024-05-20T17:05:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.474+0000 7f63d9e22640 1 -- 172.21.15.6:0/3939923771 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63d41a0fc0 con 0x7f63d4102ab0 2024-05-20T17:05:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.474+0000 7f63d0ff9640 1 -- 172.21.15.6:0/3939923771 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c40116d0 con 0x7f63d4102ab0 2024-05-20T17:05:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.474+0000 7f63d9e22640 1 -- 172.21.15.6:0/3939923771 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63d41a1420 con 0x7f63d4102ab0 2024-05-20T17:05:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.475+0000 7f63d9e22640 1 -- 172.21.15.6:0/3939923771 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63d4107800 con 0x7f63d4102ab0 2024-05-20T17:05:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.476+0000 7f63d0ff9640 1 -- 172.21.15.6:0/3939923771 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f63c4003970 con 0x7f63d4102ab0 2024-05-20T17:05:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.477+0000 7f63d0ff9640 1 --2- 172.21.15.6:0/3939923771 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f63c00a2c10 0x7f63c00a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.477+0000 7f63d2ffd640 1 --2- 172.21.15.6:0/3939923771 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f63c00a2c10 0x7f63c00a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.477+0000 7f63d0ff9640 1 -- 172.21.15.6:0/3939923771 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f63c40cf8c0 con 0x7f63d4102ab0 2024-05-20T17:05:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.478+0000 7f63d2ffd640 1 --2- 172.21.15.6:0/3939923771 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f63c00a2c10 0x7f63c00a5120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f63bc004770 tx=0x7f63bc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:20.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.482+0000 7f63d0ff9640 1 -- 172.21.15.6:0/3939923771 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f63c4015030 con 0x7f63d4102ab0 2024-05-20T17:05:20.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:20 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1480608837' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:05:20.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:20 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2633167485' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:05:20.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:20 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/831253280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:05:20.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.683+0000 7f63d9e22640 1 -- 172.21.15.6:0/3939923771 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f63d402d2a0 con 0x7f63d4102ab0 2024-05-20T17:05:20.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.683+0000 7f63d0ff9640 1 -- 172.21.15.6:0/3939923771 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+579 (secure 0 0 0) 0x7f63c409c580 con 0x7f63d4102ab0 2024-05-20T17:05:20.684 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/3509827796 2024-05-21T16:57:41.985704+0000 2024-05-20T17:05:20.684 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/3509827796 2024-05-21T16:57:41.985704+0000 2024-05-20T17:05:20.684 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/173523304 2024-05-21T16:57:41.985704+0000 2024-05-20T17:05:20.684 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/741681069 2024-05-21T16:57:14.356112+0000 2024-05-20T17:05:20.684 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2415124466 2024-05-21T16:57:14.356112+0000 2024-05-20T17:05:20.684 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3427029758 2024-05-21T16:57:14.356112+0000 2024-05-20T17:05:20.685 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/741681069 2024-05-21T16:57:14.356112+0000 2024-05-20T17:05:20.685 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3324031224 2024-05-21T16:57:14.356112+0000 2024-05-20T17:05:20.685 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3781923966 2024-05-21T16:57:41.985704+0000 2024-05-20T17:05:20.685 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2979361383 2024-05-21T16:57:41.985704+0000 2024-05-20T17:05:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:listed 10 entries 2024-05-20T17:05:20.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.685+0000 7f63d9e22640 1 -- 172.21.15.6:0/3939923771 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f63c00a2c10 msgr2=0x7f63c00a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:20.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.685+0000 7f63d9e22640 1 --2- 172.21.15.6:0/3939923771 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f63c00a2c10 0x7f63c00a5120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f63bc004770 tx=0x7f63bc031400 comp rx=0 tx=0).stop 2024-05-20T17:05:20.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.685+0000 7f63d9e22640 1 -- 172.21.15.6:0/3939923771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63d4102ab0 msgr2=0x7f63d4199190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:20.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.685+0000 7f63d9e22640 1 --2- 172.21.15.6:0/3939923771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63d4102ab0 0x7f63d4199190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f63c400ead0 tx=0x7f63c400ef90 comp rx=0 tx=0).stop 2024-05-20T17:05:20.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.685+0000 7f63d9e22640 1 -- 172.21.15.6:0/3939923771 shutdown_connections 2024-05-20T17:05:20.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.685+0000 7f63d9e22640 1 --2- 172.21.15.6:0/3939923771 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f63c00a2c10 0x7f63c00a5120 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.685+0000 7f63d9e22640 1 --2- 172.21.15.6:0/3939923771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63d41089f0 0x7f63d41a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.685+0000 7f63d9e22640 1 --2- 172.21.15.6:0/3939923771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63d4103cf0 0x7f63d41996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.685+0000 7f63d9e22640 1 --2- 172.21.15.6:0/3939923771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63d4102ab0 0x7f63d4199190 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.685+0000 7f63d9e22640 1 -- 172.21.15.6:0/3939923771 >> 172.21.15.6:0/3939923771 conn(0x7f63d40fdca0 msgr2=0x7f63d41049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:20.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.686+0000 7f63d9e22640 1 -- 172.21.15.6:0/3939923771 shutdown_connections 2024-05-20T17:05:20.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.686+0000 7f63d9e22640 1 -- 172.21.15.6:0/3939923771 wait complete. 2024-05-20T17:05:20.697 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:05:20.697 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:05:20.715 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:05:20.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:20 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1480608837' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:05:20.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:20 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2633167485' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:05:20.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:20 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/831253280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:05:20.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.870+0000 7fcf6283d640 1 -- 172.21.15.6:0/3088139644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf5c1078f0 msgr2=0x7fcf5c109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.870+0000 7fcf6283d640 1 --2- 172.21.15.6:0/3088139644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf5c1078f0 0x7fcf5c109d10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009ca0 tx=0x7fcf5402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.870+0000 7fcf6283d640 1 -- 172.21.15.6:0/3088139644 shutdown_connections 2024-05-20T17:05:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.870+0000 7fcf6283d640 1 --2- 172.21.15.6:0/3088139644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf5c1078f0 0x7fcf5c109d10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.870+0000 7fcf6283d640 1 --2- 172.21.15.6:0/3088139644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf5c102bf0 0x7fcf5c103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.870+0000 7fcf6283d640 1 --2- 172.21.15.6:0/3088139644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf5c1019b0 0x7fcf5c1026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.870+0000 7fcf6283d640 1 -- 172.21.15.6:0/3088139644 >> 172.21.15.6:0/3088139644 conn(0x7fcf5c0fcba0 msgr2=0x7fcf5c0ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.870+0000 7fcf6283d640 1 -- 172.21.15.6:0/3088139644 shutdown_connections 2024-05-20T17:05:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.870+0000 7fcf6283d640 1 -- 172.21.15.6:0/3088139644 wait complete. 2024-05-20T17:05:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.871+0000 7fcf6283d640 1 Processor -- start 2024-05-20T17:05:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.871+0000 7fcf6283d640 1 -- start start 2024-05-20T17:05:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.871+0000 7fcf6283d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf5c1019b0 0x7fcf5c069a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.871+0000 7fcf6283d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf5c102bf0 0x7fcf5c19dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.871+0000 7fcf6283d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf5c1078f0 0x7fcf5c1a0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.871+0000 7fcf6283d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c10d4c0 con 0x7fcf5c102bf0 2024-05-20T17:05:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.871+0000 7fcf6283d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c10d340 con 0x7fcf5c1078f0 2024-05-20T17:05:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.871+0000 7fcf6283d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c10d640 con 0x7fcf5c1019b0 2024-05-20T17:05:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.871+0000 7fcf5b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf5c102bf0 0x7fcf5c19dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.871+0000 7fcf5b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf5c102bf0 0x7fcf5c19dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35770/0 (socket says 172.21.15.6:35770) 2024-05-20T17:05:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.871+0000 7fcf5b7fe640 1 -- 172.21.15.6:0/856068495 learned_addr learned my addr 172.21.15.6:0/856068495 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.871+0000 7fcf5bfff640 1 --2- 172.21.15.6:0/856068495 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf5c1019b0 0x7fcf5c069a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.872+0000 7fcf60dda640 1 --2- 172.21.15.6:0/856068495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf5c1078f0 0x7fcf5c1a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.872+0000 7fcf5b7fe640 1 -- 172.21.15.6:0/856068495 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf5c1019b0 msgr2=0x7fcf5c069a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.872+0000 7fcf5b7fe640 1 --2- 172.21.15.6:0/856068495 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf5c1019b0 0x7fcf5c069a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.872+0000 7fcf5b7fe640 1 -- 172.21.15.6:0/856068495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf5c1078f0 msgr2=0x7fcf5c1a0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.872+0000 7fcf5b7fe640 1 --2- 172.21.15.6:0/856068495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf5c1078f0 0x7fcf5c1a0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.872+0000 7fcf5b7fe640 1 -- 172.21.15.6:0/856068495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5c1a0b60 con 0x7fcf5c102bf0 2024-05-20T17:05:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.872+0000 7fcf60dda640 1 --2- 172.21.15.6:0/856068495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf5c1078f0 0x7fcf5c1a0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:05:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.872+0000 7fcf5b7fe640 1 --2- 172.21.15.6:0/856068495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf5c102bf0 0x7fcf5c19dd90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000d950 tx=0x7fcf5000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.872+0000 7fcf597fa640 1 -- 172.21.15.6:0/856068495 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf50017070 con 0x7fcf5c102bf0 2024-05-20T17:05:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.872+0000 7fcf597fa640 1 -- 172.21.15.6:0/856068495 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcf50009c30 con 0x7fcf5c102bf0 2024-05-20T17:05:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.872+0000 7fcf597fa640 1 -- 172.21.15.6:0/856068495 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000f620 con 0x7fcf5c102bf0 2024-05-20T17:05:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.872+0000 7fcf6283d640 1 -- 172.21.15.6:0/856068495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf5c1a0e50 con 0x7fcf5c102bf0 2024-05-20T17:05:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.872+0000 7fcf6283d640 1 -- 172.21.15.6:0/856068495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf5c1a1310 con 0x7fcf5c102bf0 2024-05-20T17:05:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.873+0000 7fcf6283d640 1 -- 172.21.15.6:0/856068495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf5c105ff0 con 0x7fcf5c102bf0 2024-05-20T17:05:20.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.874+0000 7fcf597fa640 1 -- 172.21.15.6:0/856068495 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fcf500109a0 con 0x7fcf5c102bf0 2024-05-20T17:05:20.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.875+0000 7fcf597fa640 1 --2- 172.21.15.6:0/856068495 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fcf440a2cb0 0x7fcf440a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:20.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.875+0000 7fcf597fa640 1 -- 172.21.15.6:0/856068495 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fcf500cee50 con 0x7fcf5c102bf0 2024-05-20T17:05:20.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.875+0000 7fcf5bfff640 1 --2- 172.21.15.6:0/856068495 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fcf440a2cb0 0x7fcf440a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:20.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.876+0000 7fcf5bfff640 1 --2- 172.21.15.6:0/856068495 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fcf440a2cb0 0x7fcf440a51c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c1025b0 tx=0x7fcf4c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:20.879+0000 7fcf597fa640 1 -- 172.21.15.6:0/856068495 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcf50009de0 con 0x7fcf5c102bf0 2024-05-20T17:05:21.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:20 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1480608837' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:05:21.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:20 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2633167485' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:05:21.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:20 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/831253280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:05:21.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.064+0000 7fcf6283d640 1 -- 172.21.15.6:0/856068495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf5c02d470 con 0x7fcf5c102bf0 2024-05-20T17:05:21.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.066+0000 7fcf597fa640 1 -- 172.21.15.6:0/856068495 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+23973 (secure 0 0 0) 0x7fcf5009bb90 con 0x7fcf5c102bf0 2024-05-20T17:05:21.066 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:05:21.067 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":90,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:05:09.495505+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:05:02.947896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:05:03.842231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:05:07.551471+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:05:21.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.068+0000 7fcf6283d640 1 -- 172.21.15.6:0/856068495 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fcf440a2cb0 msgr2=0x7fcf440a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.068+0000 7fcf6283d640 1 --2- 172.21.15.6:0/856068495 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fcf440a2cb0 0x7fcf440a51c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c1025b0 tx=0x7fcf4c005f90 comp rx=0 tx=0).stop 2024-05-20T17:05:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.068+0000 7fcf6283d640 1 -- 172.21.15.6:0/856068495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf5c102bf0 msgr2=0x7fcf5c19dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.068+0000 7fcf6283d640 1 --2- 172.21.15.6:0/856068495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf5c102bf0 0x7fcf5c19dd90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000d950 tx=0x7fcf5000de10 comp rx=0 tx=0).stop 2024-05-20T17:05:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.068+0000 7fcf6283d640 1 -- 172.21.15.6:0/856068495 shutdown_connections 2024-05-20T17:05:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.068+0000 7fcf6283d640 1 --2- 172.21.15.6:0/856068495 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fcf440a2cb0 0x7fcf440a51c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.068+0000 7fcf6283d640 1 --2- 172.21.15.6:0/856068495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf5c1078f0 0x7fcf5c1a0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.068+0000 7fcf6283d640 1 --2- 172.21.15.6:0/856068495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf5c102bf0 0x7fcf5c19dd90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.068+0000 7fcf6283d640 1 --2- 172.21.15.6:0/856068495 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf5c1019b0 0x7fcf5c069a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.068+0000 7fcf6283d640 1 -- 172.21.15.6:0/856068495 >> 172.21.15.6:0/856068495 conn(0x7fcf5c0fcba0 msgr2=0x7fcf5c0ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.068+0000 7fcf6283d640 1 -- 172.21.15.6:0/856068495 shutdown_connections 2024-05-20T17:05:21.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.068+0000 7fcf6283d640 1 -- 172.21.15.6:0/856068495 wait complete. 2024-05-20T17:05:21.080 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:00:12.516679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:05:02.947896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:05:03.842231+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:05:07.551471+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:05:21.081 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:05:21.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.200+0000 7efc1503d640 1 -- 172.21.15.6:0/3476479049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc10102bd0 msgr2=0x7efc10102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:21.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.200+0000 7efc1503d640 1 --2- 172.21.15.6:0/3476479049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc10102bd0 0x7efc10102fe0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efbf8009900 tx=0x7efbf802a410 comp rx=0 tx=0).stop 2024-05-20T17:05:21.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.201+0000 7efc1503d640 1 -- 172.21.15.6:0/3476479049 shutdown_connections 2024-05-20T17:05:21.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.201+0000 7efc1503d640 1 --2- 172.21.15.6:0/3476479049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc101078d0 0x7efc10109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.201+0000 7efc1503d640 1 --2- 172.21.15.6:0/3476479049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc10102bd0 0x7efc10102fe0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.201+0000 7efc1503d640 1 --2- 172.21.15.6:0/3476479049 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc10101990 0x7efc10102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.201+0000 7efc1503d640 1 -- 172.21.15.6:0/3476479049 >> 172.21.15.6:0/3476479049 conn(0x7efc100fcb80 msgr2=0x7efc100ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.201+0000 7efc1503d640 1 -- 172.21.15.6:0/3476479049 shutdown_connections 2024-05-20T17:05:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.201+0000 7efc1503d640 1 -- 172.21.15.6:0/3476479049 wait complete. 2024-05-20T17:05:21.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.201+0000 7efc1503d640 1 Processor -- start 2024-05-20T17:05:21.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.202+0000 7efc1503d640 1 -- start start 2024-05-20T17:05:21.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.202+0000 7efc1503d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc10101990 0x7efc101980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:21.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.202+0000 7efc1503d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc10102bd0 0x7efc101985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:21.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.202+0000 7efc1503d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc101078d0 0x7efc1019f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:21.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.202+0000 7efc1503d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efc1010d510 con 0x7efc101078d0 2024-05-20T17:05:21.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.202+0000 7efc1503d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efc1010d390 con 0x7efc10102bd0 2024-05-20T17:05:21.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.202+0000 7efc1503d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efc1010d690 con 0x7efc10101990 2024-05-20T17:05:21.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.202+0000 7efc0f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc101078d0 0x7efc1019f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:21.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.202+0000 7efc0f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc101078d0 0x7efc1019f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35778/0 (socket says 172.21.15.6:35778) 2024-05-20T17:05:21.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.202+0000 7efc0f59e640 1 -- 172.21.15.6:0/1411136717 learned_addr learned my addr 172.21.15.6:0/1411136717 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:21.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.202+0000 7efc0ed9d640 1 --2- 172.21.15.6:0/1411136717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc10101990 0x7efc101980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:21.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.202+0000 7efc0e59c640 1 --2- 172.21.15.6:0/1411136717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc10102bd0 0x7efc101985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:21.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.202+0000 7efc0f59e640 1 -- 172.21.15.6:0/1411136717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc10101990 msgr2=0x7efc101980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:21.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.202+0000 7efc0f59e640 1 --2- 172.21.15.6:0/1411136717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc10101990 0x7efc101980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.202+0000 7efc0f59e640 1 -- 172.21.15.6:0/1411136717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc10102bd0 msgr2=0x7efc101985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:21.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.202+0000 7efc0f59e640 1 --2- 172.21.15.6:0/1411136717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc10102bd0 0x7efc101985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.202+0000 7efc0f59e640 1 -- 172.21.15.6:0/1411136717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1019fbf0 con 0x7efc101078d0 2024-05-20T17:05:21.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.203+0000 7efc0f59e640 1 --2- 172.21.15.6:0/1411136717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc101078d0 0x7efc1019f580 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efc0800e970 tx=0x7efc0800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:21.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.203+0000 7efc07fff640 1 -- 172.21.15.6:0/1411136717 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0800ccc0 con 0x7efc101078d0 2024-05-20T17:05:21.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.203+0000 7efc07fff640 1 -- 172.21.15.6:0/1411136717 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efc0800ce60 con 0x7efc101078d0 2024-05-20T17:05:21.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.203+0000 7efc1503d640 1 -- 172.21.15.6:0/1411136717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc1019fee0 con 0x7efc101078d0 2024-05-20T17:05:21.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.203+0000 7efc07fff640 1 -- 172.21.15.6:0/1411136717 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc08010430 con 0x7efc101078d0 2024-05-20T17:05:21.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.203+0000 7efc1503d640 1 -- 172.21.15.6:0/1411136717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc101a0340 con 0x7efc101078d0 2024-05-20T17:05:21.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.204+0000 7efc1503d640 1 -- 172.21.15.6:0/1411136717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc100691c0 con 0x7efc101078d0 2024-05-20T17:05:21.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.205+0000 7efc07fff640 1 -- 172.21.15.6:0/1411136717 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7efc08004f90 con 0x7efc101078d0 2024-05-20T17:05:21.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.206+0000 7efc07fff640 1 --2- 172.21.15.6:0/1411136717 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7efbfc0a2b90 0x7efbfc0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:21.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.206+0000 7efc0ed9d640 1 --2- 172.21.15.6:0/1411136717 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7efbfc0a2b90 0x7efbfc0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:21.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.206+0000 7efc07fff640 1 -- 172.21.15.6:0/1411136717 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7efc080cf7f0 con 0x7efc101078d0 2024-05-20T17:05:21.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.206+0000 7efc0ed9d640 1 --2- 172.21.15.6:0/1411136717 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7efbfc0a2b90 0x7efbfc0a50a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efc10102590 tx=0x7efc00009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:21.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.211+0000 7efc07fff640 1 -- 172.21.15.6:0/1411136717 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7efc0809c4b0 con 0x7efc101078d0 2024-05-20T17:05:21.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.394+0000 7efc1503d640 1 -- 172.21.15.6:0/1411136717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efc10062780 con 0x7efc101078d0 2024-05-20T17:05:21.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.395+0000 7efc07fff640 1 -- 172.21.15.6:0/1411136717 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7efc0809bdb0 con 0x7efc101078d0 2024-05-20T17:05:21.395 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:05:21.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.396+0000 7efc1503d640 1 -- 172.21.15.6:0/1411136717 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7efbfc0a2b90 msgr2=0x7efbfc0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:21.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.396+0000 7efc1503d640 1 --2- 172.21.15.6:0/1411136717 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7efbfc0a2b90 0x7efbfc0a50a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efc10102590 tx=0x7efc00009500 comp rx=0 tx=0).stop 2024-05-20T17:05:21.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.396+0000 7efc1503d640 1 -- 172.21.15.6:0/1411136717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc101078d0 msgr2=0x7efc1019f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:21.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.396+0000 7efc1503d640 1 --2- 172.21.15.6:0/1411136717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc101078d0 0x7efc1019f580 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efc0800e970 tx=0x7efc0800ed70 comp rx=0 tx=0).stop 2024-05-20T17:05:21.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.396+0000 7efc1503d640 1 -- 172.21.15.6:0/1411136717 shutdown_connections 2024-05-20T17:05:21.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.396+0000 7efc1503d640 1 --2- 172.21.15.6:0/1411136717 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7efbfc0a2b90 0x7efbfc0a50a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.396+0000 7efc1503d640 1 --2- 172.21.15.6:0/1411136717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc101078d0 0x7efc1019f580 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.396+0000 7efc1503d640 1 --2- 172.21.15.6:0/1411136717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc10102bd0 0x7efc101985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.396+0000 7efc1503d640 1 --2- 172.21.15.6:0/1411136717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc10101990 0x7efc101980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.396+0000 7efc1503d640 1 -- 172.21.15.6:0/1411136717 >> 172.21.15.6:0/1411136717 conn(0x7efc100fcb80 msgr2=0x7efc101038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:21.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.397+0000 7efc1503d640 1 -- 172.21.15.6:0/1411136717 shutdown_connections 2024-05-20T17:05:21.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.397+0000 7efc1503d640 1 -- 172.21.15.6:0/1411136717 wait complete. 2024-05-20T17:05:21.409 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:05:21.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.526+0000 7fe31a157640 1 -- 172.21.15.6:0/1958225265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe314108870 msgr2=0x7fe31410ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.526+0000 7fe31a157640 1 --2- 172.21.15.6:0/1958225265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe314108870 0x7fe31410ac90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009ca0 tx=0x7fe30c02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.526+0000 7fe31a157640 1 -- 172.21.15.6:0/1958225265 shutdown_connections 2024-05-20T17:05:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.526+0000 7fe31a157640 1 --2- 172.21.15.6:0/1958225265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe314108870 0x7fe31410ac90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.526+0000 7fe31a157640 1 --2- 172.21.15.6:0/1958225265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe314105f10 0x7fe314108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.526+0000 7fe31a157640 1 --2- 172.21.15.6:0/1958225265 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3141035b0 0x7fe3141059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.526+0000 7fe31a157640 1 -- 172.21.15.6:0/1958225265 >> 172.21.15.6:0/1958225265 conn(0x7fe3140fcbb0 msgr2=0x7fe3140ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.526+0000 7fe31a157640 1 -- 172.21.15.6:0/1958225265 shutdown_connections 2024-05-20T17:05:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.526+0000 7fe31a157640 1 -- 172.21.15.6:0/1958225265 wait complete. 2024-05-20T17:05:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.526+0000 7fe31a157640 1 Processor -- start 2024-05-20T17:05:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.527+0000 7fe31a157640 1 -- start start 2024-05-20T17:05:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.527+0000 7fe31a157640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3141035b0 0x7fe314199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.527+0000 7fe31a157640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe314105f10 0x7fe3141996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.527+0000 7fe31a157640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe314108870 0x7fe3141a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.527+0000 7fe31a157640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe31410e5f0 con 0x7fe314105f10 2024-05-20T17:05:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.527+0000 7fe31a157640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe31410e470 con 0x7fe314108870 2024-05-20T17:05:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.527+0000 7fe31a157640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe31410e770 con 0x7fe3141035b0 2024-05-20T17:05:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.527+0000 7fe312ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe314105f10 0x7fe3141996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.527+0000 7fe312ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe314105f10 0x7fe3141996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35808/0 (socket says 172.21.15.6:35808) 2024-05-20T17:05:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.527+0000 7fe312ffd640 1 -- 172.21.15.6:0/3821594640 learned_addr learned my addr 172.21.15.6:0/3821594640 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.527+0000 7fe3137fe640 1 --2- 172.21.15.6:0/3821594640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3141035b0 0x7fe314199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.527+0000 7fe313fff640 1 --2- 172.21.15.6:0/3821594640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe314108870 0x7fe3141a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.527+0000 7fe312ffd640 1 -- 172.21.15.6:0/3821594640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3141035b0 msgr2=0x7fe314199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.527+0000 7fe312ffd640 1 --2- 172.21.15.6:0/3821594640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3141035b0 0x7fe314199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.527+0000 7fe312ffd640 1 -- 172.21.15.6:0/3821594640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe314108870 msgr2=0x7fe3141a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.527+0000 7fe312ffd640 1 --2- 172.21.15.6:0/3821594640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe314108870 0x7fe3141a0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.527+0000 7fe312ffd640 1 -- 172.21.15.6:0/3821594640 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3141a0cb0 con 0x7fe314105f10 2024-05-20T17:05:21.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.527+0000 7fe3137fe640 1 --2- 172.21.15.6:0/3821594640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3141035b0 0x7fe314199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:05:21.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.528+0000 7fe312ffd640 1 --2- 172.21.15.6:0/3821594640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe314105f10 0x7fe3141996b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe30800d950 tx=0x7fe30800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:21.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.528+0000 7fe310ff9640 1 -- 172.21.15.6:0/3821594640 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe308017030 con 0x7fe314105f10 2024-05-20T17:05:21.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.528+0000 7fe310ff9640 1 -- 172.21.15.6:0/3821594640 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe308004020 con 0x7fe314105f10 2024-05-20T17:05:21.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.528+0000 7fe31a157640 1 -- 172.21.15.6:0/3821594640 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3141a0fa0 con 0x7fe314105f10 2024-05-20T17:05:21.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.528+0000 7fe310ff9640 1 -- 172.21.15.6:0/3821594640 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3080047a0 con 0x7fe314105f10 2024-05-20T17:05:21.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.528+0000 7fe31a157640 1 -- 172.21.15.6:0/3821594640 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3141a1410 con 0x7fe314105f10 2024-05-20T17:05:21.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.529+0000 7fe31a157640 1 -- 172.21.15.6:0/3821594640 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3140fe6d0 con 0x7fe314105f10 2024-05-20T17:05:21.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.530+0000 7fe310ff9640 1 -- 172.21.15.6:0/3821594640 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fe3080041d0 con 0x7fe314105f10 2024-05-20T17:05:21.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.531+0000 7fe310ff9640 1 --2- 172.21.15.6:0/3821594640 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe2fc0a2b90 0x7fe2fc0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:21.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.531+0000 7fe310ff9640 1 -- 172.21.15.6:0/3821594640 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fe3080cf450 con 0x7fe314105f10 2024-05-20T17:05:21.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.531+0000 7fe3137fe640 1 --2- 172.21.15.6:0/3821594640 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe2fc0a2b90 0x7fe2fc0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:21.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.531+0000 7fe3137fe640 1 --2- 172.21.15.6:0/3821594640 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe2fc0a2b90 0x7fe2fc0a50a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe3140747a0 tx=0x7fe304005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:21.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.535+0000 7fe310ff9640 1 -- 172.21.15.6:0/3821594640 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe30809c170 con 0x7fe314105f10 2024-05-20T17:05:21.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.719+0000 7fe31a157640 1 -- 172.21.15.6:0/3821594640 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe31402d4f0 con 0x7fe314105f10 2024-05-20T17:05:21.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.719+0000 7fe310ff9640 1 -- 172.21.15.6:0/3821594640 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7fe30809ba70 con 0x7fe314105f10 2024-05-20T17:05:21.720 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:05:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.721+0000 7fe31a157640 1 -- 172.21.15.6:0/3821594640 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe2fc0a2b90 msgr2=0x7fe2fc0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.721+0000 7fe31a157640 1 --2- 172.21.15.6:0/3821594640 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe2fc0a2b90 0x7fe2fc0a50a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe3140747a0 tx=0x7fe304005f90 comp rx=0 tx=0).stop 2024-05-20T17:05:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.721+0000 7fe31a157640 1 -- 172.21.15.6:0/3821594640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe314105f10 msgr2=0x7fe3141996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.721+0000 7fe31a157640 1 --2- 172.21.15.6:0/3821594640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe314105f10 0x7fe3141996b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe30800d950 tx=0x7fe30800de10 comp rx=0 tx=0).stop 2024-05-20T17:05:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.721+0000 7fe31a157640 1 -- 172.21.15.6:0/3821594640 shutdown_connections 2024-05-20T17:05:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.721+0000 7fe31a157640 1 --2- 172.21.15.6:0/3821594640 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe2fc0a2b90 0x7fe2fc0a50a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.721+0000 7fe31a157640 1 --2- 172.21.15.6:0/3821594640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe314108870 0x7fe3141a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.721+0000 7fe31a157640 1 --2- 172.21.15.6:0/3821594640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe314105f10 0x7fe3141996b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.721+0000 7fe31a157640 1 --2- 172.21.15.6:0/3821594640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3141035b0 0x7fe314199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.721+0000 7fe31a157640 1 -- 172.21.15.6:0/3821594640 >> 172.21.15.6:0/3821594640 conn(0x7fe3140fcbb0 msgr2=0x7fe314104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:21.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.722+0000 7fe31a157640 1 -- 172.21.15.6:0/3821594640 shutdown_connections 2024-05-20T17:05:21.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.722+0000 7fe31a157640 1 -- 172.21.15.6:0/3821594640 wait complete. 2024-05-20T17:05:21.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:21 smithi006 ceph-mon[32486]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 97 B/s wr, 0 op/s 2024-05-20T17:05:21.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:21 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3939923771' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-20T17:05:21.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:21 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/856068495' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:21.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:21 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1411136717' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:05:21.733 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:05:21.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.851+0000 7f5bac164640 1 -- 172.21.15.6:0/3762976972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba41078c0 msgr2=0x7f5ba4109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:21.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.851+0000 7f5bac164640 1 --2- 172.21.15.6:0/3762976972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba41078c0 0x7f5ba4109ce0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009ca0 tx=0x7f5b9402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.851+0000 7f5bac164640 1 -- 172.21.15.6:0/3762976972 shutdown_connections 2024-05-20T17:05:21.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.851+0000 7f5bac164640 1 --2- 172.21.15.6:0/3762976972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba41078c0 0x7f5ba4109ce0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.851+0000 7f5bac164640 1 --2- 172.21.15.6:0/3762976972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ba4102bc0 0x7f5ba4102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.851+0000 7f5bac164640 1 --2- 172.21.15.6:0/3762976972 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ba4101980 0x7f5ba4102680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.851+0000 7f5bac164640 1 -- 172.21.15.6:0/3762976972 >> 172.21.15.6:0/3762976972 conn(0x7f5ba40fcb70 msgr2=0x7f5ba40ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:21.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.851+0000 7f5bac164640 1 -- 172.21.15.6:0/3762976972 shutdown_connections 2024-05-20T17:05:21.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.851+0000 7f5bac164640 1 -- 172.21.15.6:0/3762976972 wait complete. 2024-05-20T17:05:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.852+0000 7f5bac164640 1 Processor -- start 2024-05-20T17:05:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.852+0000 7f5bac164640 1 -- start start 2024-05-20T17:05:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.852+0000 7f5bac164640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ba4101980 0x7f5ba40699d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.852+0000 7f5bac164640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ba4102bc0 0x7f5ba41a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.852+0000 7f5bac164640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba41078c0 0x7f5ba41a2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.852+0000 7f5bac164640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba410d4b0 con 0x7f5ba41078c0 2024-05-20T17:05:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.852+0000 7f5bac164640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba410d330 con 0x7f5ba4102bc0 2024-05-20T17:05:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.852+0000 7f5bac164640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba410d630 con 0x7f5ba4101980 2024-05-20T17:05:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.852+0000 7f5baa701640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba41078c0 0x7f5ba41a2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.852+0000 7f5baa701640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba41078c0 0x7f5ba41a2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35826/0 (socket says 172.21.15.6:35826) 2024-05-20T17:05:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.852+0000 7f5baa701640 1 -- 172.21.15.6:0/538729297 learned_addr learned my addr 172.21.15.6:0/538729297 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.852+0000 7f5ba9f00640 1 --2- 172.21.15.6:0/538729297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ba4101980 0x7f5ba40699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.852+0000 7f5ba96ff640 1 --2- 172.21.15.6:0/538729297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ba4102bc0 0x7f5ba41a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:21.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.852+0000 7f5baa701640 1 -- 172.21.15.6:0/538729297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ba4101980 msgr2=0x7f5ba40699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:21.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.852+0000 7f5baa701640 1 --2- 172.21.15.6:0/538729297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ba4101980 0x7f5ba40699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.852+0000 7f5baa701640 1 -- 172.21.15.6:0/538729297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ba4102bc0 msgr2=0x7f5ba41a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:21.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.852+0000 7f5baa701640 1 --2- 172.21.15.6:0/538729297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ba4102bc0 0x7f5ba41a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:21.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.853+0000 7f5baa701640 1 -- 172.21.15.6:0/538729297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba41a2db0 con 0x7f5ba41078c0 2024-05-20T17:05:21.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.853+0000 7f5baa701640 1 --2- 172.21.15.6:0/538729297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba41078c0 0x7f5ba41a2870 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009dc0 tx=0x7f5b94003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:21.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.853+0000 7f5ba2ffd640 1 -- 172.21.15.6:0/538729297 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b94004040 con 0x7f5ba41078c0 2024-05-20T17:05:21.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.853+0000 7f5ba2ffd640 1 -- 172.21.15.6:0/538729297 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5b94004690 con 0x7f5ba41078c0 2024-05-20T17:05:21.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.853+0000 7f5ba2ffd640 1 -- 172.21.15.6:0/538729297 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b94030c70 con 0x7f5ba41078c0 2024-05-20T17:05:21.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.853+0000 7f5bac164640 1 -- 172.21.15.6:0/538729297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ba41a3040 con 0x7f5ba41078c0 2024-05-20T17:05:21.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.853+0000 7f5bac164640 1 -- 172.21.15.6:0/538729297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ba41a3540 con 0x7f5ba41078c0 2024-05-20T17:05:21.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.854+0000 7f5bac164640 1 -- 172.21.15.6:0/538729297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ba41066d0 con 0x7f5ba41078c0 2024-05-20T17:05:21.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.855+0000 7f5ba2ffd640 1 -- 172.21.15.6:0/538729297 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f5b940041e0 con 0x7f5ba41078c0 2024-05-20T17:05:21.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.856+0000 7f5ba2ffd640 1 --2- 172.21.15.6:0/538729297 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5b8c0a2b90 0x7f5b8c0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:21.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.856+0000 7f5ba2ffd640 1 -- 172.21.15.6:0/538729297 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f5b940f0a60 con 0x7f5ba41078c0 2024-05-20T17:05:21.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.856+0000 7f5ba9f00640 1 --2- 172.21.15.6:0/538729297 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5b8c0a2b90 0x7f5b8c0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:21.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.857+0000 7f5ba9f00640 1 --2- 172.21.15.6:0/538729297 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5b8c0a2b90 0x7f5b8c0a50a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4102580 tx=0x7f5b9c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:21.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:21.861+0000 7f5ba2ffd640 1 -- 172.21.15.6:0/538729297 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5b940bd720 con 0x7f5ba41078c0 2024-05-20T17:05:21.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:21 smithi171 ceph-mon[35901]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 97 B/s wr, 0 op/s 2024-05-20T17:05:21.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:21 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3939923771' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-20T17:05:21.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:21 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/856068495' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:21.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:21 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1411136717' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:05:22.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:21 smithi062 ceph-mon[35425]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 97 B/s wr, 0 op/s 2024-05-20T17:05:22.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:21 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3939923771' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-20T17:05:22.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:21 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/856068495' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:22.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:21 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1411136717' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:05:22.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.043+0000 7f5bac164640 1 -- 172.21.15.6:0/538729297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5ba402d2a0 con 0x7f5ba41078c0 2024-05-20T17:05:22.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.044+0000 7f5ba2ffd640 1 -- 172.21.15.6:0/538729297 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7f5b94030e10 con 0x7f5ba41078c0 2024-05-20T17:05:22.044 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:05:22.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.046+0000 7f5bac164640 1 -- 172.21.15.6:0/538729297 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5b8c0a2b90 msgr2=0x7f5b8c0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:22.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.046+0000 7f5bac164640 1 --2- 172.21.15.6:0/538729297 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5b8c0a2b90 0x7f5b8c0a50a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4102580 tx=0x7f5b9c005f90 comp rx=0 tx=0).stop 2024-05-20T17:05:22.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.046+0000 7f5bac164640 1 -- 172.21.15.6:0/538729297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba41078c0 msgr2=0x7f5ba41a2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:22.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.046+0000 7f5bac164640 1 --2- 172.21.15.6:0/538729297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba41078c0 0x7f5ba41a2870 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009dc0 tx=0x7f5b94003ba0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.046+0000 7f5bac164640 1 -- 172.21.15.6:0/538729297 shutdown_connections 2024-05-20T17:05:22.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.046+0000 7f5bac164640 1 --2- 172.21.15.6:0/538729297 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5b8c0a2b90 0x7f5b8c0a50a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.046+0000 7f5bac164640 1 --2- 172.21.15.6:0/538729297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba41078c0 0x7f5ba41a2870 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.046+0000 7f5bac164640 1 --2- 172.21.15.6:0/538729297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ba4102bc0 0x7f5ba41a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.046+0000 7f5bac164640 1 --2- 172.21.15.6:0/538729297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ba4101980 0x7f5ba40699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.046+0000 7f5bac164640 1 -- 172.21.15.6:0/538729297 >> 172.21.15.6:0/538729297 conn(0x7f5ba40fcb70 msgr2=0x7f5ba41038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:22.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.046+0000 7f5bac164640 1 -- 172.21.15.6:0/538729297 shutdown_connections 2024-05-20T17:05:22.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.046+0000 7f5bac164640 1 -- 172.21.15.6:0/538729297 wait complete. 2024-05-20T17:05:22.057 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:05:22.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.175+0000 7f12b1232640 1 -- 172.21.15.6:0/3290005575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12ac108840 msgr2=0x7f12ac10ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:22.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.175+0000 7f12b1232640 1 --2- 172.21.15.6:0/3290005575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12ac108840 0x7f12ac10ac60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009ca0 tx=0x7f12a402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.176+0000 7f12b1232640 1 -- 172.21.15.6:0/3290005575 shutdown_connections 2024-05-20T17:05:22.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.176+0000 7f12b1232640 1 --2- 172.21.15.6:0/3290005575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12ac108840 0x7f12ac10ac60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.176+0000 7f12b1232640 1 --2- 172.21.15.6:0/3290005575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12ac105ee0 0x7f12ac108300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.176+0000 7f12b1232640 1 --2- 172.21.15.6:0/3290005575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12ac103580 0x7f12ac1059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.176+0000 7f12b1232640 1 -- 172.21.15.6:0/3290005575 >> 172.21.15.6:0/3290005575 conn(0x7f12ac0fcba0 msgr2=0x7f12ac0ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:22.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.176+0000 7f12b1232640 1 -- 172.21.15.6:0/3290005575 shutdown_connections 2024-05-20T17:05:22.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.176+0000 7f12b1232640 1 -- 172.21.15.6:0/3290005575 wait complete. 2024-05-20T17:05:22.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.176+0000 7f12b1232640 1 Processor -- start 2024-05-20T17:05:22.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.177+0000 7f12b1232640 1 -- start start 2024-05-20T17:05:22.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.177+0000 7f12b1232640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12ac103580 0x7f12ac1029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:22.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.177+0000 7f12b1232640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12ac105ee0 0x7f12ac101070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:22.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.177+0000 7f12b1232640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12ac108840 0x7f12ac1015b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:22.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.177+0000 7f12b1232640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac10e5c0 con 0x7f12ac108840 2024-05-20T17:05:22.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.177+0000 7f12b1232640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac10e440 con 0x7f12ac103580 2024-05-20T17:05:22.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.177+0000 7f12b1232640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac10e740 con 0x7f12ac105ee0 2024-05-20T17:05:22.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.177+0000 7f12ab59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12ac108840 0x7f12ac1015b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.177+0000 7f12ab59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12ac108840 0x7f12ac1015b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35836/0 (socket says 172.21.15.6:35836) 2024-05-20T17:05:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.177+0000 7f12ab59e640 1 -- 172.21.15.6:0/3170733801 learned_addr learned my addr 172.21.15.6:0/3170733801 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.177+0000 7f12aa59c640 1 --2- 172.21.15.6:0/3170733801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12ac105ee0 0x7f12ac101070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.177+0000 7f12aad9d640 1 --2- 172.21.15.6:0/3170733801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12ac103580 0x7f12ac1029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.177+0000 7f12ab59e640 1 -- 172.21.15.6:0/3170733801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12ac105ee0 msgr2=0x7f12ac101070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.177+0000 7f12ab59e640 1 --2- 172.21.15.6:0/3170733801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12ac105ee0 0x7f12ac101070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.177+0000 7f12ab59e640 1 -- 172.21.15.6:0/3170733801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12ac103580 msgr2=0x7f12ac1029d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.177+0000 7f12ab59e640 1 --2- 172.21.15.6:0/3170733801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12ac103580 0x7f12ac1029d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.177+0000 7f12ab59e640 1 -- 172.21.15.6:0/3170733801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ac101ce0 con 0x7f12ac108840 2024-05-20T17:05:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.178+0000 7f12ab59e640 1 --2- 172.21.15.6:0/3170733801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12ac108840 0x7f12ac1015b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f12a4003ba0 tx=0x7f12a4003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.178+0000 7f1293fff640 1 -- 172.21.15.6:0/3170733801 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a4003df0 con 0x7f12ac108840 2024-05-20T17:05:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.178+0000 7f1293fff640 1 -- 172.21.15.6:0/3170733801 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12a40044f0 con 0x7f12ac108840 2024-05-20T17:05:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.178+0000 7f12b1232640 1 -- 172.21.15.6:0/3170733801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12ac1a3250 con 0x7f12ac108840 2024-05-20T17:05:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.178+0000 7f1293fff640 1 -- 172.21.15.6:0/3170733801 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a4030ba0 con 0x7f12ac108840 2024-05-20T17:05:22.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.178+0000 7f12b1232640 1 -- 172.21.15.6:0/3170733801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12ac1a3710 con 0x7f12ac108840 2024-05-20T17:05:22.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.179+0000 7f12b1232640 1 -- 172.21.15.6:0/3170733801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12ac0fe6c0 con 0x7f12ac108840 2024-05-20T17:05:22.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.180+0000 7f1293fff640 1 -- 172.21.15.6:0/3170733801 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f12a4004040 con 0x7f12ac108840 2024-05-20T17:05:22.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.181+0000 7f1293fff640 1 --2- 172.21.15.6:0/3170733801 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f12940a2c10 0x7f12940a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:22.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.181+0000 7f12aad9d640 1 --2- 172.21.15.6:0/3170733801 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f12940a2c10 0x7f12940a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:22.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.181+0000 7f1293fff640 1 -- 172.21.15.6:0/3170733801 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f12a40f0720 con 0x7f12ac108840 2024-05-20T17:05:22.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.181+0000 7f12aad9d640 1 --2- 172.21.15.6:0/3170733801 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f12940a2c10 0x7f12940a5120 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f129c005d00 tx=0x7f129c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:22.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.186+0000 7f1293fff640 1 -- 172.21.15.6:0/3170733801 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f12a40bd3e0 con 0x7f12ac108840 2024-05-20T17:05:22.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.368+0000 7f12b1232640 1 -- 172.21.15.6:0/3170733801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f12ac062750 con 0x7f12ac108840 2024-05-20T17:05:22.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.369+0000 7f1293fff640 1 -- 172.21.15.6:0/3170733801 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) ==== 103+0+11 (secure 0 0 0) 0x7f12a40bcce0 con 0x7f12ac108840 2024-05-20T17:05:22.369 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:05:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.371+0000 7f12b1232640 1 -- 172.21.15.6:0/3170733801 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f12940a2c10 msgr2=0x7f12940a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.371+0000 7f12b1232640 1 --2- 172.21.15.6:0/3170733801 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f12940a2c10 0x7f12940a5120 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f129c005d00 tx=0x7f129c00b410 comp rx=0 tx=0).stop 2024-05-20T17:05:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.371+0000 7f12b1232640 1 -- 172.21.15.6:0/3170733801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12ac108840 msgr2=0x7f12ac1015b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.371+0000 7f12b1232640 1 --2- 172.21.15.6:0/3170733801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12ac108840 0x7f12ac1015b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f12a4003ba0 tx=0x7f12a4003bd0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.371+0000 7f12b1232640 1 -- 172.21.15.6:0/3170733801 shutdown_connections 2024-05-20T17:05:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.371+0000 7f12b1232640 1 --2- 172.21.15.6:0/3170733801 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f12940a2c10 0x7f12940a5120 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.371+0000 7f12b1232640 1 --2- 172.21.15.6:0/3170733801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12ac108840 0x7f12ac1015b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.371+0000 7f12b1232640 1 --2- 172.21.15.6:0/3170733801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12ac105ee0 0x7f12ac101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.371+0000 7f12b1232640 1 --2- 172.21.15.6:0/3170733801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12ac103580 0x7f12ac1029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.371+0000 7f12b1232640 1 -- 172.21.15.6:0/3170733801 >> 172.21.15.6:0/3170733801 conn(0x7f12ac0fcba0 msgr2=0x7f12ac1041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.371+0000 7f12b1232640 1 -- 172.21.15.6:0/3170733801 shutdown_connections 2024-05-20T17:05:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.371+0000 7f12b1232640 1 -- 172.21.15.6:0/3170733801 wait complete. 2024-05-20T17:05:22.383 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:05:22.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.499+0000 7f5afd27a640 1 -- 172.21.15.6:0/3118258218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af8105ed0 msgr2=0x7f5af81082f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.499+0000 7f5afd27a640 1 --2- 172.21.15.6:0/3118258218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af8105ed0 0x7f5af81082f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5aec009ca0 tx=0x7f5aec02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.499+0000 7f5afd27a640 1 -- 172.21.15.6:0/3118258218 shutdown_connections 2024-05-20T17:05:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.499+0000 7f5afd27a640 1 --2- 172.21.15.6:0/3118258218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5af8108830 0x7f5af810ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.499+0000 7f5afd27a640 1 --2- 172.21.15.6:0/3118258218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af8105ed0 0x7f5af81082f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.499+0000 7f5afd27a640 1 --2- 172.21.15.6:0/3118258218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5af8103570 0x7f5af8105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.499+0000 7f5afd27a640 1 -- 172.21.15.6:0/3118258218 >> 172.21.15.6:0/3118258218 conn(0x7f5af80fcb70 msgr2=0x7f5af80ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.499+0000 7f5afd27a640 1 -- 172.21.15.6:0/3118258218 shutdown_connections 2024-05-20T17:05:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.499+0000 7f5afd27a640 1 -- 172.21.15.6:0/3118258218 wait complete. 2024-05-20T17:05:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.499+0000 7f5afd27a640 1 Processor -- start 2024-05-20T17:05:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.500+0000 7f5afd27a640 1 -- start start 2024-05-20T17:05:22.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.500+0000 7f5afd27a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5af8103570 0x7f5af81991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:22.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.500+0000 7f5afd27a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5af8105ed0 0x7f5af8199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:22.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.500+0000 7f5afd27a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af8108830 0x7f5af81a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:22.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.500+0000 7f5afd27a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5af810e5b0 con 0x7f5af8108830 2024-05-20T17:05:22.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.500+0000 7f5afd27a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5af810e430 con 0x7f5af8105ed0 2024-05-20T17:05:22.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.500+0000 7f5afd27a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5af810e730 con 0x7f5af8103570 2024-05-20T17:05:22.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.500+0000 7f5af77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af8108830 0x7f5af81a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:22.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.500+0000 7f5af77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af8108830 0x7f5af81a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35846/0 (socket says 172.21.15.6:35846) 2024-05-20T17:05:22.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.500+0000 7f5af77fe640 1 -- 172.21.15.6:0/3123209139 learned_addr learned my addr 172.21.15.6:0/3123209139 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:22.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.500+0000 7f5af6ffd640 1 --2- 172.21.15.6:0/3123209139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5af8103570 0x7f5af81991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:22.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.500+0000 7f5af67fc640 1 --2- 172.21.15.6:0/3123209139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5af8105ed0 0x7f5af8199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:22.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.500+0000 7f5af77fe640 1 -- 172.21.15.6:0/3123209139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5af8103570 msgr2=0x7f5af81991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:22.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.500+0000 7f5af77fe640 1 --2- 172.21.15.6:0/3123209139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5af8103570 0x7f5af81991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.500+0000 7f5af77fe640 1 -- 172.21.15.6:0/3123209139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5af8105ed0 msgr2=0x7f5af8199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:22.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.500+0000 7f5af77fe640 1 --2- 172.21.15.6:0/3123209139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5af8105ed0 0x7f5af8199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.500+0000 7f5af77fe640 1 -- 172.21.15.6:0/3123209139 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af81a0d20 con 0x7f5af8108830 2024-05-20T17:05:22.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.501+0000 7f5af77fe640 1 --2- 172.21.15.6:0/3123209139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af8108830 0x7f5af81a06b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5af000d950 tx=0x7f5af000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:22.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.501+0000 7f5adffff640 1 -- 172.21.15.6:0/3123209139 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0017070 con 0x7f5af8108830 2024-05-20T17:05:22.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.501+0000 7f5adffff640 1 -- 172.21.15.6:0/3123209139 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5af0009c30 con 0x7f5af8108830 2024-05-20T17:05:22.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.501+0000 7f5adffff640 1 -- 172.21.15.6:0/3123209139 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af000f620 con 0x7f5af8108830 2024-05-20T17:05:22.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.501+0000 7f5afd27a640 1 -- 172.21.15.6:0/3123209139 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af81a0fb0 con 0x7f5af8108830 2024-05-20T17:05:22.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.501+0000 7f5afd27a640 1 -- 172.21.15.6:0/3123209139 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af81a1470 con 0x7f5af8108830 2024-05-20T17:05:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.502+0000 7f5afd27a640 1 -- 172.21.15.6:0/3123209139 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af80fe690 con 0x7f5af8108830 2024-05-20T17:05:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.503+0000 7f5adffff640 1 -- 172.21.15.6:0/3123209139 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f5af001a070 con 0x7f5af8108830 2024-05-20T17:05:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.504+0000 7f5adffff640 1 --2- 172.21.15.6:0/3123209139 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5ae00a2c10 0x7f5ae00a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.504+0000 7f5adffff640 1 -- 172.21.15.6:0/3123209139 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f5af00cec30 con 0x7f5af8108830 2024-05-20T17:05:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.504+0000 7f5af6ffd640 1 --2- 172.21.15.6:0/3123209139 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5ae00a2c10 0x7f5ae00a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.504+0000 7f5af6ffd640 1 --2- 172.21.15.6:0/3123209139 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5ae00a2c10 0x7f5ae00a5120 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5af80699d0 tx=0x7f5ae8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:22.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.508+0000 7f5adffff640 1 -- 172.21.15.6:0/3123209139 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5af0009de0 con 0x7f5af8108830 2024-05-20T17:05:22.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.706+0000 7f5afd27a640 1 -- 172.21.15.6:0/3123209139 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5af802d2a0 con 0x7f5af8108830 2024-05-20T17:05:22.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.707+0000 7f5adffff640 1 -- 172.21.15.6:0/3123209139 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+579 (secure 0 0 0) 0x7f5af009b970 con 0x7f5af8108830 2024-05-20T17:05:22.707 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/3509827796 2024-05-21T16:57:41.985704+0000 2024-05-20T17:05:22.707 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/3509827796 2024-05-21T16:57:41.985704+0000 2024-05-20T17:05:22.707 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/173523304 2024-05-21T16:57:41.985704+0000 2024-05-20T17:05:22.708 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/741681069 2024-05-21T16:57:14.356112+0000 2024-05-20T17:05:22.708 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2415124466 2024-05-21T16:57:14.356112+0000 2024-05-20T17:05:22.708 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3427029758 2024-05-21T16:57:14.356112+0000 2024-05-20T17:05:22.708 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/741681069 2024-05-21T16:57:14.356112+0000 2024-05-20T17:05:22.708 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3324031224 2024-05-21T16:57:14.356112+0000 2024-05-20T17:05:22.708 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3781923966 2024-05-21T16:57:41.985704+0000 2024-05-20T17:05:22.708 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2979361383 2024-05-21T16:57:41.985704+0000 2024-05-20T17:05:22.708 INFO:teuthology.orchestra.run.smithi006.stderr:listed 10 entries 2024-05-20T17:05:22.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.709+0000 7f5afd27a640 1 -- 172.21.15.6:0/3123209139 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5ae00a2c10 msgr2=0x7f5ae00a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:22.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.709+0000 7f5afd27a640 1 --2- 172.21.15.6:0/3123209139 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5ae00a2c10 0x7f5ae00a5120 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5af80699d0 tx=0x7f5ae8005f90 comp rx=0 tx=0).stop 2024-05-20T17:05:22.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.709+0000 7f5afd27a640 1 -- 172.21.15.6:0/3123209139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af8108830 msgr2=0x7f5af81a06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:22.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.709+0000 7f5afd27a640 1 --2- 172.21.15.6:0/3123209139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af8108830 0x7f5af81a06b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5af000d950 tx=0x7f5af000de10 comp rx=0 tx=0).stop 2024-05-20T17:05:22.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.709+0000 7f5afd27a640 1 -- 172.21.15.6:0/3123209139 shutdown_connections 2024-05-20T17:05:22.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.709+0000 7f5afd27a640 1 --2- 172.21.15.6:0/3123209139 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5ae00a2c10 0x7f5ae00a5120 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.709+0000 7f5afd27a640 1 --2- 172.21.15.6:0/3123209139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af8108830 0x7f5af81a06b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.709+0000 7f5afd27a640 1 --2- 172.21.15.6:0/3123209139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5af8105ed0 0x7f5af8199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.709+0000 7f5afd27a640 1 --2- 172.21.15.6:0/3123209139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5af8103570 0x7f5af81991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:22.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.709+0000 7f5afd27a640 1 -- 172.21.15.6:0/3123209139 >> 172.21.15.6:0/3123209139 conn(0x7f5af80fcb70 msgr2=0x7f5af8104220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:22.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.709+0000 7f5afd27a640 1 -- 172.21.15.6:0/3123209139 shutdown_connections 2024-05-20T17:05:22.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:22.709+0000 7f5afd27a640 1 -- 172.21.15.6:0/3123209139 wait complete. 2024-05-20T17:05:22.720 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:22 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3821594640' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:05:22.720 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:22 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/538729297' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:05:22.720 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:22 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3170733801' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:05:22.721 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2024-05-20T17:05:22.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:05:22.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-20T17:05:22.746 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:ceph-fuse[76047]: fuse finished with error 0 and tester_r 0 2024-05-20T17:05:22.747 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:05:22.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:22 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3821594640' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:05:22.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:22 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/538729297' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:05:22.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:22 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3170733801' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:05:23.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:22 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3821594640' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:05:23.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:22 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/538729297' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:05:23.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:22 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3170733801' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:05:23.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:23 smithi171 ceph-mon[35901]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-20T17:05:23.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:23 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3123209139' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-20T17:05:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:23 smithi006 ceph-mon[32486]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-20T17:05:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:23 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3123209139' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-20T17:05:24.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:23 smithi062 ceph-mon[35425]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-20T17:05:24.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:23 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3123209139' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-20T17:05:25.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:25 smithi171 ceph-mon[35901]: pgmap v311: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-20T17:05:25.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:25 smithi006 ceph-mon[32486]: pgmap v311: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-20T17:05:26.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:25 smithi062 ceph-mon[35425]: pgmap v311: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-20T17:05:27.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:27 smithi171 ceph-mon[35901]: pgmap v312: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-20T17:05:27.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:27 smithi006 ceph-mon[32486]: pgmap v312: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-20T17:05:28.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:27 smithi062 ceph-mon[35425]: pgmap v312: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-20T17:05:28.849 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T17:05:28.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:05:28.849 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-20T17:05:28.880 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:05:29.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.039+0000 7f8db07d5640 1 -- 172.21.15.6:0/938920308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8da81019b0 msgr2=0x7f8da81026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:29.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.039+0000 7f8db07d5640 1 --2- 172.21.15.6:0/938920308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8da81019b0 0x7f8da81026b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009900 tx=0x7f8da402a410 comp rx=0 tx=0).stop 2024-05-20T17:05:29.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.039+0000 7f8db07d5640 1 -- 172.21.15.6:0/938920308 shutdown_connections 2024-05-20T17:05:29.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.039+0000 7f8db07d5640 1 --2- 172.21.15.6:0/938920308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8da81078f0 0x7f8da8109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.039+0000 7f8db07d5640 1 --2- 172.21.15.6:0/938920308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8da8102bf0 0x7f8da8103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.039+0000 7f8db07d5640 1 --2- 172.21.15.6:0/938920308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8da81019b0 0x7f8da81026b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.039+0000 7f8db07d5640 1 -- 172.21.15.6:0/938920308 >> 172.21.15.6:0/938920308 conn(0x7f8da80fcba0 msgr2=0x7f8da80ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:29.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.039+0000 7f8db07d5640 1 -- 172.21.15.6:0/938920308 shutdown_connections 2024-05-20T17:05:29.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.039+0000 7f8db07d5640 1 -- 172.21.15.6:0/938920308 wait complete. 2024-05-20T17:05:29.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.040+0000 7f8db07d5640 1 Processor -- start 2024-05-20T17:05:29.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.040+0000 7f8db07d5640 1 -- start start 2024-05-20T17:05:29.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.040+0000 7f8db07d5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8da81019b0 0x7f8da8199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:29.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.040+0000 7f8db07d5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8da8102bf0 0x7f8da8199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:29.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.040+0000 7f8db07d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8da81078f0 0x7f8da81a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:29.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.040+0000 7f8db07d5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8da810e600 con 0x7f8da81078f0 2024-05-20T17:05:29.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.040+0000 7f8db07d5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8da810e480 con 0x7f8da8102bf0 2024-05-20T17:05:29.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.040+0000 7f8db07d5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8da810e780 con 0x7f8da81019b0 2024-05-20T17:05:29.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.041+0000 7f8daed72640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8da81078f0 0x7f8da81a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:29.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.041+0000 7f8daed72640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8da81078f0 0x7f8da81a0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35864/0 (socket says 172.21.15.6:35864) 2024-05-20T17:05:29.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.041+0000 7f8daed72640 1 -- 172.21.15.6:0/2543912841 learned_addr learned my addr 172.21.15.6:0/2543912841 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:29.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.041+0000 7f8dadd70640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8da8102bf0 0x7f8da8199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:29.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.041+0000 7f8dae571640 1 --2- 172.21.15.6:0/2543912841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8da81019b0 0x7f8da8199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:29.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.041+0000 7f8daed72640 1 -- 172.21.15.6:0/2543912841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8da81019b0 msgr2=0x7f8da8199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:29.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.041+0000 7f8daed72640 1 --2- 172.21.15.6:0/2543912841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8da81019b0 0x7f8da8199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.041+0000 7f8daed72640 1 -- 172.21.15.6:0/2543912841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8da8102bf0 msgr2=0x7f8da8199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:29.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.041+0000 7f8daed72640 1 --2- 172.21.15.6:0/2543912841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8da8102bf0 0x7f8da8199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.041+0000 7f8daed72640 1 -- 172.21.15.6:0/2543912841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da81a0c90 con 0x7f8da81078f0 2024-05-20T17:05:29.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.041+0000 7f8dae571640 1 --2- 172.21.15.6:0/2543912841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8da81019b0 0x7f8da8199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:05:29.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.041+0000 7f8dadd70640 1 --2- 172.21.15.6:0/2543912841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8da8102bf0 0x7f8da8199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:05:29.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.041+0000 7f8daed72640 1 --2- 172.21.15.6:0/2543912841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8da81078f0 0x7f8da81a0620 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8da000eb10 tx=0x7f8da000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:29.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.041+0000 7f8d9f7fe640 1 -- 172.21.15.6:0/2543912841 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da0004b20 con 0x7f8da81078f0 2024-05-20T17:05:29.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.041+0000 7f8d9f7fe640 1 -- 172.21.15.6:0/2543912841 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8da0004cc0 con 0x7f8da81078f0 2024-05-20T17:05:29.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.041+0000 7f8db07d5640 1 -- 172.21.15.6:0/2543912841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da81a0f80 con 0x7f8da81078f0 2024-05-20T17:05:29.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.041+0000 7f8d9f7fe640 1 -- 172.21.15.6:0/2543912841 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da0010690 con 0x7f8da81078f0 2024-05-20T17:05:29.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.041+0000 7f8db07d5640 1 -- 172.21.15.6:0/2543912841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da81a1390 con 0x7f8da81078f0 2024-05-20T17:05:29.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.042+0000 7f8db07d5640 1 -- 172.21.15.6:0/2543912841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8da80691f0 con 0x7f8da81078f0 2024-05-20T17:05:29.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.044+0000 7f8d9f7fe640 1 -- 172.21.15.6:0/2543912841 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f8da0005000 con 0x7f8da81078f0 2024-05-20T17:05:29.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.045+0000 7f8d9f7fe640 1 --2- 172.21.15.6:0/2543912841 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8d940a2c30 0x7f8d940a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:29.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.045+0000 7f8dae571640 1 --2- 172.21.15.6:0/2543912841 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8d940a2c30 0x7f8d940a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:29.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.045+0000 7f8d9f7fe640 1 -- 172.21.15.6:0/2543912841 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f8da00cfab0 con 0x7f8da81078f0 2024-05-20T17:05:29.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.045+0000 7f8dae571640 1 --2- 172.21.15.6:0/2543912841 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8d940a2c30 0x7f8d940a5140 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8da4005ab0 tx=0x7f8da4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:29.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.049+0000 7f8d9f7fe640 1 -- 172.21.15.6:0/2543912841 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8da0053850 con 0x7f8da81078f0 2024-05-20T17:05:29.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.235+0000 7f8db07d5640 1 -- 172.21.15.6:0/2543912841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8da8106750 con 0x7f8da81078f0 2024-05-20T17:05:29.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.237+0000 7f8d9f7fe640 1 -- 172.21.15.6:0/2543912841 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+23973 (secure 0 0 0) 0x7f8da8106750 con 0x7f8da81078f0 2024-05-20T17:05:29.237 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:05:29.237 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":90,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:05:09.495505+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:05:02.947896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:05:03.842231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:05:07.551471+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:05:29.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.239+0000 7f8db07d5640 1 -- 172.21.15.6:0/2543912841 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8d940a2c30 msgr2=0x7f8d940a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:29.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.239+0000 7f8db07d5640 1 --2- 172.21.15.6:0/2543912841 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8d940a2c30 0x7f8d940a5140 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8da4005ab0 tx=0x7f8da4005fd0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.239+0000 7f8db07d5640 1 -- 172.21.15.6:0/2543912841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8da81078f0 msgr2=0x7f8da81a0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:29.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.239+0000 7f8db07d5640 1 --2- 172.21.15.6:0/2543912841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8da81078f0 0x7f8da81a0620 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8da000eb10 tx=0x7f8da000c2d0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.239+0000 7f8db07d5640 1 -- 172.21.15.6:0/2543912841 shutdown_connections 2024-05-20T17:05:29.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.239+0000 7f8db07d5640 1 --2- 172.21.15.6:0/2543912841 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8d940a2c30 0x7f8d940a5140 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.239+0000 7f8db07d5640 1 --2- 172.21.15.6:0/2543912841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8da81078f0 0x7f8da81a0620 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.239+0000 7f8db07d5640 1 --2- 172.21.15.6:0/2543912841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8da8102bf0 0x7f8da8199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.239+0000 7f8db07d5640 1 --2- 172.21.15.6:0/2543912841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8da81019b0 0x7f8da8199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.239+0000 7f8db07d5640 1 -- 172.21.15.6:0/2543912841 >> 172.21.15.6:0/2543912841 conn(0x7f8da80fcba0 msgr2=0x7f8da81038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:29.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.239+0000 7f8db07d5640 1 -- 172.21.15.6:0/2543912841 shutdown_connections 2024-05-20T17:05:29.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.239+0000 7f8db07d5640 1 -- 172.21.15.6:0/2543912841 wait complete. 2024-05-20T17:05:29.250 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:05:29.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.366+0000 7f42692e9640 1 -- 172.21.15.6:0/1131237568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42641078f0 msgr2=0x7f4264109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:29.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.366+0000 7f42692e9640 1 --2- 172.21.15.6:0/1131237568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42641078f0 0x7f4264109d10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f425c009900 tx=0x7f425c02a410 comp rx=0 tx=0).stop 2024-05-20T17:05:29.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.366+0000 7f42692e9640 1 -- 172.21.15.6:0/1131237568 shutdown_connections 2024-05-20T17:05:29.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.366+0000 7f42692e9640 1 --2- 172.21.15.6:0/1131237568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42641078f0 0x7f4264109d10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.366+0000 7f42692e9640 1 --2- 172.21.15.6:0/1131237568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4264102bf0 0x7f4264103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.366+0000 7f42692e9640 1 --2- 172.21.15.6:0/1131237568 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42641019b0 0x7f42641026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.366+0000 7f42692e9640 1 -- 172.21.15.6:0/1131237568 >> 172.21.15.6:0/1131237568 conn(0x7f42640fcba0 msgr2=0x7f42640ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:29.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.366+0000 7f42692e9640 1 -- 172.21.15.6:0/1131237568 shutdown_connections 2024-05-20T17:05:29.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.366+0000 7f42692e9640 1 -- 172.21.15.6:0/1131237568 wait complete. 2024-05-20T17:05:29.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.366+0000 7f42692e9640 1 Processor -- start 2024-05-20T17:05:29.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.367+0000 7f42692e9640 1 -- start start 2024-05-20T17:05:29.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.367+0000 7f42692e9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42641019b0 0x7f4264197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:29.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.367+0000 7f42692e9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4264102bf0 0x7f4264198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:29.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.367+0000 7f42692e9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42641078f0 0x7f426419f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:29.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.367+0000 7f42692e9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f426410d530 con 0x7f42641019b0 2024-05-20T17:05:29.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.367+0000 7f42692e9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f426410d3b0 con 0x7f42641078f0 2024-05-20T17:05:29.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.367+0000 7f42692e9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f426410d6b0 con 0x7f4264102bf0 2024-05-20T17:05:29.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.367+0000 7f4262ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42641019b0 0x7f4264197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:29.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.367+0000 7f4262ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42641019b0 0x7f4264197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35882/0 (socket says 172.21.15.6:35882) 2024-05-20T17:05:29.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.367+0000 7f4262ffd640 1 -- 172.21.15.6:0/3251577743 learned_addr learned my addr 172.21.15.6:0/3251577743 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.367+0000 7f42627fc640 1 --2- 172.21.15.6:0/3251577743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4264102bf0 0x7f4264198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.367+0000 7f42637fe640 1 --2- 172.21.15.6:0/3251577743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42641078f0 0x7f426419f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.367+0000 7f4262ffd640 1 -- 172.21.15.6:0/3251577743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4264102bf0 msgr2=0x7f4264198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.367+0000 7f4262ffd640 1 --2- 172.21.15.6:0/3251577743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4264102bf0 0x7f4264198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.367+0000 7f4262ffd640 1 -- 172.21.15.6:0/3251577743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42641078f0 msgr2=0x7f426419f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.367+0000 7f4262ffd640 1 --2- 172.21.15.6:0/3251577743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42641078f0 0x7f426419f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.367+0000 7f4262ffd640 1 -- 172.21.15.6:0/3251577743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f426419fb20 con 0x7f42641019b0 2024-05-20T17:05:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.367+0000 7f4262ffd640 1 --2- 172.21.15.6:0/3251577743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42641019b0 0x7f4264197fe0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f425400e9f0 tx=0x7f425400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.368+0000 7f424bfff640 1 -- 172.21.15.6:0/3251577743 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425400ccc0 con 0x7f42641019b0 2024-05-20T17:05:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.368+0000 7f42692e9640 1 -- 172.21.15.6:0/3251577743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f426419fe10 con 0x7f42641019b0 2024-05-20T17:05:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.368+0000 7f424bfff640 1 -- 172.21.15.6:0/3251577743 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f42540035f0 con 0x7f42641019b0 2024-05-20T17:05:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.368+0000 7f424bfff640 1 -- 172.21.15.6:0/3251577743 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425400ce60 con 0x7f42641019b0 2024-05-20T17:05:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.368+0000 7f42692e9640 1 -- 172.21.15.6:0/3251577743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42641a0270 con 0x7f42641019b0 2024-05-20T17:05:29.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.369+0000 7f42692e9640 1 -- 172.21.15.6:0/3251577743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4264106700 con 0x7f42641019b0 2024-05-20T17:05:29.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.371+0000 7f424bfff640 1 -- 172.21.15.6:0/3251577743 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f4254004000 con 0x7f42641019b0 2024-05-20T17:05:29.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.372+0000 7f424bfff640 1 --2- 172.21.15.6:0/3251577743 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f424c0a2c30 0x7f424c0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:29.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.372+0000 7f42627fc640 1 --2- 172.21.15.6:0/3251577743 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f424c0a2c30 0x7f424c0a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:29.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.372+0000 7f424bfff640 1 -- 172.21.15.6:0/3251577743 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f42540cf7c0 con 0x7f42641019b0 2024-05-20T17:05:29.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.372+0000 7f42627fc640 1 --2- 172.21.15.6:0/3251577743 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f424c0a2c30 0x7f424c0a5140 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4264199080 tx=0x7f42580098d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:29.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.376+0000 7f424bfff640 1 -- 172.21.15.6:0/3251577743 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f425409c4e0 con 0x7f42641019b0 2024-05-20T17:05:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.561+0000 7f42692e9640 1 -- 172.21.15.6:0/3251577743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f426402d470 con 0x7f42641019b0 2024-05-20T17:05:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.563+0000 7f424bfff640 1 -- 172.21.15.6:0/3251577743 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+23973 (secure 0 0 0) 0x7f425409bde0 con 0x7f42641019b0 2024-05-20T17:05:29.563 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:05:29.563 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":90,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:05:09.495505+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:05:02.947896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:05:03.842231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:05:07.551471+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:05:29.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.565+0000 7f42692e9640 1 -- 172.21.15.6:0/3251577743 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f424c0a2c30 msgr2=0x7f424c0a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:29.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.565+0000 7f42692e9640 1 --2- 172.21.15.6:0/3251577743 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f424c0a2c30 0x7f424c0a5140 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4264199080 tx=0x7f42580098d0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.565+0000 7f42692e9640 1 -- 172.21.15.6:0/3251577743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42641019b0 msgr2=0x7f4264197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:29.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.565+0000 7f42692e9640 1 --2- 172.21.15.6:0/3251577743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42641019b0 0x7f4264197fe0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f425400e9f0 tx=0x7f425400eeb0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.565+0000 7f42692e9640 1 -- 172.21.15.6:0/3251577743 shutdown_connections 2024-05-20T17:05:29.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.565+0000 7f42692e9640 1 --2- 172.21.15.6:0/3251577743 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f424c0a2c30 0x7f424c0a5140 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.565+0000 7f42692e9640 1 --2- 172.21.15.6:0/3251577743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42641078f0 0x7f426419f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.565+0000 7f42692e9640 1 --2- 172.21.15.6:0/3251577743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4264102bf0 0x7f4264198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.565+0000 7f42692e9640 1 --2- 172.21.15.6:0/3251577743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42641019b0 0x7f4264197fe0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.565+0000 7f42692e9640 1 -- 172.21.15.6:0/3251577743 >> 172.21.15.6:0/3251577743 conn(0x7f42640fcba0 msgr2=0x7f42641038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:29.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.565+0000 7f42692e9640 1 -- 172.21.15.6:0/3251577743 shutdown_connections 2024-05-20T17:05:29.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.565+0000 7f42692e9640 1 -- 172.21.15.6:0/3251577743 wait complete. 2024-05-20T17:05:29.576 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-20T17:05:29.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.695+0000 7fc761921640 1 -- 172.21.15.6:0/1387607670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc75c102bc0 msgr2=0x7fc75c102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:29.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.695+0000 7fc761921640 1 --2- 172.21.15.6:0/1387607670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc75c102bc0 0x7fc75c102fd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc750009900 tx=0x7fc75002a410 comp rx=0 tx=0).stop 2024-05-20T17:05:29.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.695+0000 7fc761921640 1 -- 172.21.15.6:0/1387607670 shutdown_connections 2024-05-20T17:05:29.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.695+0000 7fc761921640 1 --2- 172.21.15.6:0/1387607670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc75c1078c0 0x7fc75c109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.695+0000 7fc761921640 1 --2- 172.21.15.6:0/1387607670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc75c102bc0 0x7fc75c102fd0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.695+0000 7fc761921640 1 --2- 172.21.15.6:0/1387607670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc75c101980 0x7fc75c102680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.696+0000 7fc761921640 1 -- 172.21.15.6:0/1387607670 >> 172.21.15.6:0/1387607670 conn(0x7fc75c0fcb70 msgr2=0x7fc75c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.696+0000 7fc761921640 1 -- 172.21.15.6:0/1387607670 shutdown_connections 2024-05-20T17:05:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.696+0000 7fc761921640 1 -- 172.21.15.6:0/1387607670 wait complete. 2024-05-20T17:05:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.696+0000 7fc761921640 1 Processor -- start 2024-05-20T17:05:29.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.696+0000 7fc761921640 1 -- start start 2024-05-20T17:05:29.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc761921640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc75c101980 0x7fc75c198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:29.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc761921640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc75c102bc0 0x7fc75c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:29.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc761921640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc75c1078c0 0x7fc75c19f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:29.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc761921640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc75c10d480 con 0x7fc75c1078c0 2024-05-20T17:05:29.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc761921640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc75c10d300 con 0x7fc75c102bc0 2024-05-20T17:05:29.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc761921640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc75c10d600 con 0x7fc75c101980 2024-05-20T17:05:29.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc75b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc75c1078c0 0x7fc75c19f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:29.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc75b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc75c1078c0 0x7fc75c19f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35894/0 (socket says 172.21.15.6:35894) 2024-05-20T17:05:29.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc75b7fe640 1 -- 172.21.15.6:0/2275127281 learned_addr learned my addr 172.21.15.6:0/2275127281 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:29.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc75affd640 1 --2- 172.21.15.6:0/2275127281 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc75c101980 0x7fc75c198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:29.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc75a7fc640 1 --2- 172.21.15.6:0/2275127281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc75c102bc0 0x7fc75c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:29.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc75b7fe640 1 -- 172.21.15.6:0/2275127281 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc75c101980 msgr2=0x7fc75c198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:29.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc75b7fe640 1 --2- 172.21.15.6:0/2275127281 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc75c101980 0x7fc75c198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc75b7fe640 1 -- 172.21.15.6:0/2275127281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc75c102bc0 msgr2=0x7fc75c1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:29.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc75b7fe640 1 --2- 172.21.15.6:0/2275127281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc75c102bc0 0x7fc75c1985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:29.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc75b7fe640 1 -- 172.21.15.6:0/2275127281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75c19fbc0 con 0x7fc75c1078c0 2024-05-20T17:05:29.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc75a7fc640 1 --2- 172.21.15.6:0/2275127281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc75c102bc0 0x7fc75c1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:05:29.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc75affd640 1 --2- 172.21.15.6:0/2275127281 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc75c101980 0x7fc75c198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:05:29.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc75b7fe640 1 --2- 172.21.15.6:0/2275127281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc75c1078c0 0x7fc75c19f550 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc75400eb10 tx=0x7fc75400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:29.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc76091f640 1 -- 172.21.15.6:0/2275127281 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc754004b20 con 0x7fc75c1078c0 2024-05-20T17:05:29.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.697+0000 7fc76091f640 1 -- 172.21.15.6:0/2275127281 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc754004cc0 con 0x7fc75c1078c0 2024-05-20T17:05:29.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.698+0000 7fc761921640 1 -- 172.21.15.6:0/2275127281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc75c19feb0 con 0x7fc75c1078c0 2024-05-20T17:05:29.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.698+0000 7fc76091f640 1 -- 172.21.15.6:0/2275127281 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc754010690 con 0x7fc75c1078c0 2024-05-20T17:05:29.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.698+0000 7fc761921640 1 -- 172.21.15.6:0/2275127281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc75c1a0310 con 0x7fc75c1078c0 2024-05-20T17:05:29.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.699+0000 7fc761921640 1 -- 172.21.15.6:0/2275127281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc75c068da0 con 0x7fc75c1078c0 2024-05-20T17:05:29.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.701+0000 7fc76091f640 1 -- 172.21.15.6:0/2275127281 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc754005000 con 0x7fc75c1078c0 2024-05-20T17:05:29.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.701+0000 7fc76091f640 1 --2- 172.21.15.6:0/2275127281 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc7440a2c10 0x7fc7440a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:29.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.702+0000 7fc76091f640 1 -- 172.21.15.6:0/2275127281 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fc7540cfb10 con 0x7fc75c1078c0 2024-05-20T17:05:29.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.702+0000 7fc75affd640 1 --2- 172.21.15.6:0/2275127281 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc7440a2c10 0x7fc7440a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:29.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.702+0000 7fc75affd640 1 --2- 172.21.15.6:0/2275127281 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc7440a2c10 0x7fc7440a5120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc75c102580 tx=0x7fc74c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:29.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.706+0000 7fc76091f640 1 -- 172.21.15.6:0/2275127281 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc754053850 con 0x7fc75c1078c0 2024-05-20T17:05:29.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:29 smithi006 ceph-mon[32486]: pgmap v313: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-20T17:05:29.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:29 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2543912841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:29.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:29 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3251577743' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:29.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:29.928+0000 7fc761921640 1 -- 172.21.15.6:0/2275127281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc75c02d360 con 0x7fc75c1078c0 2024-05-20T17:05:30.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:29 smithi062 ceph-mon[35425]: pgmap v313: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-20T17:05:30.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:29 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2543912841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:30.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:29 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3251577743' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:30.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:29 smithi171 ceph-mon[35901]: pgmap v313: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-20T17:05:30.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:29 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2543912841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:30.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:29 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3251577743' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.628+0000 7fc76091f640 1 -- 172.21.15.6:0/2275127281 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7fc75c068da0 con 0x7fc75c1078c0 2024-05-20T17:05:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.631+0000 7fc761921640 1 -- 172.21.15.6:0/2275127281 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc7440a2c10 msgr2=0x7fc7440a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.631+0000 7fc761921640 1 --2- 172.21.15.6:0/2275127281 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc7440a2c10 0x7fc7440a5120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc75c102580 tx=0x7fc74c005f90 comp rx=0 tx=0).stop 2024-05-20T17:05:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.631+0000 7fc761921640 1 -- 172.21.15.6:0/2275127281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc75c1078c0 msgr2=0x7fc75c19f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.631+0000 7fc761921640 1 --2- 172.21.15.6:0/2275127281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc75c1078c0 0x7fc75c19f550 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc75400eb10 tx=0x7fc75400c2d0 comp rx=0 tx=0).stop 2024-05-20T17:05:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.631+0000 7fc761921640 1 -- 172.21.15.6:0/2275127281 shutdown_connections 2024-05-20T17:05:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.631+0000 7fc761921640 1 --2- 172.21.15.6:0/2275127281 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc7440a2c10 0x7fc7440a5120 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.631+0000 7fc761921640 1 --2- 172.21.15.6:0/2275127281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc75c1078c0 0x7fc75c19f550 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.631+0000 7fc761921640 1 --2- 172.21.15.6:0/2275127281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc75c102bc0 0x7fc75c1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.631+0000 7fc761921640 1 --2- 172.21.15.6:0/2275127281 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc75c101980 0x7fc75c198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:30.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.631+0000 7fc761921640 1 -- 172.21.15.6:0/2275127281 >> 172.21.15.6:0/2275127281 conn(0x7fc75c0fcb70 msgr2=0x7fc75c1038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:30.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.631+0000 7fc761921640 1 -- 172.21.15.6:0/2275127281 shutdown_connections 2024-05-20T17:05:30.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.632+0000 7fc761921640 1 -- 172.21.15.6:0/2275127281 wait complete. 2024-05-20T17:05:30.645 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-05-20T17:05:30.645 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-05-20T17:05:30.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.771+0000 7fed80cca640 1 -- 172.21.15.6:0/3803281894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c108a20 msgr2=0x7fed7c10ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:30.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.771+0000 7fed80cca640 1 --2- 172.21.15.6:0/3803281894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c108a20 0x7fed7c10ae40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fed74009ca0 tx=0x7fed7402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:05:30.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.771+0000 7fed80cca640 1 -- 172.21.15.6:0/3803281894 shutdown_connections 2024-05-20T17:05:30.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.771+0000 7fed80cca640 1 --2- 172.21.15.6:0/3803281894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c108a20 0x7fed7c10ae40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:30.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.771+0000 7fed80cca640 1 --2- 172.21.15.6:0/3803281894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed7c1027e0 0x7fed7c102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:30.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.771+0000 7fed80cca640 1 --2- 172.21.15.6:0/3803281894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c104120 0x7fed7c1022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:30.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.771+0000 7fed80cca640 1 -- 172.21.15.6:0/3803281894 >> 172.21.15.6:0/3803281894 conn(0x7fed7c0fdcf0 msgr2=0x7fed7c100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:30.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.772+0000 7fed80cca640 1 -- 172.21.15.6:0/3803281894 shutdown_connections 2024-05-20T17:05:30.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.772+0000 7fed80cca640 1 -- 172.21.15.6:0/3803281894 wait complete. 2024-05-20T17:05:30.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.772+0000 7fed80cca640 1 Processor -- start 2024-05-20T17:05:30.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.772+0000 7fed80cca640 1 -- start start 2024-05-20T17:05:30.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed80cca640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c1027e0 0x7fed7c199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:30.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed80cca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c104120 0x7fed7c199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:30.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed80cca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed7c108a20 0x7fed7c1a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:30.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed80cca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fed7c10e700 con 0x7fed7c104120 2024-05-20T17:05:30.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed80cca640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fed7c10e580 con 0x7fed7c1027e0 2024-05-20T17:05:30.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed80cca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fed7c10e880 con 0x7fed7c108a20 2024-05-20T17:05:30.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed79d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c104120 0x7fed7c199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:30.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed79d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c104120 0x7fed7c199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60098/0 (socket says 172.21.15.6:60098) 2024-05-20T17:05:30.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed79d9b640 1 -- 172.21.15.6:0/2666802784 learned_addr learned my addr 172.21.15.6:0/2666802784 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:30.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed7a59c640 1 --2- 172.21.15.6:0/2666802784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c1027e0 0x7fed7c199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:30.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed7ad9d640 1 --2- 172.21.15.6:0/2666802784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed7c108a20 0x7fed7c1a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:30.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed79d9b640 1 -- 172.21.15.6:0/2666802784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed7c108a20 msgr2=0x7fed7c1a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:30.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed79d9b640 1 --2- 172.21.15.6:0/2666802784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed7c108a20 0x7fed7c1a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:30.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed79d9b640 1 -- 172.21.15.6:0/2666802784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c1027e0 msgr2=0x7fed7c199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:30.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed79d9b640 1 --2- 172.21.15.6:0/2666802784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c1027e0 0x7fed7c199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:30.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed79d9b640 1 -- 172.21.15.6:0/2666802784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7c1a0d80 con 0x7fed7c104120 2024-05-20T17:05:30.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed7ad9d640 1 --2- 172.21.15.6:0/2666802784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed7c108a20 0x7fed7c1a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:05:30.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed79d9b640 1 --2- 172.21.15.6:0/2666802784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c104120 0x7fed7c199780 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fed7000d950 tx=0x7fed7000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:30.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed6b7fe640 1 -- 172.21.15.6:0/2666802784 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed70017070 con 0x7fed7c104120 2024-05-20T17:05:30.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed6b7fe640 1 -- 172.21.15.6:0/2666802784 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fed70009c30 con 0x7fed7c104120 2024-05-20T17:05:30.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.773+0000 7fed6b7fe640 1 -- 172.21.15.6:0/2666802784 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7000f620 con 0x7fed7c104120 2024-05-20T17:05:30.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.774+0000 7fed80cca640 1 -- 172.21.15.6:0/2666802784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed7c1a1070 con 0x7fed7c104120 2024-05-20T17:05:30.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.774+0000 7fed80cca640 1 -- 172.21.15.6:0/2666802784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed7c1a15c0 con 0x7fed7c104120 2024-05-20T17:05:30.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.775+0000 7fed80cca640 1 -- 172.21.15.6:0/2666802784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed7c0691c0 con 0x7fed7c104120 2024-05-20T17:05:30.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.776+0000 7fed6b7fe640 1 -- 172.21.15.6:0/2666802784 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fed700109a0 con 0x7fed7c104120 2024-05-20T17:05:30.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.776+0000 7fed6b7fe640 1 --2- 172.21.15.6:0/2666802784 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fed640a2b90 0x7fed640a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:30.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.777+0000 7fed7a59c640 1 --2- 172.21.15.6:0/2666802784 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fed640a2b90 0x7fed640a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:30.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.777+0000 7fed6b7fe640 1 -- 172.21.15.6:0/2666802784 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fed700ceed0 con 0x7fed7c104120 2024-05-20T17:05:30.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.777+0000 7fed7a59c640 1 --2- 172.21.15.6:0/2666802784 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fed640a2b90 0x7fed640a50a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fed7c1036e0 tx=0x7fed6c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:30.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:30.782+0000 7fed6b7fe640 1 -- 172.21.15.6:0/2666802784 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fed70009de0 con 0x7fed7c104120 2024-05-20T17:05:30.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:30 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2275127281' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-20T17:05:31.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.010+0000 7fed80cca640 1 -- 172.21.15.6:0/2666802784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fed7c062750 con 0x7fed7c104120 2024-05-20T17:05:31.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:30 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2275127281' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-20T17:05:31.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:30 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2275127281' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-20T17:05:31.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.630+0000 7fed6b7fe640 1 -- 172.21.15.6:0/2666802784 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7fed7009bbf0 con 0x7fed7c104120 2024-05-20T17:05:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.633+0000 7fed80cca640 1 -- 172.21.15.6:0/2666802784 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fed640a2b90 msgr2=0x7fed640a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.633+0000 7fed80cca640 1 --2- 172.21.15.6:0/2666802784 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fed640a2b90 0x7fed640a50a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fed7c1036e0 tx=0x7fed6c005f90 comp rx=0 tx=0).stop 2024-05-20T17:05:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.633+0000 7fed80cca640 1 -- 172.21.15.6:0/2666802784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c104120 msgr2=0x7fed7c199780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.633+0000 7fed80cca640 1 --2- 172.21.15.6:0/2666802784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c104120 0x7fed7c199780 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fed7000d950 tx=0x7fed7000de10 comp rx=0 tx=0).stop 2024-05-20T17:05:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.633+0000 7fed80cca640 1 -- 172.21.15.6:0/2666802784 shutdown_connections 2024-05-20T17:05:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.633+0000 7fed80cca640 1 --2- 172.21.15.6:0/2666802784 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fed640a2b90 0x7fed640a50a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.633+0000 7fed80cca640 1 --2- 172.21.15.6:0/2666802784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed7c108a20 0x7fed7c1a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:31.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.633+0000 7fed80cca640 1 --2- 172.21.15.6:0/2666802784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c104120 0x7fed7c199780 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:31.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.633+0000 7fed80cca640 1 --2- 172.21.15.6:0/2666802784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c1027e0 0x7fed7c199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:31.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.633+0000 7fed80cca640 1 -- 172.21.15.6:0/2666802784 >> 172.21.15.6:0/2666802784 conn(0x7fed7c0fdcf0 msgr2=0x7fed7c104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:31.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.633+0000 7fed80cca640 1 -- 172.21.15.6:0/2666802784 shutdown_connections 2024-05-20T17:05:31.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.633+0000 7fed80cca640 1 -- 172.21.15.6:0/2666802784 wait complete. 2024-05-20T17:05:31.650 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-05-20T17:05:31.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.775+0000 7f114bf3e640 1 -- 172.21.15.6:0/1784712245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1144108840 msgr2=0x7f114410ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:31.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.775+0000 7f114bf3e640 1 --2- 172.21.15.6:0/1784712245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1144108840 0x7f114410ac60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f113c009900 tx=0x7f113c02a3f0 comp rx=0 tx=0).stop 2024-05-20T17:05:31.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.775+0000 7f114bf3e640 1 -- 172.21.15.6:0/1784712245 shutdown_connections 2024-05-20T17:05:31.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.775+0000 7f114bf3e640 1 --2- 172.21.15.6:0/1784712245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1144108840 0x7f114410ac60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:31.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.775+0000 7f114bf3e640 1 --2- 172.21.15.6:0/1784712245 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1144105ee0 0x7f1144108300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:31.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.775+0000 7f114bf3e640 1 --2- 172.21.15.6:0/1784712245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1144103580 0x7f11441059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:31.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.775+0000 7f114bf3e640 1 -- 172.21.15.6:0/1784712245 >> 172.21.15.6:0/1784712245 conn(0x7f11440fcb80 msgr2=0x7f11440ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:31.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.775+0000 7f114bf3e640 1 -- 172.21.15.6:0/1784712245 shutdown_connections 2024-05-20T17:05:31.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.775+0000 7f114bf3e640 1 -- 172.21.15.6:0/1784712245 wait complete. 2024-05-20T17:05:31.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.776+0000 7f114bf3e640 1 Processor -- start 2024-05-20T17:05:31.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.776+0000 7f114bf3e640 1 -- start start 2024-05-20T17:05:31.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.776+0000 7f114bf3e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1144103580 0x7f11441990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:31.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.776+0000 7f114bf3e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1144105ee0 0x7f1144199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:31.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.776+0000 7f114bf3e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1144108840 0x7f11441a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:31.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.776+0000 7f114bf3e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f114410e5a0 con 0x7f1144103580 2024-05-20T17:05:31.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.776+0000 7f114bf3e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f114410e420 con 0x7f1144105ee0 2024-05-20T17:05:31.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.776+0000 7f114bf3e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f114410e720 con 0x7f1144108840 2024-05-20T17:05:31.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.776+0000 7f1149cda640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1144103580 0x7f11441990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:31.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.776+0000 7f1149cda640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1144103580 0x7f11441990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60102/0 (socket says 172.21.15.6:60102) 2024-05-20T17:05:31.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.776+0000 7f1149cda640 1 -- 172.21.15.6:0/3000969758 learned_addr learned my addr 172.21.15.6:0/3000969758 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:31.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.776+0000 7f114a4db640 1 --2- 172.21.15.6:0/3000969758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1144108840 0x7f11441a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:31.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.776+0000 7f1149cda640 1 -- 172.21.15.6:0/3000969758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1144108840 msgr2=0x7f11441a05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:31.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.776+0000 7f1149cda640 1 --2- 172.21.15.6:0/3000969758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1144108840 0x7f11441a05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:31.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.776+0000 7f1149cda640 1 -- 172.21.15.6:0/3000969758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1144105ee0 msgr2=0x7f1144199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:31.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.776+0000 7f11494d9640 1 --2- 172.21.15.6:0/3000969758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1144105ee0 0x7f1144199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:31.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.776+0000 7f1149cda640 1 --2- 172.21.15.6:0/3000969758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1144105ee0 0x7f1144199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:31.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.776+0000 7f1149cda640 1 -- 172.21.15.6:0/3000969758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11441a0b70 con 0x7f1144103580 2024-05-20T17:05:31.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.776+0000 7f11494d9640 1 --2- 172.21.15.6:0/3000969758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1144105ee0 0x7f1144199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:05:31.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.777+0000 7f1149cda640 1 --2- 172.21.15.6:0/3000969758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1144103580 0x7f11441990e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f114000c970 tx=0x7f114000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:31.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.777+0000 7f1136ffd640 1 -- 172.21.15.6:0/3000969758 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140014070 con 0x7f1144103580 2024-05-20T17:05:31.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.777+0000 7f1136ffd640 1 -- 172.21.15.6:0/3000969758 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1140004440 con 0x7f1144103580 2024-05-20T17:05:31.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.777+0000 7f114bf3e640 1 -- 172.21.15.6:0/3000969758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11441a0e60 con 0x7f1144103580 2024-05-20T17:05:31.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.777+0000 7f1136ffd640 1 -- 172.21.15.6:0/3000969758 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140003e50 con 0x7f1144103580 2024-05-20T17:05:31.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.777+0000 7f114bf3e640 1 -- 172.21.15.6:0/3000969758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11441a12c0 con 0x7f1144103580 2024-05-20T17:05:31.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.778+0000 7f114bf3e640 1 -- 172.21.15.6:0/3000969758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11440691c0 con 0x7f1144103580 2024-05-20T17:05:31.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.779+0000 7f1136ffd640 1 -- 172.21.15.6:0/3000969758 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f1140017070 con 0x7f1144103580 2024-05-20T17:05:31.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.780+0000 7f1136ffd640 1 --2- 172.21.15.6:0/3000969758 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f11300a2d30 0x7f11300a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:31.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.780+0000 7f11494d9640 1 --2- 172.21.15.6:0/3000969758 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f11300a2d30 0x7f11300a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:31.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.780+0000 7f1136ffd640 1 -- 172.21.15.6:0/3000969758 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f11400cf5c0 con 0x7f1144103580 2024-05-20T17:05:31.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.781+0000 7f11494d9640 1 --2- 172.21.15.6:0/3000969758 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f11300a2d30 0x7f11300a5240 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f114419a180 tx=0x7f1138008370 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:31.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:31.784+0000 7f1136ffd640 1 -- 172.21.15.6:0/3000969758 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f114001e020 con 0x7f1144103580 2024-05-20T17:05:32.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.007+0000 7f114bf3e640 1 -- 172.21.15.6:0/3000969758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f114402d360 con 0x7f1144103580 2024-05-20T17:05:32.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:31 smithi062 ceph-mon[35425]: pgmap v314: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-20T17:05:32.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:31 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2275127281' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-20T17:05:32.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:31 smithi062 ceph-mon[35425]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:05:32.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:31 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2666802784' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-20T17:05:32.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:31 smithi171 ceph-mon[35901]: pgmap v314: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-20T17:05:32.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:31 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2275127281' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-20T17:05:32.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:31 smithi171 ceph-mon[35901]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:05:32.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:31 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2666802784' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-20T17:05:32.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:31 smithi006 ceph-mon[32486]: pgmap v314: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-20T17:05:32.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:31 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2275127281' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-20T17:05:32.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:31 smithi006 ceph-mon[32486]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:05:32.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:31 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2666802784' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-20T17:05:32.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.561+0000 7f1136ffd640 1 -- 172.21.15.6:0/3000969758 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7f114009c280 con 0x7f1144103580 2024-05-20T17:05:32.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.564+0000 7f114bf3e640 1 -- 172.21.15.6:0/3000969758 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f11300a2d30 msgr2=0x7f11300a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:32.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.564+0000 7f114bf3e640 1 --2- 172.21.15.6:0/3000969758 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f11300a2d30 0x7f11300a5240 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f114419a180 tx=0x7f1138008370 comp rx=0 tx=0).stop 2024-05-20T17:05:32.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.564+0000 7f114bf3e640 1 -- 172.21.15.6:0/3000969758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1144103580 msgr2=0x7f11441990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:32.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.564+0000 7f114bf3e640 1 --2- 172.21.15.6:0/3000969758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1144103580 0x7f11441990e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f114000c970 tx=0x7f114000ce30 comp rx=0 tx=0).stop 2024-05-20T17:05:32.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.564+0000 7f114bf3e640 1 -- 172.21.15.6:0/3000969758 shutdown_connections 2024-05-20T17:05:32.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.564+0000 7f114bf3e640 1 --2- 172.21.15.6:0/3000969758 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f11300a2d30 0x7f11300a5240 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:32.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.564+0000 7f114bf3e640 1 --2- 172.21.15.6:0/3000969758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1144108840 0x7f11441a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:32.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.564+0000 7f114bf3e640 1 --2- 172.21.15.6:0/3000969758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1144105ee0 0x7f1144199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:32.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.564+0000 7f114bf3e640 1 --2- 172.21.15.6:0/3000969758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1144103580 0x7f11441990e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:32.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.564+0000 7f114bf3e640 1 -- 172.21.15.6:0/3000969758 >> 172.21.15.6:0/3000969758 conn(0x7f11440fcb80 msgr2=0x7f11441040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:32.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.564+0000 7f114bf3e640 1 -- 172.21.15.6:0/3000969758 shutdown_connections 2024-05-20T17:05:32.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.564+0000 7f114bf3e640 1 -- 172.21.15.6:0/3000969758 wait complete. 2024-05-20T17:05:32.581 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-05-20T17:05:32.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.707+0000 7f3e50b77640 1 -- 172.21.15.6:0/322876542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e4c108720 msgr2=0x7f3e4c10ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:32.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.707+0000 7f3e50b77640 1 --2- 172.21.15.6:0/322876542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e4c108720 0x7f3e4c10ac30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009ca0 tx=0x7f3e4402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:05:32.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.708+0000 7f3e50b77640 1 -- 172.21.15.6:0/322876542 shutdown_connections 2024-05-20T17:05:32.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.708+0000 7f3e50b77640 1 --2- 172.21.15.6:0/322876542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e4c108720 0x7f3e4c10ac30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:32.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.708+0000 7f3e50b77640 1 --2- 172.21.15.6:0/322876542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e4c105bb0 0x7f3e4c108090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:32.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.708+0000 7f3e50b77640 1 --2- 172.21.15.6:0/322876542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e4c1031c0 0x7f3e4c1055e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:32.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.708+0000 7f3e50b77640 1 -- 172.21.15.6:0/322876542 >> 172.21.15.6:0/322876542 conn(0x7f3e4c0fcb80 msgr2=0x7f3e4c0ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:32.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.708+0000 7f3e50b77640 1 -- 172.21.15.6:0/322876542 shutdown_connections 2024-05-20T17:05:32.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.708+0000 7f3e50b77640 1 -- 172.21.15.6:0/322876542 wait complete. 2024-05-20T17:05:32.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.708+0000 7f3e50b77640 1 Processor -- start 2024-05-20T17:05:32.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.708+0000 7f3e50b77640 1 -- start start 2024-05-20T17:05:32.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.709+0000 7f3e50b77640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e4c1031c0 0x7f3e4c199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:32.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.709+0000 7f3e50b77640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e4c105bb0 0x7f3e4c199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:32.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.709+0000 7f3e50b77640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e4c108720 0x7f3e4c1a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:32.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.709+0000 7f3e50b77640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c10e5e0 con 0x7f3e4c108720 2024-05-20T17:05:32.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.709+0000 7f3e50b77640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c10e460 con 0x7f3e4c1031c0 2024-05-20T17:05:32.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.709+0000 7f3e50b77640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c10e760 con 0x7f3e4c105bb0 2024-05-20T17:05:32.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.709+0000 7f3e4ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e4c108720 0x7f3e4c1a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.709+0000 7f3e4ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e4c108720 0x7f3e4c1a0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60112/0 (socket says 172.21.15.6:60112) 2024-05-20T17:05:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.709+0000 7f3e4ad9d640 1 -- 172.21.15.6:0/2653150838 learned_addr learned my addr 172.21.15.6:0/2653150838 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.709+0000 7f3e4a59c640 1 --2- 172.21.15.6:0/2653150838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e4c1031c0 0x7f3e4c199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.709+0000 7f3e43fff640 1 --2- 172.21.15.6:0/2653150838 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e4c105bb0 0x7f3e4c199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.709+0000 7f3e4ad9d640 1 -- 172.21.15.6:0/2653150838 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e4c105bb0 msgr2=0x7f3e4c199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.709+0000 7f3e4ad9d640 1 --2- 172.21.15.6:0/2653150838 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e4c105bb0 0x7f3e4c199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.709+0000 7f3e4ad9d640 1 -- 172.21.15.6:0/2653150838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e4c1031c0 msgr2=0x7f3e4c199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.709+0000 7f3e4ad9d640 1 --2- 172.21.15.6:0/2653150838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e4c1031c0 0x7f3e4c199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.709+0000 7f3e4ad9d640 1 -- 172.21.15.6:0/2653150838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4c1a0c70 con 0x7f3e4c108720 2024-05-20T17:05:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.709+0000 7f3e4a59c640 1 --2- 172.21.15.6:0/2653150838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e4c1031c0 0x7f3e4c199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:05:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.709+0000 7f3e4ad9d640 1 --2- 172.21.15.6:0/2653150838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e4c108720 0x7f3e4c1a0600 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3e44031040 tx=0x7f3e44003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.710+0000 7f3e437fe640 1 -- 172.21.15.6:0/2653150838 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e44032ec0 con 0x7f3e4c108720 2024-05-20T17:05:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.710+0000 7f3e437fe640 1 -- 172.21.15.6:0/2653150838 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e440044f0 con 0x7f3e4c108720 2024-05-20T17:05:32.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.710+0000 7f3e50b77640 1 -- 172.21.15.6:0/2653150838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e4c1a0f00 con 0x7f3e4c108720 2024-05-20T17:05:32.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.710+0000 7f3e437fe640 1 -- 172.21.15.6:0/2653150838 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e44030cb0 con 0x7f3e4c108720 2024-05-20T17:05:32.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.710+0000 7f3e50b77640 1 -- 172.21.15.6:0/2653150838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e4c1a1360 con 0x7f3e4c108720 2024-05-20T17:05:32.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.711+0000 7f3e50b77640 1 -- 172.21.15.6:0/2653150838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e4c0691c0 con 0x7f3e4c108720 2024-05-20T17:05:32.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.712+0000 7f3e437fe640 1 -- 172.21.15.6:0/2653150838 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f3e44004040 con 0x7f3e4c108720 2024-05-20T17:05:32.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.713+0000 7f3e437fe640 1 --2- 172.21.15.6:0/2653150838 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3e380a2d30 0x7f3e380a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:32.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.714+0000 7f3e4a59c640 1 --2- 172.21.15.6:0/2653150838 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3e380a2d30 0x7f3e380a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:32.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.714+0000 7f3e437fe640 1 -- 172.21.15.6:0/2653150838 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f3e440f08b0 con 0x7f3e4c108720 2024-05-20T17:05:32.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.714+0000 7f3e4a59c640 1 --2- 172.21.15.6:0/2653150838 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3e380a2d30 0x7f3e380a5240 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c074740 tx=0x7f3e3c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:32.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.718+0000 7f3e437fe640 1 -- 172.21.15.6:0/2653150838 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3e440bd5b0 con 0x7f3e4c108720 2024-05-20T17:05:32.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:32 smithi171 ceph-mon[35901]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-20T17:05:32.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:32 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2666802784' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-20T17:05:32.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:32 smithi171 ceph-mon[35901]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-20T17:05:32.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:32 smithi171 ceph-mon[35901]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:05:32.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:32 smithi171 ceph-mon[35901]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-05-20T17:05:32.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:32 smithi171 ceph-mon[35901]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-05-20T17:05:32.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:32 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3000969758' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-20T17:05:32.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:32 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3000969758' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-20T17:05:32.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:32 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] up:active 2024-05-20T17:05:32.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:32 smithi171 ceph-mon[35901]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-20T17:05:32.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:32 smithi171 ceph-mon[35901]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2024-05-20T17:05:32.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:32 smithi171 ceph-mon[35901]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2024-05-20T17:05:32.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:32 smithi171 ceph-mon[35901]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-05-20T17:05:32.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:32 smithi006 ceph-mon[32486]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-20T17:05:32.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:32 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2666802784' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-20T17:05:32.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:32 smithi006 ceph-mon[32486]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-20T17:05:32.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:32 smithi006 ceph-mon[32486]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:05:32.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:32 smithi006 ceph-mon[32486]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-05-20T17:05:32.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:32 smithi006 ceph-mon[32486]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-05-20T17:05:32.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:32 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3000969758' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-20T17:05:32.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:32 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3000969758' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-20T17:05:32.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:32 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] up:active 2024-05-20T17:05:32.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:32 smithi006 ceph-mon[32486]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-20T17:05:32.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:32 smithi006 ceph-mon[32486]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2024-05-20T17:05:32.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:32 smithi006 ceph-mon[32486]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2024-05-20T17:05:32.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:32 smithi006 ceph-mon[32486]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-05-20T17:05:32.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:32.944+0000 7f3e50b77640 1 -- 172.21.15.6:0/2653150838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f3e4c0fe6a0 con 0x7f3e4c108720 2024-05-20T17:05:33.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:32 smithi062 ceph-mon[35425]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-20T17:05:33.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:32 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2666802784' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-20T17:05:33.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:32 smithi062 ceph-mon[35425]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-20T17:05:33.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:32 smithi062 ceph-mon[35425]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-20T17:05:33.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:32 smithi062 ceph-mon[35425]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-05-20T17:05:33.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:32 smithi062 ceph-mon[35425]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-05-20T17:05:33.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:32 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3000969758' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-20T17:05:33.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:32 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3000969758' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-20T17:05:33.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:32 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] up:active 2024-05-20T17:05:33.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:32 smithi062 ceph-mon[35425]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-20T17:05:33.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:32 smithi062 ceph-mon[35425]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2024-05-20T17:05:33.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:32 smithi062 ceph-mon[35425]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2024-05-20T17:05:33.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:32 smithi062 ceph-mon[35425]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-05-20T17:05:33.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.568+0000 7f3e437fe640 1 -- 172.21.15.6:0/2653150838 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7f3e4c0fe6a0 con 0x7f3e4c108720 2024-05-20T17:05:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.571+0000 7f3e50b77640 1 -- 172.21.15.6:0/2653150838 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3e380a2d30 msgr2=0x7f3e380a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.571+0000 7f3e50b77640 1 --2- 172.21.15.6:0/2653150838 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3e380a2d30 0x7f3e380a5240 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c074740 tx=0x7f3e3c005f90 comp rx=0 tx=0).stop 2024-05-20T17:05:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.571+0000 7f3e50b77640 1 -- 172.21.15.6:0/2653150838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e4c108720 msgr2=0x7f3e4c1a0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.571+0000 7f3e50b77640 1 --2- 172.21.15.6:0/2653150838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e4c108720 0x7f3e4c1a0600 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3e44031040 tx=0x7f3e44003ba0 comp rx=0 tx=0).stop 2024-05-20T17:05:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.571+0000 7f3e50b77640 1 -- 172.21.15.6:0/2653150838 shutdown_connections 2024-05-20T17:05:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.571+0000 7f3e50b77640 1 --2- 172.21.15.6:0/2653150838 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3e380a2d30 0x7f3e380a5240 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.571+0000 7f3e50b77640 1 --2- 172.21.15.6:0/2653150838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e4c108720 0x7f3e4c1a0600 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.571+0000 7f3e50b77640 1 --2- 172.21.15.6:0/2653150838 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e4c105bb0 0x7f3e4c199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.571+0000 7f3e50b77640 1 --2- 172.21.15.6:0/2653150838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e4c1031c0 0x7f3e4c199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.571+0000 7f3e50b77640 1 -- 172.21.15.6:0/2653150838 >> 172.21.15.6:0/2653150838 conn(0x7f3e4c0fcb80 msgr2=0x7f3e4c104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.571+0000 7f3e50b77640 1 -- 172.21.15.6:0/2653150838 shutdown_connections 2024-05-20T17:05:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.571+0000 7f3e50b77640 1 -- 172.21.15.6:0/2653150838 wait complete. 2024-05-20T17:05:33.588 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-05-20T17:05:33.589 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-05-20T17:05:33.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.715+0000 7f2da14e7640 1 -- 172.21.15.6:0/1487918169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d9c104120 msgr2=0x7f2d9c1022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:33.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.715+0000 7f2da14e7640 1 --2- 172.21.15.6:0/1487918169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d9c104120 0x7f2d9c1022a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c009900 tx=0x7f2d8c02a410 comp rx=0 tx=0).stop 2024-05-20T17:05:33.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.715+0000 7f2da14e7640 1 -- 172.21.15.6:0/1487918169 shutdown_connections 2024-05-20T17:05:33.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.715+0000 7f2da14e7640 1 --2- 172.21.15.6:0/1487918169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d9c108a20 0x7f2d9c10ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:33.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.715+0000 7f2da14e7640 1 --2- 172.21.15.6:0/1487918169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d9c1027e0 0x7f2d9c102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:33.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.715+0000 7f2da14e7640 1 --2- 172.21.15.6:0/1487918169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d9c104120 0x7f2d9c1022a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:33.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.715+0000 7f2da14e7640 1 -- 172.21.15.6:0/1487918169 >> 172.21.15.6:0/1487918169 conn(0x7f2d9c0fdcf0 msgr2=0x7f2d9c100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:33.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.715+0000 7f2da14e7640 1 -- 172.21.15.6:0/1487918169 shutdown_connections 2024-05-20T17:05:33.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.715+0000 7f2da14e7640 1 -- 172.21.15.6:0/1487918169 wait complete. 2024-05-20T17:05:33.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.716+0000 7f2da14e7640 1 Processor -- start 2024-05-20T17:05:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.716+0000 7f2da14e7640 1 -- start start 2024-05-20T17:05:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.716+0000 7f2da14e7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d9c1027e0 0x7f2d9c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.716+0000 7f2da14e7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d9c104120 0x7f2d9c199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.716+0000 7f2da14e7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d9c108a20 0x7f2d9c1a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.716+0000 7f2da14e7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2d9c10e6f0 con 0x7f2d9c1027e0 2024-05-20T17:05:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.716+0000 7f2da14e7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2d9c10e570 con 0x7f2d9c104120 2024-05-20T17:05:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.716+0000 7f2da14e7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2d9c10e870 con 0x7f2d9c108a20 2024-05-20T17:05:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.716+0000 7f2d9affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d9c1027e0 0x7f2d9c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.716+0000 7f2d9affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d9c1027e0 0x7f2d9c199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60136/0 (socket says 172.21.15.6:60136) 2024-05-20T17:05:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.716+0000 7f2d9affd640 1 -- 172.21.15.6:0/141370470 learned_addr learned my addr 172.21.15.6:0/141370470 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.717+0000 7f2d9a7fc640 1 --2- 172.21.15.6:0/141370470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d9c104120 0x7f2d9c199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.717+0000 7f2d9b7fe640 1 --2- 172.21.15.6:0/141370470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d9c108a20 0x7f2d9c1a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.717+0000 7f2d9affd640 1 -- 172.21.15.6:0/141370470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d9c108a20 msgr2=0x7f2d9c1a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.717+0000 7f2d9affd640 1 --2- 172.21.15.6:0/141370470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d9c108a20 0x7f2d9c1a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.717+0000 7f2d9affd640 1 -- 172.21.15.6:0/141370470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d9c104120 msgr2=0x7f2d9c199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.717+0000 7f2d9affd640 1 --2- 172.21.15.6:0/141370470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d9c104120 0x7f2d9c199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.717+0000 7f2d9affd640 1 -- 172.21.15.6:0/141370470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d9c1a0df0 con 0x7f2d9c1027e0 2024-05-20T17:05:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.717+0000 7f2d9b7fe640 1 --2- 172.21.15.6:0/141370470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d9c108a20 0x7f2d9c1a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:05:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.717+0000 7f2d9affd640 1 --2- 172.21.15.6:0/141370470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d9c1027e0 0x7f2d9c199320 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0314e0 tx=0x7f2d8c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.717+0000 7f2d93fff640 1 -- 172.21.15.6:0/141370470 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c03f030 con 0x7f2d9c1027e0 2024-05-20T17:05:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.717+0000 7f2d93fff640 1 -- 172.21.15.6:0/141370470 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2d8c0318f0 con 0x7f2d9c1027e0 2024-05-20T17:05:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.717+0000 7f2da14e7640 1 -- 172.21.15.6:0/141370470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d9c1a1080 con 0x7f2d9c1027e0 2024-05-20T17:05:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.717+0000 7f2d93fff640 1 -- 172.21.15.6:0/141370470 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c035070 con 0x7f2d9c1027e0 2024-05-20T17:05:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.717+0000 7f2da14e7640 1 -- 172.21.15.6:0/141370470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d9c1a1570 con 0x7f2d9c1027e0 2024-05-20T17:05:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.718+0000 7f2da14e7640 1 -- 172.21.15.6:0/141370470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d9c0691c0 con 0x7f2d9c1027e0 2024-05-20T17:05:33.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.719+0000 7f2d93fff640 1 -- 172.21.15.6:0/141370470 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f2d8c042030 con 0x7f2d9c1027e0 2024-05-20T17:05:33.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.720+0000 7f2d93fff640 1 --2- 172.21.15.6:0/141370470 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2d880a2b90 0x7f2d880a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:33.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.720+0000 7f2d9a7fc640 1 --2- 172.21.15.6:0/141370470 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2d880a2b90 0x7f2d880a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:33.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.720+0000 7f2d93fff640 1 -- 172.21.15.6:0/141370470 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f2d8c0efc30 con 0x7f2d9c1027e0 2024-05-20T17:05:33.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.721+0000 7f2d9a7fc640 1 --2- 172.21.15.6:0/141370470 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2d880a2b90 0x7f2d880a50a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c19a3c0 tx=0x7f2d84005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:33.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.724+0000 7f2d93fff640 1 -- 172.21.15.6:0/141370470 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2d8c0bc8f0 con 0x7f2d9c1027e0 2024-05-20T17:05:33.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:33 smithi006 ceph-mon[32486]: pgmap v315: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 0 op/s 2024-05-20T17:05:33.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:33 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2653150838' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-20T17:05:33.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:33 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2653150838' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-20T17:05:33.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:33 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] up:active 2024-05-20T17:05:33.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:33 smithi006 ceph-mon[32486]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-20T17:05:33.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:33 smithi006 ceph-mon[32486]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2024-05-20T17:05:33.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:33 smithi006 ceph-mon[32486]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2024-05-20T17:05:33.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:33 smithi006 ceph-mon[32486]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-05-20T17:05:33.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:33.935+0000 7f2da14e7640 1 -- 172.21.15.6:0/141370470 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f2d9c061f90 con 0x7f2d880a2b90 2024-05-20T17:05:34.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:33 smithi062 ceph-mon[35425]: pgmap v315: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 0 op/s 2024-05-20T17:05:34.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:33 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2653150838' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-20T17:05:34.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:33 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2653150838' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-20T17:05:34.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:33 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] up:active 2024-05-20T17:05:34.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:33 smithi062 ceph-mon[35425]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-20T17:05:34.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:33 smithi062 ceph-mon[35425]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2024-05-20T17:05:34.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:33 smithi062 ceph-mon[35425]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2024-05-20T17:05:34.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:33 smithi062 ceph-mon[35425]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-05-20T17:05:34.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:33 smithi171 ceph-mon[35901]: pgmap v315: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 0 op/s 2024-05-20T17:05:34.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:33 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2653150838' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-20T17:05:34.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:33 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2653150838' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-20T17:05:34.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:33 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] up:active 2024-05-20T17:05:34.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:33 smithi171 ceph-mon[35901]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-20T17:05:34.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:33 smithi171 ceph-mon[35901]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2024-05-20T17:05:34.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:33 smithi171 ceph-mon[35901]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2024-05-20T17:05:34.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:33 smithi171 ceph-mon[35901]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-05-20T17:05:34.380 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 17:05:33 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T17:05:33.941+0000 7f91689dd700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:05:34.380 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 17:05:33 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T17:05:33.941+0000 7f91689dd700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:05:34.381 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 17:05:33 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T17:05:33.941+0000 7f91689dd700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:05:34.381 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 17:05:33 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T17:05:33.941+0000 7f91689dd700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:05:34.381 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 17:05:33 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x[32717]: 2024-05-20T17:05:33.941+0000 7f91689dd700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-20T17:05:34.522 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:05:34 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-b[65260]: 2024-05-20T17:05:34.149+0000 7f23d9816700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-05-20T17:05:34.522 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:05:34 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-b[65260]: 2024-05-20T17:05:34.149+0000 7f23d9816700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-05-20T17:05:34.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.602+0000 7f2d93fff640 1 -- 172.21.15.6:0/141370470 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2d9c061f90 con 0x7f2d880a2b90 2024-05-20T17:05:34.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.604+0000 7f2da14e7640 1 -- 172.21.15.6:0/141370470 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2d880a2b90 msgr2=0x7f2d880a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:34.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.604+0000 7f2da14e7640 1 --2- 172.21.15.6:0/141370470 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2d880a2b90 0x7f2d880a50a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c19a3c0 tx=0x7f2d84005f90 comp rx=0 tx=0).stop 2024-05-20T17:05:34.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.604+0000 7f2da14e7640 1 -- 172.21.15.6:0/141370470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d9c1027e0 msgr2=0x7f2d9c199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:34.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.604+0000 7f2da14e7640 1 --2- 172.21.15.6:0/141370470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d9c1027e0 0x7f2d9c199320 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0314e0 tx=0x7f2d8c0042f0 comp rx=0 tx=0).stop 2024-05-20T17:05:34.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.604+0000 7f2da14e7640 1 -- 172.21.15.6:0/141370470 shutdown_connections 2024-05-20T17:05:34.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.604+0000 7f2da14e7640 1 --2- 172.21.15.6:0/141370470 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2d880a2b90 0x7f2d880a50a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:34.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.604+0000 7f2da14e7640 1 --2- 172.21.15.6:0/141370470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d9c108a20 0x7f2d9c1a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:34.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.604+0000 7f2da14e7640 1 --2- 172.21.15.6:0/141370470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d9c104120 0x7f2d9c199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:34.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.604+0000 7f2da14e7640 1 --2- 172.21.15.6:0/141370470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d9c1027e0 0x7f2d9c199320 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:34.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.604+0000 7f2da14e7640 1 -- 172.21.15.6:0/141370470 >> 172.21.15.6:0/141370470 conn(0x7f2d9c0fdcf0 msgr2=0x7f2d9c104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:34.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.605+0000 7f2da14e7640 1 -- 172.21.15.6:0/141370470 shutdown_connections 2024-05-20T17:05:34.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.605+0000 7f2da14e7640 1 -- 172.21.15.6:0/141370470 wait complete. 2024-05-20T17:05:34.617 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-05-20T17:05:34.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.744+0000 7fecdf7b5640 1 -- 172.21.15.6:0/921558244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd8104060 msgr2=0x7fecd8104470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:34.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.744+0000 7fecdf7b5640 1 --2- 172.21.15.6:0/921558244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd8104060 0x7fecd8104470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009900 tx=0x7fecd402a410 comp rx=0 tx=0).stop 2024-05-20T17:05:34.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.744+0000 7fecdf7b5640 1 -- 172.21.15.6:0/921558244 shutdown_connections 2024-05-20T17:05:34.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.744+0000 7fecdf7b5640 1 --2- 172.21.15.6:0/921558244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecd8101210 0x7fecd810ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:34.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.744+0000 7fecdf7b5640 1 --2- 172.21.15.6:0/921558244 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd8100710 0x7fecd8100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:34.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.744+0000 7fecdf7b5640 1 --2- 172.21.15.6:0/921558244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd8104060 0x7fecd8104470 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:34.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.744+0000 7fecdf7b5640 1 -- 172.21.15.6:0/921558244 >> 172.21.15.6:0/921558244 conn(0x7fecd80fc330 msgr2=0x7fecd80fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:34.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.745+0000 7fecdf7b5640 1 -- 172.21.15.6:0/921558244 shutdown_connections 2024-05-20T17:05:34.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.745+0000 7fecdf7b5640 1 -- 172.21.15.6:0/921558244 wait complete. 2024-05-20T17:05:34.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.745+0000 7fecdf7b5640 1 Processor -- start 2024-05-20T17:05:34.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.745+0000 7fecdf7b5640 1 -- start start 2024-05-20T17:05:34.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.745+0000 7fecdf7b5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecd8100710 0x7fecd81991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:34.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.745+0000 7fecdf7b5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd8101210 0x7fecd81996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:34.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.745+0000 7fecdf7b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd8104060 0x7fecd81a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:34.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.745+0000 7fecdf7b5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fecd810e5d0 con 0x7fecd8101210 2024-05-20T17:05:34.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.745+0000 7fecdf7b5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fecd810e450 con 0x7fecd8104060 2024-05-20T17:05:34.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.745+0000 7fecdf7b5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fecd810e750 con 0x7fecd8100710 2024-05-20T17:05:34.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.746+0000 7fecdcd50640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd8101210 0x7fecd81996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:34.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.746+0000 7fecddd52640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd8104060 0x7fecd81a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:34.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.746+0000 7fecddd52640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd8104060 0x7fecd81a0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.6:49370/0 (socket says 172.21.15.6:49370) 2024-05-20T17:05:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.746+0000 7fecdcd50640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd8101210 0x7fecd81996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60194/0 (socket says 172.21.15.6:60194) 2024-05-20T17:05:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.746+0000 7fecddd52640 1 -- 172.21.15.6:0/2657559410 learned_addr learned my addr 172.21.15.6:0/2657559410 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.746+0000 7fecdd551640 1 --2- 172.21.15.6:0/2657559410 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecd8100710 0x7fecd81991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.746+0000 7fecdcd50640 1 -- 172.21.15.6:0/2657559410 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecd8100710 msgr2=0x7fecd81991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.746+0000 7fecdcd50640 1 --2- 172.21.15.6:0/2657559410 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecd8100710 0x7fecd81991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.746+0000 7fecdcd50640 1 -- 172.21.15.6:0/2657559410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd8104060 msgr2=0x7fecd81a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.746+0000 7fecdcd50640 1 --2- 172.21.15.6:0/2657559410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd8104060 0x7fecd81a0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.746+0000 7fecdcd50640 1 -- 172.21.15.6:0/2657559410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd81a0cf0 con 0x7fecd8101210 2024-05-20T17:05:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.746+0000 7fecddd52640 1 --2- 172.21.15.6:0/2657559410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd8104060 0x7fecd81a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:05:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.746+0000 7fecdcd50640 1 --2- 172.21.15.6:0/2657559410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd8101210 0x7fecd81996f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fecc800e9f0 tx=0x7fecc800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.746+0000 7fecce7fc640 1 -- 172.21.15.6:0/2657559410 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc800ccc0 con 0x7fecd8101210 2024-05-20T17:05:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.746+0000 7fecce7fc640 1 -- 172.21.15.6:0/2657559410 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fecc80108e0 con 0x7fecd8101210 2024-05-20T17:05:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.746+0000 7fecce7fc640 1 -- 172.21.15.6:0/2657559410 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc8018880 con 0x7fecd8101210 2024-05-20T17:05:34.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.746+0000 7fecdf7b5640 1 -- 172.21.15.6:0/2657559410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd81a0fe0 con 0x7fecd8101210 2024-05-20T17:05:34.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.746+0000 7fecdf7b5640 1 -- 172.21.15.6:0/2657559410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd81a14a0 con 0x7fecd8101210 2024-05-20T17:05:34.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.747+0000 7fecdf7b5640 1 -- 172.21.15.6:0/2657559410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecd81079f0 con 0x7fecd8101210 2024-05-20T17:05:34.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.749+0000 7fecce7fc640 1 -- 172.21.15.6:0/2657559410 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fecc8010a90 con 0x7fecd8101210 2024-05-20T17:05:34.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.750+0000 7fecce7fc640 1 --2- 172.21.15.6:0/2657559410 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fecc40a2c10 0x7fecc40a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:34.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.750+0000 7fecce7fc640 1 -- 172.21.15.6:0/2657559410 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fecc80cf9d0 con 0x7fecd8101210 2024-05-20T17:05:34.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.750+0000 7fecdd551640 1 --2- 172.21.15.6:0/2657559410 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fecc40a2c10 0x7fecc40a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:34.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.750+0000 7fecdd551640 1 --2- 172.21.15.6:0/2657559410 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fecc40a2c10 0x7fecc40a5120 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fecd40314e0 tx=0x7fecd4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:34.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.754+0000 7fecce7fc640 1 -- 172.21.15.6:0/2657559410 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fecc809c0a0 con 0x7fecd8101210 2024-05-20T17:05:34.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.966+0000 7fecdf7b5640 1 -- 172.21.15.6:0/2657559410 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fecd8062020 con 0x7fecc40a2c10 2024-05-20T17:05:34.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.991+0000 7fecce7fc640 1 -- 172.21.15.6:0/2657559410 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fecd8062020 con 0x7fecc40a2c10 2024-05-20T17:05:34.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.993+0000 7fecdf7b5640 1 -- 172.21.15.6:0/2657559410 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fecc40a2c10 msgr2=0x7fecc40a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:34.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.993+0000 7fecdf7b5640 1 --2- 172.21.15.6:0/2657559410 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fecc40a2c10 0x7fecc40a5120 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fecd40314e0 tx=0x7fecd4031400 comp rx=0 tx=0).stop 2024-05-20T17:05:34.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.993+0000 7fecdf7b5640 1 -- 172.21.15.6:0/2657559410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd8101210 msgr2=0x7fecd81996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:34.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.993+0000 7fecdf7b5640 1 --2- 172.21.15.6:0/2657559410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd8101210 0x7fecd81996f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fecc800e9f0 tx=0x7fecc800eeb0 comp rx=0 tx=0).stop 2024-05-20T17:05:34.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.993+0000 7fecdf7b5640 1 -- 172.21.15.6:0/2657559410 shutdown_connections 2024-05-20T17:05:34.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.993+0000 7fecdf7b5640 1 --2- 172.21.15.6:0/2657559410 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fecc40a2c10 0x7fecc40a5120 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:34.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.993+0000 7fecdf7b5640 1 --2- 172.21.15.6:0/2657559410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd8104060 0x7fecd81a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:34.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.993+0000 7fecdf7b5640 1 --2- 172.21.15.6:0/2657559410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd8101210 0x7fecd81996f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:34.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.993+0000 7fecdf7b5640 1 --2- 172.21.15.6:0/2657559410 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecd8100710 0x7fecd81991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:34.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.993+0000 7fecdf7b5640 1 -- 172.21.15.6:0/2657559410 >> 172.21.15.6:0/2657559410 conn(0x7fecd80fc330 msgr2=0x7fecd8104bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:34.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.993+0000 7fecdf7b5640 1 -- 172.21.15.6:0/2657559410 shutdown_connections 2024-05-20T17:05:34.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:34.993+0000 7fecdf7b5640 1 -- 172.21.15.6:0/2657559410 wait complete. 2024-05-20T17:05:35.003 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-05-20T17:05:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.124+0000 7f1a76be2640 1 -- 172.21.15.6:0/15245147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a70104120 msgr2=0x7f1a701022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.124+0000 7f1a76be2640 1 --2- 172.21.15.6:0/15245147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a70104120 0x7f1a701022a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1a64009900 tx=0x7f1a6402a410 comp rx=0 tx=0).stop 2024-05-20T17:05:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.124+0000 7f1a76be2640 1 -- 172.21.15.6:0/15245147 shutdown_connections 2024-05-20T17:05:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.124+0000 7f1a76be2640 1 --2- 172.21.15.6:0/15245147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a70108a20 0x7f1a7010ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.124+0000 7f1a76be2640 1 --2- 172.21.15.6:0/15245147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a701027e0 0x7f1a70102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.124+0000 7f1a76be2640 1 --2- 172.21.15.6:0/15245147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a70104120 0x7f1a701022a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.124+0000 7f1a76be2640 1 -- 172.21.15.6:0/15245147 >> 172.21.15.6:0/15245147 conn(0x7f1a700fdcf0 msgr2=0x7f1a70100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.124+0000 7f1a76be2640 1 -- 172.21.15.6:0/15245147 shutdown_connections 2024-05-20T17:05:35.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.124+0000 7f1a76be2640 1 -- 172.21.15.6:0/15245147 wait complete. 2024-05-20T17:05:35.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.125+0000 7f1a76be2640 1 Processor -- start 2024-05-20T17:05:35.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.125+0000 7f1a76be2640 1 -- start start 2024-05-20T17:05:35.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.125+0000 7f1a76be2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a701027e0 0x7f1a701992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:35.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.125+0000 7f1a76be2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a70104120 0x7f1a70199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:35.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.125+0000 7f1a76be2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a70108a20 0x7f1a701a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:35.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.125+0000 7f1a76be2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7010e740 con 0x7f1a70108a20 2024-05-20T17:05:35.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.125+0000 7f1a76be2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7010e5c0 con 0x7f1a70104120 2024-05-20T17:05:35.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.125+0000 7f1a76be2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7010e8c0 con 0x7f1a701027e0 2024-05-20T17:05:35.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.126+0000 7f1a7517f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a70108a20 0x7f1a701a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:35.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.126+0000 7f1a6ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a70104120 0x7f1a70199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:35.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.126+0000 7f1a7517f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a70108a20 0x7f1a701a07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60202/0 (socket says 172.21.15.6:60202) 2024-05-20T17:05:35.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.126+0000 7f1a7517f640 1 -- 172.21.15.6:0/833173108 learned_addr learned my addr 172.21.15.6:0/833173108 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:35.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.126+0000 7f1a7497e640 1 --2- 172.21.15.6:0/833173108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a701027e0 0x7f1a701992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:35.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.126+0000 7f1a7517f640 1 -- 172.21.15.6:0/833173108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a701027e0 msgr2=0x7f1a701992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:35.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.126+0000 7f1a7517f640 1 --2- 172.21.15.6:0/833173108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a701027e0 0x7f1a701992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.126+0000 7f1a7517f640 1 -- 172.21.15.6:0/833173108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a70104120 msgr2=0x7f1a70199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:35.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.126+0000 7f1a7517f640 1 --2- 172.21.15.6:0/833173108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a70104120 0x7f1a70199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.126+0000 7f1a7517f640 1 -- 172.21.15.6:0/833173108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a701a0e20 con 0x7f1a70108a20 2024-05-20T17:05:35.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.126+0000 7f1a7517f640 1 --2- 172.21.15.6:0/833173108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a70108a20 0x7f1a701a07b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800eb10 tx=0x7f1a6800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:35.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.126+0000 7f1a6dffb640 1 -- 172.21.15.6:0/833173108 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68004b20 con 0x7f1a70108a20 2024-05-20T17:05:35.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.126+0000 7f1a6dffb640 1 -- 172.21.15.6:0/833173108 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a68004cc0 con 0x7f1a70108a20 2024-05-20T17:05:35.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.126+0000 7f1a76be2640 1 -- 172.21.15.6:0/833173108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a701a1110 con 0x7f1a70108a20 2024-05-20T17:05:35.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.126+0000 7f1a6dffb640 1 -- 172.21.15.6:0/833173108 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68010690 con 0x7f1a70108a20 2024-05-20T17:05:35.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.126+0000 7f1a76be2640 1 -- 172.21.15.6:0/833173108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a701a1610 con 0x7f1a70108a20 2024-05-20T17:05:35.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.127+0000 7f1a76be2640 1 -- 172.21.15.6:0/833173108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a700691c0 con 0x7f1a70108a20 2024-05-20T17:05:35.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.129+0000 7f1a6dffb640 1 -- 172.21.15.6:0/833173108 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f1a68005020 con 0x7f1a70108a20 2024-05-20T17:05:35.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.129+0000 7f1a6dffb640 1 --2- 172.21.15.6:0/833173108 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1a600a2b90 0x7f1a600a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:35.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.129+0000 7f1a7497e640 1 --2- 172.21.15.6:0/833173108 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1a600a2b90 0x7f1a600a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:35.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.129+0000 7f1a6dffb640 1 -- 172.21.15.6:0/833173108 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f1a680cf8a0 con 0x7f1a70108a20 2024-05-20T17:05:35.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.130+0000 7f1a7497e640 1 --2- 172.21.15.6:0/833173108 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1a600a2b90 0x7f1a600a50a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1a6402a930 tx=0x7f1a64031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:35.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.134+0000 7f1a6dffb640 1 -- 172.21.15.6:0/833173108 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1a6809c5c0 con 0x7f1a70108a20 2024-05-20T17:05:35.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.347+0000 7f1a76be2640 1 -- 172.21.15.6:0/833173108 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f1a70061f90 con 0x7f1a600a2b90 2024-05-20T17:05:35.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.352+0000 7f1a6dffb640 1 -- 172.21.15.6:0/833173108 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f1a70061f90 con 0x7f1a600a2b90 2024-05-20T17:05:35.352 INFO:teuthology.orchestra.run.smithi006.stdout:/volumes/qa/sv_0/661ab939-67dc-473a-a319-e3f005a94f68 2024-05-20T17:05:35.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.355+0000 7f1a76be2640 1 -- 172.21.15.6:0/833173108 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1a600a2b90 msgr2=0x7f1a600a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:35.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.355+0000 7f1a76be2640 1 --2- 172.21.15.6:0/833173108 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1a600a2b90 0x7f1a600a50a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1a6402a930 tx=0x7f1a64031400 comp rx=0 tx=0).stop 2024-05-20T17:05:35.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.355+0000 7f1a76be2640 1 -- 172.21.15.6:0/833173108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a70108a20 msgr2=0x7f1a701a07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:35.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.355+0000 7f1a76be2640 1 --2- 172.21.15.6:0/833173108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a70108a20 0x7f1a701a07b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800eb10 tx=0x7f1a6800c2d0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.355+0000 7f1a76be2640 1 -- 172.21.15.6:0/833173108 shutdown_connections 2024-05-20T17:05:35.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.355+0000 7f1a76be2640 1 --2- 172.21.15.6:0/833173108 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1a600a2b90 0x7f1a600a50a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.355+0000 7f1a76be2640 1 --2- 172.21.15.6:0/833173108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a70108a20 0x7f1a701a07b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.355+0000 7f1a76be2640 1 --2- 172.21.15.6:0/833173108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a70104120 0x7f1a70199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.355+0000 7f1a76be2640 1 --2- 172.21.15.6:0/833173108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a701027e0 0x7f1a701992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.355+0000 7f1a76be2640 1 -- 172.21.15.6:0/833173108 >> 172.21.15.6:0/833173108 conn(0x7f1a700fdcf0 msgr2=0x7f1a70104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:35.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.355+0000 7f1a76be2640 1 -- 172.21.15.6:0/833173108 shutdown_connections 2024-05-20T17:05:35.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.355+0000 7f1a76be2640 1 -- 172.21.15.6:0/833173108 wait complete. 2024-05-20T17:05:35.365 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-05-20T17:05:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.486+0000 7ff34939d640 1 -- 172.21.15.6:0/1350130853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3441031c0 msgr2=0x7ff3441055e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.486+0000 7ff34939d640 1 --2- 172.21.15.6:0/1350130853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3441031c0 0x7ff3441055e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff334009860 tx=0x7ff33402a340 comp rx=0 tx=0).stop 2024-05-20T17:05:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.486+0000 7ff34939d640 1 -- 172.21.15.6:0/1350130853 shutdown_connections 2024-05-20T17:05:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.486+0000 7ff34939d640 1 --2- 172.21.15.6:0/1350130853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff344108720 0x7ff34410ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.486+0000 7ff34939d640 1 --2- 172.21.15.6:0/1350130853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff344105bb0 0x7ff344108090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.486+0000 7ff34939d640 1 --2- 172.21.15.6:0/1350130853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3441031c0 0x7ff3441055e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.486+0000 7ff34939d640 1 -- 172.21.15.6:0/1350130853 >> 172.21.15.6:0/1350130853 conn(0x7ff3440fcb80 msgr2=0x7ff3440ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.486+0000 7ff34939d640 1 -- 172.21.15.6:0/1350130853 shutdown_connections 2024-05-20T17:05:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.486+0000 7ff34939d640 1 -- 172.21.15.6:0/1350130853 wait complete. 2024-05-20T17:05:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.486+0000 7ff34939d640 1 Processor -- start 2024-05-20T17:05:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.487+0000 7ff34939d640 1 -- start start 2024-05-20T17:05:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.487+0000 7ff34939d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3441031c0 0x7ff344102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.487+0000 7ff34939d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff344105bb0 0x7ff3441010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.487+0000 7ff34939d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff344108720 0x7ff344101610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.487+0000 7ff34939d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff34410e580 con 0x7ff344108720 2024-05-20T17:05:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.487+0000 7ff34939d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff34410e400 con 0x7ff3441031c0 2024-05-20T17:05:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.487+0000 7ff34939d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff34410e700 con 0x7ff344105bb0 2024-05-20T17:05:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.487+0000 7ff3437fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff344108720 0x7ff344101610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.487+0000 7ff342ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3441031c0 0x7ff344102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.487+0000 7ff342ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3441031c0 0x7ff344102a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.6:49400/0 (socket says 172.21.15.6:49400) 2024-05-20T17:05:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.487+0000 7ff342ffd640 1 -- 172.21.15.6:0/2976567272 learned_addr learned my addr 172.21.15.6:0/2976567272 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.487+0000 7ff3427fc640 1 --2- 172.21.15.6:0/2976567272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff344105bb0 0x7ff3441010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.487+0000 7ff342ffd640 1 -- 172.21.15.6:0/2976567272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff344105bb0 msgr2=0x7ff3441010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.487+0000 7ff342ffd640 1 --2- 172.21.15.6:0/2976567272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff344105bb0 0x7ff3441010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.487+0000 7ff342ffd640 1 -- 172.21.15.6:0/2976567272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff344108720 msgr2=0x7ff344101610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.487+0000 7ff342ffd640 1 --2- 172.21.15.6:0/2976567272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff344108720 0x7ff344101610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.487+0000 7ff342ffd640 1 -- 172.21.15.6:0/2976567272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff344101d40 con 0x7ff3441031c0 2024-05-20T17:05:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.487+0000 7ff3437fe640 1 --2- 172.21.15.6:0/2976567272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff344108720 0x7ff344101610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:05:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.488+0000 7ff342ffd640 1 --2- 172.21.15.6:0/2976567272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3441031c0 0x7ff344102a30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff334009780 tx=0x7ff334030bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.488+0000 7ff32bfff640 1 -- 172.21.15.6:0/2976567272 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff334040020 con 0x7ff3441031c0 2024-05-20T17:05:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.488+0000 7ff32bfff640 1 -- 172.21.15.6:0/2976567272 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff334038040 con 0x7ff3441031c0 2024-05-20T17:05:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.488+0000 7ff34939d640 1 -- 172.21.15.6:0/2976567272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3441a32a0 con 0x7ff3441031c0 2024-05-20T17:05:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.488+0000 7ff32bfff640 1 -- 172.21.15.6:0/2976567272 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff334037070 con 0x7ff3441031c0 2024-05-20T17:05:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.488+0000 7ff34939d640 1 -- 172.21.15.6:0/2976567272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3441a36a0 con 0x7ff3441031c0 2024-05-20T17:05:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.489+0000 7ff34939d640 1 -- 172.21.15.6:0/2976567272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3440691c0 con 0x7ff3441031c0 2024-05-20T17:05:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.491+0000 7ff32bfff640 1 -- 172.21.15.6:0/2976567272 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ff334043020 con 0x7ff3441031c0 2024-05-20T17:05:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.491+0000 7ff32bfff640 1 --2- 172.21.15.6:0/2976567272 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff32c0a2b90 0x7ff32c0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.491+0000 7ff32bfff640 1 -- 172.21.15.6:0/2976567272 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7ff3340ef1b0 con 0x7ff3441031c0 2024-05-20T17:05:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.491+0000 7ff3427fc640 1 --2- 172.21.15.6:0/2976567272 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff32c0a2b90 0x7ff32c0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.492+0000 7ff3427fc640 1 --2- 172.21.15.6:0/2976567272 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff32c0a2b90 0x7ff32c0a50a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff3441023d0 tx=0x7ff338009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:35.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.495+0000 7ff32bfff640 1 -- 172.21.15.6:0/2976567272 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff33404a070 con 0x7ff3441031c0 2024-05-20T17:05:35.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:35 smithi006 ceph-mon[32486]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:05:35.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:35 smithi006 ceph-mon[32486]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.1 KiB/s wr, 4 op/s 2024-05-20T17:05:35.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:35 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] up:active 2024-05-20T17:05:35.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:35 smithi006 ceph-mon[32486]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-20T17:05:35.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:35 smithi006 ceph-mon[32486]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-20T17:05:35.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:35 smithi006 ceph-mon[32486]: Cluster is now healthy 2024-05-20T17:05:35.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:35 smithi006 ceph-mon[32486]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2024-05-20T17:05:35.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:35 smithi006 ceph-mon[32486]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2024-05-20T17:05:35.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:35 smithi006 ceph-mon[32486]: daemon mds.k is now active in filesystem cephfs as rank 4 2024-05-20T17:05:35.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.712+0000 7ff34939d640 1 -- 172.21.15.6:0/2976567272 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ff3440620e0 con 0x7ff32c0a2b90 2024-05-20T17:05:35.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.739+0000 7ff32bfff640 1 -- 172.21.15.6:0/2976567272 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff3440620e0 con 0x7ff32c0a2b90 2024-05-20T17:05:35.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.741+0000 7ff34939d640 1 -- 172.21.15.6:0/2976567272 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff32c0a2b90 msgr2=0x7ff32c0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:35.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.741+0000 7ff34939d640 1 --2- 172.21.15.6:0/2976567272 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff32c0a2b90 0x7ff32c0a50a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff3441023d0 tx=0x7ff338009260 comp rx=0 tx=0).stop 2024-05-20T17:05:35.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.741+0000 7ff34939d640 1 -- 172.21.15.6:0/2976567272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3441031c0 msgr2=0x7ff344102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:35.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.741+0000 7ff34939d640 1 --2- 172.21.15.6:0/2976567272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3441031c0 0x7ff344102a30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff334009780 tx=0x7ff334030bd0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.741+0000 7ff34939d640 1 -- 172.21.15.6:0/2976567272 shutdown_connections 2024-05-20T17:05:35.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.741+0000 7ff34939d640 1 --2- 172.21.15.6:0/2976567272 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff32c0a2b90 0x7ff32c0a50a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.741+0000 7ff34939d640 1 --2- 172.21.15.6:0/2976567272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff344108720 0x7ff344101610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.741+0000 7ff34939d640 1 --2- 172.21.15.6:0/2976567272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff344105bb0 0x7ff3441010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.741+0000 7ff34939d640 1 --2- 172.21.15.6:0/2976567272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3441031c0 0x7ff344102a30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.741+0000 7ff34939d640 1 -- 172.21.15.6:0/2976567272 >> 172.21.15.6:0/2976567272 conn(0x7ff3440fcb80 msgr2=0x7ff344105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:35.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.741+0000 7ff34939d640 1 -- 172.21.15.6:0/2976567272 shutdown_connections 2024-05-20T17:05:35.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.741+0000 7ff34939d640 1 -- 172.21.15.6:0/2976567272 wait complete. 2024-05-20T17:05:35.752 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-05-20T17:05:35.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:35 smithi171 ceph-mon[35901]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:05:35.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:35 smithi171 ceph-mon[35901]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.1 KiB/s wr, 4 op/s 2024-05-20T17:05:35.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:35 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] up:active 2024-05-20T17:05:35.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:35 smithi171 ceph-mon[35901]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-20T17:05:35.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:35 smithi171 ceph-mon[35901]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-20T17:05:35.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:35 smithi171 ceph-mon[35901]: Cluster is now healthy 2024-05-20T17:05:35.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:35 smithi171 ceph-mon[35901]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2024-05-20T17:05:35.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:35 smithi171 ceph-mon[35901]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2024-05-20T17:05:35.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:35 smithi171 ceph-mon[35901]: daemon mds.k is now active in filesystem cephfs as rank 4 2024-05-20T17:05:35.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.873+0000 7f5ca4e7a640 1 -- 172.21.15.6:0/811461643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca0102ae0 msgr2=0x7f5ca01037e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:35.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.873+0000 7f5ca4e7a640 1 --2- 172.21.15.6:0/811461643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca0102ae0 0x7f5ca01037e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009ca0 tx=0x7f5c9002a8c0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.873+0000 7f5ca4e7a640 1 -- 172.21.15.6:0/811461643 shutdown_connections 2024-05-20T17:05:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.873+0000 7f5ca4e7a640 1 --2- 172.21.15.6:0/811461643 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ca0108a20 0x7f5ca010ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.873+0000 7f5ca4e7a640 1 --2- 172.21.15.6:0/811461643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ca0103d20 0x7f5ca0104130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.873+0000 7f5ca4e7a640 1 --2- 172.21.15.6:0/811461643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca0102ae0 0x7f5ca01037e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.873+0000 7f5ca4e7a640 1 -- 172.21.15.6:0/811461643 >> 172.21.15.6:0/811461643 conn(0x7f5ca00fdcf0 msgr2=0x7f5ca0100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.873+0000 7f5ca4e7a640 1 -- 172.21.15.6:0/811461643 shutdown_connections 2024-05-20T17:05:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.873+0000 7f5ca4e7a640 1 -- 172.21.15.6:0/811461643 wait complete. 2024-05-20T17:05:35.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.874+0000 7f5ca4e7a640 1 Processor -- start 2024-05-20T17:05:35.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.874+0000 7f5ca4e7a640 1 -- start start 2024-05-20T17:05:35.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.874+0000 7f5ca4e7a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ca0102ae0 0x7f5ca0199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:35.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.874+0000 7f5ca4e7a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ca0103d20 0x7f5ca0199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:35.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.874+0000 7f5ca4e7a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca0108a20 0x7f5ca01a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:35.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.874+0000 7f5ca4e7a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca010e5e0 con 0x7f5ca0108a20 2024-05-20T17:05:35.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.874+0000 7f5ca4e7a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca010e460 con 0x7f5ca0103d20 2024-05-20T17:05:35.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.874+0000 7f5ca4e7a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca010e760 con 0x7f5ca0102ae0 2024-05-20T17:05:35.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.874+0000 7f5c9ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca0108a20 0x7f5ca01a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:35.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.874+0000 7f5c9dd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ca0103d20 0x7f5ca0199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:35.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.874+0000 7f5c9ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca0108a20 0x7f5ca01a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60232/0 (socket says 172.21.15.6:60232) 2024-05-20T17:05:35.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.874+0000 7f5c9ed9d640 1 -- 172.21.15.6:0/3595519206 learned_addr learned my addr 172.21.15.6:0/3595519206 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:35.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.874+0000 7f5c9e59c640 1 --2- 172.21.15.6:0/3595519206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ca0102ae0 0x7f5ca0199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:35.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.874+0000 7f5c9dd9b640 1 -- 172.21.15.6:0/3595519206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ca0102ae0 msgr2=0x7f5ca0199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:35.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.874+0000 7f5c9dd9b640 1 --2- 172.21.15.6:0/3595519206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ca0102ae0 0x7f5ca0199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.874+0000 7f5c9dd9b640 1 -- 172.21.15.6:0/3595519206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca0108a20 msgr2=0x7f5ca01a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:35.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.874+0000 7f5c9dd9b640 1 --2- 172.21.15.6:0/3595519206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca0108a20 0x7f5ca01a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:35.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.874+0000 7f5c9dd9b640 1 -- 172.21.15.6:0/3595519206 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca01a0d20 con 0x7f5ca0103d20 2024-05-20T17:05:35.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.874+0000 7f5c9ed9d640 1 --2- 172.21.15.6:0/3595519206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca0108a20 0x7f5ca01a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:05:35.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.874+0000 7f5c9e59c640 1 --2- 172.21.15.6:0/3595519206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ca0102ae0 0x7f5ca0199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:05:35.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.875+0000 7f5c9dd9b640 1 --2- 172.21.15.6:0/3595519206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ca0103d20 0x7f5ca0199790 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400d720 tx=0x7f5c9400dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:35.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.875+0000 7f5c8f7fe640 1 -- 172.21.15.6:0/3595519206 <== mon.2 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c94017070 con 0x7f5ca0103d20 2024-05-20T17:05:35.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.875+0000 7f5c8f7fe640 1 -- 172.21.15.6:0/3595519206 <== mon.2 v2:172.21.15.62:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5c9400de30 con 0x7f5ca0103d20 2024-05-20T17:05:35.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.875+0000 7f5ca4e7a640 1 -- 172.21.15.6:0/3595519206 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca01a0fb0 con 0x7f5ca0103d20 2024-05-20T17:05:35.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.875+0000 7f5c8f7fe640 1 -- 172.21.15.6:0/3595519206 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c940047a0 con 0x7f5ca0103d20 2024-05-20T17:05:35.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.875+0000 7f5ca4e7a640 1 -- 172.21.15.6:0/3595519206 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca01a1420 con 0x7f5ca0103d20 2024-05-20T17:05:35.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.876+0000 7f5ca4e7a640 1 -- 172.21.15.6:0/3595519206 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca0107830 con 0x7f5ca0103d20 2024-05-20T17:05:35.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.877+0000 7f5c8f7fe640 1 -- 172.21.15.6:0/3595519206 <== mon.2 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f5c940099d0 con 0x7f5ca0103d20 2024-05-20T17:05:35.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.878+0000 7f5c8f7fe640 1 --2- 172.21.15.6:0/3595519206 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5c880a2b90 0x7f5c880a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:35.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.878+0000 7f5c8f7fe640 1 -- 172.21.15.6:0/3595519206 <== mon.2 v2:172.21.15.62:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f5c940ceff0 con 0x7f5ca0103d20 2024-05-20T17:05:35.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.878+0000 7f5c9e59c640 1 --2- 172.21.15.6:0/3595519206 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5c880a2b90 0x7f5c880a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:35.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.879+0000 7f5c9e59c640 1 --2- 172.21.15.6:0/3595519206 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5c880a2b90 0x7f5c880a50a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5c90000f80 tx=0x7f5c90004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:35.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:35.882+0000 7f5c8f7fe640 1 -- 172.21.15.6:0/3595519206 <== mon.2 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5c94020020 con 0x7f5ca0103d20 2024-05-20T17:05:36.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:35 smithi062 ceph-mon[35425]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:05:36.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:35 smithi062 ceph-mon[35425]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.1 KiB/s wr, 4 op/s 2024-05-20T17:05:36.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:35 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] up:active 2024-05-20T17:05:36.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:35 smithi062 ceph-mon[35425]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-20T17:05:36.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:35 smithi062 ceph-mon[35425]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-20T17:05:36.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:35 smithi062 ceph-mon[35425]: Cluster is now healthy 2024-05-20T17:05:36.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:35 smithi062 ceph-mon[35425]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2024-05-20T17:05:36.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:35 smithi062 ceph-mon[35425]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2024-05-20T17:05:36.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:35 smithi062 ceph-mon[35425]: daemon mds.k is now active in filesystem cephfs as rank 4 2024-05-20T17:05:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.102+0000 7f5ca4e7a640 1 -- 172.21.15.6:0/3595519206 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f5ca0062020 con 0x7f5c880a2b90 2024-05-20T17:05:36.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.107+0000 7f5c8f7fe640 1 -- 172.21.15.6:0/3595519206 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f5ca0062020 con 0x7f5c880a2b90 2024-05-20T17:05:36.106 INFO:teuthology.orchestra.run.smithi006.stdout:/volumes/qa/sv_1/6fd5bfed-04c1-44a8-b094-c15b9863ed70 2024-05-20T17:05:36.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.109+0000 7f5ca4e7a640 1 -- 172.21.15.6:0/3595519206 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5c880a2b90 msgr2=0x7f5c880a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:36.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.109+0000 7f5ca4e7a640 1 --2- 172.21.15.6:0/3595519206 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5c880a2b90 0x7f5c880a50a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5c90000f80 tx=0x7f5c90004a40 comp rx=0 tx=0).stop 2024-05-20T17:05:36.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.109+0000 7f5ca4e7a640 1 -- 172.21.15.6:0/3595519206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ca0103d20 msgr2=0x7f5ca0199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:36.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.109+0000 7f5ca4e7a640 1 --2- 172.21.15.6:0/3595519206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ca0103d20 0x7f5ca0199790 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400d720 tx=0x7f5c9400dbe0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.109+0000 7f5ca4e7a640 1 -- 172.21.15.6:0/3595519206 shutdown_connections 2024-05-20T17:05:36.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.109+0000 7f5ca4e7a640 1 --2- 172.21.15.6:0/3595519206 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5c880a2b90 0x7f5c880a50a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.109+0000 7f5ca4e7a640 1 --2- 172.21.15.6:0/3595519206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca0108a20 0x7f5ca01a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.109+0000 7f5ca4e7a640 1 --2- 172.21.15.6:0/3595519206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ca0103d20 0x7f5ca0199790 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.109+0000 7f5ca4e7a640 1 --2- 172.21.15.6:0/3595519206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ca0102ae0 0x7f5ca0199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.109+0000 7f5ca4e7a640 1 -- 172.21.15.6:0/3595519206 >> 172.21.15.6:0/3595519206 conn(0x7f5ca00fdcf0 msgr2=0x7f5ca0104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:36.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.109+0000 7f5ca4e7a640 1 -- 172.21.15.6:0/3595519206 shutdown_connections 2024-05-20T17:05:36.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.109+0000 7f5ca4e7a640 1 -- 172.21.15.6:0/3595519206 wait complete. 2024-05-20T17:05:36.120 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:05:36.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.236+0000 7faa18606640 1 -- 172.21.15.6:0/482647131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa10104120 msgr2=0x7faa101022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:36.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.236+0000 7faa18606640 1 --2- 172.21.15.6:0/482647131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa10104120 0x7faa101022a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009900 tx=0x7faa0c02a410 comp rx=0 tx=0).stop 2024-05-20T17:05:36.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.236+0000 7faa18606640 1 -- 172.21.15.6:0/482647131 shutdown_connections 2024-05-20T17:05:36.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.236+0000 7faa18606640 1 --2- 172.21.15.6:0/482647131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa10108a20 0x7faa1010ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.236+0000 7faa18606640 1 --2- 172.21.15.6:0/482647131 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa101027e0 0x7faa10102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.236+0000 7faa18606640 1 --2- 172.21.15.6:0/482647131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa10104120 0x7faa101022a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.236+0000 7faa18606640 1 -- 172.21.15.6:0/482647131 >> 172.21.15.6:0/482647131 conn(0x7faa100fdcf0 msgr2=0x7faa10100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:36.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.236+0000 7faa18606640 1 -- 172.21.15.6:0/482647131 shutdown_connections 2024-05-20T17:05:36.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.236+0000 7faa18606640 1 -- 172.21.15.6:0/482647131 wait complete. 2024-05-20T17:05:36.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.236+0000 7faa18606640 1 Processor -- start 2024-05-20T17:05:36.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.236+0000 7faa18606640 1 -- start start 2024-05-20T17:05:36.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.237+0000 7faa18606640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa101027e0 0x7faa1019b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:36.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.237+0000 7faa18606640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa10104120 0x7faa1019b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:36.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.237+0000 7faa18606640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa10108a20 0x7faa101a28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:36.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.237+0000 7faa18606640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faa1010e720 con 0x7faa101027e0 2024-05-20T17:05:36.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.237+0000 7faa18606640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7faa1010e5a0 con 0x7faa10104120 2024-05-20T17:05:36.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.237+0000 7faa18606640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faa1010e8a0 con 0x7faa10108a20 2024-05-20T17:05:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.237+0000 7faa163a2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa101027e0 0x7faa1019b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.237+0000 7faa163a2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa101027e0 0x7faa1019b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60246/0 (socket says 172.21.15.6:60246) 2024-05-20T17:05:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.237+0000 7faa163a2640 1 -- 172.21.15.6:0/363006379 learned_addr learned my addr 172.21.15.6:0/363006379 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.237+0000 7faa15ba1640 1 --2- 172.21.15.6:0/363006379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa10104120 0x7faa1019b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.237+0000 7faa16ba3640 1 --2- 172.21.15.6:0/363006379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa10108a20 0x7faa101a28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.237+0000 7faa163a2640 1 -- 172.21.15.6:0/363006379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa10108a20 msgr2=0x7faa101a28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.237+0000 7faa163a2640 1 --2- 172.21.15.6:0/363006379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa10108a20 0x7faa101a28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.237+0000 7faa163a2640 1 -- 172.21.15.6:0/363006379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa10104120 msgr2=0x7faa1019b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.237+0000 7faa163a2640 1 --2- 172.21.15.6:0/363006379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa10104120 0x7faa1019b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.237+0000 7faa163a2640 1 -- 172.21.15.6:0/363006379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa101a2f60 con 0x7faa101027e0 2024-05-20T17:05:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.237+0000 7faa163a2640 1 --2- 172.21.15.6:0/363006379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa101027e0 0x7faa1019b420 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0314e0 tx=0x7faa0c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.237+0000 7faa077fe640 1 -- 172.21.15.6:0/363006379 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c03f070 con 0x7faa101027e0 2024-05-20T17:05:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.238+0000 7faa18606640 1 -- 172.21.15.6:0/363006379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa101a31f0 con 0x7faa101027e0 2024-05-20T17:05:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.238+0000 7faa077fe640 1 -- 172.21.15.6:0/363006379 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faa0c031c40 con 0x7faa101027e0 2024-05-20T17:05:36.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.238+0000 7faa077fe640 1 -- 172.21.15.6:0/363006379 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c035030 con 0x7faa101027e0 2024-05-20T17:05:36.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.238+0000 7faa18606640 1 -- 172.21.15.6:0/363006379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa101a36e0 con 0x7faa101027e0 2024-05-20T17:05:36.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.238+0000 7faa18606640 1 -- 172.21.15.6:0/363006379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa100691c0 con 0x7faa101027e0 2024-05-20T17:05:36.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.240+0000 7faa077fe640 1 -- 172.21.15.6:0/363006379 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7faa0c042070 con 0x7faa101027e0 2024-05-20T17:05:36.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.241+0000 7faa077fe640 1 --2- 172.21.15.6:0/363006379 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa9fc0a2c30 0x7fa9fc0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:36.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.241+0000 7faa077fe640 1 -- 172.21.15.6:0/363006379 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7faa0c0f0240 con 0x7faa101027e0 2024-05-20T17:05:36.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.241+0000 7faa15ba1640 1 --2- 172.21.15.6:0/363006379 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa9fc0a2c30 0x7fa9fc0a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:36.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.241+0000 7faa15ba1640 1 --2- 172.21.15.6:0/363006379 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa9fc0a2c30 0x7fa9fc0a5140 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faa1019c4c0 tx=0x7faa0000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:36.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.244+0000 7faa077fe640 1 -- 172.21.15.6:0/363006379 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7faa0c0bcf60 con 0x7faa101027e0 2024-05-20T17:05:36.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.468+0000 7faa18606640 1 -- 172.21.15.6:0/363006379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa101a3b20 con 0x7faa101027e0 2024-05-20T17:05:36.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.468+0000 7faa077fe640 1 -- 172.21.15.6:0/363006379 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11914 (secure 0 0 0) 0x7faa0c0bc860 con 0x7faa101027e0 2024-05-20T17:05:36.468 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:05:36.468 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:05:04.455743+0000","modified":"2024-05-20T17:05:35.584679+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24548,"mds_1":24526,"mds_2":24484,"mds_3":24470,"mds_4":24440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/3061403904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":3061403904},{"type":"v1","addr":"172.21.15.6:6839","nonce":3061403904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/223306009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":223306009},{"type":"v1","addr":"172.21.15.6:6841","nonce":223306009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.62:6835/78063155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":78063155},{"type":"v1","addr":"172.21.15.62:6835","nonce":78063155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.171:6835/1542537621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1542537621},{"type":"v1","addr":"172.21.15.171:6835","nonce":1542537621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/732693575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":732693575},{"type":"v1","addr":"172.21.15.171:6837","nonce":732693575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6837/1745943929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1745943929},{"type":"v1","addr":"172.21.15.62:6837","nonce":1745943929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.171:6839/3246292303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3246292303},{"type":"v1","addr":"172.21.15.171:6839","nonce":3246292303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6839/3023093487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3023093487},{"type":"v1","addr":"172.21.15.62:6839","nonce":3023093487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24548,"qdb_cluster":[24440,24548,24526,24470,24484]},"id":1}]} 2024-05-20T17:05:36.468 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 28 2024-05-20T17:05:36.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.470+0000 7faa18606640 1 -- 172.21.15.6:0/363006379 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa9fc0a2c30 msgr2=0x7fa9fc0a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:36.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.470+0000 7faa18606640 1 --2- 172.21.15.6:0/363006379 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa9fc0a2c30 0x7fa9fc0a5140 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faa1019c4c0 tx=0x7faa0000b390 comp rx=0 tx=0).stop 2024-05-20T17:05:36.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.470+0000 7faa18606640 1 -- 172.21.15.6:0/363006379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa101027e0 msgr2=0x7faa1019b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:36.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.470+0000 7faa18606640 1 --2- 172.21.15.6:0/363006379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa101027e0 0x7faa1019b420 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0314e0 tx=0x7faa0c003c10 comp rx=0 tx=0).stop 2024-05-20T17:05:36.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.470+0000 7faa18606640 1 -- 172.21.15.6:0/363006379 shutdown_connections 2024-05-20T17:05:36.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.470+0000 7faa18606640 1 --2- 172.21.15.6:0/363006379 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa9fc0a2c30 0x7fa9fc0a5140 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.470+0000 7faa18606640 1 --2- 172.21.15.6:0/363006379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa10108a20 0x7faa101a28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.470+0000 7faa18606640 1 --2- 172.21.15.6:0/363006379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa10104120 0x7faa1019b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.470+0000 7faa18606640 1 --2- 172.21.15.6:0/363006379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa101027e0 0x7faa1019b420 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.470+0000 7faa18606640 1 -- 172.21.15.6:0/363006379 >> 172.21.15.6:0/363006379 conn(0x7faa100fdcf0 msgr2=0x7faa100fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:36.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.470+0000 7faa18606640 1 -- 172.21.15.6:0/363006379 shutdown_connections 2024-05-20T17:05:36.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.470+0000 7faa18606640 1 -- 172.21.15.6:0/363006379 wait complete. 2024-05-20T17:05:36.481 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:05:36.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.608+0000 7fc233316640 1 -- 172.21.15.6:0/4094431854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc22c105bd0 msgr2=0x7fc22c1080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:36.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.608+0000 7fc233316640 1 --2- 172.21.15.6:0/4094431854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc22c105bd0 0x7fc22c1080b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc21c009900 tx=0x7fc21c02a410 comp rx=0 tx=0).stop 2024-05-20T17:05:36.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.608+0000 7fc233316640 1 -- 172.21.15.6:0/4094431854 shutdown_connections 2024-05-20T17:05:36.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.608+0000 7fc233316640 1 --2- 172.21.15.6:0/4094431854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc22c108740 0x7fc22c10ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.608+0000 7fc233316640 1 --2- 172.21.15.6:0/4094431854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc22c105bd0 0x7fc22c1080b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.608+0000 7fc233316640 1 --2- 172.21.15.6:0/4094431854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc22c1031e0 0x7fc22c105600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.608+0000 7fc233316640 1 -- 172.21.15.6:0/4094431854 >> 172.21.15.6:0/4094431854 conn(0x7fc22c0fcba0 msgr2=0x7fc22c0ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:36.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.608+0000 7fc233316640 1 -- 172.21.15.6:0/4094431854 shutdown_connections 2024-05-20T17:05:36.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.608+0000 7fc233316640 1 -- 172.21.15.6:0/4094431854 wait complete. 2024-05-20T17:05:36.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.608+0000 7fc233316640 1 Processor -- start 2024-05-20T17:05:36.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.609+0000 7fc233316640 1 -- start start 2024-05-20T17:05:36.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.609+0000 7fc233316640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc22c1031e0 0x7fc22c1990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:36.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.609+0000 7fc233316640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc22c105bd0 0x7fc22c199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:36.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.609+0000 7fc233316640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc22c108740 0x7fc22c1a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:36.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.609+0000 7fc233316640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c10e5b0 con 0x7fc22c108740 2024-05-20T17:05:36.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.609+0000 7fc233316640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c10e430 con 0x7fc22c105bd0 2024-05-20T17:05:36.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.609+0000 7fc233316640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c10e730 con 0x7fc22c1031e0 2024-05-20T17:05:36.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.609+0000 7fc2318b3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc22c108740 0x7fc22c1a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:36.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.609+0000 7fc2318b3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc22c108740 0x7fc22c1a0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60260/0 (socket says 172.21.15.6:60260) 2024-05-20T17:05:36.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.609+0000 7fc2318b3640 1 -- 172.21.15.6:0/338426441 learned_addr learned my addr 172.21.15.6:0/338426441 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:36.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.609+0000 7fc2310b2640 1 --2- 172.21.15.6:0/338426441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc22c1031e0 0x7fc22c1990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:36.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.609+0000 7fc2308b1640 1 --2- 172.21.15.6:0/338426441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc22c105bd0 0x7fc22c199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:36.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.609+0000 7fc2318b3640 1 -- 172.21.15.6:0/338426441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc22c1031e0 msgr2=0x7fc22c1990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:36.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.609+0000 7fc2318b3640 1 --2- 172.21.15.6:0/338426441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc22c1031e0 0x7fc22c1990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.609+0000 7fc2318b3640 1 -- 172.21.15.6:0/338426441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc22c105bd0 msgr2=0x7fc22c199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:36.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.609+0000 7fc2318b3640 1 --2- 172.21.15.6:0/338426441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc22c105bd0 0x7fc22c199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.609+0000 7fc2318b3640 1 -- 172.21.15.6:0/338426441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22c1a0c00 con 0x7fc22c108740 2024-05-20T17:05:36.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.609+0000 7fc2318b3640 1 --2- 172.21.15.6:0/338426441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc22c108740 0x7fc22c1a0590 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc22400eaa0 tx=0x7fc22400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:36.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.610+0000 7fc2227fc640 1 -- 172.21.15.6:0/338426441 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22400cdb0 con 0x7fc22c108740 2024-05-20T17:05:36.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.610+0000 7fc2227fc640 1 -- 172.21.15.6:0/338426441 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc224005020 con 0x7fc22c108740 2024-05-20T17:05:36.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.610+0000 7fc233316640 1 -- 172.21.15.6:0/338426441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc22c1a0ef0 con 0x7fc22c108740 2024-05-20T17:05:36.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.610+0000 7fc2227fc640 1 -- 172.21.15.6:0/338426441 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2240116d0 con 0x7fc22c108740 2024-05-20T17:05:36.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.610+0000 7fc233316640 1 -- 172.21.15.6:0/338426441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc22c1a1350 con 0x7fc22c108740 2024-05-20T17:05:36.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.611+0000 7fc233316640 1 -- 172.21.15.6:0/338426441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc22c068d70 con 0x7fc22c108740 2024-05-20T17:05:36.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.612+0000 7fc2227fc640 1 -- 172.21.15.6:0/338426441 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fc2240051d0 con 0x7fc22c108740 2024-05-20T17:05:36.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.613+0000 7fc2227fc640 1 --2- 172.21.15.6:0/338426441 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc2180a2cd0 0x7fc2180a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:36.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.613+0000 7fc2310b2640 1 --2- 172.21.15.6:0/338426441 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc2180a2cd0 0x7fc2180a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:36.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.613+0000 7fc2227fc640 1 -- 172.21.15.6:0/338426441 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fc2240cf570 con 0x7fc22c108740 2024-05-20T17:05:36.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.613+0000 7fc2310b2640 1 --2- 172.21.15.6:0/338426441 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc2180a2cd0 0x7fc2180a51e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc22c069970 tx=0x7fc228005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:36.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.618+0000 7fc2227fc640 1 -- 172.21.15.6:0/338426441 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc224016030 con 0x7fc22c108740 2024-05-20T17:05:36.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.804+0000 7fc233316640 1 -- 172.21.15.6:0/338426441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc22c02d320 con 0x7fc22c108740 2024-05-20T17:05:36.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.805+0000 7fc2227fc640 1 -- 172.21.15.6:0/338426441 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+23973 (secure 0 0 0) 0x7fc22409ba80 con 0x7fc22c108740 2024-05-20T17:05:36.805 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:05:36.805 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":90,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:05:09.495505+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:05:02.947896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:05:03.842231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:05:07.551471+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:05:36.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.808+0000 7fc233316640 1 -- 172.21.15.6:0/338426441 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc2180a2cd0 msgr2=0x7fc2180a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:36.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.808+0000 7fc233316640 1 --2- 172.21.15.6:0/338426441 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc2180a2cd0 0x7fc2180a51e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc22c069970 tx=0x7fc228005f90 comp rx=0 tx=0).stop 2024-05-20T17:05:36.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.808+0000 7fc233316640 1 -- 172.21.15.6:0/338426441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc22c108740 msgr2=0x7fc22c1a0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:36.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.808+0000 7fc233316640 1 --2- 172.21.15.6:0/338426441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc22c108740 0x7fc22c1a0590 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc22400eaa0 tx=0x7fc22400ef60 comp rx=0 tx=0).stop 2024-05-20T17:05:36.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.808+0000 7fc233316640 1 -- 172.21.15.6:0/338426441 shutdown_connections 2024-05-20T17:05:36.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.808+0000 7fc233316640 1 --2- 172.21.15.6:0/338426441 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc2180a2cd0 0x7fc2180a51e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.808+0000 7fc233316640 1 --2- 172.21.15.6:0/338426441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc22c108740 0x7fc22c1a0590 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.808+0000 7fc233316640 1 --2- 172.21.15.6:0/338426441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc22c105bd0 0x7fc22c199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.808+0000 7fc233316640 1 --2- 172.21.15.6:0/338426441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc22c1031e0 0x7fc22c1990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.808+0000 7fc233316640 1 -- 172.21.15.6:0/338426441 >> 172.21.15.6:0/338426441 conn(0x7fc22c0fcba0 msgr2=0x7fc22c103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:36.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.808+0000 7fc233316640 1 -- 172.21.15.6:0/338426441 shutdown_connections 2024-05-20T17:05:36.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.808+0000 7fc233316640 1 -- 172.21.15.6:0/338426441 wait complete. 2024-05-20T17:05:36.817 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:36 smithi006 ceph-mon[32486]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:05:36.817 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:36 smithi006 ceph-mon[32486]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:05:36.817 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:36 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] up:active 2024-05-20T17:05:36.818 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:36 smithi006 ceph-mon[32486]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2024-05-20T17:05:36.818 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:36 smithi006 ceph-mon[32486]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:05:36.818 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:36 smithi006 ceph-mon[32486]: from='client.24767 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:05:36.818 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:36 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/363006379' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:05:36.820 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-20T17:05:36.820 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:05:36.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:36 smithi171 ceph-mon[35901]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:05:36.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:36 smithi171 ceph-mon[35901]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:05:36.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:36 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] up:active 2024-05-20T17:05:36.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:36 smithi171 ceph-mon[35901]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2024-05-20T17:05:36.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:36 smithi171 ceph-mon[35901]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:05:36.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:36 smithi171 ceph-mon[35901]: from='client.24767 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:05:36.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:36 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/363006379' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:05:36.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.935+0000 7f04233fc640 1 -- 172.21.15.6:0/2956564139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f041c105be0 msgr2=0x7f041c1080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:36.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.935+0000 7f04233fc640 1 --2- 172.21.15.6:0/2956564139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f041c105be0 0x7f041c1080c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f040c009900 tx=0x7f040c02a410 comp rx=0 tx=0).stop 2024-05-20T17:05:36.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.935+0000 7f04233fc640 1 -- 172.21.15.6:0/2956564139 shutdown_connections 2024-05-20T17:05:36.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.935+0000 7f04233fc640 1 --2- 172.21.15.6:0/2956564139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f041c108750 0x7f041c10ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.935+0000 7f04233fc640 1 --2- 172.21.15.6:0/2956564139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f041c105be0 0x7f041c1080c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.935+0000 7f04233fc640 1 --2- 172.21.15.6:0/2956564139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f041c100e00 0x7f041c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.935+0000 7f04233fc640 1 -- 172.21.15.6:0/2956564139 >> 172.21.15.6:0/2956564139 conn(0x7f041c0fc330 msgr2=0x7f041c0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:36.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.935+0000 7f04233fc640 1 -- 172.21.15.6:0/2956564139 shutdown_connections 2024-05-20T17:05:36.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.935+0000 7f04233fc640 1 -- 172.21.15.6:0/2956564139 wait complete. 2024-05-20T17:05:36.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.936+0000 7f04233fc640 1 Processor -- start 2024-05-20T17:05:36.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.936+0000 7f04233fc640 1 -- start start 2024-05-20T17:05:36.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.936+0000 7f04233fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f041c100e00 0x7f041c199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:36.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.936+0000 7f04233fc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f041c105be0 0x7f041c199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:36.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.936+0000 7f04233fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f041c108750 0x7f041c1a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:36.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.936+0000 7f04233fc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f041c10e610 con 0x7f041c108750 2024-05-20T17:05:36.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.936+0000 7f04233fc640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f041c10e490 con 0x7f041c100e00 2024-05-20T17:05:36.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.936+0000 7f04233fc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f041c10e790 con 0x7f041c105be0 2024-05-20T17:05:36.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.936+0000 7f0421999640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f041c108750 0x7f041c1a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:36.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.936+0000 7f0421999640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f041c108750 0x7f041c1a05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60280/0 (socket says 172.21.15.6:60280) 2024-05-20T17:05:36.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.936+0000 7f0421999640 1 -- 172.21.15.6:0/3383167483 learned_addr learned my addr 172.21.15.6:0/3383167483 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:36.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.936+0000 7f0421198640 1 --2- 172.21.15.6:0/3383167483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f041c100e00 0x7f041c199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:36.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.936+0000 7f0420997640 1 --2- 172.21.15.6:0/3383167483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f041c105be0 0x7f041c199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:36.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.937+0000 7f0421999640 1 -- 172.21.15.6:0/3383167483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f041c105be0 msgr2=0x7f041c199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:36.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.937+0000 7f0421999640 1 --2- 172.21.15.6:0/3383167483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f041c105be0 0x7f041c199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.937+0000 7f0421999640 1 -- 172.21.15.6:0/3383167483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f041c100e00 msgr2=0x7f041c199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:36.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.937+0000 7f0421999640 1 --2- 172.21.15.6:0/3383167483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f041c100e00 0x7f041c199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:36.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.937+0000 7f0421999640 1 -- 172.21.15.6:0/3383167483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041c1a0bb0 con 0x7f041c108750 2024-05-20T17:05:36.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.937+0000 7f0421198640 1 --2- 172.21.15.6:0/3383167483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f041c100e00 0x7f041c199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:05:36.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.937+0000 7f0421999640 1 --2- 172.21.15.6:0/3383167483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f041c108750 0x7f041c1a05f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f041400cce0 tx=0x7f041400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:36.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.937+0000 7f04127fc640 1 -- 172.21.15.6:0/3383167483 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041400f450 con 0x7f041c108750 2024-05-20T17:05:36.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.937+0000 7f04127fc640 1 -- 172.21.15.6:0/3383167483 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f041400faa0 con 0x7f041c108750 2024-05-20T17:05:36.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.937+0000 7f04233fc640 1 -- 172.21.15.6:0/3383167483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f041c1a0ea0 con 0x7f041c108750 2024-05-20T17:05:36.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.937+0000 7f04127fc640 1 -- 172.21.15.6:0/3383167483 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0414018b70 con 0x7f041c108750 2024-05-20T17:05:36.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.937+0000 7f04233fc640 1 -- 172.21.15.6:0/3383167483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f041c1a12b0 con 0x7f041c108750 2024-05-20T17:05:36.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.938+0000 7f04233fc640 1 -- 172.21.15.6:0/3383167483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f041c0fde50 con 0x7f041c108750 2024-05-20T17:05:36.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.940+0000 7f04127fc640 1 -- 172.21.15.6:0/3383167483 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f0414018d10 con 0x7f041c108750 2024-05-20T17:05:36.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.940+0000 7f04127fc640 1 --2- 172.21.15.6:0/3383167483 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f04080a2cd0 0x7f04080a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:36.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.940+0000 7f04127fc640 1 -- 172.21.15.6:0/3383167483 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f04140cf820 con 0x7f041c108750 2024-05-20T17:05:36.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.940+0000 7f0421198640 1 --2- 172.21.15.6:0/3383167483 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f04080a2cd0 0x7f04080a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:36.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.941+0000 7f0421198640 1 --2- 172.21.15.6:0/3383167483 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f04080a2cd0 0x7f04080a51e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f041c103ad0 tx=0x7f0418005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:36.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:36.944+0000 7f04127fc640 1 -- 172.21.15.6:0/3383167483 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0414014030 con 0x7f041c108750 2024-05-20T17:05:37.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:36 smithi062 ceph-mon[35425]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:05:37.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:36 smithi062 ceph-mon[35425]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:05:37.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:36 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] up:active 2024-05-20T17:05:37.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:36 smithi062 ceph-mon[35425]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2024-05-20T17:05:37.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:36 smithi062 ceph-mon[35425]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:05:37.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:36 smithi062 ceph-mon[35425]: from='client.24767 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:05:37.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:36 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/363006379' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:05:37.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.129+0000 7f04233fc640 1 -- 172.21.15.6:0/3383167483 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f041c061f90 con 0x7f04080a2cd0 2024-05-20T17:05:37.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.140+0000 7f04127fc640 1 -- 172.21.15.6:0/3383167483 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340307 (secure 0 0 0) 0x7f041c061f90 con 0x7f04080a2cd0 2024-05-20T17:05:37.144 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:05:37.145 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:05:37.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.144+0000 7f04233fc640 1 -- 172.21.15.6:0/3383167483 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f04080a2cd0 msgr2=0x7f04080a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:37.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.144+0000 7f04233fc640 1 --2- 172.21.15.6:0/3383167483 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f04080a2cd0 0x7f04080a51e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f041c103ad0 tx=0x7f0418005f90 comp rx=0 tx=0).stop 2024-05-20T17:05:37.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.144+0000 7f04233fc640 1 -- 172.21.15.6:0/3383167483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f041c108750 msgr2=0x7f041c1a05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:37.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.144+0000 7f04233fc640 1 --2- 172.21.15.6:0/3383167483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f041c108750 0x7f041c1a05f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f041400cce0 tx=0x7f041400a620 comp rx=0 tx=0).stop 2024-05-20T17:05:37.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.144+0000 7f04233fc640 1 -- 172.21.15.6:0/3383167483 shutdown_connections 2024-05-20T17:05:37.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.144+0000 7f04233fc640 1 --2- 172.21.15.6:0/3383167483 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f04080a2cd0 0x7f04080a51e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:37.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.144+0000 7f04233fc640 1 --2- 172.21.15.6:0/3383167483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f041c108750 0x7f041c1a05f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:37.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.144+0000 7f04233fc640 1 --2- 172.21.15.6:0/3383167483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f041c105be0 0x7f041c199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:37.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.144+0000 7f04233fc640 1 --2- 172.21.15.6:0/3383167483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f041c100e00 0x7f041c199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:37.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.144+0000 7f04233fc640 1 -- 172.21.15.6:0/3383167483 >> 172.21.15.6:0/3383167483 conn(0x7f041c0fc330 msgr2=0x7f041c109650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:37.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.144+0000 7f04233fc640 1 -- 172.21.15.6:0/3383167483 shutdown_connections 2024-05-20T17:05:37.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.144+0000 7f04233fc640 1 -- 172.21.15.6:0/3383167483 wait complete. 2024-05-20T17:05:37.154 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-05-20T17:05:36.089624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597378,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":147,"num_read_kb":130,"num_write":330,"num_write_kb":2981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":262,"ondisk_log_size":262,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375252,"kb_used_data":13596,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566572,"statfs":{"total":1151940427776,"available":1151556169728,"internally_reserved":0,"allocated":13922304,"data_stored":7574534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2370,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":100,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004065"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.130216+0000","last_change":"2024-05-20T17:05:05.110008+0000","last_active":"2024-05-20T17:05:10.130216+0000","last_peered":"2024-05-20T17:05:10.130216+0000","last_clean":"2024-05-20T17:05:10.130216+0000","last_became_active":"2024-05-20T17:05:05.109556+0000","last_became_peered":"2024-05-20T17:05:05.109556+0000","last_unstale":"2024-05-20T17:05:10.130216+0000","last_undegraded":"2024-05-20T17:05:10.130216+0000","last_fullsized":"2024-05-20T17:05:10.130216+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:05:55.733938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.737336+0000","last_change":"2024-05-20T17:05:05.106305+0000","last_active":"2024-05-20T17:05:09.737336+0000","last_peered":"2024-05-20T17:05:09.737336+0000","last_clean":"2024-05-20T17:05:09.737336+0000","last_became_active":"2024-05-20T17:05:05.105520+0000","last_became_peered":"2024-05-20T17:05:05.105520+0000","last_unstale":"2024-05-20T17:05:09.737336+0000","last_undegraded":"2024-05-20T17:05:09.737336+0000","last_fullsized":"2024-05-20T17:05:09.737336+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:28:55.385934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.737067+0000","last_change":"2024-05-20T17:05:05.103165+0000","last_active":"2024-05-20T17:05:09.737067+0000","last_peered":"2024-05-20T17:05:09.737067+0000","last_clean":"2024-05-20T17:05:09.737067+0000","last_became_active":"2024-05-20T17:05:05.102808+0000","last_became_peered":"2024-05-20T17:05:05.102808+0000","last_unstale":"2024-05-20T17:05:09.737067+0000","last_undegraded":"2024-05-20T17:05:09.737067+0000","last_fullsized":"2024-05-20T17:05:09.737067+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:47:14.217973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.628057+0000","last_change":"2024-05-20T17:05:05.108954+0000","last_active":"2024-05-20T17:05:09.628057+0000","last_peered":"2024-05-20T17:05:09.628057+0000","last_clean":"2024-05-20T17:05:09.628057+0000","last_became_active":"2024-05-20T17:05:05.108563+0000","last_became_peered":"2024-05-20T17:05:05.108563+0000","last_unstale":"2024-05-20T17:05:09.628057+0000","last_undegraded":"2024-05-20T17:05:09.628057+0000","last_fullsized":"2024-05-20T17:05:09.628057+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:07:22.929896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128617+0000","last_change":"2024-05-20T17:05:05.103357+0000","last_active":"2024-05-20T17:05:10.128617+0000","last_peered":"2024-05-20T17:05:10.128617+0000","last_clean":"2024-05-20T17:05:10.128617+0000","last_became_active":"2024-05-20T17:05:05.102990+0000","last_became_peered":"2024-05-20T17:05:05.102990+0000","last_unstale":"2024-05-20T17:05:10.128617+0000","last_undegraded":"2024-05-20T17:05:10.128617+0000","last_fullsized":"2024-05-20T17:05:10.128617+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:01.800910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129327+0000","last_change":"2024-05-20T17:05:05.114822+0000","last_active":"2024-05-20T17:05:10.129327+0000","last_peered":"2024-05-20T17:05:10.129327+0000","last_clean":"2024-05-20T17:05:10.129327+0000","last_became_active":"2024-05-20T17:05:05.114402+0000","last_became_peered":"2024-05-20T17:05:05.114402+0000","last_unstale":"2024-05-20T17:05:10.129327+0000","last_undegraded":"2024-05-20T17:05:10.129327+0000","last_fullsized":"2024-05-20T17:05:10.129327+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:03:19.530670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128760+0000","last_change":"2024-05-20T17:05:05.111478+0000","last_active":"2024-05-20T17:05:10.128760+0000","last_peered":"2024-05-20T17:05:10.128760+0000","last_clean":"2024-05-20T17:05:10.128760+0000","last_became_active":"2024-05-20T17:05:05.111054+0000","last_became_peered":"2024-05-20T17:05:05.111054+0000","last_unstale":"2024-05-20T17:05:10.128760+0000","last_undegraded":"2024-05-20T17:05:10.128760+0000","last_fullsized":"2024-05-20T17:05:10.128760+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:09:52.783885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128241+0000","last_change":"2024-05-20T17:05:05.109706+0000","last_active":"2024-05-20T17:05:10.128241+0000","last_peered":"2024-05-20T17:05:10.128241+0000","last_clean":"2024-05-20T17:05:10.128241+0000","last_became_active":"2024-05-20T17:05:05.109258+0000","last_became_peered":"2024-05-20T17:05:05.109258+0000","last_unstale":"2024-05-20T17:05:10.128241+0000","last_undegraded":"2024-05-20T17:05:10.128241+0000","last_fullsized":"2024-05-20T17:05:10.128241+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:11:48.568541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570062+0000","last_change":"2024-05-20T17:05:05.097099+0000","last_active":"2024-05-20T17:05:09.570062+0000","last_peered":"2024-05-20T17:05:09.570062+0000","last_clean":"2024-05-20T17:05:09.570062+0000","last_became_active":"2024-05-20T17:05:05.096514+0000","last_became_peered":"2024-05-20T17:05:05.096514+0000","last_unstale":"2024-05-20T17:05:09.570062+0000","last_undegraded":"2024-05-20T17:05:09.570062+0000","last_fullsized":"2024-05-20T17:05:09.570062+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:30:30.472956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129005+0000","last_change":"2024-05-20T17:05:05.114535+0000","last_active":"2024-05-20T17:05:10.129005+0000","last_peered":"2024-05-20T17:05:10.129005+0000","last_clean":"2024-05-20T17:05:10.129005+0000","last_became_active":"2024-05-20T17:05:05.114126+0000","last_became_peered":"2024-05-20T17:05:05.114126+0000","last_unstale":"2024-05-20T17:05:10.129005+0000","last_undegraded":"2024-05-20T17:05:10.129005+0000","last_fullsized":"2024-05-20T17:05:10.129005+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:36:05.541565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129850+0000","last_change":"2024-05-20T17:05:05.115584+0000","last_active":"2024-05-20T17:05:10.129850+0000","last_peered":"2024-05-20T17:05:10.129850+0000","last_clean":"2024-05-20T17:05:10.129850+0000","last_became_active":"2024-05-20T17:05:05.115178+0000","last_became_peered":"2024-05-20T17:05:05.115178+0000","last_unstale":"2024-05-20T17:05:10.129850+0000","last_undegraded":"2024-05-20T17:05:10.129850+0000","last_fullsized":"2024-05-20T17:05:10.129850+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:11:36.593125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.628016+0000","last_change":"2024-05-20T17:05:05.112302+0000","last_active":"2024-05-20T17:05:09.628016+0000","last_peered":"2024-05-20T17:05:09.628016+0000","last_clean":"2024-05-20T17:05:09.628016+0000","last_became_active":"2024-05-20T17:05:05.109423+0000","last_became_peered":"2024-05-20T17:05:05.109423+0000","last_unstale":"2024-05-20T17:05:09.628016+0000","last_undegraded":"2024-05-20T17:05:09.628016+0000","last_fullsized":"2024-05-20T17:05:09.628016+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:43.149894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.567596+0000","last_change":"2024-05-20T17:05:05.094024+0000","last_active":"2024-05-20T17:05:09.567596+0000","last_peered":"2024-05-20T17:05:09.567596+0000","last_clean":"2024-05-20T17:05:09.567596+0000","last_became_active":"2024-05-20T17:05:05.093681+0000","last_became_peered":"2024-05-20T17:05:05.093681+0000","last_unstale":"2024-05-20T17:05:09.567596+0000","last_undegraded":"2024-05-20T17:05:09.567596+0000","last_fullsized":"2024-05-20T17:05:09.567596+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:05:57.768796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.736870+0000","last_change":"2024-05-20T17:05:05.109210+0000","last_active":"2024-05-20T17:05:09.736870+0000","last_peered":"2024-05-20T17:05:09.736870+0000","last_clean":"2024-05-20T17:05:09.736870+0000","last_became_active":"2024-05-20T17:05:05.108819+0000","last_became_peered":"2024-05-20T17:05:05.108819+0000","last_unstale":"2024-05-20T17:05:09.736870+0000","last_undegraded":"2024-05-20T17:05:09.736870+0000","last_fullsized":"2024-05-20T17:05:09.736870+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:47:10.954313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.736858+0000","last_change":"2024-05-20T17:05:05.107455+0000","last_active":"2024-05-20T17:05:09.736858+0000","last_peered":"2024-05-20T17:05:09.736858+0000","last_clean":"2024-05-20T17:05:09.736858+0000","last_became_active":"2024-05-20T17:05:05.107010+0000","last_became_peered":"2024-05-20T17:05:05.107010+0000","last_unstale":"2024-05-20T17:05:09.736858+0000","last_undegraded":"2024-05-20T17:05:09.736858+0000","last_fullsized":"2024-05-20T17:05:09.736858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:31:21.445393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.569157+0000","last_change":"2024-05-20T17:05:05.116417+0000","last_active":"2024-05-20T17:05:09.569157+0000","last_peered":"2024-05-20T17:05:09.569157+0000","last_clean":"2024-05-20T17:05:09.569157+0000","last_became_active":"2024-05-20T17:05:05.116018+0000","last_became_peered":"2024-05-20T17:05:05.116018+0000","last_unstale":"2024-05-20T17:05:09.569157+0000","last_undegraded":"2024-05-20T17:05:09.569157+0000","last_fullsized":"2024-05-20T17:05:09.569157+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:16:52.984984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129993+0000","last_change":"2024-05-20T17:05:05.109029+0000","last_active":"2024-05-20T17:05:10.129993+0000","last_peered":"2024-05-20T17:05:10.129993+0000","last_clean":"2024-05-20T17:05:10.129993+0000","last_became_active":"2024-05-20T17:05:05.108677+0000","last_became_peered":"2024-05-20T17:05:05.108677+0000","last_unstale":"2024-05-20T17:05:10.129993+0000","last_undegraded":"2024-05-20T17:05:10.129993+0000","last_fullsized":"2024-05-20T17:05:10.129993+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:24:36.698549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.658780+0000","last_change":"2024-05-20T17:05:05.104962+0000","last_active":"2024-05-20T17:05:09.658780+0000","last_peered":"2024-05-20T17:05:09.658780+0000","last_clean":"2024-05-20T17:05:09.658780+0000","last_became_active":"2024-05-20T17:05:05.104503+0000","last_became_peered":"2024-05-20T17:05:05.104503+0000","last_unstale":"2024-05-20T17:05:09.658780+0000","last_undegraded":"2024-05-20T17:05:09.658780+0000","last_fullsized":"2024-05-20T17:05:09.658780+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:51.807731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129694+0000","last_change":"2024-05-20T17:05:05.094714+0000","last_active":"2024-05-20T17:05:10.129694+0000","last_peered":"2024-05-20T17:05:10.129694+0000","last_clean":"2024-05-20T17:05:10.129694+0000","last_became_active":"2024-05-20T17:05:05.094343+0000","last_became_peered":"2024-05-20T17:05:05.094343+0000","last_unstale":"2024-05-20T17:05:10.129694+0000","last_undegraded":"2024-05-20T17:05:10.129694+0000","last_fullsized":"2024-05-20T17:05:10.129694+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:17:50.711969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129620+0000","last_change":"2024-05-20T17:05:09.130195+0000","last_active":"2024-05-20T17:05:10.129620+0000","last_peered":"2024-05-20T17:05:10.129620+0000","last_clean":"2024-05-20T17:05:10.129620+0000","last_became_active":"2024-05-20T17:05:09.129809+0000","last_became_peered":"2024-05-20T17:05:09.129809+0000","last_unstale":"2024-05-20T17:05:10.129620+0000","last_undegraded":"2024-05-20T17:05:10.129620+0000","last_fullsized":"2024-05-20T17:05:10.129620+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:30:23.666443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'4","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.658867+0000","last_change":"2024-05-20T17:05:04.093762+0000","last_active":"2024-05-20T17:05:09.658867+0000","last_peered":"2024-05-20T17:05:09.658867+0000","last_clean":"2024-05-20T17:05:09.658867+0000","last_became_active":"2024-05-20T17:05:04.093408+0000","last_became_peered":"2024-05-20T17:05:04.093408+0000","last_unstale":"2024-05-20T17:05:09.658867+0000","last_undegraded":"2024-05-20T17:05:09.658867+0000","last_fullsized":"2024-05-20T17:05:09.658867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:38:12.725701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128531+0000","last_change":"2024-05-20T17:05:05.110848+0000","last_active":"2024-05-20T17:05:10.128531+0000","last_peered":"2024-05-20T17:05:10.128531+0000","last_clean":"2024-05-20T17:05:10.128531+0000","last_became_active":"2024-05-20T17:05:05.110467+0000","last_became_peered":"2024-05-20T17:05:05.110467+0000","last_unstale":"2024-05-20T17:05:10.128531+0000","last_undegraded":"2024-05-20T17:05:10.128531+0000","last_fullsized":"2024-05-20T17:05:10.128531+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:09:11.436295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.627398+0000","last_change":"2024-05-20T17:05:09.138726+0000","last_active":"2024-05-20T17:05:09.627398+0000","last_peered":"2024-05-20T17:05:09.627398+0000","last_clean":"2024-05-20T17:05:09.627398+0000","last_became_active":"2024-05-20T17:05:09.138012+0000","last_became_peered":"2024-05-20T17:05:09.138012+0000","last_unstale":"2024-05-20T17:05:09.627398+0000","last_undegraded":"2024-05-20T17:05:09.627398+0000","last_fullsized":"2024-05-20T17:05:09.627398+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:42:40.892912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128851+0000","last_change":"2024-05-20T17:05:04.101591+0000","last_active":"2024-05-20T17:05:10.128851+0000","last_peered":"2024-05-20T17:05:10.128851+0000","last_clean":"2024-05-20T17:05:10.128851+0000","last_became_active":"2024-05-20T17:05:04.101258+0000","last_became_peered":"2024-05-20T17:05:04.101258+0000","last_unstale":"2024-05-20T17:05:10.128851+0000","last_undegraded":"2024-05-20T17:05:10.128851+0000","last_fullsized":"2024-05-20T17:05:10.128851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:13:35.443657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.737125+0000","last_change":"2024-05-20T17:05:05.114726+0000","last_active":"2024-05-20T17:05:09.737125+0000","last_peered":"2024-05-20T17:05:09.737125+0000","last_clean":"2024-05-20T17:05:09.737125+0000","last_became_active":"2024-05-20T17:05:05.114371+0000","last_became_peered":"2024-05-20T17:05:05.114371+0000","last_unstale":"2024-05-20T17:05:09.737125+0000","last_undegraded":"2024-05-20T17:05:09.737125+0000","last_fullsized":"2024-05-20T17:05:09.737125+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:50:37.982368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.627614+0000","last_change":"2024-05-20T17:05:09.139600+0000","last_active":"2024-05-20T17:05:09.627614+0000","last_peered":"2024-05-20T17:05:09.627614+0000","last_clean":"2024-05-20T17:05:09.627614+0000","last_became_active":"2024-05-20T17:05:09.138784+0000","last_became_peered":"2024-05-20T17:05:09.138784+0000","last_unstale":"2024-05-20T17:05:09.627614+0000","last_undegraded":"2024-05-20T17:05:09.627614+0000","last_fullsized":"2024-05-20T17:05:09.627614+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:51:06.592224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:35.587321+0000","last_change":"2024-05-20T17:05:04.094198+0000","last_active":"2024-05-20T17:05:35.587321+0000","last_peered":"2024-05-20T17:05:35.587321+0000","last_clean":"2024-05-20T17:05:35.587321+0000","last_became_active":"2024-05-20T17:05:04.092910+0000","last_became_peered":"2024-05-20T17:05:04.092910+0000","last_unstale":"2024-05-20T17:05:35.587321+0000","last_undegraded":"2024-05-20T17:05:35.587321+0000","last_fullsized":"2024-05-20T17:05:35.587321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:48:59.565790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.569358+0000","last_change":"2024-05-20T17:05:05.094554+0000","last_active":"2024-05-20T17:05:09.569358+0000","last_peered":"2024-05-20T17:05:09.569358+0000","last_clean":"2024-05-20T17:05:09.569358+0000","last_became_active":"2024-05-20T17:05:05.092846+0000","last_became_peered":"2024-05-20T17:05:05.092846+0000","last_unstale":"2024-05-20T17:05:09.569358+0000","last_undegraded":"2024-05-20T17:05:09.569358+0000","last_fullsized":"2024-05-20T17:05:09.569358+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:32:00.607173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.627418+0000","last_change":"2024-05-20T17:05:09.129918+0000","last_active":"2024-05-20T17:05:09.627418+0000","last_peered":"2024-05-20T17:05:09.627418+0000","last_clean":"2024-05-20T17:05:09.627418+0000","last_became_active":"2024-05-20T17:05:09.129497+0000","last_became_peered":"2024-05-20T17:05:09.129497+0000","last_unstale":"2024-05-20T17:05:09.627418+0000","last_undegraded":"2024-05-20T17:05:09.627418+0000","last_fullsized":"2024-05-20T17:05:09.627418+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:45:16.189840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:34.592882+0000","last_change":"2024-05-20T17:05:04.104740+0000","last_active":"2024-05-20T17:05:34.592882+0000","last_peered":"2024-05-20T17:05:34.592882+0000","last_clean":"2024-05-20T17:05:34.592882+0000","last_became_active":"2024-05-20T17:05:04.103297+0000","last_became_peered":"2024-05-20T17:05:04.103297+0000","last_unstale":"2024-05-20T17:05:34.592882+0000","last_undegraded":"2024-05-20T17:05:34.592882+0000","last_fullsized":"2024-05-20T17:05:34.592882+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:48:08.543394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570542+0000","last_change":"2024-05-20T17:05:05.108681+0000","last_active":"2024-05-20T17:05:09.570542+0000","last_peered":"2024-05-20T17:05:09.570542+0000","last_clean":"2024-05-20T17:05:09.570542+0000","last_became_active":"2024-05-20T17:05:05.108275+0000","last_became_peered":"2024-05-20T17:05:05.108275+0000","last_unstale":"2024-05-20T17:05:09.570542+0000","last_undegraded":"2024-05-20T17:05:09.570542+0000","last_fullsized":"2024-05-20T17:05:09.570542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:15:26.540948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129630+0000","last_change":"2024-05-20T17:05:09.125991+0000","last_active":"2024-05-20T17:05:10.129630+0000","last_peered":"2024-05-20T17:05:10.129630+0000","last_clean":"2024-05-20T17:05:10.129630+0000","last_became_active":"2024-05-20T17:05:09.125493+0000","last_became_peered":"2024-05-20T17:05:09.125493+0000","last_unstale":"2024-05-20T17:05:10.129630+0000","last_undegraded":"2024-05-20T17:05:10.129630+0000","last_fullsized":"2024-05-20T17:05:10.129630+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:09:19.603595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570826+0000","last_change":"2024-05-20T17:05:04.100387+0000","last_active":"2024-05-20T17:05:09.570826+0000","last_peered":"2024-05-20T17:05:09.570826+0000","last_clean":"2024-05-20T17:05:09.570826+0000","last_became_active":"2024-05-20T17:05:04.099834+0000","last_became_peered":"2024-05-20T17:05:04.099834+0000","last_unstale":"2024-05-20T17:05:09.570826+0000","last_undegraded":"2024-05-20T17:05:09.570826+0000","last_fullsized":"2024-05-20T17:05:09.570826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:10:18.696925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128901+0000","last_change":"2024-05-20T17:05:05.094015+0000","last_active":"2024-05-20T17:05:10.128901+0000","last_peered":"2024-05-20T17:05:10.128901+0000","last_clean":"2024-05-20T17:05:10.128901+0000","last_became_active":"2024-05-20T17:05:05.093650+0000","last_became_peered":"2024-05-20T17:05:05.093650+0000","last_unstale":"2024-05-20T17:05:10.128901+0000","last_undegraded":"2024-05-20T17:05:10.128901+0000","last_fullsized":"2024-05-20T17:05:10.128901+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:39:46.944348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129220+0000","last_change":"2024-05-20T17:05:09.122824+0000","last_active":"2024-05-20T17:05:10.129220+0000","last_peered":"2024-05-20T17:05:10.129220+0000","last_clean":"2024-05-20T17:05:10.129220+0000","last_became_active":"2024-05-20T17:05:09.122047+0000","last_became_peered":"2024-05-20T17:05:09.122047+0000","last_unstale":"2024-05-20T17:05:10.129220+0000","last_undegraded":"2024-05-20T17:05:10.129220+0000","last_fullsized":"2024-05-20T17:05:10.129220+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:55:49.843543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:33.584191+0000","last_change":"2024-05-20T17:05:04.094476+0000","last_active":"2024-05-20T17:05:33.584191+0000","last_peered":"2024-05-20T17:05:33.584191+0000","last_clean":"2024-05-20T17:05:33.584191+0000","last_became_active":"2024-05-20T17:05:04.093749+0000","last_became_peered":"2024-05-20T17:05:04.093749+0000","last_unstale":"2024-05-20T17:05:33.584191+0000","last_undegraded":"2024-05-20T17:05:33.584191+0000","last_fullsized":"2024-05-20T17:05:33.584191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:10:22.418169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570750+0000","last_change":"2024-05-20T17:05:05.107958+0000","last_active":"2024-05-20T17:05:09.570750+0000","last_peered":"2024-05-20T17:05:09.570750+0000","last_clean":"2024-05-20T17:05:09.570750+0000","last_became_active":"2024-05-20T17:05:05.107613+0000","last_became_peered":"2024-05-20T17:05:05.107613+0000","last_unstale":"2024-05-20T17:05:09.570750+0000","last_undegraded":"2024-05-20T17:05:09.570750+0000","last_fullsized":"2024-05-20T17:05:09.570750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:32.617707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.130084+0000","last_change":"2024-05-20T17:05:09.137556+0000","last_active":"2024-05-20T17:05:10.130084+0000","last_peered":"2024-05-20T17:05:10.130084+0000","last_clean":"2024-05-20T17:05:10.130084+0000","last_became_active":"2024-05-20T17:05:09.137168+0000","last_became_peered":"2024-05-20T17:05:09.137168+0000","last_unstale":"2024-05-20T17:05:10.130084+0000","last_undegraded":"2024-05-20T17:05:10.130084+0000","last_fullsized":"2024-05-20T17:05:10.130084+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:14:24.917203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:32.578880+0000","last_change":"2024-05-20T17:05:04.088139+0000","last_active":"2024-05-20T17:05:32.578880+0000","last_peered":"2024-05-20T17:05:32.578880+0000","last_clean":"2024-05-20T17:05:32.578880+0000","last_became_active":"2024-05-20T17:05:04.087746+0000","last_became_peered":"2024-05-20T17:05:04.087746+0000","last_unstale":"2024-05-20T17:05:32.578880+0000","last_undegraded":"2024-05-20T17:05:32.578880+0000","last_fullsized":"2024-05-20T17:05:32.578880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:27:43.440887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128098+0000","last_change":"2024-05-20T17:05:05.099478+0000","last_active":"2024-05-20T17:05:10.128098+0000","last_peered":"2024-05-20T17:05:10.128098+0000","last_clean":"2024-05-20T17:05:10.128098+0000","last_became_active":"2024-05-20T17:05:05.099058+0000","last_became_peered":"2024-05-20T17:05:05.099058+0000","last_unstale":"2024-05-20T17:05:10.128098+0000","last_undegraded":"2024-05-20T17:05:10.128098+0000","last_fullsized":"2024-05-20T17:05:10.128098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:41:51.133985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.737319+0000","last_change":"2024-05-20T17:05:09.132210+0000","last_active":"2024-05-20T17:05:09.737319+0000","last_peered":"2024-05-20T17:05:09.737319+0000","last_clean":"2024-05-20T17:05:09.737319+0000","last_became_active":"2024-05-20T17:05:09.131782+0000","last_became_peered":"2024-05-20T17:05:09.131782+0000","last_unstale":"2024-05-20T17:05:09.737319+0000","last_undegraded":"2024-05-20T17:05:09.737319+0000","last_fullsized":"2024-05-20T17:05:09.737319+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:39:13.111988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570151+0000","last_change":"2024-05-20T17:05:04.100091+0000","last_active":"2024-05-20T17:05:09.570151+0000","last_peered":"2024-05-20T17:05:09.570151+0000","last_clean":"2024-05-20T17:05:09.570151+0000","last_became_active":"2024-05-20T17:05:04.099741+0000","last_became_peered":"2024-05-20T17:05:04.099741+0000","last_unstale":"2024-05-20T17:05:09.570151+0000","last_undegraded":"2024-05-20T17:05:09.570151+0000","last_fullsized":"2024-05-20T17:05:09.570151+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:58:51.078656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.658200+0000","last_change":"2024-05-20T17:05:05.101320+0000","last_active":"2024-05-20T17:05:09.658200+0000","last_peered":"2024-05-20T17:05:09.658200+0000","last_clean":"2024-05-20T17:05:09.658200+0000","last_became_active":"2024-05-20T17:05:05.100957+0000","last_became_peered":"2024-05-20T17:05:05.100957+0000","last_unstale":"2024-05-20T17:05:09.658200+0000","last_undegraded":"2024-05-20T17:05:09.658200+0000","last_fullsized":"2024-05-20T17:05:09.658200+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:19.765284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128499+0000","last_change":"2024-05-20T17:05:09.131013+0000","last_active":"2024-05-20T17:05:10.128499+0000","last_peered":"2024-05-20T17:05:10.128499+0000","last_clean":"2024-05-20T17:05:10.128499+0000","last_became_active":"2024-05-20T17:05:09.130459+0000","last_became_peered":"2024-05-20T17:05:09.130459+0000","last_unstale":"2024-05-20T17:05:10.128499+0000","last_undegraded":"2024-05-20T17:05:10.128499+0000","last_fullsized":"2024-05-20T17:05:10.128499+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:46.158164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:33.572282+0000","last_change":"2024-05-20T17:05:04.094572+0000","last_active":"2024-05-20T17:05:33.572282+0000","last_peered":"2024-05-20T17:05:33.572282+0000","last_clean":"2024-05-20T17:05:33.572282+0000","last_became_active":"2024-05-20T17:05:04.094170+0000","last_became_peered":"2024-05-20T17:05:04.094170+0000","last_unstale":"2024-05-20T17:05:33.572282+0000","last_undegraded":"2024-05-20T17:05:33.572282+0000","last_fullsized":"2024-05-20T17:05:33.572282+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:31:00.700434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570060+0000","last_change":"2024-05-20T17:05:05.108241+0000","last_active":"2024-05-20T17:05:09.570060+0000","last_peered":"2024-05-20T17:05:09.570060+0000","last_clean":"2024-05-20T17:05:09.570060+0000","last_became_active":"2024-05-20T17:05:05.107515+0000","last_became_peered":"2024-05-20T17:05:05.107515+0000","last_unstale":"2024-05-20T17:05:09.570060+0000","last_undegraded":"2024-05-20T17:05:09.570060+0000","last_fullsized":"2024-05-20T17:05:09.570060+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:41:44.735821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.658293+0000","last_change":"2024-05-20T17:05:09.133897+0000","last_active":"2024-05-20T17:05:09.658293+0000","last_peered":"2024-05-20T17:05:09.658293+0000","last_clean":"2024-05-20T17:05:09.658293+0000","last_became_active":"2024-05-20T17:05:09.128953+0000","last_became_peered":"2024-05-20T17:05:09.128953+0000","last_unstale":"2024-05-20T17:05:09.658293+0000","last_undegraded":"2024-05-20T17:05:09.658293+0000","last_fullsized":"2024-05-20T17:05:09.658293+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:48:01.515930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:31.646750+0000","last_change":"2024-05-20T17:05:04.099314+0000","last_active":"2024-05-20T17:05:31.646750+0000","last_peered":"2024-05-20T17:05:31.646750+0000","last_clean":"2024-05-20T17:05:31.646750+0000","last_became_active":"2024-05-20T17:05:04.098912+0000","last_became_peered":"2024-05-20T17:05:04.098912+0000","last_unstale":"2024-05-20T17:05:31.646750+0000","last_undegraded":"2024-05-20T17:05:31.646750+0000","last_fullsized":"2024-05-20T17:05:31.646750+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:42:57.797943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.737268+0000","last_change":"2024-05-20T17:05:05.117909+0000","last_active":"2024-05-20T17:05:09.737268+0000","last_peered":"2024-05-20T17:05:09.737268+0000","last_clean":"2024-05-20T17:05:09.737268+0000","last_became_active":"2024-05-20T17:05:05.117031+0000","last_became_peered":"2024-05-20T17:05:05.117031+0000","last_unstale":"2024-05-20T17:05:09.737268+0000","last_undegraded":"2024-05-20T17:05:09.737268+0000","last_fullsized":"2024-05-20T17:05:09.737268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:09:29.211373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.627962+0000","last_change":"2024-05-20T17:05:09.139845+0000","last_active":"2024-05-20T17:05:09.627962+0000","last_peered":"2024-05-20T17:05:09.627962+0000","last_clean":"2024-05-20T17:05:09.627962+0000","last_became_active":"2024-05-20T17:05:09.138523+0000","last_became_peered":"2024-05-20T17:05:09.138523+0000","last_unstale":"2024-05-20T17:05:09.627962+0000","last_undegraded":"2024-05-20T17:05:09.627962+0000","last_fullsized":"2024-05-20T17:05:09.627962+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:33:24.772946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"85'3","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570347+0000","last_change":"2024-05-20T17:05:04.101362+0000","last_active":"2024-05-20T17:05:09.570347+0000","last_peered":"2024-05-20T17:05:09.570347+0000","last_clean":"2024-05-20T17:05:09.570347+0000","last_became_active":"2024-05-20T17:05:04.100972+0000","last_became_peered":"2024-05-20T17:05:04.100972+0000","last_unstale":"2024-05-20T17:05:09.570347+0000","last_undegraded":"2024-05-20T17:05:09.570347+0000","last_fullsized":"2024-05-20T17:05:09.570347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:43:57.245788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.569653+0000","last_change":"2024-05-20T17:05:05.105432+0000","last_active":"2024-05-20T17:05:09.569653+0000","last_peered":"2024-05-20T17:05:09.569653+0000","last_clean":"2024-05-20T17:05:09.569653+0000","last_became_active":"2024-05-20T17:05:05.100514+0000","last_became_peered":"2024-05-20T17:05:05.100514+0000","last_unstale":"2024-05-20T17:05:09.569653+0000","last_undegraded":"2024-05-20T17:05:09.569653+0000","last_fullsized":"2024-05-20T17:05:09.569653+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:39:41.164482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.658366+0000","last_change":"2024-05-20T17:05:09.124544+0000","last_active":"2024-05-20T17:05:09.658366+0000","last_peered":"2024-05-20T17:05:09.658366+0000","last_clean":"2024-05-20T17:05:09.658366+0000","last_became_active":"2024-05-20T17:05:09.123525+0000","last_became_peered":"2024-05-20T17:05:09.123525+0000","last_unstale":"2024-05-20T17:05:09.658366+0000","last_undegraded":"2024-05-20T17:05:09.658366+0000","last_fullsized":"2024-05-20T17:05:09.658366+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:10:26.250112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'12","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:33.573975+0000","last_change":"2024-05-20T17:05:04.097234+0000","last_active":"2024-05-20T17:05:33.573975+0000","last_peered":"2024-05-20T17:05:33.573975+0000","last_clean":"2024-05-20T17:05:33.573975+0000","last_became_active":"2024-05-20T17:05:04.096532+0000","last_became_peered":"2024-05-20T17:05:04.096532+0000","last_unstale":"2024-05-20T17:05:33.573975+0000","last_undegraded":"2024-05-20T17:05:33.573975+0000","last_fullsized":"2024-05-20T17:05:33.573975+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:07:12.407496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6,"num_read_kb":7,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129693+0000","last_change":"2024-05-20T17:05:05.113881+0000","last_active":"2024-05-20T17:05:10.129693+0000","last_peered":"2024-05-20T17:05:10.129693+0000","last_clean":"2024-05-20T17:05:10.129693+0000","last_became_active":"2024-05-20T17:05:05.113523+0000","last_became_peered":"2024-05-20T17:05:05.113523+0000","last_unstale":"2024-05-20T17:05:10.129693+0000","last_undegraded":"2024-05-20T17:05:10.129693+0000","last_fullsized":"2024-05-20T17:05:10.129693+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:50:44.206742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.571068+0000","last_change":"2024-05-20T17:05:09.133344+0000","last_active":"2024-05-20T17:05:09.571068+0000","last_peered":"2024-05-20T17:05:09.571068+0000","last_clean":"2024-05-20T17:05:09.571068+0000","last_became_active":"2024-05-20T17:05:09.132914+0000","last_became_peered":"2024-05-20T17:05:09.132914+0000","last_unstale":"2024-05-20T17:05:09.571068+0000","last_undegraded":"2024-05-20T17:05:09.571068+0000","last_fullsized":"2024-05-20T17:05:09.571068+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:56:17.279757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:34.591407+0000","last_change":"2024-05-20T17:05:04.099029+0000","last_active":"2024-05-20T17:05:34.591407+0000","last_peered":"2024-05-20T17:05:34.591407+0000","last_clean":"2024-05-20T17:05:34.591407+0000","last_became_active":"2024-05-20T17:05:04.098553+0000","last_became_peered":"2024-05-20T17:05:04.098553+0000","last_unstale":"2024-05-20T17:05:34.591407+0000","last_undegraded":"2024-05-20T17:05:34.591407+0000","last_fullsized":"2024-05-20T17:05:34.591407+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:12.793008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.567576+0000","last_change":"2024-05-20T17:05:05.107734+0000","last_active":"2024-05-20T17:05:09.567576+0000","last_peered":"2024-05-20T17:05:09.567576+0000","last_clean":"2024-05-20T17:05:09.567576+0000","last_became_active":"2024-05-20T17:05:05.107388+0000","last_became_peered":"2024-05-20T17:05:05.107388+0000","last_unstale":"2024-05-20T17:05:09.567576+0000","last_undegraded":"2024-05-20T17:05:09.567576+0000","last_fullsized":"2024-05-20T17:05:09.567576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:51.147757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128694+0000","last_change":"2024-05-20T17:05:09.137618+0000","last_active":"2024-05-20T17:05:10.128694+0000","last_peered":"2024-05-20T17:05:10.128694+0000","last_clean":"2024-05-20T17:05:10.128694+0000","last_became_active":"2024-05-20T17:05:09.137172+0000","last_became_peered":"2024-05-20T17:05:09.137172+0000","last_unstale":"2024-05-20T17:05:10.128694+0000","last_undegraded":"2024-05-20T17:05:10.128694+0000","last_fullsized":"2024-05-20T17:05:10.128694+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:17:45.218886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570532+0000","last_change":"2024-05-20T17:05:04.095628+0000","last_active":"2024-05-20T17:05:09.570532+0000","last_peered":"2024-05-20T17:05:09.570532+0000","last_clean":"2024-05-20T17:05:09.570532+0000","last_became_active":"2024-05-20T17:05:04.095187+0000","last_became_peered":"2024-05-20T17:05:04.095187+0000","last_unstale":"2024-05-20T17:05:09.570532+0000","last_undegraded":"2024-05-20T17:05:09.570532+0000","last_fullsized":"2024-05-20T17:05:09.570532+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:03:33.601967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129510+0000","last_change":"2024-05-20T17:05:05.108321+0000","last_active":"2024-05-20T17:05:10.129510+0000","last_peered":"2024-05-20T17:05:10.129510+0000","last_clean":"2024-05-20T17:05:10.129510+0000","last_became_active":"2024-05-20T17:05:05.107943+0000","last_became_peered":"2024-05-20T17:05:05.107943+0000","last_unstale":"2024-05-20T17:05:10.129510+0000","last_undegraded":"2024-05-20T17:05:10.129510+0000","last_fullsized":"2024-05-20T17:05:10.129510+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:12:44.324799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.658791+0000","last_change":"2024-05-20T17:05:09.135210+0000","last_active":"2024-05-20T17:05:09.658791+0000","last_peered":"2024-05-20T17:05:09.658791+0000","last_clean":"2024-05-20T17:05:09.658791+0000","last_became_active":"2024-05-20T17:05:09.134226+0000","last_became_peered":"2024-05-20T17:05:09.134226+0000","last_unstale":"2024-05-20T17:05:09.658791+0000","last_undegraded":"2024-05-20T17:05:09.658791+0000","last_fullsized":"2024-05-20T17:05:09.658791+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:36:22.833036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.627255+0000","last_change":"2024-05-20T17:05:04.089661+0000","last_active":"2024-05-20T17:05:09.627255+0000","last_peered":"2024-05-20T17:05:09.627255+0000","last_clean":"2024-05-20T17:05:09.627255+0000","last_became_active":"2024-05-20T17:05:04.088939+0000","last_became_peered":"2024-05-20T17:05:04.088939+0000","last_unstale":"2024-05-20T17:05:09.627255+0000","last_undegraded":"2024-05-20T17:05:09.627255+0000","last_fullsized":"2024-05-20T17:05:09.627255+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:48:15.962887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128750+0000","last_change":"2024-05-20T17:05:05.113827+0000","last_active":"2024-05-20T17:05:10.128750+0000","last_peered":"2024-05-20T17:05:10.128750+0000","last_clean":"2024-05-20T17:05:10.128750+0000","last_became_active":"2024-05-20T17:05:05.111547+0000","last_became_peered":"2024-05-20T17:05:05.111547+0000","last_unstale":"2024-05-20T17:05:10.128750+0000","last_undegraded":"2024-05-20T17:05:10.128750+0000","last_fullsized":"2024-05-20T17:05:10.128750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:29:13.826983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.568089+0000","last_change":"2024-05-20T17:05:09.138814+0000","last_active":"2024-05-20T17:05:09.568089+0000","last_peered":"2024-05-20T17:05:09.568089+0000","last_clean":"2024-05-20T17:05:09.568089+0000","last_became_active":"2024-05-20T17:05:09.138119+0000","last_became_peered":"2024-05-20T17:05:09.138119+0000","last_unstale":"2024-05-20T17:05:09.568089+0000","last_undegraded":"2024-05-20T17:05:09.568089+0000","last_fullsized":"2024-05-20T17:05:09.568089+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:23.323841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:34.592424+0000","last_change":"2024-05-20T17:05:04.102468+0000","last_active":"2024-05-20T17:05:34.592424+0000","last_peered":"2024-05-20T17:05:34.592424+0000","last_clean":"2024-05-20T17:05:34.592424+0000","last_became_active":"2024-05-20T17:05:04.102073+0000","last_became_peered":"2024-05-20T17:05:04.102073+0000","last_unstale":"2024-05-20T17:05:34.592424+0000","last_undegraded":"2024-05-20T17:05:34.592424+0000","last_fullsized":"2024-05-20T17:05:34.592424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:42:46.929625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570122+0000","last_change":"2024-05-20T17:05:05.111382+0000","last_active":"2024-05-20T17:05:09.570122+0000","last_peered":"2024-05-20T17:05:09.570122+0000","last_clean":"2024-05-20T17:05:09.570122+0000","last_became_active":"2024-05-20T17:05:05.111009+0000","last_became_peered":"2024-05-20T17:05:05.111009+0000","last_unstale":"2024-05-20T17:05:09.570122+0000","last_undegraded":"2024-05-20T17:05:09.570122+0000","last_fullsized":"2024-05-20T17:05:09.570122+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:40:08.354340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570311+0000","last_change":"2024-05-20T17:05:09.134534+0000","last_active":"2024-05-20T17:05:09.570311+0000","last_peered":"2024-05-20T17:05:09.570311+0000","last_clean":"2024-05-20T17:05:09.570311+0000","last_became_active":"2024-05-20T17:05:09.134097+0000","last_became_peered":"2024-05-20T17:05:09.134097+0000","last_unstale":"2024-05-20T17:05:09.570311+0000","last_undegraded":"2024-05-20T17:05:09.570311+0000","last_fullsized":"2024-05-20T17:05:09.570311+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:43.782343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:32.567891+0000","last_change":"2024-05-20T17:05:04.104314+0000","last_active":"2024-05-20T17:05:32.567891+0000","last_peered":"2024-05-20T17:05:32.567891+0000","last_clean":"2024-05-20T17:05:32.567891+0000","last_became_active":"2024-05-20T17:05:04.103338+0000","last_became_peered":"2024-05-20T17:05:04.103338+0000","last_unstale":"2024-05-20T17:05:32.567891+0000","last_undegraded":"2024-05-20T17:05:32.567891+0000","last_fullsized":"2024-05-20T17:05:32.567891+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:32:06.721674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129747+0000","last_change":"2024-05-20T17:05:05.107566+0000","last_active":"2024-05-20T17:05:10.129747+0000","last_peered":"2024-05-20T17:05:10.129747+0000","last_clean":"2024-05-20T17:05:10.129747+0000","last_became_active":"2024-05-20T17:05:05.107190+0000","last_became_peered":"2024-05-20T17:05:05.107190+0000","last_unstale":"2024-05-20T17:05:10.129747+0000","last_undegraded":"2024-05-20T17:05:10.129747+0000","last_fullsized":"2024-05-20T17:05:10.129747+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:55:15.312700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128433+0000","last_change":"2024-05-20T17:05:09.369886+0000","last_active":"2024-05-20T17:05:10.128433+0000","last_peered":"2024-05-20T17:05:10.128433+0000","last_clean":"2024-05-20T17:05:10.128433+0000","last_became_active":"2024-05-20T17:05:09.369254+0000","last_became_peered":"2024-05-20T17:05:09.369254+0000","last_unstale":"2024-05-20T17:05:10.128433+0000","last_undegraded":"2024-05-20T17:05:10.128433+0000","last_fullsized":"2024-05-20T17:05:10.128433+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:54:54.784952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.658476+0000","last_change":"2024-05-20T17:05:04.100182+0000","last_active":"2024-05-20T17:05:09.658476+0000","last_peered":"2024-05-20T17:05:09.658476+0000","last_clean":"2024-05-20T17:05:09.658476+0000","last_became_active":"2024-05-20T17:05:04.099801+0000","last_became_peered":"2024-05-20T17:05:04.099801+0000","last_unstale":"2024-05-20T17:05:09.658476+0000","last_undegraded":"2024-05-20T17:05:09.658476+0000","last_fullsized":"2024-05-20T17:05:09.658476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:34.666869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129491+0000","last_change":"2024-05-20T17:05:05.111514+0000","last_active":"2024-05-20T17:05:10.129491+0000","last_peered":"2024-05-20T17:05:10.129491+0000","last_clean":"2024-05-20T17:05:10.129491+0000","last_became_active":"2024-05-20T17:05:05.111137+0000","last_became_peered":"2024-05-20T17:05:05.111137+0000","last_unstale":"2024-05-20T17:05:10.129491+0000","last_undegraded":"2024-05-20T17:05:10.129491+0000","last_fullsized":"2024-05-20T17:05:10.129491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:19:44.677701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.567843+0000","last_change":"2024-05-20T17:05:09.133601+0000","last_active":"2024-05-20T17:05:09.567843+0000","last_peered":"2024-05-20T17:05:09.567843+0000","last_clean":"2024-05-20T17:05:09.567843+0000","last_became_active":"2024-05-20T17:05:09.132297+0000","last_became_peered":"2024-05-20T17:05:09.132297+0000","last_unstale":"2024-05-20T17:05:09.567843+0000","last_undegraded":"2024-05-20T17:05:09.567843+0000","last_fullsized":"2024-05-20T17:05:09.567843+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:06.896380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128761+0000","last_change":"2024-05-20T17:05:04.099522+0000","last_active":"2024-05-20T17:05:10.128761+0000","last_peered":"2024-05-20T17:05:10.128761+0000","last_clean":"2024-05-20T17:05:10.128761+0000","last_became_active":"2024-05-20T17:05:04.098933+0000","last_became_peered":"2024-05-20T17:05:04.098933+0000","last_unstale":"2024-05-20T17:05:10.128761+0000","last_undegraded":"2024-05-20T17:05:10.128761+0000","last_fullsized":"2024-05-20T17:05:10.128761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:14.996617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128885+0000","last_change":"2024-05-20T17:05:05.116526+0000","last_active":"2024-05-20T17:05:10.128885+0000","last_peered":"2024-05-20T17:05:10.128885+0000","last_clean":"2024-05-20T17:05:10.128885+0000","last_became_active":"2024-05-20T17:05:05.116108+0000","last_became_peered":"2024-05-20T17:05:05.116108+0000","last_unstale":"2024-05-20T17:05:10.128885+0000","last_undegraded":"2024-05-20T17:05:10.128885+0000","last_fullsized":"2024-05-20T17:05:10.128885+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:20:03.481555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.568022+0000","last_change":"2024-05-20T17:05:09.369912+0000","last_active":"2024-05-20T17:05:09.568022+0000","last_peered":"2024-05-20T17:05:09.568022+0000","last_clean":"2024-05-20T17:05:09.568022+0000","last_became_active":"2024-05-20T17:05:09.369456+0000","last_became_peered":"2024-05-20T17:05:09.369456+0000","last_unstale":"2024-05-20T17:05:09.568022+0000","last_undegraded":"2024-05-20T17:05:09.568022+0000","last_fullsized":"2024-05-20T17:05:09.568022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:09:11.675548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570522+0000","last_change":"2024-05-20T17:05:05.093045+0000","last_active":"2024-05-20T17:05:09.570522+0000","last_peered":"2024-05-20T17:05:09.570522+0000","last_clean":"2024-05-20T17:05:09.570522+0000","last_became_active":"2024-05-20T17:05:05.092477+0000","last_became_peered":"2024-05-20T17:05:05.092477+0000","last_unstale":"2024-05-20T17:05:09.570522+0000","last_undegraded":"2024-05-20T17:05:09.570522+0000","last_fullsized":"2024-05-20T17:05:09.570522+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:08:43.038885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'4","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:32.579910+0000","last_change":"2024-05-20T17:05:04.100893+0000","last_active":"2024-05-20T17:05:32.579910+0000","last_peered":"2024-05-20T17:05:32.579910+0000","last_clean":"2024-05-20T17:05:32.579910+0000","last_became_active":"2024-05-20T17:05:04.100519+0000","last_became_peered":"2024-05-20T17:05:04.100519+0000","last_unstale":"2024-05-20T17:05:32.579910+0000","last_undegraded":"2024-05-20T17:05:32.579910+0000","last_fullsized":"2024-05-20T17:05:32.579910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:10:13.764472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129753+0000","last_change":"2024-05-20T17:05:09.123689+0000","last_active":"2024-05-20T17:05:10.129753+0000","last_peered":"2024-05-20T17:05:10.129753+0000","last_clean":"2024-05-20T17:05:10.129753+0000","last_became_active":"2024-05-20T17:05:09.123124+0000","last_became_peered":"2024-05-20T17:05:09.123124+0000","last_unstale":"2024-05-20T17:05:10.129753+0000","last_undegraded":"2024-05-20T17:05:10.129753+0000","last_fullsized":"2024-05-20T17:05:10.129753+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:22:45.865765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128174+0000","last_change":"2024-05-20T17:05:05.100637+0000","last_active":"2024-05-20T17:05:10.128174+0000","last_peered":"2024-05-20T17:05:10.128174+0000","last_clean":"2024-05-20T17:05:10.128174+0000","last_became_active":"2024-05-20T17:05:05.100264+0000","last_became_peered":"2024-05-20T17:05:05.100264+0000","last_unstale":"2024-05-20T17:05:10.128174+0000","last_undegraded":"2024-05-20T17:05:10.128174+0000","last_fullsized":"2024-05-20T17:05:10.128174+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:52:36.743365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:31.649179+0000","last_change":"2024-05-20T17:05:04.089427+0000","last_active":"2024-05-20T17:05:31.649179+0000","last_peered":"2024-05-20T17:05:31.649179+0000","last_clean":"2024-05-20T17:05:31.649179+0000","last_became_active":"2024-05-20T17:05:04.088880+0000","last_became_peered":"2024-05-20T17:05:04.088880+0000","last_unstale":"2024-05-20T17:05:31.649179+0000","last_undegraded":"2024-05-20T17:05:31.649179+0000","last_fullsized":"2024-05-20T17:05:31.649179+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:16.068072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":344,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128475+0000","last_change":"2024-05-20T17:03:47.606627+0000","last_active":"2024-05-20T17:05:10.128475+0000","last_peered":"2024-05-20T17:05:10.128475+0000","last_clean":"2024-05-20T17:05:10.128475+0000","last_became_active":"2024-05-20T17:03:47.606105+0000","last_became_peered":"2024-05-20T17:03:47.606105+0000","last_unstale":"2024-05-20T17:05:10.128475+0000","last_undegraded":"2024-05-20T17:05:10.128475+0000","last_fullsized":"2024-05-20T17:05:10.128475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:00:12.876377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:00:12.876377+0000","last_clean_scrub_stamp":"2024-05-20T17:00:12.876377+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:26:46.526462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570923+0000","last_change":"2024-05-20T17:05:09.370158+0000","last_active":"2024-05-20T17:05:09.570923+0000","last_peered":"2024-05-20T17:05:09.570923+0000","last_clean":"2024-05-20T17:05:09.570923+0000","last_became_active":"2024-05-20T17:05:09.369481+0000","last_became_peered":"2024-05-20T17:05:09.369481+0000","last_unstale":"2024-05-20T17:05:09.570923+0000","last_undegraded":"2024-05-20T17:05:09.570923+0000","last_fullsized":"2024-05-20T17:05:09.570923+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:57:25.940447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.567329+0000","last_change":"2024-05-20T17:05:05.100689+0000","last_active":"2024-05-20T17:05:09.567329+0000","last_peered":"2024-05-20T17:05:09.567329+0000","last_clean":"2024-05-20T17:05:09.567329+0000","last_became_active":"2024-05-20T17:05:05.100321+0000","last_became_peered":"2024-05-20T17:05:05.100321+0000","last_unstale":"2024-05-20T17:05:09.567329+0000","last_undegraded":"2024-05-20T17:05:09.567329+0000","last_fullsized":"2024-05-20T17:05:09.567329+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:10:07.742067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:32.578039+0000","last_change":"2024-05-20T17:05:04.093532+0000","last_active":"2024-05-20T17:05:32.578039+0000","last_peered":"2024-05-20T17:05:32.578039+0000","last_clean":"2024-05-20T17:05:32.578039+0000","last_became_active":"2024-05-20T17:05:04.093047+0000","last_became_peered":"2024-05-20T17:05:04.093047+0000","last_unstale":"2024-05-20T17:05:32.578039+0000","last_undegraded":"2024-05-20T17:05:32.578039+0000","last_fullsized":"2024-05-20T17:05:32.578039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:39:37.505637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128664+0000","last_change":"2024-05-20T17:05:09.130715+0000","last_active":"2024-05-20T17:05:10.128664+0000","last_peered":"2024-05-20T17:05:10.128664+0000","last_clean":"2024-05-20T17:05:10.128664+0000","last_became_active":"2024-05-20T17:05:09.130237+0000","last_became_peered":"2024-05-20T17:05:09.130237+0000","last_unstale":"2024-05-20T17:05:10.128664+0000","last_undegraded":"2024-05-20T17:05:10.128664+0000","last_fullsized":"2024-05-20T17:05:10.128664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:52:15.160631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:33.585625+0000","last_change":"2024-05-20T17:05:04.103942+0000","last_active":"2024-05-20T17:05:33.585625+0000","last_peered":"2024-05-20T17:05:33.585625+0000","last_clean":"2024-05-20T17:05:33.585625+0000","last_became_active":"2024-05-20T17:05:04.102971+0000","last_became_peered":"2024-05-20T17:05:04.102971+0000","last_unstale":"2024-05-20T17:05:33.585625+0000","last_undegraded":"2024-05-20T17:05:33.585625+0000","last_fullsized":"2024-05-20T17:05:33.585625+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:41:37.719913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.567805+0000","last_change":"2024-05-20T17:05:05.087201+0000","last_active":"2024-05-20T17:05:09.567805+0000","last_peered":"2024-05-20T17:05:09.567805+0000","last_clean":"2024-05-20T17:05:09.567805+0000","last_became_active":"2024-05-20T17:05:05.086809+0000","last_became_peered":"2024-05-20T17:05:05.086809+0000","last_unstale":"2024-05-20T17:05:09.567805+0000","last_undegraded":"2024-05-20T17:05:09.567805+0000","last_fullsized":"2024-05-20T17:05:09.567805+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:31:45.925200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128151+0000","last_change":"2024-05-20T17:05:09.369881+0000","last_active":"2024-05-20T17:05:10.128151+0000","last_peered":"2024-05-20T17:05:10.128151+0000","last_clean":"2024-05-20T17:05:10.128151+0000","last_became_active":"2024-05-20T17:05:09.369391+0000","last_became_peered":"2024-05-20T17:05:09.369391+0000","last_unstale":"2024-05-20T17:05:10.128151+0000","last_undegraded":"2024-05-20T17:05:10.128151+0000","last_fullsized":"2024-05-20T17:05:10.128151+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:00:00.397289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.658778+0000","last_change":"2024-05-20T17:05:04.098857+0000","last_active":"2024-05-20T17:05:09.658778+0000","last_peered":"2024-05-20T17:05:09.658778+0000","last_clean":"2024-05-20T17:05:09.658778+0000","last_became_active":"2024-05-20T17:05:04.098480+0000","last_became_peered":"2024-05-20T17:05:04.098480+0000","last_unstale":"2024-05-20T17:05:09.658778+0000","last_undegraded":"2024-05-20T17:05:09.658778+0000","last_fullsized":"2024-05-20T17:05:09.658778+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:03:57.164706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128806+0000","last_change":"2024-05-20T17:05:05.121077+0000","last_active":"2024-05-20T17:05:10.128806+0000","last_peered":"2024-05-20T17:05:10.128806+0000","last_clean":"2024-05-20T17:05:10.128806+0000","last_became_active":"2024-05-20T17:05:05.120651+0000","last_became_peered":"2024-05-20T17:05:05.120651+0000","last_unstale":"2024-05-20T17:05:10.128806+0000","last_undegraded":"2024-05-20T17:05:10.128806+0000","last_fullsized":"2024-05-20T17:05:10.128806+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:59:30.061898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128531+0000","last_change":"2024-05-20T17:05:09.122839+0000","last_active":"2024-05-20T17:05:10.128531+0000","last_peered":"2024-05-20T17:05:10.128531+0000","last_clean":"2024-05-20T17:05:10.128531+0000","last_became_active":"2024-05-20T17:05:09.122390+0000","last_became_peered":"2024-05-20T17:05:09.122390+0000","last_unstale":"2024-05-20T17:05:10.128531+0000","last_undegraded":"2024-05-20T17:05:10.128531+0000","last_fullsized":"2024-05-20T17:05:10.128531+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:50:27.849698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:31.648273+0000","last_change":"2024-05-20T17:05:04.092416+0000","last_active":"2024-05-20T17:05:31.648273+0000","last_peered":"2024-05-20T17:05:31.648273+0000","last_clean":"2024-05-20T17:05:31.648273+0000","last_became_active":"2024-05-20T17:05:04.091886+0000","last_became_peered":"2024-05-20T17:05:04.091886+0000","last_unstale":"2024-05-20T17:05:31.648273+0000","last_undegraded":"2024-05-20T17:05:31.648273+0000","last_fullsized":"2024-05-20T17:05:31.648273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:00:02.281867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.737206+0000","last_change":"2024-05-20T17:05:05.115650+0000","last_active":"2024-05-20T17:05:09.737206+0000","last_peered":"2024-05-20T17:05:09.737206+0000","last_clean":"2024-05-20T17:05:09.737206+0000","last_became_active":"2024-05-20T17:05:05.115303+0000","last_became_peered":"2024-05-20T17:05:05.115303+0000","last_unstale":"2024-05-20T17:05:09.737206+0000","last_undegraded":"2024-05-20T17:05:09.737206+0000","last_fullsized":"2024-05-20T17:05:09.737206+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:10:02.144645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.627846+0000","last_change":"2024-05-20T17:05:09.371289+0000","last_active":"2024-05-20T17:05:09.627846+0000","last_peered":"2024-05-20T17:05:09.627846+0000","last_clean":"2024-05-20T17:05:09.627846+0000","last_became_active":"2024-05-20T17:05:09.369823+0000","last_became_peered":"2024-05-20T17:05:09.369823+0000","last_unstale":"2024-05-20T17:05:09.627846+0000","last_undegraded":"2024-05-20T17:05:09.627846+0000","last_fullsized":"2024-05-20T17:05:09.627846+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:34:57.738554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:31.647970+0000","last_change":"2024-05-20T17:05:04.104909+0000","last_active":"2024-05-20T17:05:31.647970+0000","last_peered":"2024-05-20T17:05:31.647970+0000","last_clean":"2024-05-20T17:05:31.647970+0000","last_became_active":"2024-05-20T17:05:04.104457+0000","last_became_peered":"2024-05-20T17:05:04.104457+0000","last_unstale":"2024-05-20T17:05:31.647970+0000","last_undegraded":"2024-05-20T17:05:31.647970+0000","last_fullsized":"2024-05-20T17:05:31.647970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:53:41.790963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128152+0000","last_change":"2024-05-20T17:05:05.103188+0000","last_active":"2024-05-20T17:05:10.128152+0000","last_peered":"2024-05-20T17:05:10.128152+0000","last_clean":"2024-05-20T17:05:10.128152+0000","last_became_active":"2024-05-20T17:05:05.102780+0000","last_became_peered":"2024-05-20T17:05:05.102780+0000","last_unstale":"2024-05-20T17:05:10.128152+0000","last_undegraded":"2024-05-20T17:05:10.128152+0000","last_fullsized":"2024-05-20T17:05:10.128152+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:32.907211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.658930+0000","last_change":"2024-05-20T17:05:09.126155+0000","last_active":"2024-05-20T17:05:09.658930+0000","last_peered":"2024-05-20T17:05:09.658930+0000","last_clean":"2024-05-20T17:05:09.658930+0000","last_became_active":"2024-05-20T17:05:09.125464+0000","last_became_peered":"2024-05-20T17:05:09.125464+0000","last_unstale":"2024-05-20T17:05:09.658930+0000","last_undegraded":"2024-05-20T17:05:09.658930+0000","last_fullsized":"2024-05-20T17:05:09.658930+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:28:52.747574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:34.590832+0000","last_change":"2024-05-20T17:05:04.088923+0000","last_active":"2024-05-20T17:05:34.590832+0000","last_peered":"2024-05-20T17:05:34.590832+0000","last_clean":"2024-05-20T17:05:34.590832+0000","last_became_active":"2024-05-20T17:05:04.088335+0000","last_became_peered":"2024-05-20T17:05:04.088335+0000","last_unstale":"2024-05-20T17:05:34.590832+0000","last_undegraded":"2024-05-20T17:05:34.590832+0000","last_fullsized":"2024-05-20T17:05:34.590832+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:43:18.288139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129468+0000","last_change":"2024-05-20T17:05:05.110964+0000","last_active":"2024-05-20T17:05:10.129468+0000","last_peered":"2024-05-20T17:05:10.129468+0000","last_clean":"2024-05-20T17:05:10.129468+0000","last_became_active":"2024-05-20T17:05:05.110593+0000","last_became_peered":"2024-05-20T17:05:05.110593+0000","last_unstale":"2024-05-20T17:05:10.129468+0000","last_undegraded":"2024-05-20T17:05:10.129468+0000","last_fullsized":"2024-05-20T17:05:10.129468+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:27.921812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.627924+0000","last_change":"2024-05-20T17:05:09.139541+0000","last_active":"2024-05-20T17:05:09.627924+0000","last_peered":"2024-05-20T17:05:09.627924+0000","last_clean":"2024-05-20T17:05:09.627924+0000","last_became_active":"2024-05-20T17:05:09.139008+0000","last_became_peered":"2024-05-20T17:05:09.139008+0000","last_unstale":"2024-05-20T17:05:09.627924+0000","last_undegraded":"2024-05-20T17:05:09.627924+0000","last_fullsized":"2024-05-20T17:05:09.627924+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:50.125661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'3","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:33.584830+0000","last_change":"2024-05-20T17:05:04.095527+0000","last_active":"2024-05-20T17:05:33.584830+0000","last_peered":"2024-05-20T17:05:33.584830+0000","last_clean":"2024-05-20T17:05:33.584830+0000","last_became_active":"2024-05-20T17:05:04.095096+0000","last_became_peered":"2024-05-20T17:05:04.095096+0000","last_unstale":"2024-05-20T17:05:33.584830+0000","last_undegraded":"2024-05-20T17:05:33.584830+0000","last_fullsized":"2024-05-20T17:05:33.584830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:44:21.559200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128457+0000","last_change":"2024-05-20T17:05:05.113644+0000","last_active":"2024-05-20T17:05:10.128457+0000","last_peered":"2024-05-20T17:05:10.128457+0000","last_clean":"2024-05-20T17:05:10.128457+0000","last_became_active":"2024-05-20T17:05:05.113186+0000","last_became_peered":"2024-05-20T17:05:05.113186+0000","last_unstale":"2024-05-20T17:05:10.128457+0000","last_undegraded":"2024-05-20T17:05:10.128457+0000","last_fullsized":"2024-05-20T17:05:10.128457+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:54.243939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.627942+0000","last_change":"2024-05-20T17:05:09.370048+0000","last_active":"2024-05-20T17:05:09.627942+0000","last_peered":"2024-05-20T17:05:09.627942+0000","last_clean":"2024-05-20T17:05:09.627942+0000","last_became_active":"2024-05-20T17:05:09.369529+0000","last_became_peered":"2024-05-20T17:05:09.369529+0000","last_unstale":"2024-05-20T17:05:09.627942+0000","last_undegraded":"2024-05-20T17:05:09.627942+0000","last_fullsized":"2024-05-20T17:05:09.627942+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:49:09.332673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:31.649112+0000","last_change":"2024-05-20T17:05:04.102795+0000","last_active":"2024-05-20T17:05:31.649112+0000","last_peered":"2024-05-20T17:05:31.649112+0000","last_clean":"2024-05-20T17:05:31.649112+0000","last_became_active":"2024-05-20T17:05:04.102204+0000","last_became_peered":"2024-05-20T17:05:04.102204+0000","last_unstale":"2024-05-20T17:05:31.649112+0000","last_undegraded":"2024-05-20T17:05:31.649112+0000","last_fullsized":"2024-05-20T17:05:31.649112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:38:10.634153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129041+0000","last_change":"2024-05-20T17:05:05.115003+0000","last_active":"2024-05-20T17:05:10.129041+0000","last_peered":"2024-05-20T17:05:10.129041+0000","last_clean":"2024-05-20T17:05:10.129041+0000","last_became_active":"2024-05-20T17:05:05.114596+0000","last_became_peered":"2024-05-20T17:05:05.114596+0000","last_unstale":"2024-05-20T17:05:10.129041+0000","last_undegraded":"2024-05-20T17:05:10.129041+0000","last_fullsized":"2024-05-20T17:05:10.129041+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:47:39.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.569570+0000","last_change":"2024-05-20T17:05:09.131310+0000","last_active":"2024-05-20T17:05:09.569570+0000","last_peered":"2024-05-20T17:05:09.569570+0000","last_clean":"2024-05-20T17:05:09.569570+0000","last_became_active":"2024-05-20T17:05:09.130643+0000","last_became_peered":"2024-05-20T17:05:09.130643+0000","last_unstale":"2024-05-20T17:05:09.569570+0000","last_undegraded":"2024-05-20T17:05:09.569570+0000","last_fullsized":"2024-05-20T17:05:09.569570+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:58:21.996929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'5","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:35.597341+0000","last_change":"2024-05-20T17:05:04.100547+0000","last_active":"2024-05-20T17:05:35.597341+0000","last_peered":"2024-05-20T17:05:35.597341+0000","last_clean":"2024-05-20T17:05:35.597341+0000","last_became_active":"2024-05-20T17:05:04.100167+0000","last_became_peered":"2024-05-20T17:05:04.100167+0000","last_unstale":"2024-05-20T17:05:35.597341+0000","last_undegraded":"2024-05-20T17:05:35.597341+0000","last_fullsized":"2024-05-20T17:05:35.597341+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:44.182489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129858+0000","last_change":"2024-05-20T17:05:05.118459+0000","last_active":"2024-05-20T17:05:10.129858+0000","last_peered":"2024-05-20T17:05:10.129858+0000","last_clean":"2024-05-20T17:05:10.129858+0000","last_became_active":"2024-05-20T17:05:05.115445+0000","last_became_peered":"2024-05-20T17:05:05.115445+0000","last_unstale":"2024-05-20T17:05:10.129858+0000","last_undegraded":"2024-05-20T17:05:10.129858+0000","last_fullsized":"2024-05-20T17:05:10.129858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:06:36.042952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.736969+0000","last_change":"2024-05-20T17:05:09.136508+0000","last_active":"2024-05-20T17:05:09.736969+0000","last_peered":"2024-05-20T17:05:09.736969+0000","last_clean":"2024-05-20T17:05:09.736969+0000","last_became_active":"2024-05-20T17:05:09.135825+0000","last_became_peered":"2024-05-20T17:05:09.135825+0000","last_unstale":"2024-05-20T17:05:09.736969+0000","last_undegraded":"2024-05-20T17:05:09.736969+0000","last_fullsized":"2024-05-20T17:05:09.736969+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:00:48.585071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570706+0000","last_change":"2024-05-20T17:05:04.096484+0000","last_active":"2024-05-20T17:05:09.570706+0000","last_peered":"2024-05-20T17:05:09.570706+0000","last_clean":"2024-05-20T17:05:09.570706+0000","last_became_active":"2024-05-20T17:05:04.096053+0000","last_became_peered":"2024-05-20T17:05:04.096053+0000","last_unstale":"2024-05-20T17:05:09.570706+0000","last_undegraded":"2024-05-20T17:05:09.570706+0000","last_fullsized":"2024-05-20T17:05:09.570706+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:35:19.373932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129554+0000","last_change":"2024-05-20T17:05:05.118667+0000","last_active":"2024-05-20T17:05:10.129554+0000","last_peered":"2024-05-20T17:05:10.129554+0000","last_clean":"2024-05-20T17:05:10.129554+0000","last_became_active":"2024-05-20T17:05:05.118173+0000","last_became_peered":"2024-05-20T17:05:05.118173+0000","last_unstale":"2024-05-20T17:05:10.129554+0000","last_undegraded":"2024-05-20T17:05:10.129554+0000","last_fullsized":"2024-05-20T17:05:10.129554+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:14.658446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570041+0000","last_change":"2024-05-20T17:05:09.127806+0000","last_active":"2024-05-20T17:05:09.570041+0000","last_peered":"2024-05-20T17:05:09.570041+0000","last_clean":"2024-05-20T17:05:09.570041+0000","last_became_active":"2024-05-20T17:05:09.126739+0000","last_became_peered":"2024-05-20T17:05:09.126739+0000","last_unstale":"2024-05-20T17:05:09.570041+0000","last_undegraded":"2024-05-20T17:05:09.570041+0000","last_fullsized":"2024-05-20T17:05:09.570041+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:41:58.391763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.567924+0000","last_change":"2024-05-20T17:05:04.096955+0000","last_active":"2024-05-20T17:05:09.567924+0000","last_peered":"2024-05-20T17:05:09.567924+0000","last_clean":"2024-05-20T17:05:09.567924+0000","last_became_active":"2024-05-20T17:05:04.096467+0000","last_became_peered":"2024-05-20T17:05:04.096467+0000","last_unstale":"2024-05-20T17:05:09.567924+0000","last_undegraded":"2024-05-20T17:05:09.567924+0000","last_fullsized":"2024-05-20T17:05:09.567924+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:32:06.511617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129550+0000","last_change":"2024-05-20T17:05:05.106615+0000","last_active":"2024-05-20T17:05:10.129550+0000","last_peered":"2024-05-20T17:05:10.129550+0000","last_clean":"2024-05-20T17:05:10.129550+0000","last_became_active":"2024-05-20T17:05:05.106216+0000","last_became_peered":"2024-05-20T17:05:05.106216+0000","last_unstale":"2024-05-20T17:05:10.129550+0000","last_undegraded":"2024-05-20T17:05:10.129550+0000","last_fullsized":"2024-05-20T17:05:10.129550+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:32:10.920803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129580+0000","last_change":"2024-05-20T17:05:05.098027+0000","last_active":"2024-05-20T17:05:10.129580+0000","last_peered":"2024-05-20T17:05:10.129580+0000","last_clean":"2024-05-20T17:05:10.129580+0000","last_became_active":"2024-05-20T17:05:05.097639+0000","last_became_peered":"2024-05-20T17:05:05.097639+0000","last_unstale":"2024-05-20T17:05:10.129580+0000","last_undegraded":"2024-05-20T17:05:10.129580+0000","last_fullsized":"2024-05-20T17:05:10.129580+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:13:06.432459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129134+0000","last_change":"2024-05-20T17:05:05.101197+0000","last_active":"2024-05-20T17:05:10.129134+0000","last_peered":"2024-05-20T17:05:10.129134+0000","last_clean":"2024-05-20T17:05:10.129134+0000","last_became_active":"2024-05-20T17:05:05.100865+0000","last_became_peered":"2024-05-20T17:05:05.100865+0000","last_unstale":"2024-05-20T17:05:10.129134+0000","last_undegraded":"2024-05-20T17:05:10.129134+0000","last_fullsized":"2024-05-20T17:05:10.129134+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:57:28.892291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128276+0000","last_change":"2024-05-20T17:05:05.109529+0000","last_active":"2024-05-20T17:05:10.128276+0000","last_peered":"2024-05-20T17:05:10.128276+0000","last_clean":"2024-05-20T17:05:10.128276+0000","last_became_active":"2024-05-20T17:05:05.108332+0000","last_became_peered":"2024-05-20T17:05:05.108332+0000","last_unstale":"2024-05-20T17:05:10.128276+0000","last_undegraded":"2024-05-20T17:05:10.128276+0000","last_fullsized":"2024-05-20T17:05:10.128276+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:07.612296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.737054+0000","last_change":"2024-05-20T17:05:05.115602+0000","last_active":"2024-05-20T17:05:09.737054+0000","last_peered":"2024-05-20T17:05:09.737054+0000","last_clean":"2024-05-20T17:05:09.737054+0000","last_became_active":"2024-05-20T17:05:05.115250+0000","last_became_peered":"2024-05-20T17:05:05.115250+0000","last_unstale":"2024-05-20T17:05:09.737054+0000","last_undegraded":"2024-05-20T17:05:09.737054+0000","last_fullsized":"2024-05-20T17:05:09.737054+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:10:50.691956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.567908+0000","last_change":"2024-05-20T17:05:05.110528+0000","last_active":"2024-05-20T17:05:09.567908+0000","last_peered":"2024-05-20T17:05:09.567908+0000","last_clean":"2024-05-20T17:05:09.567908+0000","last_became_active":"2024-05-20T17:05:05.110158+0000","last_became_peered":"2024-05-20T17:05:05.110158+0000","last_unstale":"2024-05-20T17:05:09.567908+0000","last_undegraded":"2024-05-20T17:05:09.567908+0000","last_fullsized":"2024-05-20T17:05:09.567908+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:58:15.143026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129355+0000","last_change":"2024-05-20T17:05:05.094890+0000","last_active":"2024-05-20T17:05:10.129355+0000","last_peered":"2024-05-20T17:05:10.129355+0000","last_clean":"2024-05-20T17:05:10.129355+0000","last_became_active":"2024-05-20T17:05:05.094452+0000","last_became_peered":"2024-05-20T17:05:05.094452+0000","last_unstale":"2024-05-20T17:05:10.129355+0000","last_undegraded":"2024-05-20T17:05:10.129355+0000","last_fullsized":"2024-05-20T17:05:10.129355+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:34:00.182526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129465+0000","last_change":"2024-05-20T17:05:05.088916+0000","last_active":"2024-05-20T17:05:10.129465+0000","last_peered":"2024-05-20T17:05:10.129465+0000","last_clean":"2024-05-20T17:05:10.129465+0000","last_became_active":"2024-05-20T17:05:05.088257+0000","last_became_peered":"2024-05-20T17:05:05.088257+0000","last_unstale":"2024-05-20T17:05:10.129465+0000","last_undegraded":"2024-05-20T17:05:10.129465+0000","last_fullsized":"2024-05-20T17:05:10.129465+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:43:51.310579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128938+0000","last_change":"2024-05-20T17:05:05.110019+0000","last_active":"2024-05-20T17:05:10.128938+0000","last_peered":"2024-05-20T17:05:10.128938+0000","last_clean":"2024-05-20T17:05:10.128938+0000","last_became_active":"2024-05-20T17:05:05.109567+0000","last_became_peered":"2024-05-20T17:05:05.109567+0000","last_unstale":"2024-05-20T17:05:10.128938+0000","last_undegraded":"2024-05-20T17:05:10.128938+0000","last_fullsized":"2024-05-20T17:05:10.128938+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:21:21.712166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570362+0000","last_change":"2024-05-20T17:05:05.105421+0000","last_active":"2024-05-20T17:05:09.570362+0000","last_peered":"2024-05-20T17:05:09.570362+0000","last_clean":"2024-05-20T17:05:09.570362+0000","last_became_active":"2024-05-20T17:05:05.105086+0000","last_became_peered":"2024-05-20T17:05:05.105086+0000","last_unstale":"2024-05-20T17:05:09.570362+0000","last_undegraded":"2024-05-20T17:05:09.570362+0000","last_fullsized":"2024-05-20T17:05:09.570362+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:56:07.257884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128585+0000","last_change":"2024-05-20T17:05:05.108394+0000","last_active":"2024-05-20T17:05:10.128585+0000","last_peered":"2024-05-20T17:05:10.128585+0000","last_clean":"2024-05-20T17:05:10.128585+0000","last_became_active":"2024-05-20T17:05:05.108003+0000","last_became_peered":"2024-05-20T17:05:05.108003+0000","last_unstale":"2024-05-20T17:05:10.128585+0000","last_undegraded":"2024-05-20T17:05:10.128585+0000","last_fullsized":"2024-05-20T17:05:10.128585+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:38.476660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.569616+0000","last_change":"2024-05-20T17:05:05.116825+0000","last_active":"2024-05-20T17:05:09.569616+0000","last_peered":"2024-05-20T17:05:09.569616+0000","last_clean":"2024-05-20T17:05:09.569616+0000","last_became_active":"2024-05-20T17:05:05.116366+0000","last_became_peered":"2024-05-20T17:05:05.116366+0000","last_unstale":"2024-05-20T17:05:09.569616+0000","last_undegraded":"2024-05-20T17:05:09.569616+0000","last_fullsized":"2024-05-20T17:05:09.569616+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:23:19.711036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.567653+0000","last_change":"2024-05-20T17:05:05.106896+0000","last_active":"2024-05-20T17:05:09.567653+0000","last_peered":"2024-05-20T17:05:09.567653+0000","last_clean":"2024-05-20T17:05:09.567653+0000","last_became_active":"2024-05-20T17:05:05.106514+0000","last_became_peered":"2024-05-20T17:05:05.106514+0000","last_unstale":"2024-05-20T17:05:09.567653+0000","last_undegraded":"2024-05-20T17:05:09.567653+0000","last_fullsized":"2024-05-20T17:05:09.567653+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:08:22.235321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128582+0000","last_change":"2024-05-20T17:05:05.110071+0000","last_active":"2024-05-20T17:05:10.128582+0000","last_peered":"2024-05-20T17:05:10.128582+0000","last_clean":"2024-05-20T17:05:10.128582+0000","last_became_active":"2024-05-20T17:05:05.109703+0000","last_became_peered":"2024-05-20T17:05:05.109703+0000","last_unstale":"2024-05-20T17:05:10.128582+0000","last_undegraded":"2024-05-20T17:05:10.128582+0000","last_fullsized":"2024-05-20T17:05:10.128582+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:41:46.858191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7010,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":149,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":59170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350995,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":991232,"data_stored":480266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612632,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1630208,"data_stored":1076054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776157,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":481050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037796,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1024000,"data_stored":481766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299432,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28580,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716572,"statfs":{"total":95995035648,"available":95965769728,"internally_reserved":0,"allocated":1601536,"data_stored":1072426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462957,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":480356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":1003520,"data_stored":484108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738445,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":1003520,"data_stored":480960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411394,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":505770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149758,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":480674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888120,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":995328,"data_stored":480288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724595,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32740,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712412,"statfs":{"total":95995035648,"available":95961509888,"internally_reserved":0,"allocated":1597440,"data_stored":1070816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":42834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":5544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:05:37.163 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:05:37.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.309+0000 7f216168d640 1 -- 172.21.15.6:0/3845740080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f215c100e20 msgr2=0x7f215c105ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:37.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.309+0000 7f216168d640 1 --2- 172.21.15.6:0/3845740080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f215c100e20 0x7f215c105ae0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f214c009900 tx=0x7f214c02a410 comp rx=0 tx=0).stop 2024-05-20T17:05:37.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.309+0000 7f216168d640 1 -- 172.21.15.6:0/3845740080 shutdown_connections 2024-05-20T17:05:37.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.309+0000 7f216168d640 1 --2- 172.21.15.6:0/3845740080 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f215c108740 0x7f215c10ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:37.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.309+0000 7f216168d640 1 --2- 172.21.15.6:0/3845740080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f215c101320 0x7f215c1080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:37.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.309+0000 7f216168d640 1 --2- 172.21.15.6:0/3845740080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f215c100e20 0x7f215c105ae0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:37.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.309+0000 7f216168d640 1 -- 172.21.15.6:0/3845740080 >> 172.21.15.6:0/3845740080 conn(0x7f215c0fc330 msgr2=0x7f215c0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:37.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.309+0000 7f216168d640 1 -- 172.21.15.6:0/3845740080 shutdown_connections 2024-05-20T17:05:37.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.309+0000 7f216168d640 1 -- 172.21.15.6:0/3845740080 wait complete. 2024-05-20T17:05:37.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.310+0000 7f216168d640 1 Processor -- start 2024-05-20T17:05:37.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.310+0000 7f216168d640 1 -- start start 2024-05-20T17:05:37.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.310+0000 7f216168d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f215c100e20 0x7f215c1990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:37.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.310+0000 7f216168d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f215c101320 0x7f215c199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:37.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.310+0000 7f216168d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f215c108740 0x7f215c1a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:37.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.310+0000 7f216168d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f215c10e5d0 con 0x7f215c100e20 2024-05-20T17:05:37.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.310+0000 7f216168d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f215c10e450 con 0x7f215c108740 2024-05-20T17:05:37.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.310+0000 7f216168d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f215c10e750 con 0x7f215c101320 2024-05-20T17:05:37.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.310+0000 7f215affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f215c100e20 0x7f215c1990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:37.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.310+0000 7f215affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f215c100e20 0x7f215c1990c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60306/0 (socket says 172.21.15.6:60306) 2024-05-20T17:05:37.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.310+0000 7f215affd640 1 -- 172.21.15.6:0/1917000739 learned_addr learned my addr 172.21.15.6:0/1917000739 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:37.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.311+0000 7f215b7fe640 1 --2- 172.21.15.6:0/1917000739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f215c108740 0x7f215c1a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:37.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.311+0000 7f215a7fc640 1 --2- 172.21.15.6:0/1917000739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f215c101320 0x7f215c199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:37.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.311+0000 7f215affd640 1 -- 172.21.15.6:0/1917000739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f215c101320 msgr2=0x7f215c199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:37.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.311+0000 7f215affd640 1 --2- 172.21.15.6:0/1917000739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f215c101320 0x7f215c199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:37.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.311+0000 7f215affd640 1 -- 172.21.15.6:0/1917000739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f215c108740 msgr2=0x7f215c1a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:37.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.311+0000 7f215affd640 1 --2- 172.21.15.6:0/1917000739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f215c108740 0x7f215c1a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:37.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.311+0000 7f215affd640 1 -- 172.21.15.6:0/1917000739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c1a0c00 con 0x7f215c100e20 2024-05-20T17:05:37.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.311+0000 7f215affd640 1 --2- 172.21.15.6:0/1917000739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f215c100e20 0x7f215c1990c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f214c0314e0 tx=0x7f214c003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:37.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.311+0000 7f2143fff640 1 -- 172.21.15.6:0/1917000739 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c03f070 con 0x7f215c100e20 2024-05-20T17:05:37.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.311+0000 7f2143fff640 1 -- 172.21.15.6:0/1917000739 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f214c031e40 con 0x7f215c100e20 2024-05-20T17:05:37.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.311+0000 7f216168d640 1 -- 172.21.15.6:0/1917000739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215c1a0e90 con 0x7f215c100e20 2024-05-20T17:05:37.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.311+0000 7f2143fff640 1 -- 172.21.15.6:0/1917000739 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c035030 con 0x7f215c100e20 2024-05-20T17:05:37.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.311+0000 7f216168d640 1 -- 172.21.15.6:0/1917000739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215c1a12f0 con 0x7f215c100e20 2024-05-20T17:05:37.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.312+0000 7f216168d640 1 -- 172.21.15.6:0/1917000739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f215c0fde50 con 0x7f215c100e20 2024-05-20T17:05:37.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.314+0000 7f2143fff640 1 -- 172.21.15.6:0/1917000739 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f214c042070 con 0x7f215c100e20 2024-05-20T17:05:37.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.315+0000 7f2143fff640 1 --2- 172.21.15.6:0/1917000739 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f21440a2d50 0x7f21440a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:37.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.315+0000 7f215a7fc640 1 --2- 172.21.15.6:0/1917000739 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f21440a2d50 0x7f21440a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:37.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.315+0000 7f2143fff640 1 -- 172.21.15.6:0/1917000739 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f214c03be00 con 0x7f215c100e20 2024-05-20T17:05:37.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.316+0000 7f215a7fc640 1 --2- 172.21.15.6:0/1917000739 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f21440a2d50 0x7f21440a5260 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f21500058c0 tx=0x7f215000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:37.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.319+0000 7f2143fff640 1 -- 172.21.15.6:0/1917000739 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f214c0bc820 con 0x7f215c100e20 2024-05-20T17:05:37.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.499+0000 7f216168d640 1 -- 172.21.15.6:0/1917000739 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f215c061f90 con 0x7f21440a2d50 2024-05-20T17:05:37.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.509+0000 7f2143fff640 1 -- 172.21.15.6:0/1917000739 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340307 (secure 0 0 0) 0x7f215c061f90 con 0x7f21440a2d50 2024-05-20T17:05:37.512 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:05:37.513 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:05:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.512+0000 7f216168d640 1 -- 172.21.15.6:0/1917000739 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f21440a2d50 msgr2=0x7f21440a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.512+0000 7f216168d640 1 --2- 172.21.15.6:0/1917000739 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f21440a2d50 0x7f21440a5260 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f21500058c0 tx=0x7f215000a2d0 comp rx=0 tx=0).stop 2024-05-20T17:05:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.512+0000 7f216168d640 1 -- 172.21.15.6:0/1917000739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f215c100e20 msgr2=0x7f215c1990c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.512+0000 7f216168d640 1 --2- 172.21.15.6:0/1917000739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f215c100e20 0x7f215c1990c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f214c0314e0 tx=0x7f214c003d50 comp rx=0 tx=0).stop 2024-05-20T17:05:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.512+0000 7f216168d640 1 -- 172.21.15.6:0/1917000739 shutdown_connections 2024-05-20T17:05:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.512+0000 7f216168d640 1 --2- 172.21.15.6:0/1917000739 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f21440a2d50 0x7f21440a5260 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.512+0000 7f216168d640 1 --2- 172.21.15.6:0/1917000739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f215c108740 0x7f215c1a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:37.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.512+0000 7f216168d640 1 --2- 172.21.15.6:0/1917000739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f215c101320 0x7f215c199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:37.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.512+0000 7f216168d640 1 --2- 172.21.15.6:0/1917000739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f215c100e20 0x7f215c1990c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:37.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.512+0000 7f216168d640 1 -- 172.21.15.6:0/1917000739 >> 172.21.15.6:0/1917000739 conn(0x7f215c0fc330 msgr2=0x7f215c104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:37.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.512+0000 7f216168d640 1 -- 172.21.15.6:0/1917000739 shutdown_connections 2024-05-20T17:05:37.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:37.512+0000 7f216168d640 1 -- 172.21.15.6:0/1917000739 wait complete. 2024-05-20T17:05:37.523 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-05-20T17:05:36.089624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597378,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":147,"num_read_kb":130,"num_write":330,"num_write_kb":2981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":262,"ondisk_log_size":262,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375252,"kb_used_data":13596,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566572,"statfs":{"total":1151940427776,"available":1151556169728,"internally_reserved":0,"allocated":13922304,"data_stored":7574534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2370,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":100,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004065"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.130216+0000","last_change":"2024-05-20T17:05:05.110008+0000","last_active":"2024-05-20T17:05:10.130216+0000","last_peered":"2024-05-20T17:05:10.130216+0000","last_clean":"2024-05-20T17:05:10.130216+0000","last_became_active":"2024-05-20T17:05:05.109556+0000","last_became_peered":"2024-05-20T17:05:05.109556+0000","last_unstale":"2024-05-20T17:05:10.130216+0000","last_undegraded":"2024-05-20T17:05:10.130216+0000","last_fullsized":"2024-05-20T17:05:10.130216+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:05:55.733938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.737336+0000","last_change":"2024-05-20T17:05:05.106305+0000","last_active":"2024-05-20T17:05:09.737336+0000","last_peered":"2024-05-20T17:05:09.737336+0000","last_clean":"2024-05-20T17:05:09.737336+0000","last_became_active":"2024-05-20T17:05:05.105520+0000","last_became_peered":"2024-05-20T17:05:05.105520+0000","last_unstale":"2024-05-20T17:05:09.737336+0000","last_undegraded":"2024-05-20T17:05:09.737336+0000","last_fullsized":"2024-05-20T17:05:09.737336+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:28:55.385934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.737067+0000","last_change":"2024-05-20T17:05:05.103165+0000","last_active":"2024-05-20T17:05:09.737067+0000","last_peered":"2024-05-20T17:05:09.737067+0000","last_clean":"2024-05-20T17:05:09.737067+0000","last_became_active":"2024-05-20T17:05:05.102808+0000","last_became_peered":"2024-05-20T17:05:05.102808+0000","last_unstale":"2024-05-20T17:05:09.737067+0000","last_undegraded":"2024-05-20T17:05:09.737067+0000","last_fullsized":"2024-05-20T17:05:09.737067+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:47:14.217973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.628057+0000","last_change":"2024-05-20T17:05:05.108954+0000","last_active":"2024-05-20T17:05:09.628057+0000","last_peered":"2024-05-20T17:05:09.628057+0000","last_clean":"2024-05-20T17:05:09.628057+0000","last_became_active":"2024-05-20T17:05:05.108563+0000","last_became_peered":"2024-05-20T17:05:05.108563+0000","last_unstale":"2024-05-20T17:05:09.628057+0000","last_undegraded":"2024-05-20T17:05:09.628057+0000","last_fullsized":"2024-05-20T17:05:09.628057+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:07:22.929896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128617+0000","last_change":"2024-05-20T17:05:05.103357+0000","last_active":"2024-05-20T17:05:10.128617+0000","last_peered":"2024-05-20T17:05:10.128617+0000","last_clean":"2024-05-20T17:05:10.128617+0000","last_became_active":"2024-05-20T17:05:05.102990+0000","last_became_peered":"2024-05-20T17:05:05.102990+0000","last_unstale":"2024-05-20T17:05:10.128617+0000","last_undegraded":"2024-05-20T17:05:10.128617+0000","last_fullsized":"2024-05-20T17:05:10.128617+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:01.800910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129327+0000","last_change":"2024-05-20T17:05:05.114822+0000","last_active":"2024-05-20T17:05:10.129327+0000","last_peered":"2024-05-20T17:05:10.129327+0000","last_clean":"2024-05-20T17:05:10.129327+0000","last_became_active":"2024-05-20T17:05:05.114402+0000","last_became_peered":"2024-05-20T17:05:05.114402+0000","last_unstale":"2024-05-20T17:05:10.129327+0000","last_undegraded":"2024-05-20T17:05:10.129327+0000","last_fullsized":"2024-05-20T17:05:10.129327+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:03:19.530670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128760+0000","last_change":"2024-05-20T17:05:05.111478+0000","last_active":"2024-05-20T17:05:10.128760+0000","last_peered":"2024-05-20T17:05:10.128760+0000","last_clean":"2024-05-20T17:05:10.128760+0000","last_became_active":"2024-05-20T17:05:05.111054+0000","last_became_peered":"2024-05-20T17:05:05.111054+0000","last_unstale":"2024-05-20T17:05:10.128760+0000","last_undegraded":"2024-05-20T17:05:10.128760+0000","last_fullsized":"2024-05-20T17:05:10.128760+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:09:52.783885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128241+0000","last_change":"2024-05-20T17:05:05.109706+0000","last_active":"2024-05-20T17:05:10.128241+0000","last_peered":"2024-05-20T17:05:10.128241+0000","last_clean":"2024-05-20T17:05:10.128241+0000","last_became_active":"2024-05-20T17:05:05.109258+0000","last_became_peered":"2024-05-20T17:05:05.109258+0000","last_unstale":"2024-05-20T17:05:10.128241+0000","last_undegraded":"2024-05-20T17:05:10.128241+0000","last_fullsized":"2024-05-20T17:05:10.128241+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:11:48.568541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570062+0000","last_change":"2024-05-20T17:05:05.097099+0000","last_active":"2024-05-20T17:05:09.570062+0000","last_peered":"2024-05-20T17:05:09.570062+0000","last_clean":"2024-05-20T17:05:09.570062+0000","last_became_active":"2024-05-20T17:05:05.096514+0000","last_became_peered":"2024-05-20T17:05:05.096514+0000","last_unstale":"2024-05-20T17:05:09.570062+0000","last_undegraded":"2024-05-20T17:05:09.570062+0000","last_fullsized":"2024-05-20T17:05:09.570062+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:30:30.472956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129005+0000","last_change":"2024-05-20T17:05:05.114535+0000","last_active":"2024-05-20T17:05:10.129005+0000","last_peered":"2024-05-20T17:05:10.129005+0000","last_clean":"2024-05-20T17:05:10.129005+0000","last_became_active":"2024-05-20T17:05:05.114126+0000","last_became_peered":"2024-05-20T17:05:05.114126+0000","last_unstale":"2024-05-20T17:05:10.129005+0000","last_undegraded":"2024-05-20T17:05:10.129005+0000","last_fullsized":"2024-05-20T17:05:10.129005+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:36:05.541565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129850+0000","last_change":"2024-05-20T17:05:05.115584+0000","last_active":"2024-05-20T17:05:10.129850+0000","last_peered":"2024-05-20T17:05:10.129850+0000","last_clean":"2024-05-20T17:05:10.129850+0000","last_became_active":"2024-05-20T17:05:05.115178+0000","last_became_peered":"2024-05-20T17:05:05.115178+0000","last_unstale":"2024-05-20T17:05:10.129850+0000","last_undegraded":"2024-05-20T17:05:10.129850+0000","last_fullsized":"2024-05-20T17:05:10.129850+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:11:36.593125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.628016+0000","last_change":"2024-05-20T17:05:05.112302+0000","last_active":"2024-05-20T17:05:09.628016+0000","last_peered":"2024-05-20T17:05:09.628016+0000","last_clean":"2024-05-20T17:05:09.628016+0000","last_became_active":"2024-05-20T17:05:05.109423+0000","last_became_peered":"2024-05-20T17:05:05.109423+0000","last_unstale":"2024-05-20T17:05:09.628016+0000","last_undegraded":"2024-05-20T17:05:09.628016+0000","last_fullsized":"2024-05-20T17:05:09.628016+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:43.149894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.567596+0000","last_change":"2024-05-20T17:05:05.094024+0000","last_active":"2024-05-20T17:05:09.567596+0000","last_peered":"2024-05-20T17:05:09.567596+0000","last_clean":"2024-05-20T17:05:09.567596+0000","last_became_active":"2024-05-20T17:05:05.093681+0000","last_became_peered":"2024-05-20T17:05:05.093681+0000","last_unstale":"2024-05-20T17:05:09.567596+0000","last_undegraded":"2024-05-20T17:05:09.567596+0000","last_fullsized":"2024-05-20T17:05:09.567596+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:05:57.768796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.736870+0000","last_change":"2024-05-20T17:05:05.109210+0000","last_active":"2024-05-20T17:05:09.736870+0000","last_peered":"2024-05-20T17:05:09.736870+0000","last_clean":"2024-05-20T17:05:09.736870+0000","last_became_active":"2024-05-20T17:05:05.108819+0000","last_became_peered":"2024-05-20T17:05:05.108819+0000","last_unstale":"2024-05-20T17:05:09.736870+0000","last_undegraded":"2024-05-20T17:05:09.736870+0000","last_fullsized":"2024-05-20T17:05:09.736870+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:47:10.954313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.736858+0000","last_change":"2024-05-20T17:05:05.107455+0000","last_active":"2024-05-20T17:05:09.736858+0000","last_peered":"2024-05-20T17:05:09.736858+0000","last_clean":"2024-05-20T17:05:09.736858+0000","last_became_active":"2024-05-20T17:05:05.107010+0000","last_became_peered":"2024-05-20T17:05:05.107010+0000","last_unstale":"2024-05-20T17:05:09.736858+0000","last_undegraded":"2024-05-20T17:05:09.736858+0000","last_fullsized":"2024-05-20T17:05:09.736858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:31:21.445393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.569157+0000","last_change":"2024-05-20T17:05:05.116417+0000","last_active":"2024-05-20T17:05:09.569157+0000","last_peered":"2024-05-20T17:05:09.569157+0000","last_clean":"2024-05-20T17:05:09.569157+0000","last_became_active":"2024-05-20T17:05:05.116018+0000","last_became_peered":"2024-05-20T17:05:05.116018+0000","last_unstale":"2024-05-20T17:05:09.569157+0000","last_undegraded":"2024-05-20T17:05:09.569157+0000","last_fullsized":"2024-05-20T17:05:09.569157+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:16:52.984984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129993+0000","last_change":"2024-05-20T17:05:05.109029+0000","last_active":"2024-05-20T17:05:10.129993+0000","last_peered":"2024-05-20T17:05:10.129993+0000","last_clean":"2024-05-20T17:05:10.129993+0000","last_became_active":"2024-05-20T17:05:05.108677+0000","last_became_peered":"2024-05-20T17:05:05.108677+0000","last_unstale":"2024-05-20T17:05:10.129993+0000","last_undegraded":"2024-05-20T17:05:10.129993+0000","last_fullsized":"2024-05-20T17:05:10.129993+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:24:36.698549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.658780+0000","last_change":"2024-05-20T17:05:05.104962+0000","last_active":"2024-05-20T17:05:09.658780+0000","last_peered":"2024-05-20T17:05:09.658780+0000","last_clean":"2024-05-20T17:05:09.658780+0000","last_became_active":"2024-05-20T17:05:05.104503+0000","last_became_peered":"2024-05-20T17:05:05.104503+0000","last_unstale":"2024-05-20T17:05:09.658780+0000","last_undegraded":"2024-05-20T17:05:09.658780+0000","last_fullsized":"2024-05-20T17:05:09.658780+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:51.807731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129694+0000","last_change":"2024-05-20T17:05:05.094714+0000","last_active":"2024-05-20T17:05:10.129694+0000","last_peered":"2024-05-20T17:05:10.129694+0000","last_clean":"2024-05-20T17:05:10.129694+0000","last_became_active":"2024-05-20T17:05:05.094343+0000","last_became_peered":"2024-05-20T17:05:05.094343+0000","last_unstale":"2024-05-20T17:05:10.129694+0000","last_undegraded":"2024-05-20T17:05:10.129694+0000","last_fullsized":"2024-05-20T17:05:10.129694+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:17:50.711969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129620+0000","last_change":"2024-05-20T17:05:09.130195+0000","last_active":"2024-05-20T17:05:10.129620+0000","last_peered":"2024-05-20T17:05:10.129620+0000","last_clean":"2024-05-20T17:05:10.129620+0000","last_became_active":"2024-05-20T17:05:09.129809+0000","last_became_peered":"2024-05-20T17:05:09.129809+0000","last_unstale":"2024-05-20T17:05:10.129620+0000","last_undegraded":"2024-05-20T17:05:10.129620+0000","last_fullsized":"2024-05-20T17:05:10.129620+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:30:23.666443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'4","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.658867+0000","last_change":"2024-05-20T17:05:04.093762+0000","last_active":"2024-05-20T17:05:09.658867+0000","last_peered":"2024-05-20T17:05:09.658867+0000","last_clean":"2024-05-20T17:05:09.658867+0000","last_became_active":"2024-05-20T17:05:04.093408+0000","last_became_peered":"2024-05-20T17:05:04.093408+0000","last_unstale":"2024-05-20T17:05:09.658867+0000","last_undegraded":"2024-05-20T17:05:09.658867+0000","last_fullsized":"2024-05-20T17:05:09.658867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:38:12.725701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128531+0000","last_change":"2024-05-20T17:05:05.110848+0000","last_active":"2024-05-20T17:05:10.128531+0000","last_peered":"2024-05-20T17:05:10.128531+0000","last_clean":"2024-05-20T17:05:10.128531+0000","last_became_active":"2024-05-20T17:05:05.110467+0000","last_became_peered":"2024-05-20T17:05:05.110467+0000","last_unstale":"2024-05-20T17:05:10.128531+0000","last_undegraded":"2024-05-20T17:05:10.128531+0000","last_fullsized":"2024-05-20T17:05:10.128531+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:09:11.436295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.627398+0000","last_change":"2024-05-20T17:05:09.138726+0000","last_active":"2024-05-20T17:05:09.627398+0000","last_peered":"2024-05-20T17:05:09.627398+0000","last_clean":"2024-05-20T17:05:09.627398+0000","last_became_active":"2024-05-20T17:05:09.138012+0000","last_became_peered":"2024-05-20T17:05:09.138012+0000","last_unstale":"2024-05-20T17:05:09.627398+0000","last_undegraded":"2024-05-20T17:05:09.627398+0000","last_fullsized":"2024-05-20T17:05:09.627398+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:42:40.892912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128851+0000","last_change":"2024-05-20T17:05:04.101591+0000","last_active":"2024-05-20T17:05:10.128851+0000","last_peered":"2024-05-20T17:05:10.128851+0000","last_clean":"2024-05-20T17:05:10.128851+0000","last_became_active":"2024-05-20T17:05:04.101258+0000","last_became_peered":"2024-05-20T17:05:04.101258+0000","last_unstale":"2024-05-20T17:05:10.128851+0000","last_undegraded":"2024-05-20T17:05:10.128851+0000","last_fullsized":"2024-05-20T17:05:10.128851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:13:35.443657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.737125+0000","last_change":"2024-05-20T17:05:05.114726+0000","last_active":"2024-05-20T17:05:09.737125+0000","last_peered":"2024-05-20T17:05:09.737125+0000","last_clean":"2024-05-20T17:05:09.737125+0000","last_became_active":"2024-05-20T17:05:05.114371+0000","last_became_peered":"2024-05-20T17:05:05.114371+0000","last_unstale":"2024-05-20T17:05:09.737125+0000","last_undegraded":"2024-05-20T17:05:09.737125+0000","last_fullsized":"2024-05-20T17:05:09.737125+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:50:37.982368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.627614+0000","last_change":"2024-05-20T17:05:09.139600+0000","last_active":"2024-05-20T17:05:09.627614+0000","last_peered":"2024-05-20T17:05:09.627614+0000","last_clean":"2024-05-20T17:05:09.627614+0000","last_became_active":"2024-05-20T17:05:09.138784+0000","last_became_peered":"2024-05-20T17:05:09.138784+0000","last_unstale":"2024-05-20T17:05:09.627614+0000","last_undegraded":"2024-05-20T17:05:09.627614+0000","last_fullsized":"2024-05-20T17:05:09.627614+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:51:06.592224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:35.587321+0000","last_change":"2024-05-20T17:05:04.094198+0000","last_active":"2024-05-20T17:05:35.587321+0000","last_peered":"2024-05-20T17:05:35.587321+0000","last_clean":"2024-05-20T17:05:35.587321+0000","last_became_active":"2024-05-20T17:05:04.092910+0000","last_became_peered":"2024-05-20T17:05:04.092910+0000","last_unstale":"2024-05-20T17:05:35.587321+0000","last_undegraded":"2024-05-20T17:05:35.587321+0000","last_fullsized":"2024-05-20T17:05:35.587321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:48:59.565790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.569358+0000","last_change":"2024-05-20T17:05:05.094554+0000","last_active":"2024-05-20T17:05:09.569358+0000","last_peered":"2024-05-20T17:05:09.569358+0000","last_clean":"2024-05-20T17:05:09.569358+0000","last_became_active":"2024-05-20T17:05:05.092846+0000","last_became_peered":"2024-05-20T17:05:05.092846+0000","last_unstale":"2024-05-20T17:05:09.569358+0000","last_undegraded":"2024-05-20T17:05:09.569358+0000","last_fullsized":"2024-05-20T17:05:09.569358+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:32:00.607173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.627418+0000","last_change":"2024-05-20T17:05:09.129918+0000","last_active":"2024-05-20T17:05:09.627418+0000","last_peered":"2024-05-20T17:05:09.627418+0000","last_clean":"2024-05-20T17:05:09.627418+0000","last_became_active":"2024-05-20T17:05:09.129497+0000","last_became_peered":"2024-05-20T17:05:09.129497+0000","last_unstale":"2024-05-20T17:05:09.627418+0000","last_undegraded":"2024-05-20T17:05:09.627418+0000","last_fullsized":"2024-05-20T17:05:09.627418+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:45:16.189840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:34.592882+0000","last_change":"2024-05-20T17:05:04.104740+0000","last_active":"2024-05-20T17:05:34.592882+0000","last_peered":"2024-05-20T17:05:34.592882+0000","last_clean":"2024-05-20T17:05:34.592882+0000","last_became_active":"2024-05-20T17:05:04.103297+0000","last_became_peered":"2024-05-20T17:05:04.103297+0000","last_unstale":"2024-05-20T17:05:34.592882+0000","last_undegraded":"2024-05-20T17:05:34.592882+0000","last_fullsized":"2024-05-20T17:05:34.592882+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:48:08.543394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570542+0000","last_change":"2024-05-20T17:05:05.108681+0000","last_active":"2024-05-20T17:05:09.570542+0000","last_peered":"2024-05-20T17:05:09.570542+0000","last_clean":"2024-05-20T17:05:09.570542+0000","last_became_active":"2024-05-20T17:05:05.108275+0000","last_became_peered":"2024-05-20T17:05:05.108275+0000","last_unstale":"2024-05-20T17:05:09.570542+0000","last_undegraded":"2024-05-20T17:05:09.570542+0000","last_fullsized":"2024-05-20T17:05:09.570542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:15:26.540948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129630+0000","last_change":"2024-05-20T17:05:09.125991+0000","last_active":"2024-05-20T17:05:10.129630+0000","last_peered":"2024-05-20T17:05:10.129630+0000","last_clean":"2024-05-20T17:05:10.129630+0000","last_became_active":"2024-05-20T17:05:09.125493+0000","last_became_peered":"2024-05-20T17:05:09.125493+0000","last_unstale":"2024-05-20T17:05:10.129630+0000","last_undegraded":"2024-05-20T17:05:10.129630+0000","last_fullsized":"2024-05-20T17:05:10.129630+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:09:19.603595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570826+0000","last_change":"2024-05-20T17:05:04.100387+0000","last_active":"2024-05-20T17:05:09.570826+0000","last_peered":"2024-05-20T17:05:09.570826+0000","last_clean":"2024-05-20T17:05:09.570826+0000","last_became_active":"2024-05-20T17:05:04.099834+0000","last_became_peered":"2024-05-20T17:05:04.099834+0000","last_unstale":"2024-05-20T17:05:09.570826+0000","last_undegraded":"2024-05-20T17:05:09.570826+0000","last_fullsized":"2024-05-20T17:05:09.570826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:10:18.696925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128901+0000","last_change":"2024-05-20T17:05:05.094015+0000","last_active":"2024-05-20T17:05:10.128901+0000","last_peered":"2024-05-20T17:05:10.128901+0000","last_clean":"2024-05-20T17:05:10.128901+0000","last_became_active":"2024-05-20T17:05:05.093650+0000","last_became_peered":"2024-05-20T17:05:05.093650+0000","last_unstale":"2024-05-20T17:05:10.128901+0000","last_undegraded":"2024-05-20T17:05:10.128901+0000","last_fullsized":"2024-05-20T17:05:10.128901+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:39:46.944348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129220+0000","last_change":"2024-05-20T17:05:09.122824+0000","last_active":"2024-05-20T17:05:10.129220+0000","last_peered":"2024-05-20T17:05:10.129220+0000","last_clean":"2024-05-20T17:05:10.129220+0000","last_became_active":"2024-05-20T17:05:09.122047+0000","last_became_peered":"2024-05-20T17:05:09.122047+0000","last_unstale":"2024-05-20T17:05:10.129220+0000","last_undegraded":"2024-05-20T17:05:10.129220+0000","last_fullsized":"2024-05-20T17:05:10.129220+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:55:49.843543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:33.584191+0000","last_change":"2024-05-20T17:05:04.094476+0000","last_active":"2024-05-20T17:05:33.584191+0000","last_peered":"2024-05-20T17:05:33.584191+0000","last_clean":"2024-05-20T17:05:33.584191+0000","last_became_active":"2024-05-20T17:05:04.093749+0000","last_became_peered":"2024-05-20T17:05:04.093749+0000","last_unstale":"2024-05-20T17:05:33.584191+0000","last_undegraded":"2024-05-20T17:05:33.584191+0000","last_fullsized":"2024-05-20T17:05:33.584191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:10:22.418169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570750+0000","last_change":"2024-05-20T17:05:05.107958+0000","last_active":"2024-05-20T17:05:09.570750+0000","last_peered":"2024-05-20T17:05:09.570750+0000","last_clean":"2024-05-20T17:05:09.570750+0000","last_became_active":"2024-05-20T17:05:05.107613+0000","last_became_peered":"2024-05-20T17:05:05.107613+0000","last_unstale":"2024-05-20T17:05:09.570750+0000","last_undegraded":"2024-05-20T17:05:09.570750+0000","last_fullsized":"2024-05-20T17:05:09.570750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:32.617707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.130084+0000","last_change":"2024-05-20T17:05:09.137556+0000","last_active":"2024-05-20T17:05:10.130084+0000","last_peered":"2024-05-20T17:05:10.130084+0000","last_clean":"2024-05-20T17:05:10.130084+0000","last_became_active":"2024-05-20T17:05:09.137168+0000","last_became_peered":"2024-05-20T17:05:09.137168+0000","last_unstale":"2024-05-20T17:05:10.130084+0000","last_undegraded":"2024-05-20T17:05:10.130084+0000","last_fullsized":"2024-05-20T17:05:10.130084+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:14:24.917203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:32.578880+0000","last_change":"2024-05-20T17:05:04.088139+0000","last_active":"2024-05-20T17:05:32.578880+0000","last_peered":"2024-05-20T17:05:32.578880+0000","last_clean":"2024-05-20T17:05:32.578880+0000","last_became_active":"2024-05-20T17:05:04.087746+0000","last_became_peered":"2024-05-20T17:05:04.087746+0000","last_unstale":"2024-05-20T17:05:32.578880+0000","last_undegraded":"2024-05-20T17:05:32.578880+0000","last_fullsized":"2024-05-20T17:05:32.578880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:27:43.440887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128098+0000","last_change":"2024-05-20T17:05:05.099478+0000","last_active":"2024-05-20T17:05:10.128098+0000","last_peered":"2024-05-20T17:05:10.128098+0000","last_clean":"2024-05-20T17:05:10.128098+0000","last_became_active":"2024-05-20T17:05:05.099058+0000","last_became_peered":"2024-05-20T17:05:05.099058+0000","last_unstale":"2024-05-20T17:05:10.128098+0000","last_undegraded":"2024-05-20T17:05:10.128098+0000","last_fullsized":"2024-05-20T17:05:10.128098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:41:51.133985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.737319+0000","last_change":"2024-05-20T17:05:09.132210+0000","last_active":"2024-05-20T17:05:09.737319+0000","last_peered":"2024-05-20T17:05:09.737319+0000","last_clean":"2024-05-20T17:05:09.737319+0000","last_became_active":"2024-05-20T17:05:09.131782+0000","last_became_peered":"2024-05-20T17:05:09.131782+0000","last_unstale":"2024-05-20T17:05:09.737319+0000","last_undegraded":"2024-05-20T17:05:09.737319+0000","last_fullsized":"2024-05-20T17:05:09.737319+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:39:13.111988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570151+0000","last_change":"2024-05-20T17:05:04.100091+0000","last_active":"2024-05-20T17:05:09.570151+0000","last_peered":"2024-05-20T17:05:09.570151+0000","last_clean":"2024-05-20T17:05:09.570151+0000","last_became_active":"2024-05-20T17:05:04.099741+0000","last_became_peered":"2024-05-20T17:05:04.099741+0000","last_unstale":"2024-05-20T17:05:09.570151+0000","last_undegraded":"2024-05-20T17:05:09.570151+0000","last_fullsized":"2024-05-20T17:05:09.570151+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:58:51.078656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.658200+0000","last_change":"2024-05-20T17:05:05.101320+0000","last_active":"2024-05-20T17:05:09.658200+0000","last_peered":"2024-05-20T17:05:09.658200+0000","last_clean":"2024-05-20T17:05:09.658200+0000","last_became_active":"2024-05-20T17:05:05.100957+0000","last_became_peered":"2024-05-20T17:05:05.100957+0000","last_unstale":"2024-05-20T17:05:09.658200+0000","last_undegraded":"2024-05-20T17:05:09.658200+0000","last_fullsized":"2024-05-20T17:05:09.658200+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:19.765284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128499+0000","last_change":"2024-05-20T17:05:09.131013+0000","last_active":"2024-05-20T17:05:10.128499+0000","last_peered":"2024-05-20T17:05:10.128499+0000","last_clean":"2024-05-20T17:05:10.128499+0000","last_became_active":"2024-05-20T17:05:09.130459+0000","last_became_peered":"2024-05-20T17:05:09.130459+0000","last_unstale":"2024-05-20T17:05:10.128499+0000","last_undegraded":"2024-05-20T17:05:10.128499+0000","last_fullsized":"2024-05-20T17:05:10.128499+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:46.158164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:33.572282+0000","last_change":"2024-05-20T17:05:04.094572+0000","last_active":"2024-05-20T17:05:33.572282+0000","last_peered":"2024-05-20T17:05:33.572282+0000","last_clean":"2024-05-20T17:05:33.572282+0000","last_became_active":"2024-05-20T17:05:04.094170+0000","last_became_peered":"2024-05-20T17:05:04.094170+0000","last_unstale":"2024-05-20T17:05:33.572282+0000","last_undegraded":"2024-05-20T17:05:33.572282+0000","last_fullsized":"2024-05-20T17:05:33.572282+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:31:00.700434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570060+0000","last_change":"2024-05-20T17:05:05.108241+0000","last_active":"2024-05-20T17:05:09.570060+0000","last_peered":"2024-05-20T17:05:09.570060+0000","last_clean":"2024-05-20T17:05:09.570060+0000","last_became_active":"2024-05-20T17:05:05.107515+0000","last_became_peered":"2024-05-20T17:05:05.107515+0000","last_unstale":"2024-05-20T17:05:09.570060+0000","last_undegraded":"2024-05-20T17:05:09.570060+0000","last_fullsized":"2024-05-20T17:05:09.570060+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:41:44.735821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.658293+0000","last_change":"2024-05-20T17:05:09.133897+0000","last_active":"2024-05-20T17:05:09.658293+0000","last_peered":"2024-05-20T17:05:09.658293+0000","last_clean":"2024-05-20T17:05:09.658293+0000","last_became_active":"2024-05-20T17:05:09.128953+0000","last_became_peered":"2024-05-20T17:05:09.128953+0000","last_unstale":"2024-05-20T17:05:09.658293+0000","last_undegraded":"2024-05-20T17:05:09.658293+0000","last_fullsized":"2024-05-20T17:05:09.658293+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:48:01.515930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:31.646750+0000","last_change":"2024-05-20T17:05:04.099314+0000","last_active":"2024-05-20T17:05:31.646750+0000","last_peered":"2024-05-20T17:05:31.646750+0000","last_clean":"2024-05-20T17:05:31.646750+0000","last_became_active":"2024-05-20T17:05:04.098912+0000","last_became_peered":"2024-05-20T17:05:04.098912+0000","last_unstale":"2024-05-20T17:05:31.646750+0000","last_undegraded":"2024-05-20T17:05:31.646750+0000","last_fullsized":"2024-05-20T17:05:31.646750+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:42:57.797943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.737268+0000","last_change":"2024-05-20T17:05:05.117909+0000","last_active":"2024-05-20T17:05:09.737268+0000","last_peered":"2024-05-20T17:05:09.737268+0000","last_clean":"2024-05-20T17:05:09.737268+0000","last_became_active":"2024-05-20T17:05:05.117031+0000","last_became_peered":"2024-05-20T17:05:05.117031+0000","last_unstale":"2024-05-20T17:05:09.737268+0000","last_undegraded":"2024-05-20T17:05:09.737268+0000","last_fullsized":"2024-05-20T17:05:09.737268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:09:29.211373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.627962+0000","last_change":"2024-05-20T17:05:09.139845+0000","last_active":"2024-05-20T17:05:09.627962+0000","last_peered":"2024-05-20T17:05:09.627962+0000","last_clean":"2024-05-20T17:05:09.627962+0000","last_became_active":"2024-05-20T17:05:09.138523+0000","last_became_peered":"2024-05-20T17:05:09.138523+0000","last_unstale":"2024-05-20T17:05:09.627962+0000","last_undegraded":"2024-05-20T17:05:09.627962+0000","last_fullsized":"2024-05-20T17:05:09.627962+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:33:24.772946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"85'3","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570347+0000","last_change":"2024-05-20T17:05:04.101362+0000","last_active":"2024-05-20T17:05:09.570347+0000","last_peered":"2024-05-20T17:05:09.570347+0000","last_clean":"2024-05-20T17:05:09.570347+0000","last_became_active":"2024-05-20T17:05:04.100972+0000","last_became_peered":"2024-05-20T17:05:04.100972+0000","last_unstale":"2024-05-20T17:05:09.570347+0000","last_undegraded":"2024-05-20T17:05:09.570347+0000","last_fullsized":"2024-05-20T17:05:09.570347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:43:57.245788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.569653+0000","last_change":"2024-05-20T17:05:05.105432+0000","last_active":"2024-05-20T17:05:09.569653+0000","last_peered":"2024-05-20T17:05:09.569653+0000","last_clean":"2024-05-20T17:05:09.569653+0000","last_became_active":"2024-05-20T17:05:05.100514+0000","last_became_peered":"2024-05-20T17:05:05.100514+0000","last_unstale":"2024-05-20T17:05:09.569653+0000","last_undegraded":"2024-05-20T17:05:09.569653+0000","last_fullsized":"2024-05-20T17:05:09.569653+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:39:41.164482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.658366+0000","last_change":"2024-05-20T17:05:09.124544+0000","last_active":"2024-05-20T17:05:09.658366+0000","last_peered":"2024-05-20T17:05:09.658366+0000","last_clean":"2024-05-20T17:05:09.658366+0000","last_became_active":"2024-05-20T17:05:09.123525+0000","last_became_peered":"2024-05-20T17:05:09.123525+0000","last_unstale":"2024-05-20T17:05:09.658366+0000","last_undegraded":"2024-05-20T17:05:09.658366+0000","last_fullsized":"2024-05-20T17:05:09.658366+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:10:26.250112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'12","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:33.573975+0000","last_change":"2024-05-20T17:05:04.097234+0000","last_active":"2024-05-20T17:05:33.573975+0000","last_peered":"2024-05-20T17:05:33.573975+0000","last_clean":"2024-05-20T17:05:33.573975+0000","last_became_active":"2024-05-20T17:05:04.096532+0000","last_became_peered":"2024-05-20T17:05:04.096532+0000","last_unstale":"2024-05-20T17:05:33.573975+0000","last_undegraded":"2024-05-20T17:05:33.573975+0000","last_fullsized":"2024-05-20T17:05:33.573975+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:07:12.407496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6,"num_read_kb":7,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129693+0000","last_change":"2024-05-20T17:05:05.113881+0000","last_active":"2024-05-20T17:05:10.129693+0000","last_peered":"2024-05-20T17:05:10.129693+0000","last_clean":"2024-05-20T17:05:10.129693+0000","last_became_active":"2024-05-20T17:05:05.113523+0000","last_became_peered":"2024-05-20T17:05:05.113523+0000","last_unstale":"2024-05-20T17:05:10.129693+0000","last_undegraded":"2024-05-20T17:05:10.129693+0000","last_fullsized":"2024-05-20T17:05:10.129693+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:50:44.206742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.571068+0000","last_change":"2024-05-20T17:05:09.133344+0000","last_active":"2024-05-20T17:05:09.571068+0000","last_peered":"2024-05-20T17:05:09.571068+0000","last_clean":"2024-05-20T17:05:09.571068+0000","last_became_active":"2024-05-20T17:05:09.132914+0000","last_became_peered":"2024-05-20T17:05:09.132914+0000","last_unstale":"2024-05-20T17:05:09.571068+0000","last_undegraded":"2024-05-20T17:05:09.571068+0000","last_fullsized":"2024-05-20T17:05:09.571068+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:56:17.279757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:34.591407+0000","last_change":"2024-05-20T17:05:04.099029+0000","last_active":"2024-05-20T17:05:34.591407+0000","last_peered":"2024-05-20T17:05:34.591407+0000","last_clean":"2024-05-20T17:05:34.591407+0000","last_became_active":"2024-05-20T17:05:04.098553+0000","last_became_peered":"2024-05-20T17:05:04.098553+0000","last_unstale":"2024-05-20T17:05:34.591407+0000","last_undegraded":"2024-05-20T17:05:34.591407+0000","last_fullsized":"2024-05-20T17:05:34.591407+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:12.793008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.567576+0000","last_change":"2024-05-20T17:05:05.107734+0000","last_active":"2024-05-20T17:05:09.567576+0000","last_peered":"2024-05-20T17:05:09.567576+0000","last_clean":"2024-05-20T17:05:09.567576+0000","last_became_active":"2024-05-20T17:05:05.107388+0000","last_became_peered":"2024-05-20T17:05:05.107388+0000","last_unstale":"2024-05-20T17:05:09.567576+0000","last_undegraded":"2024-05-20T17:05:09.567576+0000","last_fullsized":"2024-05-20T17:05:09.567576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:51.147757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128694+0000","last_change":"2024-05-20T17:05:09.137618+0000","last_active":"2024-05-20T17:05:10.128694+0000","last_peered":"2024-05-20T17:05:10.128694+0000","last_clean":"2024-05-20T17:05:10.128694+0000","last_became_active":"2024-05-20T17:05:09.137172+0000","last_became_peered":"2024-05-20T17:05:09.137172+0000","last_unstale":"2024-05-20T17:05:10.128694+0000","last_undegraded":"2024-05-20T17:05:10.128694+0000","last_fullsized":"2024-05-20T17:05:10.128694+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:17:45.218886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570532+0000","last_change":"2024-05-20T17:05:04.095628+0000","last_active":"2024-05-20T17:05:09.570532+0000","last_peered":"2024-05-20T17:05:09.570532+0000","last_clean":"2024-05-20T17:05:09.570532+0000","last_became_active":"2024-05-20T17:05:04.095187+0000","last_became_peered":"2024-05-20T17:05:04.095187+0000","last_unstale":"2024-05-20T17:05:09.570532+0000","last_undegraded":"2024-05-20T17:05:09.570532+0000","last_fullsized":"2024-05-20T17:05:09.570532+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:03:33.601967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129510+0000","last_change":"2024-05-20T17:05:05.108321+0000","last_active":"2024-05-20T17:05:10.129510+0000","last_peered":"2024-05-20T17:05:10.129510+0000","last_clean":"2024-05-20T17:05:10.129510+0000","last_became_active":"2024-05-20T17:05:05.107943+0000","last_became_peered":"2024-05-20T17:05:05.107943+0000","last_unstale":"2024-05-20T17:05:10.129510+0000","last_undegraded":"2024-05-20T17:05:10.129510+0000","last_fullsized":"2024-05-20T17:05:10.129510+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:12:44.324799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.658791+0000","last_change":"2024-05-20T17:05:09.135210+0000","last_active":"2024-05-20T17:05:09.658791+0000","last_peered":"2024-05-20T17:05:09.658791+0000","last_clean":"2024-05-20T17:05:09.658791+0000","last_became_active":"2024-05-20T17:05:09.134226+0000","last_became_peered":"2024-05-20T17:05:09.134226+0000","last_unstale":"2024-05-20T17:05:09.658791+0000","last_undegraded":"2024-05-20T17:05:09.658791+0000","last_fullsized":"2024-05-20T17:05:09.658791+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:36:22.833036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.627255+0000","last_change":"2024-05-20T17:05:04.089661+0000","last_active":"2024-05-20T17:05:09.627255+0000","last_peered":"2024-05-20T17:05:09.627255+0000","last_clean":"2024-05-20T17:05:09.627255+0000","last_became_active":"2024-05-20T17:05:04.088939+0000","last_became_peered":"2024-05-20T17:05:04.088939+0000","last_unstale":"2024-05-20T17:05:09.627255+0000","last_undegraded":"2024-05-20T17:05:09.627255+0000","last_fullsized":"2024-05-20T17:05:09.627255+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:48:15.962887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128750+0000","last_change":"2024-05-20T17:05:05.113827+0000","last_active":"2024-05-20T17:05:10.128750+0000","last_peered":"2024-05-20T17:05:10.128750+0000","last_clean":"2024-05-20T17:05:10.128750+0000","last_became_active":"2024-05-20T17:05:05.111547+0000","last_became_peered":"2024-05-20T17:05:05.111547+0000","last_unstale":"2024-05-20T17:05:10.128750+0000","last_undegraded":"2024-05-20T17:05:10.128750+0000","last_fullsized":"2024-05-20T17:05:10.128750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:29:13.826983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.568089+0000","last_change":"2024-05-20T17:05:09.138814+0000","last_active":"2024-05-20T17:05:09.568089+0000","last_peered":"2024-05-20T17:05:09.568089+0000","last_clean":"2024-05-20T17:05:09.568089+0000","last_became_active":"2024-05-20T17:05:09.138119+0000","last_became_peered":"2024-05-20T17:05:09.138119+0000","last_unstale":"2024-05-20T17:05:09.568089+0000","last_undegraded":"2024-05-20T17:05:09.568089+0000","last_fullsized":"2024-05-20T17:05:09.568089+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:23.323841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:34.592424+0000","last_change":"2024-05-20T17:05:04.102468+0000","last_active":"2024-05-20T17:05:34.592424+0000","last_peered":"2024-05-20T17:05:34.592424+0000","last_clean":"2024-05-20T17:05:34.592424+0000","last_became_active":"2024-05-20T17:05:04.102073+0000","last_became_peered":"2024-05-20T17:05:04.102073+0000","last_unstale":"2024-05-20T17:05:34.592424+0000","last_undegraded":"2024-05-20T17:05:34.592424+0000","last_fullsized":"2024-05-20T17:05:34.592424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:42:46.929625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570122+0000","last_change":"2024-05-20T17:05:05.111382+0000","last_active":"2024-05-20T17:05:09.570122+0000","last_peered":"2024-05-20T17:05:09.570122+0000","last_clean":"2024-05-20T17:05:09.570122+0000","last_became_active":"2024-05-20T17:05:05.111009+0000","last_became_peered":"2024-05-20T17:05:05.111009+0000","last_unstale":"2024-05-20T17:05:09.570122+0000","last_undegraded":"2024-05-20T17:05:09.570122+0000","last_fullsized":"2024-05-20T17:05:09.570122+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:40:08.354340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570311+0000","last_change":"2024-05-20T17:05:09.134534+0000","last_active":"2024-05-20T17:05:09.570311+0000","last_peered":"2024-05-20T17:05:09.570311+0000","last_clean":"2024-05-20T17:05:09.570311+0000","last_became_active":"2024-05-20T17:05:09.134097+0000","last_became_peered":"2024-05-20T17:05:09.134097+0000","last_unstale":"2024-05-20T17:05:09.570311+0000","last_undegraded":"2024-05-20T17:05:09.570311+0000","last_fullsized":"2024-05-20T17:05:09.570311+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:43.782343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:32.567891+0000","last_change":"2024-05-20T17:05:04.104314+0000","last_active":"2024-05-20T17:05:32.567891+0000","last_peered":"2024-05-20T17:05:32.567891+0000","last_clean":"2024-05-20T17:05:32.567891+0000","last_became_active":"2024-05-20T17:05:04.103338+0000","last_became_peered":"2024-05-20T17:05:04.103338+0000","last_unstale":"2024-05-20T17:05:32.567891+0000","last_undegraded":"2024-05-20T17:05:32.567891+0000","last_fullsized":"2024-05-20T17:05:32.567891+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:32:06.721674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129747+0000","last_change":"2024-05-20T17:05:05.107566+0000","last_active":"2024-05-20T17:05:10.129747+0000","last_peered":"2024-05-20T17:05:10.129747+0000","last_clean":"2024-05-20T17:05:10.129747+0000","last_became_active":"2024-05-20T17:05:05.107190+0000","last_became_peered":"2024-05-20T17:05:05.107190+0000","last_unstale":"2024-05-20T17:05:10.129747+0000","last_undegraded":"2024-05-20T17:05:10.129747+0000","last_fullsized":"2024-05-20T17:05:10.129747+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:55:15.312700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128433+0000","last_change":"2024-05-20T17:05:09.369886+0000","last_active":"2024-05-20T17:05:10.128433+0000","last_peered":"2024-05-20T17:05:10.128433+0000","last_clean":"2024-05-20T17:05:10.128433+0000","last_became_active":"2024-05-20T17:05:09.369254+0000","last_became_peered":"2024-05-20T17:05:09.369254+0000","last_unstale":"2024-05-20T17:05:10.128433+0000","last_undegraded":"2024-05-20T17:05:10.128433+0000","last_fullsized":"2024-05-20T17:05:10.128433+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:54:54.784952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.658476+0000","last_change":"2024-05-20T17:05:04.100182+0000","last_active":"2024-05-20T17:05:09.658476+0000","last_peered":"2024-05-20T17:05:09.658476+0000","last_clean":"2024-05-20T17:05:09.658476+0000","last_became_active":"2024-05-20T17:05:04.099801+0000","last_became_peered":"2024-05-20T17:05:04.099801+0000","last_unstale":"2024-05-20T17:05:09.658476+0000","last_undegraded":"2024-05-20T17:05:09.658476+0000","last_fullsized":"2024-05-20T17:05:09.658476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:34.666869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129491+0000","last_change":"2024-05-20T17:05:05.111514+0000","last_active":"2024-05-20T17:05:10.129491+0000","last_peered":"2024-05-20T17:05:10.129491+0000","last_clean":"2024-05-20T17:05:10.129491+0000","last_became_active":"2024-05-20T17:05:05.111137+0000","last_became_peered":"2024-05-20T17:05:05.111137+0000","last_unstale":"2024-05-20T17:05:10.129491+0000","last_undegraded":"2024-05-20T17:05:10.129491+0000","last_fullsized":"2024-05-20T17:05:10.129491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:19:44.677701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.567843+0000","last_change":"2024-05-20T17:05:09.133601+0000","last_active":"2024-05-20T17:05:09.567843+0000","last_peered":"2024-05-20T17:05:09.567843+0000","last_clean":"2024-05-20T17:05:09.567843+0000","last_became_active":"2024-05-20T17:05:09.132297+0000","last_became_peered":"2024-05-20T17:05:09.132297+0000","last_unstale":"2024-05-20T17:05:09.567843+0000","last_undegraded":"2024-05-20T17:05:09.567843+0000","last_fullsized":"2024-05-20T17:05:09.567843+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:06.896380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128761+0000","last_change":"2024-05-20T17:05:04.099522+0000","last_active":"2024-05-20T17:05:10.128761+0000","last_peered":"2024-05-20T17:05:10.128761+0000","last_clean":"2024-05-20T17:05:10.128761+0000","last_became_active":"2024-05-20T17:05:04.098933+0000","last_became_peered":"2024-05-20T17:05:04.098933+0000","last_unstale":"2024-05-20T17:05:10.128761+0000","last_undegraded":"2024-05-20T17:05:10.128761+0000","last_fullsized":"2024-05-20T17:05:10.128761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:14.996617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128885+0000","last_change":"2024-05-20T17:05:05.116526+0000","last_active":"2024-05-20T17:05:10.128885+0000","last_peered":"2024-05-20T17:05:10.128885+0000","last_clean":"2024-05-20T17:05:10.128885+0000","last_became_active":"2024-05-20T17:05:05.116108+0000","last_became_peered":"2024-05-20T17:05:05.116108+0000","last_unstale":"2024-05-20T17:05:10.128885+0000","last_undegraded":"2024-05-20T17:05:10.128885+0000","last_fullsized":"2024-05-20T17:05:10.128885+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:20:03.481555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.568022+0000","last_change":"2024-05-20T17:05:09.369912+0000","last_active":"2024-05-20T17:05:09.568022+0000","last_peered":"2024-05-20T17:05:09.568022+0000","last_clean":"2024-05-20T17:05:09.568022+0000","last_became_active":"2024-05-20T17:05:09.369456+0000","last_became_peered":"2024-05-20T17:05:09.369456+0000","last_unstale":"2024-05-20T17:05:09.568022+0000","last_undegraded":"2024-05-20T17:05:09.568022+0000","last_fullsized":"2024-05-20T17:05:09.568022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:09:11.675548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570522+0000","last_change":"2024-05-20T17:05:05.093045+0000","last_active":"2024-05-20T17:05:09.570522+0000","last_peered":"2024-05-20T17:05:09.570522+0000","last_clean":"2024-05-20T17:05:09.570522+0000","last_became_active":"2024-05-20T17:05:05.092477+0000","last_became_peered":"2024-05-20T17:05:05.092477+0000","last_unstale":"2024-05-20T17:05:09.570522+0000","last_undegraded":"2024-05-20T17:05:09.570522+0000","last_fullsized":"2024-05-20T17:05:09.570522+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:08:43.038885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'4","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:32.579910+0000","last_change":"2024-05-20T17:05:04.100893+0000","last_active":"2024-05-20T17:05:32.579910+0000","last_peered":"2024-05-20T17:05:32.579910+0000","last_clean":"2024-05-20T17:05:32.579910+0000","last_became_active":"2024-05-20T17:05:04.100519+0000","last_became_peered":"2024-05-20T17:05:04.100519+0000","last_unstale":"2024-05-20T17:05:32.579910+0000","last_undegraded":"2024-05-20T17:05:32.579910+0000","last_fullsized":"2024-05-20T17:05:32.579910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:10:13.764472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129753+0000","last_change":"2024-05-20T17:05:09.123689+0000","last_active":"2024-05-20T17:05:10.129753+0000","last_peered":"2024-05-20T17:05:10.129753+0000","last_clean":"2024-05-20T17:05:10.129753+0000","last_became_active":"2024-05-20T17:05:09.123124+0000","last_became_peered":"2024-05-20T17:05:09.123124+0000","last_unstale":"2024-05-20T17:05:10.129753+0000","last_undegraded":"2024-05-20T17:05:10.129753+0000","last_fullsized":"2024-05-20T17:05:10.129753+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:22:45.865765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128174+0000","last_change":"2024-05-20T17:05:05.100637+0000","last_active":"2024-05-20T17:05:10.128174+0000","last_peered":"2024-05-20T17:05:10.128174+0000","last_clean":"2024-05-20T17:05:10.128174+0000","last_became_active":"2024-05-20T17:05:05.100264+0000","last_became_peered":"2024-05-20T17:05:05.100264+0000","last_unstale":"2024-05-20T17:05:10.128174+0000","last_undegraded":"2024-05-20T17:05:10.128174+0000","last_fullsized":"2024-05-20T17:05:10.128174+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:52:36.743365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:31.649179+0000","last_change":"2024-05-20T17:05:04.089427+0000","last_active":"2024-05-20T17:05:31.649179+0000","last_peered":"2024-05-20T17:05:31.649179+0000","last_clean":"2024-05-20T17:05:31.649179+0000","last_became_active":"2024-05-20T17:05:04.088880+0000","last_became_peered":"2024-05-20T17:05:04.088880+0000","last_unstale":"2024-05-20T17:05:31.649179+0000","last_undegraded":"2024-05-20T17:05:31.649179+0000","last_fullsized":"2024-05-20T17:05:31.649179+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:16.068072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":344,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128475+0000","last_change":"2024-05-20T17:03:47.606627+0000","last_active":"2024-05-20T17:05:10.128475+0000","last_peered":"2024-05-20T17:05:10.128475+0000","last_clean":"2024-05-20T17:05:10.128475+0000","last_became_active":"2024-05-20T17:03:47.606105+0000","last_became_peered":"2024-05-20T17:03:47.606105+0000","last_unstale":"2024-05-20T17:05:10.128475+0000","last_undegraded":"2024-05-20T17:05:10.128475+0000","last_fullsized":"2024-05-20T17:05:10.128475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:00:12.876377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:00:12.876377+0000","last_clean_scrub_stamp":"2024-05-20T17:00:12.876377+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:26:46.526462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570923+0000","last_change":"2024-05-20T17:05:09.370158+0000","last_active":"2024-05-20T17:05:09.570923+0000","last_peered":"2024-05-20T17:05:09.570923+0000","last_clean":"2024-05-20T17:05:09.570923+0000","last_became_active":"2024-05-20T17:05:09.369481+0000","last_became_peered":"2024-05-20T17:05:09.369481+0000","last_unstale":"2024-05-20T17:05:09.570923+0000","last_undegraded":"2024-05-20T17:05:09.570923+0000","last_fullsized":"2024-05-20T17:05:09.570923+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:57:25.940447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.567329+0000","last_change":"2024-05-20T17:05:05.100689+0000","last_active":"2024-05-20T17:05:09.567329+0000","last_peered":"2024-05-20T17:05:09.567329+0000","last_clean":"2024-05-20T17:05:09.567329+0000","last_became_active":"2024-05-20T17:05:05.100321+0000","last_became_peered":"2024-05-20T17:05:05.100321+0000","last_unstale":"2024-05-20T17:05:09.567329+0000","last_undegraded":"2024-05-20T17:05:09.567329+0000","last_fullsized":"2024-05-20T17:05:09.567329+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:10:07.742067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:32.578039+0000","last_change":"2024-05-20T17:05:04.093532+0000","last_active":"2024-05-20T17:05:32.578039+0000","last_peered":"2024-05-20T17:05:32.578039+0000","last_clean":"2024-05-20T17:05:32.578039+0000","last_became_active":"2024-05-20T17:05:04.093047+0000","last_became_peered":"2024-05-20T17:05:04.093047+0000","last_unstale":"2024-05-20T17:05:32.578039+0000","last_undegraded":"2024-05-20T17:05:32.578039+0000","last_fullsized":"2024-05-20T17:05:32.578039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:39:37.505637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128664+0000","last_change":"2024-05-20T17:05:09.130715+0000","last_active":"2024-05-20T17:05:10.128664+0000","last_peered":"2024-05-20T17:05:10.128664+0000","last_clean":"2024-05-20T17:05:10.128664+0000","last_became_active":"2024-05-20T17:05:09.130237+0000","last_became_peered":"2024-05-20T17:05:09.130237+0000","last_unstale":"2024-05-20T17:05:10.128664+0000","last_undegraded":"2024-05-20T17:05:10.128664+0000","last_fullsized":"2024-05-20T17:05:10.128664+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:52:15.160631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:33.585625+0000","last_change":"2024-05-20T17:05:04.103942+0000","last_active":"2024-05-20T17:05:33.585625+0000","last_peered":"2024-05-20T17:05:33.585625+0000","last_clean":"2024-05-20T17:05:33.585625+0000","last_became_active":"2024-05-20T17:05:04.102971+0000","last_became_peered":"2024-05-20T17:05:04.102971+0000","last_unstale":"2024-05-20T17:05:33.585625+0000","last_undegraded":"2024-05-20T17:05:33.585625+0000","last_fullsized":"2024-05-20T17:05:33.585625+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:41:37.719913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.567805+0000","last_change":"2024-05-20T17:05:05.087201+0000","last_active":"2024-05-20T17:05:09.567805+0000","last_peered":"2024-05-20T17:05:09.567805+0000","last_clean":"2024-05-20T17:05:09.567805+0000","last_became_active":"2024-05-20T17:05:05.086809+0000","last_became_peered":"2024-05-20T17:05:05.086809+0000","last_unstale":"2024-05-20T17:05:09.567805+0000","last_undegraded":"2024-05-20T17:05:09.567805+0000","last_fullsized":"2024-05-20T17:05:09.567805+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:31:45.925200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128151+0000","last_change":"2024-05-20T17:05:09.369881+0000","last_active":"2024-05-20T17:05:10.128151+0000","last_peered":"2024-05-20T17:05:10.128151+0000","last_clean":"2024-05-20T17:05:10.128151+0000","last_became_active":"2024-05-20T17:05:09.369391+0000","last_became_peered":"2024-05-20T17:05:09.369391+0000","last_unstale":"2024-05-20T17:05:10.128151+0000","last_undegraded":"2024-05-20T17:05:10.128151+0000","last_fullsized":"2024-05-20T17:05:10.128151+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:00:00.397289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.658778+0000","last_change":"2024-05-20T17:05:04.098857+0000","last_active":"2024-05-20T17:05:09.658778+0000","last_peered":"2024-05-20T17:05:09.658778+0000","last_clean":"2024-05-20T17:05:09.658778+0000","last_became_active":"2024-05-20T17:05:04.098480+0000","last_became_peered":"2024-05-20T17:05:04.098480+0000","last_unstale":"2024-05-20T17:05:09.658778+0000","last_undegraded":"2024-05-20T17:05:09.658778+0000","last_fullsized":"2024-05-20T17:05:09.658778+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:03:57.164706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128806+0000","last_change":"2024-05-20T17:05:05.121077+0000","last_active":"2024-05-20T17:05:10.128806+0000","last_peered":"2024-05-20T17:05:10.128806+0000","last_clean":"2024-05-20T17:05:10.128806+0000","last_became_active":"2024-05-20T17:05:05.120651+0000","last_became_peered":"2024-05-20T17:05:05.120651+0000","last_unstale":"2024-05-20T17:05:10.128806+0000","last_undegraded":"2024-05-20T17:05:10.128806+0000","last_fullsized":"2024-05-20T17:05:10.128806+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:59:30.061898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128531+0000","last_change":"2024-05-20T17:05:09.122839+0000","last_active":"2024-05-20T17:05:10.128531+0000","last_peered":"2024-05-20T17:05:10.128531+0000","last_clean":"2024-05-20T17:05:10.128531+0000","last_became_active":"2024-05-20T17:05:09.122390+0000","last_became_peered":"2024-05-20T17:05:09.122390+0000","last_unstale":"2024-05-20T17:05:10.128531+0000","last_undegraded":"2024-05-20T17:05:10.128531+0000","last_fullsized":"2024-05-20T17:05:10.128531+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:50:27.849698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:31.648273+0000","last_change":"2024-05-20T17:05:04.092416+0000","last_active":"2024-05-20T17:05:31.648273+0000","last_peered":"2024-05-20T17:05:31.648273+0000","last_clean":"2024-05-20T17:05:31.648273+0000","last_became_active":"2024-05-20T17:05:04.091886+0000","last_became_peered":"2024-05-20T17:05:04.091886+0000","last_unstale":"2024-05-20T17:05:31.648273+0000","last_undegraded":"2024-05-20T17:05:31.648273+0000","last_fullsized":"2024-05-20T17:05:31.648273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:00:02.281867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.737206+0000","last_change":"2024-05-20T17:05:05.115650+0000","last_active":"2024-05-20T17:05:09.737206+0000","last_peered":"2024-05-20T17:05:09.737206+0000","last_clean":"2024-05-20T17:05:09.737206+0000","last_became_active":"2024-05-20T17:05:05.115303+0000","last_became_peered":"2024-05-20T17:05:05.115303+0000","last_unstale":"2024-05-20T17:05:09.737206+0000","last_undegraded":"2024-05-20T17:05:09.737206+0000","last_fullsized":"2024-05-20T17:05:09.737206+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:10:02.144645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.627846+0000","last_change":"2024-05-20T17:05:09.371289+0000","last_active":"2024-05-20T17:05:09.627846+0000","last_peered":"2024-05-20T17:05:09.627846+0000","last_clean":"2024-05-20T17:05:09.627846+0000","last_became_active":"2024-05-20T17:05:09.369823+0000","last_became_peered":"2024-05-20T17:05:09.369823+0000","last_unstale":"2024-05-20T17:05:09.627846+0000","last_undegraded":"2024-05-20T17:05:09.627846+0000","last_fullsized":"2024-05-20T17:05:09.627846+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:34:57.738554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:31.647970+0000","last_change":"2024-05-20T17:05:04.104909+0000","last_active":"2024-05-20T17:05:31.647970+0000","last_peered":"2024-05-20T17:05:31.647970+0000","last_clean":"2024-05-20T17:05:31.647970+0000","last_became_active":"2024-05-20T17:05:04.104457+0000","last_became_peered":"2024-05-20T17:05:04.104457+0000","last_unstale":"2024-05-20T17:05:31.647970+0000","last_undegraded":"2024-05-20T17:05:31.647970+0000","last_fullsized":"2024-05-20T17:05:31.647970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:53:41.790963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128152+0000","last_change":"2024-05-20T17:05:05.103188+0000","last_active":"2024-05-20T17:05:10.128152+0000","last_peered":"2024-05-20T17:05:10.128152+0000","last_clean":"2024-05-20T17:05:10.128152+0000","last_became_active":"2024-05-20T17:05:05.102780+0000","last_became_peered":"2024-05-20T17:05:05.102780+0000","last_unstale":"2024-05-20T17:05:10.128152+0000","last_undegraded":"2024-05-20T17:05:10.128152+0000","last_fullsized":"2024-05-20T17:05:10.128152+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:32.907211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.658930+0000","last_change":"2024-05-20T17:05:09.126155+0000","last_active":"2024-05-20T17:05:09.658930+0000","last_peered":"2024-05-20T17:05:09.658930+0000","last_clean":"2024-05-20T17:05:09.658930+0000","last_became_active":"2024-05-20T17:05:09.125464+0000","last_became_peered":"2024-05-20T17:05:09.125464+0000","last_unstale":"2024-05-20T17:05:09.658930+0000","last_undegraded":"2024-05-20T17:05:09.658930+0000","last_fullsized":"2024-05-20T17:05:09.658930+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:28:52.747574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:34.590832+0000","last_change":"2024-05-20T17:05:04.088923+0000","last_active":"2024-05-20T17:05:34.590832+0000","last_peered":"2024-05-20T17:05:34.590832+0000","last_clean":"2024-05-20T17:05:34.590832+0000","last_became_active":"2024-05-20T17:05:04.088335+0000","last_became_peered":"2024-05-20T17:05:04.088335+0000","last_unstale":"2024-05-20T17:05:34.590832+0000","last_undegraded":"2024-05-20T17:05:34.590832+0000","last_fullsized":"2024-05-20T17:05:34.590832+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:43:18.288139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129468+0000","last_change":"2024-05-20T17:05:05.110964+0000","last_active":"2024-05-20T17:05:10.129468+0000","last_peered":"2024-05-20T17:05:10.129468+0000","last_clean":"2024-05-20T17:05:10.129468+0000","last_became_active":"2024-05-20T17:05:05.110593+0000","last_became_peered":"2024-05-20T17:05:05.110593+0000","last_unstale":"2024-05-20T17:05:10.129468+0000","last_undegraded":"2024-05-20T17:05:10.129468+0000","last_fullsized":"2024-05-20T17:05:10.129468+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:27.921812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.627924+0000","last_change":"2024-05-20T17:05:09.139541+0000","last_active":"2024-05-20T17:05:09.627924+0000","last_peered":"2024-05-20T17:05:09.627924+0000","last_clean":"2024-05-20T17:05:09.627924+0000","last_became_active":"2024-05-20T17:05:09.139008+0000","last_became_peered":"2024-05-20T17:05:09.139008+0000","last_unstale":"2024-05-20T17:05:09.627924+0000","last_undegraded":"2024-05-20T17:05:09.627924+0000","last_fullsized":"2024-05-20T17:05:09.627924+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:50.125661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'3","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:33.584830+0000","last_change":"2024-05-20T17:05:04.095527+0000","last_active":"2024-05-20T17:05:33.584830+0000","last_peered":"2024-05-20T17:05:33.584830+0000","last_clean":"2024-05-20T17:05:33.584830+0000","last_became_active":"2024-05-20T17:05:04.095096+0000","last_became_peered":"2024-05-20T17:05:04.095096+0000","last_unstale":"2024-05-20T17:05:33.584830+0000","last_undegraded":"2024-05-20T17:05:33.584830+0000","last_fullsized":"2024-05-20T17:05:33.584830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:44:21.559200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128457+0000","last_change":"2024-05-20T17:05:05.113644+0000","last_active":"2024-05-20T17:05:10.128457+0000","last_peered":"2024-05-20T17:05:10.128457+0000","last_clean":"2024-05-20T17:05:10.128457+0000","last_became_active":"2024-05-20T17:05:05.113186+0000","last_became_peered":"2024-05-20T17:05:05.113186+0000","last_unstale":"2024-05-20T17:05:10.128457+0000","last_undegraded":"2024-05-20T17:05:10.128457+0000","last_fullsized":"2024-05-20T17:05:10.128457+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:54.243939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.627942+0000","last_change":"2024-05-20T17:05:09.370048+0000","last_active":"2024-05-20T17:05:09.627942+0000","last_peered":"2024-05-20T17:05:09.627942+0000","last_clean":"2024-05-20T17:05:09.627942+0000","last_became_active":"2024-05-20T17:05:09.369529+0000","last_became_peered":"2024-05-20T17:05:09.369529+0000","last_unstale":"2024-05-20T17:05:09.627942+0000","last_undegraded":"2024-05-20T17:05:09.627942+0000","last_fullsized":"2024-05-20T17:05:09.627942+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:49:09.332673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:31.649112+0000","last_change":"2024-05-20T17:05:04.102795+0000","last_active":"2024-05-20T17:05:31.649112+0000","last_peered":"2024-05-20T17:05:31.649112+0000","last_clean":"2024-05-20T17:05:31.649112+0000","last_became_active":"2024-05-20T17:05:04.102204+0000","last_became_peered":"2024-05-20T17:05:04.102204+0000","last_unstale":"2024-05-20T17:05:31.649112+0000","last_undegraded":"2024-05-20T17:05:31.649112+0000","last_fullsized":"2024-05-20T17:05:31.649112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:38:10.634153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129041+0000","last_change":"2024-05-20T17:05:05.115003+0000","last_active":"2024-05-20T17:05:10.129041+0000","last_peered":"2024-05-20T17:05:10.129041+0000","last_clean":"2024-05-20T17:05:10.129041+0000","last_became_active":"2024-05-20T17:05:05.114596+0000","last_became_peered":"2024-05-20T17:05:05.114596+0000","last_unstale":"2024-05-20T17:05:10.129041+0000","last_undegraded":"2024-05-20T17:05:10.129041+0000","last_fullsized":"2024-05-20T17:05:10.129041+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:47:39.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.569570+0000","last_change":"2024-05-20T17:05:09.131310+0000","last_active":"2024-05-20T17:05:09.569570+0000","last_peered":"2024-05-20T17:05:09.569570+0000","last_clean":"2024-05-20T17:05:09.569570+0000","last_became_active":"2024-05-20T17:05:09.130643+0000","last_became_peered":"2024-05-20T17:05:09.130643+0000","last_unstale":"2024-05-20T17:05:09.569570+0000","last_undegraded":"2024-05-20T17:05:09.569570+0000","last_fullsized":"2024-05-20T17:05:09.569570+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:58:21.996929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'5","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:35.597341+0000","last_change":"2024-05-20T17:05:04.100547+0000","last_active":"2024-05-20T17:05:35.597341+0000","last_peered":"2024-05-20T17:05:35.597341+0000","last_clean":"2024-05-20T17:05:35.597341+0000","last_became_active":"2024-05-20T17:05:04.100167+0000","last_became_peered":"2024-05-20T17:05:04.100167+0000","last_unstale":"2024-05-20T17:05:35.597341+0000","last_undegraded":"2024-05-20T17:05:35.597341+0000","last_fullsized":"2024-05-20T17:05:35.597341+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:44.182489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129858+0000","last_change":"2024-05-20T17:05:05.118459+0000","last_active":"2024-05-20T17:05:10.129858+0000","last_peered":"2024-05-20T17:05:10.129858+0000","last_clean":"2024-05-20T17:05:10.129858+0000","last_became_active":"2024-05-20T17:05:05.115445+0000","last_became_peered":"2024-05-20T17:05:05.115445+0000","last_unstale":"2024-05-20T17:05:10.129858+0000","last_undegraded":"2024-05-20T17:05:10.129858+0000","last_fullsized":"2024-05-20T17:05:10.129858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:06:36.042952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.736969+0000","last_change":"2024-05-20T17:05:09.136508+0000","last_active":"2024-05-20T17:05:09.736969+0000","last_peered":"2024-05-20T17:05:09.736969+0000","last_clean":"2024-05-20T17:05:09.736969+0000","last_became_active":"2024-05-20T17:05:09.135825+0000","last_became_peered":"2024-05-20T17:05:09.135825+0000","last_unstale":"2024-05-20T17:05:09.736969+0000","last_undegraded":"2024-05-20T17:05:09.736969+0000","last_fullsized":"2024-05-20T17:05:09.736969+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:00:48.585071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570706+0000","last_change":"2024-05-20T17:05:04.096484+0000","last_active":"2024-05-20T17:05:09.570706+0000","last_peered":"2024-05-20T17:05:09.570706+0000","last_clean":"2024-05-20T17:05:09.570706+0000","last_became_active":"2024-05-20T17:05:04.096053+0000","last_became_peered":"2024-05-20T17:05:04.096053+0000","last_unstale":"2024-05-20T17:05:09.570706+0000","last_undegraded":"2024-05-20T17:05:09.570706+0000","last_fullsized":"2024-05-20T17:05:09.570706+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:35:19.373932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129554+0000","last_change":"2024-05-20T17:05:05.118667+0000","last_active":"2024-05-20T17:05:10.129554+0000","last_peered":"2024-05-20T17:05:10.129554+0000","last_clean":"2024-05-20T17:05:10.129554+0000","last_became_active":"2024-05-20T17:05:05.118173+0000","last_became_peered":"2024-05-20T17:05:05.118173+0000","last_unstale":"2024-05-20T17:05:10.129554+0000","last_undegraded":"2024-05-20T17:05:10.129554+0000","last_fullsized":"2024-05-20T17:05:10.129554+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:14.658446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570041+0000","last_change":"2024-05-20T17:05:09.127806+0000","last_active":"2024-05-20T17:05:09.570041+0000","last_peered":"2024-05-20T17:05:09.570041+0000","last_clean":"2024-05-20T17:05:09.570041+0000","last_became_active":"2024-05-20T17:05:09.126739+0000","last_became_peered":"2024-05-20T17:05:09.126739+0000","last_unstale":"2024-05-20T17:05:09.570041+0000","last_undegraded":"2024-05-20T17:05:09.570041+0000","last_fullsized":"2024-05-20T17:05:09.570041+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:41:58.391763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.567924+0000","last_change":"2024-05-20T17:05:04.096955+0000","last_active":"2024-05-20T17:05:09.567924+0000","last_peered":"2024-05-20T17:05:09.567924+0000","last_clean":"2024-05-20T17:05:09.567924+0000","last_became_active":"2024-05-20T17:05:04.096467+0000","last_became_peered":"2024-05-20T17:05:04.096467+0000","last_unstale":"2024-05-20T17:05:09.567924+0000","last_undegraded":"2024-05-20T17:05:09.567924+0000","last_fullsized":"2024-05-20T17:05:09.567924+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:32:06.511617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129550+0000","last_change":"2024-05-20T17:05:05.106615+0000","last_active":"2024-05-20T17:05:10.129550+0000","last_peered":"2024-05-20T17:05:10.129550+0000","last_clean":"2024-05-20T17:05:10.129550+0000","last_became_active":"2024-05-20T17:05:05.106216+0000","last_became_peered":"2024-05-20T17:05:05.106216+0000","last_unstale":"2024-05-20T17:05:10.129550+0000","last_undegraded":"2024-05-20T17:05:10.129550+0000","last_fullsized":"2024-05-20T17:05:10.129550+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:32:10.920803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129580+0000","last_change":"2024-05-20T17:05:05.098027+0000","last_active":"2024-05-20T17:05:10.129580+0000","last_peered":"2024-05-20T17:05:10.129580+0000","last_clean":"2024-05-20T17:05:10.129580+0000","last_became_active":"2024-05-20T17:05:05.097639+0000","last_became_peered":"2024-05-20T17:05:05.097639+0000","last_unstale":"2024-05-20T17:05:10.129580+0000","last_undegraded":"2024-05-20T17:05:10.129580+0000","last_fullsized":"2024-05-20T17:05:10.129580+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:13:06.432459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129134+0000","last_change":"2024-05-20T17:05:05.101197+0000","last_active":"2024-05-20T17:05:10.129134+0000","last_peered":"2024-05-20T17:05:10.129134+0000","last_clean":"2024-05-20T17:05:10.129134+0000","last_became_active":"2024-05-20T17:05:05.100865+0000","last_became_peered":"2024-05-20T17:05:05.100865+0000","last_unstale":"2024-05-20T17:05:10.129134+0000","last_undegraded":"2024-05-20T17:05:10.129134+0000","last_fullsized":"2024-05-20T17:05:10.129134+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:57:28.892291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128276+0000","last_change":"2024-05-20T17:05:05.109529+0000","last_active":"2024-05-20T17:05:10.128276+0000","last_peered":"2024-05-20T17:05:10.128276+0000","last_clean":"2024-05-20T17:05:10.128276+0000","last_became_active":"2024-05-20T17:05:05.108332+0000","last_became_peered":"2024-05-20T17:05:05.108332+0000","last_unstale":"2024-05-20T17:05:10.128276+0000","last_undegraded":"2024-05-20T17:05:10.128276+0000","last_fullsized":"2024-05-20T17:05:10.128276+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:07.612296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.737054+0000","last_change":"2024-05-20T17:05:05.115602+0000","last_active":"2024-05-20T17:05:09.737054+0000","last_peered":"2024-05-20T17:05:09.737054+0000","last_clean":"2024-05-20T17:05:09.737054+0000","last_became_active":"2024-05-20T17:05:05.115250+0000","last_became_peered":"2024-05-20T17:05:05.115250+0000","last_unstale":"2024-05-20T17:05:09.737054+0000","last_undegraded":"2024-05-20T17:05:09.737054+0000","last_fullsized":"2024-05-20T17:05:09.737054+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:10:50.691956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.567908+0000","last_change":"2024-05-20T17:05:05.110528+0000","last_active":"2024-05-20T17:05:09.567908+0000","last_peered":"2024-05-20T17:05:09.567908+0000","last_clean":"2024-05-20T17:05:09.567908+0000","last_became_active":"2024-05-20T17:05:05.110158+0000","last_became_peered":"2024-05-20T17:05:05.110158+0000","last_unstale":"2024-05-20T17:05:09.567908+0000","last_undegraded":"2024-05-20T17:05:09.567908+0000","last_fullsized":"2024-05-20T17:05:09.567908+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:58:15.143026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129355+0000","last_change":"2024-05-20T17:05:05.094890+0000","last_active":"2024-05-20T17:05:10.129355+0000","last_peered":"2024-05-20T17:05:10.129355+0000","last_clean":"2024-05-20T17:05:10.129355+0000","last_became_active":"2024-05-20T17:05:05.094452+0000","last_became_peered":"2024-05-20T17:05:05.094452+0000","last_unstale":"2024-05-20T17:05:10.129355+0000","last_undegraded":"2024-05-20T17:05:10.129355+0000","last_fullsized":"2024-05-20T17:05:10.129355+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:34:00.182526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.129465+0000","last_change":"2024-05-20T17:05:05.088916+0000","last_active":"2024-05-20T17:05:10.129465+0000","last_peered":"2024-05-20T17:05:10.129465+0000","last_clean":"2024-05-20T17:05:10.129465+0000","last_became_active":"2024-05-20T17:05:05.088257+0000","last_became_peered":"2024-05-20T17:05:05.088257+0000","last_unstale":"2024-05-20T17:05:10.129465+0000","last_undegraded":"2024-05-20T17:05:10.129465+0000","last_fullsized":"2024-05-20T17:05:10.129465+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:43:51.310579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128938+0000","last_change":"2024-05-20T17:05:05.110019+0000","last_active":"2024-05-20T17:05:10.128938+0000","last_peered":"2024-05-20T17:05:10.128938+0000","last_clean":"2024-05-20T17:05:10.128938+0000","last_became_active":"2024-05-20T17:05:05.109567+0000","last_became_peered":"2024-05-20T17:05:05.109567+0000","last_unstale":"2024-05-20T17:05:10.128938+0000","last_undegraded":"2024-05-20T17:05:10.128938+0000","last_fullsized":"2024-05-20T17:05:10.128938+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:21:21.712166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.570362+0000","last_change":"2024-05-20T17:05:05.105421+0000","last_active":"2024-05-20T17:05:09.570362+0000","last_peered":"2024-05-20T17:05:09.570362+0000","last_clean":"2024-05-20T17:05:09.570362+0000","last_became_active":"2024-05-20T17:05:05.105086+0000","last_became_peered":"2024-05-20T17:05:05.105086+0000","last_unstale":"2024-05-20T17:05:09.570362+0000","last_undegraded":"2024-05-20T17:05:09.570362+0000","last_fullsized":"2024-05-20T17:05:09.570362+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:56:07.257884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128585+0000","last_change":"2024-05-20T17:05:05.108394+0000","last_active":"2024-05-20T17:05:10.128585+0000","last_peered":"2024-05-20T17:05:10.128585+0000","last_clean":"2024-05-20T17:05:10.128585+0000","last_became_active":"2024-05-20T17:05:05.108003+0000","last_became_peered":"2024-05-20T17:05:05.108003+0000","last_unstale":"2024-05-20T17:05:10.128585+0000","last_undegraded":"2024-05-20T17:05:10.128585+0000","last_fullsized":"2024-05-20T17:05:10.128585+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:38.476660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.569616+0000","last_change":"2024-05-20T17:05:05.116825+0000","last_active":"2024-05-20T17:05:09.569616+0000","last_peered":"2024-05-20T17:05:09.569616+0000","last_clean":"2024-05-20T17:05:09.569616+0000","last_became_active":"2024-05-20T17:05:05.116366+0000","last_became_peered":"2024-05-20T17:05:05.116366+0000","last_unstale":"2024-05-20T17:05:09.569616+0000","last_undegraded":"2024-05-20T17:05:09.569616+0000","last_fullsized":"2024-05-20T17:05:09.569616+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:23:19.711036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:09.567653+0000","last_change":"2024-05-20T17:05:05.106896+0000","last_active":"2024-05-20T17:05:09.567653+0000","last_peered":"2024-05-20T17:05:09.567653+0000","last_clean":"2024-05-20T17:05:09.567653+0000","last_became_active":"2024-05-20T17:05:05.106514+0000","last_became_peered":"2024-05-20T17:05:05.106514+0000","last_unstale":"2024-05-20T17:05:09.567653+0000","last_undegraded":"2024-05-20T17:05:09.567653+0000","last_fullsized":"2024-05-20T17:05:09.567653+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:08:22.235321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-05-20T17:05:10.128582+0000","last_change":"2024-05-20T17:05:05.110071+0000","last_active":"2024-05-20T17:05:10.128582+0000","last_peered":"2024-05-20T17:05:10.128582+0000","last_clean":"2024-05-20T17:05:10.128582+0000","last_became_active":"2024-05-20T17:05:05.109703+0000","last_became_peered":"2024-05-20T17:05:05.109703+0000","last_unstale":"2024-05-20T17:05:10.128582+0000","last_undegraded":"2024-05-20T17:05:10.128582+0000","last_fullsized":"2024-05-20T17:05:10.128582+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:41:46.858191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7010,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":149,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":59170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350995,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":991232,"data_stored":480266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612632,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1630208,"data_stored":1076054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776157,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":481050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037796,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1024000,"data_stored":481766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299432,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28580,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716572,"statfs":{"total":95995035648,"available":95965769728,"internally_reserved":0,"allocated":1601536,"data_stored":1072426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462957,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":480356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":1003520,"data_stored":484108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738445,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":1003520,"data_stored":480960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411394,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":505770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149758,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":480674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888120,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":995328,"data_stored":480288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724595,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32740,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712412,"statfs":{"total":95995035648,"available":95961509888,"internally_reserved":0,"allocated":1597440,"data_stored":1070816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":42834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":5544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:05:37.528 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-20T17:05:37.528 INFO:tasks.cephadm:Setting up client nodes... 2024-05-20T17:05:37.529 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-20T17:05:37.815 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:05:37.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:37 smithi171 ceph-mon[35901]: pgmap v317: 129 pgs: 129 active+clean; 583 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-05-20T17:05:37.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:37 smithi171 ceph-mon[35901]: from='client.24773 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:05:37.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:37 smithi171 ceph-mon[35901]: mgrmap e17: x(active, since 7m), standbys: y, z 2024-05-20T17:05:37.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:37 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/338426441' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:37.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:37 smithi006 ceph-mon[32486]: pgmap v317: 129 pgs: 129 active+clean; 583 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-05-20T17:05:37.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:37 smithi006 ceph-mon[32486]: from='client.24773 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:05:37.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:37 smithi006 ceph-mon[32486]: mgrmap e17: x(active, since 7m), standbys: y, z 2024-05-20T17:05:37.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:37 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/338426441' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:38.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:37 smithi062 ceph-mon[35425]: pgmap v317: 129 pgs: 129 active+clean; 583 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-05-20T17:05:38.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:37 smithi062 ceph-mon[35425]: from='client.24773 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:05:38.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:37 smithi062 ceph-mon[35425]: mgrmap e17: x(active, since 7m), standbys: y, z 2024-05-20T17:05:38.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:37 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/338426441' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:38.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:38 smithi171 ceph-mon[35901]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:05:38.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:38 smithi171 ceph-mon[35901]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:05:38.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:38 smithi006 ceph-mon[32486]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:05:38.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:38 smithi006 ceph-mon[32486]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:05:39.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:38 smithi062 ceph-mon[35425]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:05:39.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:38 smithi062 ceph-mon[35425]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:05:39.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:39 smithi006 ceph-mon[32486]: pgmap v318: 129 pgs: 129 active+clean; 586 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.2 KiB/s wr, 17 op/s 2024-05-20T17:05:39.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.770+0000 7f2bd6707700 1 -- 172.21.15.6:0/2522166386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd0104320 msgr2=0x7f2bd0104730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:39.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.770+0000 7f2bd6707700 1 --2- 172.21.15.6:0/2522166386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd0104320 0x7f2bd0104730 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4009990 tx=0x7f2bc4009ca0 comp rx=0 tx=0).stop 2024-05-20T17:05:39.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.770+0000 7f2bd6707700 1 -- 172.21.15.6:0/2522166386 shutdown_connections 2024-05-20T17:05:39.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.770+0000 7f2bd6707700 1 --2- 172.21.15.6:0/2522166386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bd0104cc0 0x7f2bd010b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:39.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.770+0000 7f2bd6707700 1 --2- 172.21.15.6:0/2522166386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bd01031f0 0x7f2bd0103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:39.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.770+0000 7f2bd6707700 1 --2- 172.21.15.6:0/2522166386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd0104320 0x7f2bd0104730 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:39.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.770+0000 7f2bd6707700 1 -- 172.21.15.6:0/2522166386 >> 172.21.15.6:0/2522166386 conn(0x7f2bd00fe850 msgr2=0x7f2bd0100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:39.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.770+0000 7f2bd6707700 1 -- 172.21.15.6:0/2522166386 shutdown_connections 2024-05-20T17:05:39.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.770+0000 7f2bd6707700 1 -- 172.21.15.6:0/2522166386 wait complete. 2024-05-20T17:05:39.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.771+0000 7f2bd6707700 1 Processor -- start 2024-05-20T17:05:39.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.771+0000 7f2bd6707700 1 -- start start 2024-05-20T17:05:39.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.771+0000 7f2bd6707700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bd01031f0 0x7f2bd01997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:39.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.771+0000 7f2bd6707700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bd0104320 0x7f2bd0199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:39.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.771+0000 7f2bd6707700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd0104cc0 0x7f2bd01a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:39.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.771+0000 7f2bd6707700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd010eca0 con 0x7f2bd0104cc0 2024-05-20T17:05:39.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.771+0000 7f2bd6707700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd010eb20 con 0x7f2bd01031f0 2024-05-20T17:05:39.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.771+0000 7f2bd6707700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd010ee20 con 0x7f2bd0104320 2024-05-20T17:05:39.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.771+0000 7f2bd4ca4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd0104cc0 0x7f2bd01a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:39.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.772+0000 7f2bd4ca4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd0104cc0 0x7f2bd01a0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60322/0 (socket says 172.21.15.6:60322) 2024-05-20T17:05:39.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.772+0000 7f2bd4ca4700 1 -- 172.21.15.6:0/931525340 learned_addr learned my addr 172.21.15.6:0/931525340 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:39.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.772+0000 7f2bcffff700 1 --2- 172.21.15.6:0/931525340 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bd01031f0 0x7f2bd01997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:39.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.772+0000 7f2bcf7fe700 1 --2- 172.21.15.6:0/931525340 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bd0104320 0x7f2bd0199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:39.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.772+0000 7f2bd4ca4700 1 -- 172.21.15.6:0/931525340 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bd0104320 msgr2=0x7f2bd0199d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:39.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.772+0000 7f2bd4ca4700 1 --2- 172.21.15.6:0/931525340 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bd0104320 0x7f2bd0199d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:39.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.772+0000 7f2bd4ca4700 1 -- 172.21.15.6:0/931525340 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bd01031f0 msgr2=0x7f2bd01997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:39.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.772+0000 7f2bd4ca4700 1 --2- 172.21.15.6:0/931525340 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bd01031f0 0x7f2bd01997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:39.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.772+0000 7f2bd4ca4700 1 -- 172.21.15.6:0/931525340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd01a1320 con 0x7f2bd0104cc0 2024-05-20T17:05:39.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.772+0000 7f2bd4ca4700 1 --2- 172.21.15.6:0/931525340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd0104cc0 0x7f2bd01a0ca0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8007ee0 tx=0x7f2bc800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:39.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.772+0000 7f2bcd7fa700 1 -- 172.21.15.6:0/931525340 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8004bb0 con 0x7f2bd0104cc0 2024-05-20T17:05:39.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.772+0000 7f2bd6707700 1 -- 172.21.15.6:0/931525340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd01a1610 con 0x7f2bd0104cc0 2024-05-20T17:05:39.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.772+0000 7f2bcd7fa700 1 -- 172.21.15.6:0/931525340 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2bc8004d50 con 0x7f2bd0104cc0 2024-05-20T17:05:39.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.772+0000 7f2bcd7fa700 1 -- 172.21.15.6:0/931525340 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80058e0 con 0x7f2bd0104cc0 2024-05-20T17:05:39.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.772+0000 7f2bd6707700 1 -- 172.21.15.6:0/931525340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd01a1b50 con 0x7f2bd0104cc0 2024-05-20T17:05:39.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.773+0000 7f2bd6707700 1 -- 172.21.15.6:0/931525340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bd0050170 con 0x7f2bd0104cc0 2024-05-20T17:05:39.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.776+0000 7f2bcd7fa700 1 -- 172.21.15.6:0/931525340 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f2bc801a020 con 0x7f2bd0104cc0 2024-05-20T17:05:39.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.776+0000 7f2bcd7fa700 1 --2- 172.21.15.6:0/931525340 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2bb80a2cb0 0x7f2bb80a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:39.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.776+0000 7f2bcffff700 1 --2- 172.21.15.6:0/931525340 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2bb80a2cb0 0x7f2bb80a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:39.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.777+0000 7f2bcd7fa700 1 -- 172.21.15.6:0/931525340 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f2bc80cf130 con 0x7f2bd0104cc0 2024-05-20T17:05:39.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.777+0000 7f2bcffff700 1 --2- 172.21.15.6:0/931525340 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2bb80a2cb0 0x7f2bb80a51c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0104220 tx=0x7f2bc0007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:39.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:39.780+0000 7f2bcd7fa700 1 -- 172.21.15.6:0/931525340 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2bc8010070 con 0x7f2bd0104cc0 2024-05-20T17:05:39.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:39 smithi171 ceph-mon[35901]: pgmap v318: 129 pgs: 129 active+clean; 586 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.2 KiB/s wr, 17 op/s 2024-05-20T17:05:40.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:39 smithi062 ceph-mon[35425]: pgmap v318: 129 pgs: 129 active+clean; 586 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.2 KiB/s wr, 17 op/s 2024-05-20T17:05:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:40.077+0000 7f2bd6707700 1 -- 172.21.15.6:0/931525340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f2bd002dc60 con 0x7f2bd0104cc0 2024-05-20T17:05:40.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:40.080+0000 7f2bcd7fa700 1 -- 172.21.15.6:0/931525340 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f2bc809bcf0 con 0x7f2bd0104cc0 2024-05-20T17:05:40.079 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-05-20T17:05:40.079 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDkgktmeiClBBAAvNmdiXpxB/W16k0B1qKiJg== 2024-05-20T17:05:40.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:40.082+0000 7f2bd6707700 1 -- 172.21.15.6:0/931525340 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2bb80a2cb0 msgr2=0x7f2bb80a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:40.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:40.082+0000 7f2bd6707700 1 --2- 172.21.15.6:0/931525340 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2bb80a2cb0 0x7f2bb80a51c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0104220 tx=0x7f2bc0007400 comp rx=0 tx=0).stop 2024-05-20T17:05:40.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:40.082+0000 7f2bd6707700 1 -- 172.21.15.6:0/931525340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd0104cc0 msgr2=0x7f2bd01a0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:40.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:40.082+0000 7f2bd6707700 1 --2- 172.21.15.6:0/931525340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd0104cc0 0x7f2bd01a0ca0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8007ee0 tx=0x7f2bc800d3b0 comp rx=0 tx=0).stop 2024-05-20T17:05:40.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:40.082+0000 7f2bd6707700 1 -- 172.21.15.6:0/931525340 shutdown_connections 2024-05-20T17:05:40.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:40.082+0000 7f2bd6707700 1 --2- 172.21.15.6:0/931525340 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2bb80a2cb0 0x7f2bb80a51c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:40.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:40.082+0000 7f2bd6707700 1 --2- 172.21.15.6:0/931525340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd0104cc0 0x7f2bd01a0ca0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:40.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:40.082+0000 7f2bd6707700 1 --2- 172.21.15.6:0/931525340 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bd01031f0 0x7f2bd01997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:40.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:40.082+0000 7f2bd6707700 1 --2- 172.21.15.6:0/931525340 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bd0104320 0x7f2bd0199d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:40.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:40.082+0000 7f2bd6707700 1 -- 172.21.15.6:0/931525340 >> 172.21.15.6:0/931525340 conn(0x7f2bd00fe850 msgr2=0x7f2bd0107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:40.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:40.083+0000 7f2bd6707700 1 -- 172.21.15.6:0/931525340 shutdown_connections 2024-05-20T17:05:40.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:40.083+0000 7f2bd6707700 1 -- 172.21.15.6:0/931525340 wait complete. 2024-05-20T17:05:40.858 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:40 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/931525340' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-20T17:05:40.858 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:40 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/931525340' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-20T17:05:40.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:40 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/931525340' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-20T17:05:40.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:40 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/931525340' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-20T17:05:40.886 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:05:40.887 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-20T17:05:40.887 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-20T17:05:40.926 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-20T17:05:40.927 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-20T17:05:40.927 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph mgr dump --format=json 2024-05-20T17:05:41.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:40 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/931525340' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-20T17:05:41.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:40 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/931525340' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-20T17:05:41.223 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:05:41.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:41 smithi171 ceph-mon[35901]: pgmap v319: 129 pgs: 129 active+clean; 623 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.7 KiB/s wr, 21 op/s 2024-05-20T17:05:41.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:41 smithi006 ceph-mon[32486]: pgmap v319: 129 pgs: 129 active+clean; 623 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.7 KiB/s wr, 21 op/s 2024-05-20T17:05:42.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:41 smithi062 ceph-mon[35425]: pgmap v319: 129 pgs: 129 active+clean; 623 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.7 KiB/s wr, 21 op/s 2024-05-20T17:05:42.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-05-20T17:05:42.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-05-20T17:05:42.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-05-20T17:05:42.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]: dispatch 2024-05-20T17:05:42.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-05-20T17:05:42.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-05-20T17:05:42.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-05-20T17:05:42.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-05-20T17:05:42.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-05-20T17:05:42.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 10]}]: dispatch 2024-05-20T17:05:42.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-05-20T17:05:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-05-20T17:05:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-05-20T17:05:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]: dispatch 2024-05-20T17:05:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-05-20T17:05:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-05-20T17:05:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-05-20T17:05:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-05-20T17:05:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-05-20T17:05:42.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 10]}]: dispatch 2024-05-20T17:05:43.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-05-20T17:05:43.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-05-20T17:05:43.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-05-20T17:05:43.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]: dispatch 2024-05-20T17:05:43.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-05-20T17:05:43.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-05-20T17:05:43.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-05-20T17:05:43.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-05-20T17:05:43.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-05-20T17:05:43.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 10]}]: dispatch 2024-05-20T17:05:43.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.045+0000 7fd44bfba700 1 -- 172.21.15.6:0/2637046864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd444102340 msgr2=0x7fd444102750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:43.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.045+0000 7fd44bfba700 1 --2- 172.21.15.6:0/2637046864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd444102340 0x7fd444102750 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd4400099c0 tx=0x7fd440009cd0 comp rx=0 tx=0).stop 2024-05-20T17:05:43.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.045+0000 7fd44bfba700 1 -- 172.21.15.6:0/2637046864 shutdown_connections 2024-05-20T17:05:43.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.045+0000 7fd44bfba700 1 --2- 172.21.15.6:0/2637046864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4441075c0 0x7fd44410ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:43.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.045+0000 7fd44bfba700 1 --2- 172.21.15.6:0/2637046864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd444102340 0x7fd444102750 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:43.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.045+0000 7fd44bfba700 1 --2- 172.21.15.6:0/2637046864 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd444106c70 0x7fd444107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:43.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.045+0000 7fd44bfba700 1 -- 172.21.15.6:0/2637046864 >> 172.21.15.6:0/2637046864 conn(0x7fd4440fdc70 msgr2=0x7fd444100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:43.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.045+0000 7fd44bfba700 1 -- 172.21.15.6:0/2637046864 shutdown_connections 2024-05-20T17:05:43.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.045+0000 7fd44bfba700 1 -- 172.21.15.6:0/2637046864 wait complete. 2024-05-20T17:05:43.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.046+0000 7fd44bfba700 1 Processor -- start 2024-05-20T17:05:43.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.046+0000 7fd44bfba700 1 -- start start 2024-05-20T17:05:43.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.046+0000 7fd44bfba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd444102340 0x7fd44419f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:43.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.046+0000 7fd44bfba700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd444106c70 0x7fd44419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:43.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.046+0000 7fd44bfba700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4441075c0 0x7fd444199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:43.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.046+0000 7fd44bfba700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd4441121f0 con 0x7fd444102340 2024-05-20T17:05:43.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.046+0000 7fd44bfba700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd444112070 con 0x7fd444106c70 2024-05-20T17:05:43.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.047+0000 7fd44bfba700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd444112370 con 0x7fd4441075c0 2024-05-20T17:05:43.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.047+0000 7fd449d56700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd444102340 0x7fd44419f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:43.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.047+0000 7fd449d56700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd444102340 0x7fd44419f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39178/0 (socket says 172.21.15.6:39178) 2024-05-20T17:05:43.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.047+0000 7fd449d56700 1 -- 172.21.15.6:0/1632235205 learned_addr learned my addr 172.21.15.6:0/1632235205 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:43.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.047+0000 7fd449555700 1 --2- 172.21.15.6:0/1632235205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd444106c70 0x7fd44419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:43.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.047+0000 7fd44a557700 1 --2- 172.21.15.6:0/1632235205 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4441075c0 0x7fd444199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:43.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.047+0000 7fd449d56700 1 -- 172.21.15.6:0/1632235205 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4441075c0 msgr2=0x7fd444199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:43.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.047+0000 7fd449d56700 1 --2- 172.21.15.6:0/1632235205 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4441075c0 0x7fd444199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:43.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.047+0000 7fd449d56700 1 -- 172.21.15.6:0/1632235205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd444106c70 msgr2=0x7fd44419fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:43.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.047+0000 7fd449d56700 1 --2- 172.21.15.6:0/1632235205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd444106c70 0x7fd44419fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.047+0000 7fd449d56700 1 -- 172.21.15.6:0/1632235205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44419a150 con 0x7fd444102340 2024-05-20T17:05:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.047+0000 7fd449555700 1 --2- 172.21.15.6:0/1632235205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd444106c70 0x7fd44419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:05:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.047+0000 7fd449d56700 1 --2- 172.21.15.6:0/1632235205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd444102340 0x7fd44419f880 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd440006010 tx=0x7fd4400055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.047+0000 7fd43affd700 1 -- 172.21.15.6:0/1632235205 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440026070 con 0x7fd444102340 2024-05-20T17:05:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.047+0000 7fd44bfba700 1 -- 172.21.15.6:0/1632235205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd44419a3e0 con 0x7fd444102340 2024-05-20T17:05:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.047+0000 7fd43affd700 1 -- 172.21.15.6:0/1632235205 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd44000f460 con 0x7fd444102340 2024-05-20T17:05:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.047+0000 7fd43affd700 1 -- 172.21.15.6:0/1632235205 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440009e60 con 0x7fd444102340 2024-05-20T17:05:43.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.048+0000 7fd44bfba700 1 -- 172.21.15.6:0/1632235205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4441a6710 con 0x7fd444102340 2024-05-20T17:05:43.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.048+0000 7fd44bfba700 1 -- 172.21.15.6:0/1632235205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd444050170 con 0x7fd444102340 2024-05-20T17:05:43.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.050+0000 7fd43affd700 1 -- 172.21.15.6:0/1632235205 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fd440029070 con 0x7fd444102340 2024-05-20T17:05:43.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.051+0000 7fd43affd700 1 --2- 172.21.15.6:0/1632235205 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd4300a2cb0 0x7fd4300a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:43.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.051+0000 7fd449555700 1 --2- 172.21.15.6:0/1632235205 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd4300a2cb0 0x7fd4300a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:43.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.051+0000 7fd43affd700 1 -- 172.21.15.6:0/1632235205 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9092+0+0 (secure 0 0 0) 0x7fd4400d0240 con 0x7fd444102340 2024-05-20T17:05:43.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.051+0000 7fd449555700 1 --2- 172.21.15.6:0/1632235205 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd4300a2cb0 0x7fd4300a51c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd444105490 tx=0x7fd43400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:43.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.055+0000 7fd43affd700 1 -- 172.21.15.6:0/1632235205 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd440030080 con 0x7fd444102340 2024-05-20T17:05:43.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.323+0000 7fd44bfba700 1 -- 172.21.15.6:0/1632235205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fd44402dc60 con 0x7fd444102340 2024-05-20T17:05:43.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.328+0000 7fd43affd700 1 -- 172.21.15.6:0/1632235205 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263190 (secure 0 0 0) 0x7fd440013070 con 0x7fd444102340 2024-05-20T17:05:43.328 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:05:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.331+0000 7fd44bfba700 1 -- 172.21.15.6:0/1632235205 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd4300a2cb0 msgr2=0x7fd4300a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.331+0000 7fd44bfba700 1 --2- 172.21.15.6:0/1632235205 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd4300a2cb0 0x7fd4300a51c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd444105490 tx=0x7fd43400b410 comp rx=0 tx=0).stop 2024-05-20T17:05:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.331+0000 7fd44bfba700 1 -- 172.21.15.6:0/1632235205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd444102340 msgr2=0x7fd44419f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.331+0000 7fd44bfba700 1 --2- 172.21.15.6:0/1632235205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd444102340 0x7fd44419f880 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd440006010 tx=0x7fd4400055f0 comp rx=0 tx=0).stop 2024-05-20T17:05:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.331+0000 7fd44bfba700 1 -- 172.21.15.6:0/1632235205 shutdown_connections 2024-05-20T17:05:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.331+0000 7fd44bfba700 1 --2- 172.21.15.6:0/1632235205 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd4300a2cb0 0x7fd4300a51c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.331+0000 7fd44bfba700 1 --2- 172.21.15.6:0/1632235205 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4441075c0 0x7fd444199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.331+0000 7fd44bfba700 1 --2- 172.21.15.6:0/1632235205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd444102340 0x7fd44419f880 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.331+0000 7fd44bfba700 1 --2- 172.21.15.6:0/1632235205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd444106c70 0x7fd44419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.331+0000 7fd44bfba700 1 -- 172.21.15.6:0/1632235205 >> 172.21.15.6:0/1632235205 conn(0x7fd4440fdc70 msgr2=0x7fd444074ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.331+0000 7fd44bfba700 1 -- 172.21.15.6:0/1632235205 shutdown_connections 2024-05-20T17:05:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:43.331+0000 7fd44bfba700 1 -- 172.21.15.6:0/1632235205 wait complete. 2024-05-20T17:05:43.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:43 smithi006 ceph-mon[32486]: pgmap v320: 129 pgs: 129 active+clean; 623 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.7 KiB/s wr, 22 op/s 2024-05-20T17:05:43.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-05-20T17:05:43.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-05-20T17:05:43.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-05-20T17:05:43.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-05-20T17:05:43.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-05-20T17:05:43.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-05-20T17:05:43.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-05-20T17:05:43.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-05-20T17:05:43.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-05-20T17:05:43.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 10]}]': finished 2024-05-20T17:05:43.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:43 smithi006 ceph-mon[32486]: osdmap e91: 12 total, 12 up, 12 in 2024-05-20T17:05:43.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:43 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1632235205' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-20T17:05:44.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:43 smithi062 ceph-mon[35425]: pgmap v320: 129 pgs: 129 active+clean; 623 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.7 KiB/s wr, 22 op/s 2024-05-20T17:05:44.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-05-20T17:05:44.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-05-20T17:05:44.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-05-20T17:05:44.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-05-20T17:05:44.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-05-20T17:05:44.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-05-20T17:05:44.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-05-20T17:05:44.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-05-20T17:05:44.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-05-20T17:05:44.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 10]}]': finished 2024-05-20T17:05:44.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:43 smithi062 ceph-mon[35425]: osdmap e91: 12 total, 12 up, 12 in 2024-05-20T17:05:44.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:43 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1632235205' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-20T17:05:44.099 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3244338052},{"type":"v1","addr":"172.21.15.6:6801","nonce":3244338052}]},"active_addr":"172.21.15.6:6801/3244338052","active_change":"2024-05-20T16:57:41.985885+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.6:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":953728063}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":3438686756}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":3635737455}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":1135171957}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":668852812}]}]} 2024-05-20T17:05:44.105 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-20T17:05:44.105 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-20T17:05:44.105 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph osd dump --format=json 2024-05-20T17:05:44.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:43 smithi171 ceph-mon[35901]: pgmap v320: 129 pgs: 129 active+clean; 623 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.7 KiB/s wr, 22 op/s 2024-05-20T17:05:44.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-05-20T17:05:44.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-05-20T17:05:44.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-05-20T17:05:44.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-05-20T17:05:44.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-05-20T17:05:44.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-05-20T17:05:44.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-05-20T17:05:44.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-05-20T17:05:44.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-05-20T17:05:44.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 10]}]': finished 2024-05-20T17:05:44.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:43 smithi171 ceph-mon[35901]: osdmap e91: 12 total, 12 up, 12 in 2024-05-20T17:05:44.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:43 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1632235205' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-20T17:05:44.360 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:05:44.771 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:44 smithi006 ceph-mon[32486]: osdmap e92: 12 total, 12 up, 12 in 2024-05-20T17:05:45.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:44 smithi062 ceph-mon[35425]: osdmap e92: 12 total, 12 up, 12 in 2024-05-20T17:05:45.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:44 smithi171 ceph-mon[35901]: osdmap e92: 12 total, 12 up, 12 in 2024-05-20T17:05:45.836 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:45 smithi006 ceph-mon[32486]: pgmap v323: 129 pgs: 129 active+clean; 628 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 KiB/s wr, 23 op/s 2024-05-20T17:05:46.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:45 smithi062 ceph-mon[35425]: pgmap v323: 129 pgs: 129 active+clean; 628 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 KiB/s wr, 23 op/s 2024-05-20T17:05:46.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:45 smithi171 ceph-mon[35901]: pgmap v323: 129 pgs: 129 active+clean; 628 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 KiB/s wr, 23 op/s 2024-05-20T17:05:46.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.202+0000 7f00198f7700 1 -- 172.21.15.6:0/557789684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0014104c30 msgr2=0x7f001410d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:46.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.202+0000 7f00198f7700 1 --2- 172.21.15.6:0/557789684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0014104c30 0x7f001410d180 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efffc009990 tx=0x7efffc009ca0 comp rx=0 tx=0).stop 2024-05-20T17:05:46.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.202+0000 7f00198f7700 1 -- 172.21.15.6:0/557789684 shutdown_connections 2024-05-20T17:05:46.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.202+0000 7f00198f7700 1 --2- 172.21.15.6:0/557789684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f001410d750 0x7f001410fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:46.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.202+0000 7f00198f7700 1 --2- 172.21.15.6:0/557789684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00141042e0 0x7f00141046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:46.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.202+0000 7f00198f7700 1 --2- 172.21.15.6:0/557789684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0014104c30 0x7f001410d180 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:46.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.202+0000 7f00198f7700 1 -- 172.21.15.6:0/557789684 >> 172.21.15.6:0/557789684 conn(0x7f00140fdc70 msgr2=0x7f0014100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:46.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.202+0000 7f00198f7700 1 -- 172.21.15.6:0/557789684 shutdown_connections 2024-05-20T17:05:46.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.203+0000 7f00198f7700 1 -- 172.21.15.6:0/557789684 wait complete. 2024-05-20T17:05:46.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.203+0000 7f00198f7700 1 Processor -- start 2024-05-20T17:05:46.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.203+0000 7f00198f7700 1 -- start start 2024-05-20T17:05:46.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.204+0000 7f00198f7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00141042e0 0x7f001419f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:46.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.204+0000 7f00198f7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0014104c30 0x7f001419fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:46.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.204+0000 7f00198f7700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f001410d750 0x7f0014199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:46.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.204+0000 7f00198f7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f00141132e0 con 0x7f00141042e0 2024-05-20T17:05:46.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.204+0000 7f00198f7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0014113160 con 0x7f0014104c30 2024-05-20T17:05:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.204+0000 7f00198f7700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0014113460 con 0x7f001410d750 2024-05-20T17:05:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.204+0000 7f0012ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00141042e0 0x7f001419f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.204+0000 7f0012ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00141042e0 0x7f001419f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39190/0 (socket says 172.21.15.6:39190) 2024-05-20T17:05:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.204+0000 7f0012ffd700 1 -- 172.21.15.6:0/3498400778 learned_addr learned my addr 172.21.15.6:0/3498400778 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.204+0000 7f00127fc700 1 --2- 172.21.15.6:0/3498400778 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0014104c30 0x7f001419fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.204+0000 7f00137fe700 1 --2- 172.21.15.6:0/3498400778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f001410d750 0x7f0014199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.204+0000 7f0012ffd700 1 -- 172.21.15.6:0/3498400778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f001410d750 msgr2=0x7f0014199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.204+0000 7f0012ffd700 1 --2- 172.21.15.6:0/3498400778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f001410d750 0x7f0014199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.204+0000 7f0012ffd700 1 -- 172.21.15.6:0/3498400778 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0014104c30 msgr2=0x7f001419fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.204+0000 7f0012ffd700 1 --2- 172.21.15.6:0/3498400778 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0014104c30 0x7f001419fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.204+0000 7f0012ffd700 1 -- 172.21.15.6:0/3498400778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001419a150 con 0x7f00141042e0 2024-05-20T17:05:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.204+0000 7f0012ffd700 1 --2- 172.21.15.6:0/3498400778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00141042e0 0x7f001419f8a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0004007ee0 tx=0x7f000400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.205+0000 7f00188f5700 1 -- 172.21.15.6:0/3498400778 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000401a070 con 0x7f00141042e0 2024-05-20T17:05:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.205+0000 7f00188f5700 1 -- 172.21.15.6:0/3498400778 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f000400ddd0 con 0x7f00141042e0 2024-05-20T17:05:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.205+0000 7f00198f7700 1 -- 172.21.15.6:0/3498400778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f001419a440 con 0x7f00141042e0 2024-05-20T17:05:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.205+0000 7f00188f5700 1 -- 172.21.15.6:0/3498400778 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0004014710 con 0x7f00141042e0 2024-05-20T17:05:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.205+0000 7f00198f7700 1 -- 172.21.15.6:0/3498400778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00141a6750 con 0x7f00141042e0 2024-05-20T17:05:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.206+0000 7f00198f7700 1 -- 172.21.15.6:0/3498400778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0014050170 con 0x7f00141042e0 2024-05-20T17:05:46.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.207+0000 7f00188f5700 1 -- 172.21.15.6:0/3498400778 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f000401d070 con 0x7f00141042e0 2024-05-20T17:05:46.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.208+0000 7f00188f5700 1 --2- 172.21.15.6:0/3498400778 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f00000a2cb0 0x7f00000a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:46.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.208+0000 7f00127fc700 1 --2- 172.21.15.6:0/3498400778 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f00000a2cb0 0x7f00000a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:46.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.208+0000 7f00188f5700 1 -- 172.21.15.6:0/3498400778 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f00040cf320 con 0x7f00141042e0 2024-05-20T17:05:46.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.208+0000 7f00127fc700 1 --2- 172.21.15.6:0/3498400778 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f00000a2cb0 0x7f00000a51c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efffc00b5c0 tx=0x7efffc005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:46.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.211+0000 7f00188f5700 1 -- 172.21.15.6:0/3498400778 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0004010070 con 0x7f00141042e0 2024-05-20T17:05:46.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.417+0000 7f00198f7700 1 -- 172.21.15.6:0/3498400778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f001419afd0 con 0x7f00141042e0 2024-05-20T17:05:46.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.419+0000 7f00188f5700 1 -- 172.21.15.6:0/3498400778 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24443 (secure 0 0 0) 0x7f000409be60 con 0x7f00141042e0 2024-05-20T17:05:46.419 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:05:46.420 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":92,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:05:43.615360+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:05:02.947896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:05:03.842231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:05:07.551471+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:05:46.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.421+0000 7f00198f7700 1 -- 172.21.15.6:0/3498400778 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f00000a2cb0 msgr2=0x7f00000a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:46.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.421+0000 7f00198f7700 1 --2- 172.21.15.6:0/3498400778 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f00000a2cb0 0x7f00000a51c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efffc00b5c0 tx=0x7efffc005960 comp rx=0 tx=0).stop 2024-05-20T17:05:46.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.421+0000 7f00198f7700 1 -- 172.21.15.6:0/3498400778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00141042e0 msgr2=0x7f001419f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:46.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.421+0000 7f00198f7700 1 --2- 172.21.15.6:0/3498400778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00141042e0 0x7f001419f8a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0004007ee0 tx=0x7f000400d3b0 comp rx=0 tx=0).stop 2024-05-20T17:05:46.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.421+0000 7f00198f7700 1 -- 172.21.15.6:0/3498400778 shutdown_connections 2024-05-20T17:05:46.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.421+0000 7f00198f7700 1 --2- 172.21.15.6:0/3498400778 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f00000a2cb0 0x7f00000a51c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:46.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.421+0000 7f00198f7700 1 --2- 172.21.15.6:0/3498400778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f001410d750 0x7f0014199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:46.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.421+0000 7f00198f7700 1 --2- 172.21.15.6:0/3498400778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00141042e0 0x7f001419f8a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:46.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.421+0000 7f00198f7700 1 --2- 172.21.15.6:0/3498400778 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0014104c30 0x7f001419fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:46.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.421+0000 7f00198f7700 1 -- 172.21.15.6:0/3498400778 >> 172.21.15.6:0/3498400778 conn(0x7f00140fdc70 msgr2=0x7f00140fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:46.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.421+0000 7f00198f7700 1 -- 172.21.15.6:0/3498400778 shutdown_connections 2024-05-20T17:05:46.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:46.421+0000 7f00198f7700 1 -- 172.21.15.6:0/3498400778 wait complete. 2024-05-20T17:05:47.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:46 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3498400778' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:47.077 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:46 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3498400778' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:47.107 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-20T17:05:47.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph osd dump --format=json 2024-05-20T17:05:47.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:46 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3498400778' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:47.358 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:05:47.755 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:47 smithi006 ceph-mon[32486]: pgmap v324: 129 pgs: 129 active+clean; 628 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:05:48.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:47 smithi062 ceph-mon[35425]: pgmap v324: 129 pgs: 129 active+clean; 628 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:05:48.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:47 smithi171 ceph-mon[35901]: pgmap v324: 129 pgs: 129 active+clean; 628 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:05:49.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.126+0000 7f318a506700 1 -- 172.21.15.6:0/4152607448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318410d750 msgr2=0x7f318410fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:49.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.126+0000 7f318a506700 1 --2- 172.21.15.6:0/4152607448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318410d750 0x7f318410fc60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f317c00b0a0 tx=0x7f317c00b3b0 comp rx=0 tx=0).stop 2024-05-20T17:05:49.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.126+0000 7f318a506700 1 -- 172.21.15.6:0/4152607448 shutdown_connections 2024-05-20T17:05:49.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.126+0000 7f318a506700 1 --2- 172.21.15.6:0/4152607448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318410d750 0x7f318410fc60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:49.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.126+0000 7f318a506700 1 --2- 172.21.15.6:0/4152607448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31841042e0 0x7f31841046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:49.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.126+0000 7f318a506700 1 --2- 172.21.15.6:0/4152607448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3184104c30 0x7f318410d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:49.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.126+0000 7f318a506700 1 -- 172.21.15.6:0/4152607448 >> 172.21.15.6:0/4152607448 conn(0x7f31840fdc70 msgr2=0x7f3184100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:49.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.126+0000 7f318a506700 1 -- 172.21.15.6:0/4152607448 shutdown_connections 2024-05-20T17:05:49.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.126+0000 7f318a506700 1 -- 172.21.15.6:0/4152607448 wait complete. 2024-05-20T17:05:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.127+0000 7f318a506700 1 Processor -- start 2024-05-20T17:05:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.127+0000 7f318a506700 1 -- start start 2024-05-20T17:05:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.128+0000 7f318a506700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31841042e0 0x7f3184101fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.128+0000 7f318a506700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3184104c30 0x7f3184102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.128+0000 7f318a506700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f318410d750 0x7f3184102a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.128+0000 7f318a506700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3184113300 con 0x7f31841042e0 2024-05-20T17:05:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.128+0000 7f318a506700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3184113180 con 0x7f318410d750 2024-05-20T17:05:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.128+0000 7f318a506700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3184113480 con 0x7f3184104c30 2024-05-20T17:05:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.128+0000 7f3183fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31841042e0 0x7f3184101fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.128+0000 7f3183fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31841042e0 0x7f3184101fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39218/0 (socket says 172.21.15.6:39218) 2024-05-20T17:05:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.128+0000 7f3183fff700 1 -- 172.21.15.6:0/2923702039 learned_addr learned my addr 172.21.15.6:0/2923702039 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.128+0000 7f31837fe700 1 --2- 172.21.15.6:0/2923702039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3184104c30 0x7f3184102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.128+0000 7f3188aa3700 1 --2- 172.21.15.6:0/2923702039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f318410d750 0x7f3184102a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.128+0000 7f3183fff700 1 -- 172.21.15.6:0/2923702039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3184104c30 msgr2=0x7f3184102510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.128+0000 7f3183fff700 1 --2- 172.21.15.6:0/2923702039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3184104c30 0x7f3184102510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.128+0000 7f3183fff700 1 -- 172.21.15.6:0/2923702039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f318410d750 msgr2=0x7f3184102a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.128+0000 7f3183fff700 1 --2- 172.21.15.6:0/2923702039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f318410d750 0x7f3184102a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.128+0000 7f3183fff700 1 -- 172.21.15.6:0/2923702039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31841a7f70 con 0x7f31841042e0 2024-05-20T17:05:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.128+0000 7f3188aa3700 1 --2- 172.21.15.6:0/2923702039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f318410d750 0x7f3184102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:05:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.128+0000 7f3183fff700 1 --2- 172.21.15.6:0/2923702039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31841042e0 0x7f3184101fd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f317400d980 tx=0x7f317400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.129+0000 7f31817fa700 1 -- 172.21.15.6:0/2923702039 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3174016070 con 0x7f31841042e0 2024-05-20T17:05:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.129+0000 7f31817fa700 1 -- 172.21.15.6:0/2923702039 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f317400be00 con 0x7f31841042e0 2024-05-20T17:05:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.129+0000 7f318a506700 1 -- 172.21.15.6:0/2923702039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31841a8260 con 0x7f31841042e0 2024-05-20T17:05:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.129+0000 7f31817fa700 1 -- 172.21.15.6:0/2923702039 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317400f3c0 con 0x7f31841042e0 2024-05-20T17:05:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.129+0000 7f318a506700 1 -- 172.21.15.6:0/2923702039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31841a87a0 con 0x7f31841042e0 2024-05-20T17:05:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.130+0000 7f318a506700 1 -- 172.21.15.6:0/2923702039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3184050170 con 0x7f31841042e0 2024-05-20T17:05:49.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.132+0000 7f31817fa700 1 -- 172.21.15.6:0/2923702039 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f3174019070 con 0x7f31841042e0 2024-05-20T17:05:49.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.132+0000 7f31817fa700 1 --2- 172.21.15.6:0/2923702039 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f316c0a2cb0 0x7f316c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:49.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.133+0000 7f31817fa700 1 -- 172.21.15.6:0/2923702039 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f31740cf8a0 con 0x7f31841042e0 2024-05-20T17:05:49.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.133+0000 7f31837fe700 1 --2- 172.21.15.6:0/2923702039 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f316c0a2cb0 0x7f316c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:49.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.133+0000 7f31837fe700 1 --2- 172.21.15.6:0/2923702039 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f316c0a2cb0 0x7f316c0a51c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3184101280 tx=0x7f317800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:49.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.137+0000 7f31817fa700 1 -- 172.21.15.6:0/2923702039 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3174020020 con 0x7f31841042e0 2024-05-20T17:05:49.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.343+0000 7f318a506700 1 -- 172.21.15.6:0/2923702039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f318402dd80 con 0x7f31841042e0 2024-05-20T17:05:49.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.344+0000 7f31817fa700 1 -- 172.21.15.6:0/2923702039 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24443 (secure 0 0 0) 0x7f317409c340 con 0x7f31841042e0 2024-05-20T17:05:49.346 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:05:49.346 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":92,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:05:43.615360+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:05:02.947896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:05:03.842231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:05:07.551471+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:05:49.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.347+0000 7f318a506700 1 -- 172.21.15.6:0/2923702039 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f316c0a2cb0 msgr2=0x7f316c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:49.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.347+0000 7f318a506700 1 --2- 172.21.15.6:0/2923702039 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f316c0a2cb0 0x7f316c0a51c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3184101280 tx=0x7f317800b410 comp rx=0 tx=0).stop 2024-05-20T17:05:49.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.347+0000 7f318a506700 1 -- 172.21.15.6:0/2923702039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31841042e0 msgr2=0x7f3184101fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:49.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.347+0000 7f318a506700 1 --2- 172.21.15.6:0/2923702039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31841042e0 0x7f3184101fd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f317400d980 tx=0x7f317400dc90 comp rx=0 tx=0).stop 2024-05-20T17:05:49.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.347+0000 7f318a506700 1 -- 172.21.15.6:0/2923702039 shutdown_connections 2024-05-20T17:05:49.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.347+0000 7f318a506700 1 --2- 172.21.15.6:0/2923702039 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f316c0a2cb0 0x7f316c0a51c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:49.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.347+0000 7f318a506700 1 --2- 172.21.15.6:0/2923702039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f318410d750 0x7f3184102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:49.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.347+0000 7f318a506700 1 --2- 172.21.15.6:0/2923702039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31841042e0 0x7f3184101fd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:49.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.347+0000 7f318a506700 1 --2- 172.21.15.6:0/2923702039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3184104c30 0x7f3184102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:49.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.347+0000 7f318a506700 1 -- 172.21.15.6:0/2923702039 >> 172.21.15.6:0/2923702039 conn(0x7f31840fdc70 msgr2=0x7f31840ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:49.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.347+0000 7f318a506700 1 -- 172.21.15.6:0/2923702039 shutdown_connections 2024-05-20T17:05:49.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:49.347+0000 7f318a506700 1 -- 172.21.15.6:0/2923702039 wait complete. 2024-05-20T17:05:50.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:49 smithi062 ceph-mon[35425]: pgmap v325: 129 pgs: 129 active+clean; 628 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:05:50.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:49 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2923702039' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:50.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:49 smithi006 ceph-mon[32486]: pgmap v325: 129 pgs: 129 active+clean; 628 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:05:50.070 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:49 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2923702039' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:50.104 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-20T17:05:50.105 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-20T17:05:50.105 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-20T17:05:50.106 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-20T17:05:50.106 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-20T17:05:50.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-20T17:05:50.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-20T17:05:50.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-20T17:05:50.108 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-05-20T17:05:50.108 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-05-20T17:05:50.109 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-05-20T17:05:50.109 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-05-20T17:05:50.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:49 smithi171 ceph-mon[35901]: pgmap v325: 129 pgs: 129 active+clean; 628 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:05:50.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:49 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2923702039' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:05:50.789 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:05:51.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:51 smithi006 ceph-mon[32486]: pgmap v326: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.9 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:05:51.918 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:51 smithi171 ceph-mon[35901]: pgmap v326: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.9 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:05:52.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:51 smithi062 ceph-mon[35425]: pgmap v326: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.9 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:05:52.319 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:05:52.319 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:05:52.320 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:05:52.321 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:05:52.322 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:05:52.337 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:05:52.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.562+0000 7f5223694700 1 -- 172.21.15.6:0/2989469715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521c1075c0 msgr2=0x7f521c10ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:52.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.562+0000 7f5223694700 1 --2- 172.21.15.6:0/2989469715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521c1075c0 0x7f521c10ef20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f521400b0d0 tx=0x7f521400b3e0 comp rx=0 tx=0).stop 2024-05-20T17:05:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.562+0000 7f5223694700 1 -- 172.21.15.6:0/2989469715 shutdown_connections 2024-05-20T17:05:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.562+0000 7f5223694700 1 --2- 172.21.15.6:0/2989469715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521c1075c0 0x7f521c10ef20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.562+0000 7f5223694700 1 --2- 172.21.15.6:0/2989469715 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f521c102340 0x7f521c102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.562+0000 7f5223694700 1 --2- 172.21.15.6:0/2989469715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f521c106c70 0x7f521c107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.562+0000 7f5223694700 1 -- 172.21.15.6:0/2989469715 >> 172.21.15.6:0/2989469715 conn(0x7f521c0fdc40 msgr2=0x7f521c100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.562+0000 7f5223694700 1 -- 172.21.15.6:0/2989469715 shutdown_connections 2024-05-20T17:05:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.562+0000 7f5223694700 1 -- 172.21.15.6:0/2989469715 wait complete. 2024-05-20T17:05:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.563+0000 7f5223694700 1 Processor -- start 2024-05-20T17:05:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.563+0000 7f5223694700 1 -- start start 2024-05-20T17:05:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.564+0000 7f5223694700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521c102340 0x7f521c19be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.564+0000 7f5223694700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f521c106c70 0x7f521c19c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.564+0000 7f5223694700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f521c1075c0 0x7f521c1a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.564+0000 7f5223694700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f521c1111a0 con 0x7f521c102340 2024-05-20T17:05:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.564+0000 7f5223694700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f521c111020 con 0x7f521c1075c0 2024-05-20T17:05:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.564+0000 7f5223694700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f521c111320 con 0x7f521c106c70 2024-05-20T17:05:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.564+0000 7f5221430700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521c102340 0x7f521c19be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.564+0000 7f5221430700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521c102340 0x7f521c19be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59406/0 (socket says 172.21.15.6:59406) 2024-05-20T17:05:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.564+0000 7f5221430700 1 -- 172.21.15.6:0/1944829704 learned_addr learned my addr 172.21.15.6:0/1944829704 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.564+0000 7f5220c2f700 1 --2- 172.21.15.6:0/1944829704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f521c106c70 0x7f521c19c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.564+0000 7f5221c31700 1 --2- 172.21.15.6:0/1944829704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f521c1075c0 0x7f521c1a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:52.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.565+0000 7f5221430700 1 -- 172.21.15.6:0/1944829704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f521c106c70 msgr2=0x7f521c19c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:52.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.565+0000 7f5221430700 1 --2- 172.21.15.6:0/1944829704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f521c106c70 0x7f521c19c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:52.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.565+0000 7f5221430700 1 -- 172.21.15.6:0/1944829704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f521c1075c0 msgr2=0x7f521c1a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:52.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.565+0000 7f5221430700 1 --2- 172.21.15.6:0/1944829704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f521c1075c0 0x7f521c1a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:52.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.565+0000 7f5221430700 1 -- 172.21.15.6:0/1944829704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521c1a0d60 con 0x7f521c102340 2024-05-20T17:05:52.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.565+0000 7f5221430700 1 --2- 172.21.15.6:0/1944829704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521c102340 0x7f521c19be90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f521800e9a0 tx=0x7f521800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:52.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.565+0000 7f52127fc700 1 -- 172.21.15.6:0/1944829704 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521800cbd0 con 0x7f521c102340 2024-05-20T17:05:52.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.565+0000 7f52127fc700 1 -- 172.21.15.6:0/1944829704 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f521800cd70 con 0x7f521c102340 2024-05-20T17:05:52.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.565+0000 7f5223694700 1 -- 172.21.15.6:0/1944829704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f521c1a1050 con 0x7f521c102340 2024-05-20T17:05:52.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.565+0000 7f5223694700 1 -- 172.21.15.6:0/1944829704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f521c1a8970 con 0x7f521c102340 2024-05-20T17:05:52.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.565+0000 7f52127fc700 1 -- 172.21.15.6:0/1944829704 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218018680 con 0x7f521c102340 2024-05-20T17:05:52.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.566+0000 7f5223694700 1 -- 172.21.15.6:0/1944829704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5200001030 con 0x7f521c102340 2024-05-20T17:05:52.568 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:05:52.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.569+0000 7f52127fc700 1 -- 172.21.15.6:0/1944829704 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f52180188e0 con 0x7f521c102340 2024-05-20T17:05:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:05:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:05:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.570+0000 7f52127fc700 1 --2- 172.21.15.6:0/1944829704 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f52080a2d70 0x7f52080a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.571+0000 7f5220c2f700 1 --2- 172.21.15.6:0/1944829704 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f52080a2d70 0x7f52080a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.571+0000 7f52127fc700 1 -- 172.21.15.6:0/1944829704 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f52180d0210 con 0x7f521c102340 2024-05-20T17:05:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.571+0000 7f52127fc700 1 --2- 172.21.15.6:0/1944829704 >> [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924] conn(0x7f52080adf20 0x7f52080b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.571+0000 7f52127fc700 1 -- 172.21.15.6:0/1944829704 --> [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f521801bec0 con 0x7f52080adf20 2024-05-20T17:05:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.571+0000 7f52127fc700 1 -- 172.21.15.6:0/1944829704 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f52180d0660 con 0x7f521c102340 2024-05-20T17:05:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.571+0000 7f5221c31700 1 --2- 172.21.15.6:0/1944829704 >> [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924] conn(0x7f52080adf20 0x7f52080b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.572+0000 7f5220c2f700 1 --2- 172.21.15.6:0/1944829704 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f52080a2d70 0x7f52080a5280 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f520c005950 tx=0x7f520c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.572+0000 7f5221c31700 1 --2- 172.21.15.6:0/1944829704 >> [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924] conn(0x7f52080adf20 0x7f52080b0410 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.573+0000 7f52127fc700 1 -- 172.21.15.6:0/1944829704 <== osd.3 v2:172.21.15.6:6810/4226183924 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f521801bec0 con 0x7f52080adf20 2024-05-20T17:05:52.581 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:05:52.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.604+0000 7f5223694700 1 -- 172.21.15.6:0/1944829704 --> [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5200002e60 con 0x7f52080adf20 2024-05-20T17:05:52.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.604+0000 7f52127fc700 1 -- 172.21.15.6:0/1944829704 <== osd.3 v2:172.21.15.6:6810/4226183924 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5200002e60 con 0x7f52080adf20 2024-05-20T17:05:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.605+0000 7f5223694700 1 -- 172.21.15.6:0/1944829704 >> [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924] conn(0x7f52080adf20 msgr2=0x7f52080b0410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.605+0000 7f5223694700 1 --2- 172.21.15.6:0/1944829704 >> [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924] conn(0x7f52080adf20 0x7f52080b0410 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.605+0000 7f5223694700 1 -- 172.21.15.6:0/1944829704 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f52080a2d70 msgr2=0x7f52080a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.605+0000 7f5223694700 1 --2- 172.21.15.6:0/1944829704 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f52080a2d70 0x7f52080a5280 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f520c005950 tx=0x7f520c0058e0 comp rx=0 tx=0).stop 2024-05-20T17:05:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.605+0000 7f5223694700 1 -- 172.21.15.6:0/1944829704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521c102340 msgr2=0x7f521c19be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.605+0000 7f5223694700 1 --2- 172.21.15.6:0/1944829704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521c102340 0x7f521c19be90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f521800e9a0 tx=0x7f521800ecb0 comp rx=0 tx=0).stop 2024-05-20T17:05:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.605+0000 7f5221c31700 1 -- 172.21.15.6:0/1944829704 reap_dead start 2024-05-20T17:05:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.605+0000 7f5223694700 1 -- 172.21.15.6:0/1944829704 shutdown_connections 2024-05-20T17:05:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.605+0000 7f5223694700 1 -- 172.21.15.6:0/1944829704 >> 172.21.15.6:0/1944829704 conn(0x7f521c0fdc40 msgr2=0x7f521c105c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.605+0000 7f5223694700 1 -- 172.21.15.6:0/1944829704 shutdown_connections 2024-05-20T17:05:52.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:52.605+0000 7f5223694700 1 -- 172.21.15.6:0/1944829704 wait complete. 2024-05-20T17:05:53.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:53 smithi006 ceph-mon[32486]: pgmap v327: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.3 KiB/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:05:54.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:53 smithi062 ceph-mon[35425]: pgmap v327: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.3 KiB/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:05:54.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:53 smithi171 ceph-mon[35901]: pgmap v327: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.3 KiB/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:05:55.797 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:55 smithi006 ceph-mon[32486]: pgmap v328: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.1 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:05:56.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:55 smithi062 ceph-mon[35425]: pgmap v328: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.1 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:05:56.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:55 smithi171 ceph-mon[35901]: pgmap v328: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.1 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:05:57.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:57 smithi006 ceph-mon[32486]: pgmap v329: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:05:58.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:57 smithi062 ceph-mon[35425]: pgmap v329: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:05:58.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:57 smithi171 ceph-mon[35901]: pgmap v329: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:05:59.755 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:05:59 smithi006 ceph-mon[32486]: pgmap v330: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-20T17:05:59.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.873+0000 7f690004f700 1 -- 172.21.15.6:0/3973278674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f8102340 msgr2=0x7f68f8102750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:59.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.873+0000 7f690004f700 1 --2- 172.21.15.6:0/3973278674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f8102340 0x7f68f8102750 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f68f40099c0 tx=0x7f68f4009cd0 comp rx=0 tx=0).stop 2024-05-20T17:05:59.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.873+0000 7f690004f700 1 -- 172.21.15.6:0/3973278674 shutdown_connections 2024-05-20T17:05:59.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.873+0000 7f690004f700 1 --2- 172.21.15.6:0/3973278674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68f81075c0 0x7f68f810ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:59.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.873+0000 7f690004f700 1 --2- 172.21.15.6:0/3973278674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f8102340 0x7f68f8102750 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:59.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.873+0000 7f690004f700 1 --2- 172.21.15.6:0/3973278674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68f8106c70 0x7f68f8107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:59.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.873+0000 7f690004f700 1 -- 172.21.15.6:0/3973278674 >> 172.21.15.6:0/3973278674 conn(0x7f68f80fdc40 msgr2=0x7f68f8100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:59.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.873+0000 7f690004f700 1 -- 172.21.15.6:0/3973278674 shutdown_connections 2024-05-20T17:05:59.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.873+0000 7f690004f700 1 -- 172.21.15.6:0/3973278674 wait complete. 2024-05-20T17:05:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.874+0000 7f690004f700 1 Processor -- start 2024-05-20T17:05:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.874+0000 7f690004f700 1 -- start start 2024-05-20T17:05:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.874+0000 7f690004f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68f8102340 0x7f68f819f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.874+0000 7f690004f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68f8106c70 0x7f68f819fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.874+0000 7f690004f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f81075c0 0x7f68f8199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.874+0000 7f690004f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f68f81121f0 con 0x7f68f81075c0 2024-05-20T17:05:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.874+0000 7f690004f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f68f8112070 con 0x7f68f8106c70 2024-05-20T17:05:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.874+0000 7f690004f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f68f8112370 con 0x7f68f8102340 2024-05-20T17:05:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.874+0000 7f68fe5ec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f81075c0 0x7f68f8199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.874+0000 7f68fe5ec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f81075c0 0x7f68f8199aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59428/0 (socket says 172.21.15.6:59428) 2024-05-20T17:05:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.874+0000 7f68fe5ec700 1 -- 172.21.15.6:0/1226557896 learned_addr learned my addr 172.21.15.6:0/1226557896 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:05:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.874+0000 7f68fddeb700 1 --2- 172.21.15.6:0/1226557896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68f8102340 0x7f68f819f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.874+0000 7f68fd5ea700 1 --2- 172.21.15.6:0/1226557896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68f8106c70 0x7f68f819fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.875+0000 7f68fe5ec700 1 -- 172.21.15.6:0/1226557896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68f8102340 msgr2=0x7f68f819f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.875+0000 7f68fe5ec700 1 --2- 172.21.15.6:0/1226557896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68f8102340 0x7f68f819f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.875+0000 7f68fe5ec700 1 -- 172.21.15.6:0/1226557896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68f8106c70 msgr2=0x7f68f819fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.875+0000 7f68fe5ec700 1 --2- 172.21.15.6:0/1226557896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68f8106c70 0x7f68f819fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.875+0000 7f68fe5ec700 1 -- 172.21.15.6:0/1226557896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f819a150 con 0x7f68f81075c0 2024-05-20T17:05:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.875+0000 7f68fd5ea700 1 --2- 172.21.15.6:0/1226557896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68f8106c70 0x7f68f819fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:05:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.875+0000 7f68fe5ec700 1 --2- 172.21.15.6:0/1226557896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f81075c0 0x7f68f8199aa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f68f0007ee0 tx=0x7f68f000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.875+0000 7f68eeffd700 1 -- 172.21.15.6:0/1226557896 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f000ddd0 con 0x7f68f81075c0 2024-05-20T17:05:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.875+0000 7f690004f700 1 -- 172.21.15.6:0/1226557896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f819a440 con 0x7f68f81075c0 2024-05-20T17:05:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.875+0000 7f68eeffd700 1 -- 172.21.15.6:0/1226557896 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f68f0004020 con 0x7f68f81075c0 2024-05-20T17:05:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.875+0000 7f68eeffd700 1 -- 172.21.15.6:0/1226557896 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f0015660 con 0x7f68f81075c0 2024-05-20T17:05:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.875+0000 7f690004f700 1 -- 172.21.15.6:0/1226557896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f81a6710 con 0x7f68f81075c0 2024-05-20T17:05:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.876+0000 7f690004f700 1 -- 172.21.15.6:0/1226557896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f68f8062d90 con 0x7f68f81075c0 2024-05-20T17:05:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.877+0000 7f68eeffd700 1 -- 172.21.15.6:0/1226557896 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f68f00041d0 con 0x7f68f81075c0 2024-05-20T17:05:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.878+0000 7f68eeffd700 1 --2- 172.21.15.6:0/1226557896 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f68e40a2cb0 0x7f68e40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.878+0000 7f68eeffd700 1 -- 172.21.15.6:0/1226557896 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f68f00cfab0 con 0x7f68f81075c0 2024-05-20T17:05:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.878+0000 7f68fddeb700 1 --2- 172.21.15.6:0/1226557896 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f68e40a2cb0 0x7f68e40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:59.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.878+0000 7f68eeffd700 1 --2- 172.21.15.6:0/1226557896 >> [v2:172.21.15.62:6824/2012507198,v1:172.21.15.62:6825/2012507198] conn(0x7f68e40ade60 0x7f68e40b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:05:59.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.878+0000 7f68eeffd700 1 -- 172.21.15.6:0/1226557896 --> [v2:172.21.15.62:6824/2012507198,v1:172.21.15.62:6825/2012507198] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68f0020e50 con 0x7f68e40ade60 2024-05-20T17:05:59.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.878+0000 7f68eeffd700 1 -- 172.21.15.6:0/1226557896 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f68f00cff00 con 0x7f68f81075c0 2024-05-20T17:05:59.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.879+0000 7f68fddeb700 1 --2- 172.21.15.6:0/1226557896 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f68e40a2cb0 0x7f68e40a51c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f68f4000c00 tx=0x7f68f4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.879+0000 7f68fd5ea700 1 --2- 172.21.15.6:0/1226557896 >> [v2:172.21.15.62:6824/2012507198,v1:172.21.15.62:6825/2012507198] conn(0x7f68e40ade60 0x7f68e40b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:05:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.879+0000 7f68fd5ea700 1 --2- 172.21.15.6:0/1226557896 >> [v2:172.21.15.62:6824/2012507198,v1:172.21.15.62:6825/2012507198] conn(0x7f68e40ade60 0x7f68e40b0350 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:05:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.880+0000 7f68eeffd700 1 -- 172.21.15.6:0/1226557896 <== osd.10 v2:172.21.15.62:6824/2012507198 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f68f0020e50 con 0x7f68e40ade60 2024-05-20T17:05:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.897+0000 7f690004f700 1 -- 172.21.15.6:0/1226557896 --> [v2:172.21.15.62:6824/2012507198,v1:172.21.15.62:6825/2012507198] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f68f8063210 con 0x7f68e40ade60 2024-05-20T17:05:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.897+0000 7f68eeffd700 1 -- 172.21.15.6:0/1226557896 <== osd.10 v2:172.21.15.62:6824/2012507198 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f68f8063210 con 0x7f68e40ade60 2024-05-20T17:05:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.898+0000 7f690004f700 1 -- 172.21.15.6:0/1226557896 >> [v2:172.21.15.62:6824/2012507198,v1:172.21.15.62:6825/2012507198] conn(0x7f68e40ade60 msgr2=0x7f68e40b0350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.898+0000 7f690004f700 1 --2- 172.21.15.6:0/1226557896 >> [v2:172.21.15.62:6824/2012507198,v1:172.21.15.62:6825/2012507198] conn(0x7f68e40ade60 0x7f68e40b0350 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:05:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.898+0000 7f690004f700 1 -- 172.21.15.6:0/1226557896 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f68e40a2cb0 msgr2=0x7f68e40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.898+0000 7f690004f700 1 --2- 172.21.15.6:0/1226557896 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f68e40a2cb0 0x7f68e40a51c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f68f4000c00 tx=0x7f68f4005fb0 comp rx=0 tx=0).stop 2024-05-20T17:05:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.898+0000 7f690004f700 1 -- 172.21.15.6:0/1226557896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f81075c0 msgr2=0x7f68f8199aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:05:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.898+0000 7f690004f700 1 --2- 172.21.15.6:0/1226557896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f81075c0 0x7f68f8199aa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f68f0007ee0 tx=0x7f68f000d3b0 comp rx=0 tx=0).stop 2024-05-20T17:05:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.898+0000 7f68fe5ec700 1 -- 172.21.15.6:0/1226557896 reap_dead start 2024-05-20T17:05:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.898+0000 7f690004f700 1 -- 172.21.15.6:0/1226557896 shutdown_connections 2024-05-20T17:05:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.898+0000 7f690004f700 1 -- 172.21.15.6:0/1226557896 >> 172.21.15.6:0/1226557896 conn(0x7f68f80fdc40 msgr2=0x7f68f806a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:05:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.898+0000 7f690004f700 1 -- 172.21.15.6:0/1226557896 shutdown_connections 2024-05-20T17:05:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:05:59.898+0000 7f690004f700 1 -- 172.21.15.6:0/1226557896 wait complete. 2024-05-20T17:06:00.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:05:59 smithi062 ceph-mon[35425]: pgmap v330: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-20T17:06:00.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:05:59 smithi171 ceph-mon[35901]: pgmap v330: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-20T17:06:00.909 INFO:teuthology.orchestra.run.smithi006.stdout:313532612638 2024-05-20T17:06:00.910 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-05-20T17:06:02.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:01 smithi062 ceph-mon[35425]: pgmap v331: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-20T17:06:02.050 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:01 smithi006 ceph-mon[32486]: pgmap v331: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-20T17:06:02.079 INFO:teuthology.orchestra.run.smithi006.stdout:111669149762 2024-05-20T17:06:02.079 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-20T17:06:02.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:01 smithi171 ceph-mon[35901]: pgmap v331: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-20T17:06:03.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.597+0000 7f99967c2700 1 -- 172.21.15.6:0/3652537071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9990102340 msgr2=0x7f9990102750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:03.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.597+0000 7f99967c2700 1 --2- 172.21.15.6:0/3652537071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9990102340 0x7f9990102750 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f99800099c0 tx=0x7f9980009cd0 comp rx=0 tx=0).stop 2024-05-20T17:06:03.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.597+0000 7f99967c2700 1 -- 172.21.15.6:0/3652537071 shutdown_connections 2024-05-20T17:06:03.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.597+0000 7f99967c2700 1 --2- 172.21.15.6:0/3652537071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99901075c0 0x7f999010ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:03.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.597+0000 7f99967c2700 1 --2- 172.21.15.6:0/3652537071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9990102340 0x7f9990102750 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:03.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.597+0000 7f99967c2700 1 --2- 172.21.15.6:0/3652537071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9990106c70 0x7f9990107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:03.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.597+0000 7f99967c2700 1 -- 172.21.15.6:0/3652537071 >> 172.21.15.6:0/3652537071 conn(0x7f99900fdc70 msgr2=0x7f9990100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:03.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.597+0000 7f99967c2700 1 -- 172.21.15.6:0/3652537071 shutdown_connections 2024-05-20T17:06:03.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.597+0000 7f99967c2700 1 -- 172.21.15.6:0/3652537071 wait complete. 2024-05-20T17:06:03.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.598+0000 7f99967c2700 1 Processor -- start 2024-05-20T17:06:03.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.598+0000 7f99967c2700 1 -- start start 2024-05-20T17:06:03.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.598+0000 7f99967c2700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9990102340 0x7f999019f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:03.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.598+0000 7f99967c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9990106c70 0x7f999019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:03.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.598+0000 7f99967c2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99901075c0 0x7f9990199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:03.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.598+0000 7f99967c2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9990113340 con 0x7f9990106c70 2024-05-20T17:06:03.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.598+0000 7f99967c2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f99901131c0 con 0x7f99901075c0 2024-05-20T17:06:03.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.598+0000 7f99967c2700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f99901134c0 con 0x7f9990102340 2024-05-20T17:06:03.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.598+0000 7f9987fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9990106c70 0x7f999019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:03.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.599+0000 7f9987fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9990106c70 0x7f999019fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59438/0 (socket says 172.21.15.6:59438) 2024-05-20T17:06:03.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.599+0000 7f9987fff700 1 -- 172.21.15.6:0/2352443762 learned_addr learned my addr 172.21.15.6:0/2352443762 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.599+0000 7f9994d5f700 1 --2- 172.21.15.6:0/2352443762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99901075c0 0x7f9990199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.599+0000 7f998ffff700 1 --2- 172.21.15.6:0/2352443762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9990102340 0x7f999019f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.599+0000 7f9987fff700 1 -- 172.21.15.6:0/2352443762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9990102340 msgr2=0x7f999019f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.599+0000 7f9987fff700 1 --2- 172.21.15.6:0/2352443762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9990102340 0x7f999019f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.599+0000 7f9987fff700 1 -- 172.21.15.6:0/2352443762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99901075c0 msgr2=0x7f9990199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.599+0000 7f9987fff700 1 --2- 172.21.15.6:0/2352443762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99901075c0 0x7f9990199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.599+0000 7f9987fff700 1 -- 172.21.15.6:0/2352443762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999019a0e0 con 0x7f9990106c70 2024-05-20T17:06:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.599+0000 7f9987fff700 1 --2- 172.21.15.6:0/2352443762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9990106c70 0x7f999019fdc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f997800c9e0 tx=0x7f997800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.599+0000 7f998dffb700 1 -- 172.21.15.6:0/2352443762 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978007aa0 con 0x7f9990106c70 2024-05-20T17:06:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.599+0000 7f998dffb700 1 -- 172.21.15.6:0/2352443762 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9978007c40 con 0x7f9990106c70 2024-05-20T17:06:03.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.599+0000 7f99967c2700 1 -- 172.21.15.6:0/2352443762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f999019a3d0 con 0x7f9990106c70 2024-05-20T17:06:03.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.599+0000 7f998dffb700 1 -- 172.21.15.6:0/2352443762 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978018660 con 0x7f9990106c70 2024-05-20T17:06:03.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.599+0000 7f99967c2700 1 -- 172.21.15.6:0/2352443762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99901a6710 con 0x7f9990106c70 2024-05-20T17:06:03.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.600+0000 7f99967c2700 1 -- 172.21.15.6:0/2352443762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9990062dd0 con 0x7f9990106c70 2024-05-20T17:06:03.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.602+0000 7f998dffb700 1 -- 172.21.15.6:0/2352443762 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f997800f450 con 0x7f9990106c70 2024-05-20T17:06:03.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.603+0000 7f998dffb700 1 --2- 172.21.15.6:0/2352443762 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f997c0a2cb0 0x7f997c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:03.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.603+0000 7f998ffff700 1 --2- 172.21.15.6:0/2352443762 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f997c0a2cb0 0x7f997c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.603+0000 7f998dffb700 1 -- 172.21.15.6:0/2352443762 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f99780cfb50 con 0x7f9990106c70 2024-05-20T17:06:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.603+0000 7f998dffb700 1 --2- 172.21.15.6:0/2352443762 >> [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917] conn(0x7f997c0ade60 0x7f997c0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.603+0000 7f998dffb700 1 -- 172.21.15.6:0/2352443762 --> [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f997c0b0a20 con 0x7f997c0ade60 2024-05-20T17:06:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.603+0000 7f998dffb700 1 -- 172.21.15.6:0/2352443762 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f99780cff00 con 0x7f9990106c70 2024-05-20T17:06:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.603+0000 7f9994d5f700 1 --2- 172.21.15.6:0/2352443762 >> [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917] conn(0x7f997c0ade60 0x7f997c0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.603+0000 7f998ffff700 1 --2- 172.21.15.6:0/2352443762 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f997c0a2cb0 0x7f997c0a51c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9980000c00 tx=0x7f9980005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.604+0000 7f9994d5f700 1 --2- 172.21.15.6:0/2352443762 >> [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917] conn(0x7f997c0ade60 0x7f997c0b0350 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.604+0000 7f998dffb700 1 -- 172.21.15.6:0/2352443762 <== osd.9 v2:172.21.15.6:6826/500627917 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f997c0b0a20 con 0x7f997c0ade60 2024-05-20T17:06:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.621+0000 7f99967c2700 1 -- 172.21.15.6:0/2352443762 --> [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9990063250 con 0x7f997c0ade60 2024-05-20T17:06:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.621+0000 7f998dffb700 1 -- 172.21.15.6:0/2352443762 <== osd.9 v2:172.21.15.6:6826/500627917 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9990063250 con 0x7f997c0ade60 2024-05-20T17:06:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.622+0000 7f99967c2700 1 -- 172.21.15.6:0/2352443762 >> [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917] conn(0x7f997c0ade60 msgr2=0x7f997c0b0350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.622+0000 7f99967c2700 1 --2- 172.21.15.6:0/2352443762 >> [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917] conn(0x7f997c0ade60 0x7f997c0b0350 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:03.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.622+0000 7f99967c2700 1 -- 172.21.15.6:0/2352443762 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f997c0a2cb0 msgr2=0x7f997c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:03.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.622+0000 7f99967c2700 1 --2- 172.21.15.6:0/2352443762 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f997c0a2cb0 0x7f997c0a51c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9980000c00 tx=0x7f9980005fb0 comp rx=0 tx=0).stop 2024-05-20T17:06:03.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.622+0000 7f99967c2700 1 -- 172.21.15.6:0/2352443762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9990106c70 msgr2=0x7f999019fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:03.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.622+0000 7f99967c2700 1 --2- 172.21.15.6:0/2352443762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9990106c70 0x7f999019fdc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f997800c9e0 tx=0x7f997800ccf0 comp rx=0 tx=0).stop 2024-05-20T17:06:03.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.622+0000 7f9994d5f700 1 -- 172.21.15.6:0/2352443762 reap_dead start 2024-05-20T17:06:03.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.622+0000 7f99967c2700 1 -- 172.21.15.6:0/2352443762 shutdown_connections 2024-05-20T17:06:03.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.622+0000 7f99967c2700 1 -- 172.21.15.6:0/2352443762 >> 172.21.15.6:0/2352443762 conn(0x7f99900fdc70 msgr2=0x7f9990100b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:03.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.622+0000 7f99967c2700 1 -- 172.21.15.6:0/2352443762 shutdown_connections 2024-05-20T17:06:03.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:00.622+0000 7f99967c2700 1 -- 172.21.15.6:0/2352443762 wait complete. 2024-05-20T17:06:04.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:03 smithi062 ceph-mon[35425]: pgmap v332: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-20T17:06:04.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:03 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:06:04.081 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:03 smithi171 ceph-mon[35901]: pgmap v332: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-20T17:06:04.081 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:03 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:06:04.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:03 smithi006 ceph-mon[32486]: pgmap v332: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-20T17:06:04.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:03 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:06:04.817 INFO:teuthology.orchestra.run.smithi006.stdout:292057776163 2024-05-20T17:06:04.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-05-20T17:06:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.336+0000 7f849a7de700 1 -- 172.21.15.6:0/2718871800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8494103450 msgr2=0x7f8494103860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.336+0000 7f849a7de700 1 --2- 172.21.15.6:0/2718871800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8494103450 0x7f8494103860 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f84840099c0 tx=0x7f8484009cd0 comp rx=0 tx=0).stop 2024-05-20T17:06:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.336+0000 7f849a7de700 1 -- 172.21.15.6:0/2718871800 shutdown_connections 2024-05-20T17:06:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.336+0000 7f849a7de700 1 --2- 172.21.15.6:0/2718871800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84941086d0 0x7f8494110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.336+0000 7f849a7de700 1 --2- 172.21.15.6:0/2718871800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8494103450 0x7f8494103860 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.336+0000 7f849a7de700 1 --2- 172.21.15.6:0/2718871800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8494107d80 0x7f8494108190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.336+0000 7f849a7de700 1 -- 172.21.15.6:0/2718871800 >> 172.21.15.6:0/2718871800 conn(0x7f84940fed20 msgr2=0x7f8494101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.336+0000 7f849a7de700 1 -- 172.21.15.6:0/2718871800 shutdown_connections 2024-05-20T17:06:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.336+0000 7f849a7de700 1 -- 172.21.15.6:0/2718871800 wait complete. 2024-05-20T17:06:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.337+0000 7f849a7de700 1 Processor -- start 2024-05-20T17:06:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.337+0000 7f849a7de700 1 -- start start 2024-05-20T17:06:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.337+0000 7f849a7de700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8494103450 0x7f849419f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.337+0000 7f849a7de700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8494107d80 0x7f849419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.337+0000 7f849a7de700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84941086d0 0x7f8494199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.337+0000 7f849a7de700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8494113300 con 0x7f84941086d0 2024-05-20T17:06:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.337+0000 7f849a7de700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8494113180 con 0x7f8494103450 2024-05-20T17:06:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.337+0000 7f849a7de700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8494113480 con 0x7f8494107d80 2024-05-20T17:06:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.337+0000 7f8498d7b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84941086d0 0x7f8494199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.337+0000 7f8498d7b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84941086d0 0x7f8494199ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49198/0 (socket says 172.21.15.6:49198) 2024-05-20T17:06:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.337+0000 7f8498d7b700 1 -- 172.21.15.6:0/2007423269 learned_addr learned my addr 172.21.15.6:0/2007423269 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.337+0000 7f8493fff700 1 --2- 172.21.15.6:0/2007423269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8494103450 0x7f849419f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.337+0000 7f84937fe700 1 --2- 172.21.15.6:0/2007423269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8494107d80 0x7f849419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:05.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.338+0000 7f8498d7b700 1 -- 172.21.15.6:0/2007423269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8494107d80 msgr2=0x7f849419fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:05.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.338+0000 7f8498d7b700 1 --2- 172.21.15.6:0/2007423269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8494107d80 0x7f849419fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:05.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.338+0000 7f8498d7b700 1 -- 172.21.15.6:0/2007423269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8494103450 msgr2=0x7f849419f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:05.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.338+0000 7f8498d7b700 1 --2- 172.21.15.6:0/2007423269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8494103450 0x7f849419f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:05.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.338+0000 7f8498d7b700 1 -- 172.21.15.6:0/2007423269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849419a170 con 0x7f84941086d0 2024-05-20T17:06:05.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.338+0000 7f8493fff700 1 --2- 172.21.15.6:0/2007423269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8494103450 0x7f849419f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:06:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.338+0000 7f8498d7b700 1 --2- 172.21.15.6:0/2007423269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84941086d0 0x7f8494199ac0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f848c00ef30 tx=0x7f848c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.338+0000 7f84917fa700 1 -- 172.21.15.6:0/2007423269 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c0092e0 con 0x7f84941086d0 2024-05-20T17:06:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.338+0000 7f84917fa700 1 -- 172.21.15.6:0/2007423269 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f848c004bb0 con 0x7f84941086d0 2024-05-20T17:06:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.338+0000 7f849a7de700 1 -- 172.21.15.6:0/2007423269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f849419a400 con 0x7f84941086d0 2024-05-20T17:06:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.338+0000 7f84917fa700 1 -- 172.21.15.6:0/2007423269 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c004020 con 0x7f84941086d0 2024-05-20T17:06:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.338+0000 7f849a7de700 1 -- 172.21.15.6:0/2007423269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f849419a8f0 con 0x7f84941086d0 2024-05-20T17:06:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.339+0000 7f849a7de700 1 -- 172.21.15.6:0/2007423269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8494062dd0 con 0x7f84941086d0 2024-05-20T17:06:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.341+0000 7f84917fa700 1 -- 172.21.15.6:0/2007423269 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f848c01b030 con 0x7f84941086d0 2024-05-20T17:06:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.341+0000 7f84917fa700 1 --2- 172.21.15.6:0/2007423269 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f847c0a2cb0 0x7f847c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.341+0000 7f8493fff700 1 --2- 172.21.15.6:0/2007423269 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f847c0a2cb0 0x7f847c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.341+0000 7f84917fa700 1 -- 172.21.15.6:0/2007423269 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f848c0cfc70 con 0x7f84941086d0 2024-05-20T17:06:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.342+0000 7f84917fa700 1 --2- 172.21.15.6:0/2007423269 >> [v2:172.21.15.171:6808/2616695062,v1:172.21.15.171:6809/2616695062] conn(0x7f847c0ade60 0x7f847c0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.342+0000 7f84917fa700 1 -- 172.21.15.6:0/2007423269 --> [v2:172.21.15.171:6808/2616695062,v1:172.21.15.171:6809/2616695062] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f848c011e50 con 0x7f847c0ade60 2024-05-20T17:06:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.342+0000 7f84917fa700 1 -- 172.21.15.6:0/2007423269 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f848c0d00c0 con 0x7f84941086d0 2024-05-20T17:06:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.342+0000 7f84937fe700 1 --2- 172.21.15.6:0/2007423269 >> [v2:172.21.15.171:6808/2616695062,v1:172.21.15.171:6809/2616695062] conn(0x7f847c0ade60 0x7f847c0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.342+0000 7f8493fff700 1 --2- 172.21.15.6:0/2007423269 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f847c0a2cb0 0x7f847c0a51c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8484000c00 tx=0x7f848401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.342+0000 7f84937fe700 1 --2- 172.21.15.6:0/2007423269 >> [v2:172.21.15.171:6808/2616695062,v1:172.21.15.171:6809/2616695062] conn(0x7f847c0ade60 0x7f847c0b0350 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.343+0000 7f84917fa700 1 -- 172.21.15.6:0/2007423269 <== osd.5 v2:172.21.15.171:6808/2616695062 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f848c011e50 con 0x7f847c0ade60 2024-05-20T17:06:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.360+0000 7f849a7de700 1 -- 172.21.15.6:0/2007423269 --> [v2:172.21.15.171:6808/2616695062,v1:172.21.15.171:6809/2616695062] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8494063250 con 0x7f847c0ade60 2024-05-20T17:06:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.360+0000 7f84917fa700 1 -- 172.21.15.6:0/2007423269 <== osd.5 v2:172.21.15.171:6808/2616695062 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8494063250 con 0x7f847c0ade60 2024-05-20T17:06:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.361+0000 7f849a7de700 1 -- 172.21.15.6:0/2007423269 >> [v2:172.21.15.171:6808/2616695062,v1:172.21.15.171:6809/2616695062] conn(0x7f847c0ade60 msgr2=0x7f847c0b0350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.361+0000 7f849a7de700 1 --2- 172.21.15.6:0/2007423269 >> [v2:172.21.15.171:6808/2616695062,v1:172.21.15.171:6809/2616695062] conn(0x7f847c0ade60 0x7f847c0b0350 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.361+0000 7f849a7de700 1 -- 172.21.15.6:0/2007423269 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f847c0a2cb0 msgr2=0x7f847c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.361+0000 7f849a7de700 1 --2- 172.21.15.6:0/2007423269 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f847c0a2cb0 0x7f847c0a51c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8484000c00 tx=0x7f848401a040 comp rx=0 tx=0).stop 2024-05-20T17:06:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.361+0000 7f849a7de700 1 -- 172.21.15.6:0/2007423269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84941086d0 msgr2=0x7f8494199ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.361+0000 7f849a7de700 1 --2- 172.21.15.6:0/2007423269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84941086d0 0x7f8494199ac0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f848c00ef30 tx=0x7f848c00c3a0 comp rx=0 tx=0).stop 2024-05-20T17:06:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.361+0000 7f8498d7b700 1 -- 172.21.15.6:0/2007423269 reap_dead start 2024-05-20T17:06:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.361+0000 7f849a7de700 1 -- 172.21.15.6:0/2007423269 shutdown_connections 2024-05-20T17:06:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.361+0000 7f849a7de700 1 -- 172.21.15.6:0/2007423269 >> 172.21.15.6:0/2007423269 conn(0x7f84940fed20 msgr2=0x7f8494109630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.361+0000 7f849a7de700 1 -- 172.21.15.6:0/2007423269 shutdown_connections 2024-05-20T17:06:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:05.361+0000 7f849a7de700 1 -- 172.21.15.6:0/2007423269 wait complete. 2024-05-20T17:06:05.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:05 smithi006 ceph-mon[32486]: pgmap v333: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-20T17:06:05.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:05 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:05.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:05 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:05.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:05 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:05.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:05 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:06.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:05 smithi062 ceph-mon[35425]: pgmap v333: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-20T17:06:06.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:05 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:06.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:05 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:06.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:05 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:06.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:05 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:06.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:05 smithi171 ceph-mon[35901]: pgmap v333: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-20T17:06:06.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:05 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:06.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:05 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:06.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:05 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:06.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:05 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:06.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.417+0000 7fe8e5e67700 1 -- 172.21.15.6:0/2758424064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8e0107600 msgr2=0x7fe8e010ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:06.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.417+0000 7fe8e5e67700 1 --2- 172.21.15.6:0/2758424064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8e0107600 0x7fe8e010ef60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800b0d0 tx=0x7fe8d800b3e0 comp rx=0 tx=0).stop 2024-05-20T17:06:06.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.418+0000 7fe8e5e67700 1 -- 172.21.15.6:0/2758424064 shutdown_connections 2024-05-20T17:06:06.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.418+0000 7fe8e5e67700 1 --2- 172.21.15.6:0/2758424064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8e0107600 0x7fe8e010ef60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:06.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.418+0000 7fe8e5e67700 1 --2- 172.21.15.6:0/2758424064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8e01023d0 0x7fe8e01027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:06.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.418+0000 7fe8e5e67700 1 --2- 172.21.15.6:0/2758424064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8e0106cb0 0x7fe8e01070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:06.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.418+0000 7fe8e5e67700 1 -- 172.21.15.6:0/2758424064 >> 172.21.15.6:0/2758424064 conn(0x7fe8e0077c80 msgr2=0x7fe8e00780c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:06.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.418+0000 7fe8e5e67700 1 -- 172.21.15.6:0/2758424064 shutdown_connections 2024-05-20T17:06:06.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.418+0000 7fe8e5e67700 1 -- 172.21.15.6:0/2758424064 wait complete. 2024-05-20T17:06:06.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.418+0000 7fe8e5e67700 1 Processor -- start 2024-05-20T17:06:06.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.419+0000 7fe8e5e67700 1 -- start start 2024-05-20T17:06:06.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.419+0000 7fe8e5e67700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8e01023d0 0x7fe8e019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:06.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.419+0000 7fe8e5e67700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8e0106cb0 0x7fe8e019b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:06.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.419+0000 7fe8e5e67700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8e0107600 0x7fe8e019b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:06.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.419+0000 7fe8e5e67700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e0112230 con 0x7fe8e0107600 2024-05-20T17:06:06.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.419+0000 7fe8e5e67700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e01120b0 con 0x7fe8e0106cb0 2024-05-20T17:06:06.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.419+0000 7fe8e5e67700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e01123b0 con 0x7fe8e01023d0 2024-05-20T17:06:06.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.419+0000 7fe8dffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8e0107600 0x7fe8e019b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:06.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.419+0000 7fe8dffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8e0107600 0x7fe8e019b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49216/0 (socket says 172.21.15.6:49216) 2024-05-20T17:06:06.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.419+0000 7fe8dffff700 1 -- 172.21.15.6:0/3402495386 learned_addr learned my addr 172.21.15.6:0/3402495386 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:06.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.419+0000 7fe8df7fe700 1 --2- 172.21.15.6:0/3402495386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8e01023d0 0x7fe8e019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:06.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.419+0000 7fe8d6ffd700 1 --2- 172.21.15.6:0/3402495386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8e0106cb0 0x7fe8e019b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:06.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.420+0000 7fe8dffff700 1 -- 172.21.15.6:0/3402495386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8e01023d0 msgr2=0x7fe8e019aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:06.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.420+0000 7fe8dffff700 1 --2- 172.21.15.6:0/3402495386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8e01023d0 0x7fe8e019aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:06.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.420+0000 7fe8dffff700 1 -- 172.21.15.6:0/3402495386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8e0106cb0 msgr2=0x7fe8e019b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:06.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.420+0000 7fe8dffff700 1 --2- 172.21.15.6:0/3402495386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8e0106cb0 0x7fe8e019b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:06.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.420+0000 7fe8dffff700 1 -- 172.21.15.6:0/3402495386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e01a5e40 con 0x7fe8e0107600 2024-05-20T17:06:06.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.420+0000 7fe8df7fe700 1 --2- 172.21.15.6:0/3402495386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8e01023d0 0x7fe8e019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:06:06.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.420+0000 7fe8dffff700 1 --2- 172.21.15.6:0/3402495386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8e0107600 0x7fe8e019b590 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80095c0 tx=0x7fe8d8007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:06.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.420+0000 7fe8dd7fa700 1 -- 172.21.15.6:0/3402495386 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d801f070 con 0x7fe8e0107600 2024-05-20T17:06:06.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.420+0000 7fe8e5e67700 1 -- 172.21.15.6:0/3402495386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e01a60d0 con 0x7fe8e0107600 2024-05-20T17:06:06.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.420+0000 7fe8dd7fa700 1 -- 172.21.15.6:0/3402495386 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe8d8007e20 con 0x7fe8e0107600 2024-05-20T17:06:06.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.420+0000 7fe8dd7fa700 1 -- 172.21.15.6:0/3402495386 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d801b4a0 con 0x7fe8e0107600 2024-05-20T17:06:06.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.420+0000 7fe8e5e67700 1 -- 172.21.15.6:0/3402495386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e01a6520 con 0x7fe8e0107600 2024-05-20T17:06:06.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.421+0000 7fe8e5e67700 1 -- 172.21.15.6:0/3402495386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe8e0100530 con 0x7fe8e0107600 2024-05-20T17:06:06.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.423+0000 7fe8dd7fa700 1 -- 172.21.15.6:0/3402495386 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fe8d8022070 con 0x7fe8e0107600 2024-05-20T17:06:06.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.424+0000 7fe8dd7fa700 1 --2- 172.21.15.6:0/3402495386 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe8cc0a2cb0 0x7fe8cc0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:06.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.424+0000 7fe8dd7fa700 1 -- 172.21.15.6:0/3402495386 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fe8d800f020 con 0x7fe8e0107600 2024-05-20T17:06:06.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.424+0000 7fe8df7fe700 1 --2- 172.21.15.6:0/3402495386 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe8cc0a2cb0 0x7fe8cc0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:06.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.424+0000 7fe8dd7fa700 1 --2- 172.21.15.6:0/3402495386 >> [v2:172.21.15.171:6824/698174151,v1:172.21.15.171:6825/698174151] conn(0x7fe8cc0add30 0x7fe8cc0b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:06.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.424+0000 7fe8dd7fa700 1 -- 172.21.15.6:0/3402495386 --> [v2:172.21.15.171:6824/698174151,v1:172.21.15.171:6825/698174151] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe8d80075c0 con 0x7fe8cc0add30 2024-05-20T17:06:06.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.424+0000 7fe8dd7fa700 1 -- 172.21.15.6:0/3402495386 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fe8d80d0fb0 con 0x7fe8e0107600 2024-05-20T17:06:06.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.424+0000 7fe8d6ffd700 1 --2- 172.21.15.6:0/3402495386 >> [v2:172.21.15.171:6824/698174151,v1:172.21.15.171:6825/698174151] conn(0x7fe8cc0add30 0x7fe8cc0b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:06.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.424+0000 7fe8df7fe700 1 --2- 172.21.15.6:0/3402495386 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe8cc0a2cb0 0x7fe8cc0a51c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0005950 tx=0x7fe8d000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:06.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.425+0000 7fe8d6ffd700 1 --2- 172.21.15.6:0/3402495386 >> [v2:172.21.15.171:6824/698174151,v1:172.21.15.171:6825/698174151] conn(0x7fe8cc0add30 0x7fe8cc0b0220 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:06.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.426+0000 7fe8dd7fa700 1 -- 172.21.15.6:0/3402495386 <== osd.11 v2:172.21.15.171:6824/698174151 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe8d80075c0 con 0x7fe8cc0add30 2024-05-20T17:06:06.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.442+0000 7fe8e5e67700 1 -- 172.21.15.6:0/3402495386 --> [v2:172.21.15.171:6824/698174151,v1:172.21.15.171:6825/698174151] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe8e0103830 con 0x7fe8cc0add30 2024-05-20T17:06:06.444 INFO:teuthology.orchestra.run.smithi006.stdout:167503724602 2024-05-20T17:06:06.444 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-20T17:06:06.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.443+0000 7fe8dd7fa700 1 -- 172.21.15.6:0/3402495386 <== osd.11 v2:172.21.15.171:6824/698174151 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe8e0103830 con 0x7fe8cc0add30 2024-05-20T17:06:06.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.444+0000 7fe8e5e67700 1 -- 172.21.15.6:0/3402495386 >> [v2:172.21.15.171:6824/698174151,v1:172.21.15.171:6825/698174151] conn(0x7fe8cc0add30 msgr2=0x7fe8cc0b0220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:06.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.444+0000 7fe8e5e67700 1 --2- 172.21.15.6:0/3402495386 >> [v2:172.21.15.171:6824/698174151,v1:172.21.15.171:6825/698174151] conn(0x7fe8cc0add30 0x7fe8cc0b0220 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:06.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.444+0000 7fe8e5e67700 1 -- 172.21.15.6:0/3402495386 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe8cc0a2cb0 msgr2=0x7fe8cc0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:06.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.444+0000 7fe8e5e67700 1 --2- 172.21.15.6:0/3402495386 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe8cc0a2cb0 0x7fe8cc0a51c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0005950 tx=0x7fe8d000b410 comp rx=0 tx=0).stop 2024-05-20T17:06:06.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.444+0000 7fe8e5e67700 1 -- 172.21.15.6:0/3402495386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8e0107600 msgr2=0x7fe8e019b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:06.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.444+0000 7fe8e5e67700 1 --2- 172.21.15.6:0/3402495386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8e0107600 0x7fe8e019b590 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80095c0 tx=0x7fe8d8007a20 comp rx=0 tx=0).stop 2024-05-20T17:06:06.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.444+0000 7fe8dffff700 1 -- 172.21.15.6:0/3402495386 reap_dead start 2024-05-20T17:06:06.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.444+0000 7fe8e5e67700 1 -- 172.21.15.6:0/3402495386 shutdown_connections 2024-05-20T17:06:06.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.444+0000 7fe8e5e67700 1 -- 172.21.15.6:0/3402495386 >> 172.21.15.6:0/3402495386 conn(0x7fe8e0077c80 msgr2=0x7fe8e00ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:06.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.444+0000 7fe8e5e67700 1 -- 172.21.15.6:0/3402495386 shutdown_connections 2024-05-20T17:06:06.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:06.444+0000 7fe8e5e67700 1 -- 172.21.15.6:0/3402495386 wait complete. 2024-05-20T17:06:07.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.469+0000 7f389e354700 1 -- 172.21.15.6:0/2963518563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3898102340 msgr2=0x7f3898102750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:07.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.469+0000 7f389e354700 1 --2- 172.21.15.6:0/2963518563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3898102340 0x7f3898102750 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f38880099c0 tx=0x7f3888009cd0 comp rx=0 tx=0).stop 2024-05-20T17:06:07.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.469+0000 7f389e354700 1 -- 172.21.15.6:0/2963518563 shutdown_connections 2024-05-20T17:06:07.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.469+0000 7f389e354700 1 --2- 172.21.15.6:0/2963518563 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38981075c0 0x7f389810ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:07.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.469+0000 7f389e354700 1 --2- 172.21.15.6:0/2963518563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3898102340 0x7f3898102750 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:07.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.469+0000 7f389e354700 1 --2- 172.21.15.6:0/2963518563 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3898106c70 0x7f3898107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:07.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.469+0000 7f389e354700 1 -- 172.21.15.6:0/2963518563 >> 172.21.15.6:0/2963518563 conn(0x7f38980fdc40 msgr2=0x7f3898100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:07.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.470+0000 7f389e354700 1 -- 172.21.15.6:0/2963518563 shutdown_connections 2024-05-20T17:06:07.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.470+0000 7f389e354700 1 -- 172.21.15.6:0/2963518563 wait complete. 2024-05-20T17:06:07.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.470+0000 7f389e354700 1 Processor -- start 2024-05-20T17:06:07.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.470+0000 7f389e354700 1 -- start start 2024-05-20T17:06:07.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.471+0000 7f389e354700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3898102340 0x7f389819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:07.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.471+0000 7f389e354700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3898106c70 0x7f389819b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:07.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.471+0000 7f389e354700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38981075c0 0x7f389819b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:07.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.471+0000 7f389e354700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3898112270 con 0x7f3898102340 2024-05-20T17:06:07.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.471+0000 7f389e354700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f38981120f0 con 0x7f3898106c70 2024-05-20T17:06:07.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.471+0000 7f389e354700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f38981123f0 con 0x7f38981075c0 2024-05-20T17:06:07.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.471+0000 7f3897fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3898102340 0x7f389819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:07.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.471+0000 7f3897fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3898102340 0x7f389819ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49232/0 (socket says 172.21.15.6:49232) 2024-05-20T17:06:07.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.471+0000 7f3897fff700 1 -- 172.21.15.6:0/676281973 learned_addr learned my addr 172.21.15.6:0/676281973 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:07.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.471+0000 7f388ffff700 1 --2- 172.21.15.6:0/676281973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3898106c70 0x7f389819b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:07.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.471+0000 7f389c8f1700 1 --2- 172.21.15.6:0/676281973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38981075c0 0x7f389819b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:07.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.471+0000 7f3897fff700 1 -- 172.21.15.6:0/676281973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38981075c0 msgr2=0x7f389819b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:07.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.471+0000 7f3897fff700 1 --2- 172.21.15.6:0/676281973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38981075c0 0x7f389819b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:07.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.471+0000 7f3897fff700 1 -- 172.21.15.6:0/676281973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3898106c70 msgr2=0x7f389819b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:07.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.471+0000 7f3897fff700 1 --2- 172.21.15.6:0/676281973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3898106c70 0x7f389819b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:07.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.471+0000 7f3897fff700 1 -- 172.21.15.6:0/676281973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38981a5ea0 con 0x7f3898102340 2024-05-20T17:06:07.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.471+0000 7f3897fff700 1 --2- 172.21.15.6:0/676281973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3898102340 0x7f389819ab50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3888006010 tx=0x7f3888009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:07.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.472+0000 7f3895ffb700 1 -- 172.21.15.6:0/676281973 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888027070 con 0x7f3898102340 2024-05-20T17:06:07.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.472+0000 7f389e354700 1 -- 172.21.15.6:0/676281973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38981a6130 con 0x7f3898102340 2024-05-20T17:06:07.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.472+0000 7f3895ffb700 1 -- 172.21.15.6:0/676281973 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3888003f50 con 0x7f3898102340 2024-05-20T17:06:07.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.472+0000 7f3895ffb700 1 -- 172.21.15.6:0/676281973 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888022cd0 con 0x7f3898102340 2024-05-20T17:06:07.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.472+0000 7f389e354700 1 -- 172.21.15.6:0/676281973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38981a65e0 con 0x7f3898102340 2024-05-20T17:06:07.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.472+0000 7f389e354700 1 -- 172.21.15.6:0/676281973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3898062d50 con 0x7f3898102340 2024-05-20T17:06:07.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.474+0000 7f3895ffb700 1 -- 172.21.15.6:0/676281973 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f388802a070 con 0x7f3898102340 2024-05-20T17:06:07.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.475+0000 7f3895ffb700 1 --2- 172.21.15.6:0/676281973 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f38840a2cb0 0x7f38840a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:07.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.475+0000 7f388ffff700 1 --2- 172.21.15.6:0/676281973 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f38840a2cb0 0x7f38840a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:07.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.475+0000 7f3895ffb700 1 -- 172.21.15.6:0/676281973 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f38880d0920 con 0x7f3898102340 2024-05-20T17:06:07.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.475+0000 7f3895ffb700 1 --2- 172.21.15.6:0/676281973 >> [v2:172.21.15.62:6800/2080543878,v1:172.21.15.62:6801/2080543878] conn(0x7f38840ade60 0x7f38840b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:07.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.475+0000 7f3895ffb700 1 -- 172.21.15.6:0/676281973 --> [v2:172.21.15.62:6800/2080543878,v1:172.21.15.62:6801/2080543878] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3888001d30 con 0x7f38840ade60 2024-05-20T17:06:07.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.475+0000 7f3895ffb700 1 -- 172.21.15.6:0/676281973 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f38880d0d70 con 0x7f3898102340 2024-05-20T17:06:07.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.475+0000 7f388ffff700 1 --2- 172.21.15.6:0/676281973 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f38840a2cb0 0x7f38840a51c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f38981012c0 tx=0x7f388000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:07.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.476+0000 7f389c8f1700 1 --2- 172.21.15.6:0/676281973 >> [v2:172.21.15.62:6800/2080543878,v1:172.21.15.62:6801/2080543878] conn(0x7f38840ade60 0x7f38840b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:07.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.476+0000 7f389c8f1700 1 --2- 172.21.15.6:0/676281973 >> [v2:172.21.15.62:6800/2080543878,v1:172.21.15.62:6801/2080543878] conn(0x7f38840ade60 0x7f38840b0350 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:07.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.477+0000 7f3895ffb700 1 -- 172.21.15.6:0/676281973 <== osd.1 v2:172.21.15.62:6800/2080543878 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3888001d30 con 0x7f38840ade60 2024-05-20T17:06:07.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.493+0000 7f389e354700 1 -- 172.21.15.6:0/676281973 --> [v2:172.21.15.62:6800/2080543878,v1:172.21.15.62:6801/2080543878] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f38980631d0 con 0x7f38840ade60 2024-05-20T17:06:07.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.494+0000 7f3895ffb700 1 -- 172.21.15.6:0/676281973 <== osd.1 v2:172.21.15.62:6800/2080543878 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f38980631d0 con 0x7f38840ade60 2024-05-20T17:06:07.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.494+0000 7f389e354700 1 -- 172.21.15.6:0/676281973 >> [v2:172.21.15.62:6800/2080543878,v1:172.21.15.62:6801/2080543878] conn(0x7f38840ade60 msgr2=0x7f38840b0350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:07.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.494+0000 7f389e354700 1 --2- 172.21.15.6:0/676281973 >> [v2:172.21.15.62:6800/2080543878,v1:172.21.15.62:6801/2080543878] conn(0x7f38840ade60 0x7f38840b0350 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:07.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.494+0000 7f389e354700 1 -- 172.21.15.6:0/676281973 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f38840a2cb0 msgr2=0x7f38840a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:07.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.494+0000 7f389e354700 1 --2- 172.21.15.6:0/676281973 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f38840a2cb0 0x7f38840a51c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f38981012c0 tx=0x7f388000b410 comp rx=0 tx=0).stop 2024-05-20T17:06:07.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.494+0000 7f389e354700 1 -- 172.21.15.6:0/676281973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3898102340 msgr2=0x7f389819ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:07.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.494+0000 7f389e354700 1 --2- 172.21.15.6:0/676281973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3898102340 0x7f389819ab50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3888006010 tx=0x7f3888009f80 comp rx=0 tx=0).stop 2024-05-20T17:06:07.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.494+0000 7f389c8f1700 1 -- 172.21.15.6:0/676281973 reap_dead start 2024-05-20T17:06:07.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.494+0000 7f389e354700 1 -- 172.21.15.6:0/676281973 shutdown_connections 2024-05-20T17:06:07.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.494+0000 7f389e354700 1 -- 172.21.15.6:0/676281973 >> 172.21.15.6:0/676281973 conn(0x7f38980fdc40 msgr2=0x7f3898106450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:07.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.495+0000 7f389e354700 1 -- 172.21.15.6:0/676281973 shutdown_connections 2024-05-20T17:06:07.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:07.495+0000 7f389e354700 1 -- 172.21.15.6:0/676281973 wait complete. 2024-05-20T17:06:07.790 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:07 smithi006 ceph-mon[32486]: pgmap v334: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-20T17:06:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:07 smithi062 ceph-mon[35425]: pgmap v334: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-20T17:06:08.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:07 smithi171 ceph-mon[35901]: pgmap v334: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-20T17:06:08.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.126+0000 7f584b1eb700 1 -- 172.21.15.6:0/1936459196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58441086d0 msgr2=0x7f5844110030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:08.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.126+0000 7f584b1eb700 1 --2- 172.21.15.6:0/1936459196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58441086d0 0x7f5844110030 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f583c0099c0 tx=0x7f583c009cd0 comp rx=0 tx=0).stop 2024-05-20T17:06:08.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.126+0000 7f584b1eb700 1 -- 172.21.15.6:0/1936459196 shutdown_connections 2024-05-20T17:06:08.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.126+0000 7f584b1eb700 1 --2- 172.21.15.6:0/1936459196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58441086d0 0x7f5844110030 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:08.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.126+0000 7f584b1eb700 1 --2- 172.21.15.6:0/1936459196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5844103450 0x7f5844103860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:08.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.126+0000 7f584b1eb700 1 --2- 172.21.15.6:0/1936459196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5844107d80 0x7f5844108190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:08.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.126+0000 7f584b1eb700 1 -- 172.21.15.6:0/1936459196 >> 172.21.15.6:0/1936459196 conn(0x7f58440fed20 msgr2=0x7f5844101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:08.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.126+0000 7f584b1eb700 1 -- 172.21.15.6:0/1936459196 shutdown_connections 2024-05-20T17:06:08.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.126+0000 7f584b1eb700 1 -- 172.21.15.6:0/1936459196 wait complete. 2024-05-20T17:06:08.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.127+0000 7f584b1eb700 1 Processor -- start 2024-05-20T17:06:08.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.127+0000 7f584b1eb700 1 -- start start 2024-05-20T17:06:08.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.127+0000 7f584b1eb700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5844103450 0x7f5844199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:08.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.127+0000 7f584b1eb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5844107d80 0x7f584419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:08.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.127+0000 7f584b1eb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58441086d0 0x7f584419e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:08.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.127+0000 7f584b1eb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5844113320 con 0x7f58441086d0 2024-05-20T17:06:08.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.127+0000 7f584b1eb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f58441131a0 con 0x7f5844107d80 2024-05-20T17:06:08.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.127+0000 7f584b1eb700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f58441134a0 con 0x7f5844103450 2024-05-20T17:06:08.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.127+0000 7f5849788700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58441086d0 0x7f584419e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:08.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.127+0000 7f5849788700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58441086d0 0x7f584419e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49256/0 (socket says 172.21.15.6:49256) 2024-05-20T17:06:08.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.127+0000 7f5849788700 1 -- 172.21.15.6:0/332992635 learned_addr learned my addr 172.21.15.6:0/332992635 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:08.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.127+0000 7f583bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5844107d80 0x7f584419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:08.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.127+0000 7f5848f87700 1 --2- 172.21.15.6:0/332992635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5844103450 0x7f5844199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:08.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.127+0000 7f5849788700 1 -- 172.21.15.6:0/332992635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5844103450 msgr2=0x7f5844199d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.127+0000 7f5849788700 1 --2- 172.21.15.6:0/332992635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5844103450 0x7f5844199d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.127+0000 7f5849788700 1 -- 172.21.15.6:0/332992635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5844107d80 msgr2=0x7f584419a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.127+0000 7f5849788700 1 --2- 172.21.15.6:0/332992635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5844107d80 0x7f584419a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.127+0000 7f5849788700 1 -- 172.21.15.6:0/332992635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584419ec20 con 0x7f58441086d0 2024-05-20T17:06:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.128+0000 7f5849788700 1 --2- 172.21.15.6:0/332992635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58441086d0 0x7f584419e580 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f583c0059d0 tx=0x7f583c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.128+0000 7f5839ffb700 1 -- 172.21.15.6:0/332992635 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c026070 con 0x7f58441086d0 2024-05-20T17:06:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.128+0000 7f584b1eb700 1 -- 172.21.15.6:0/332992635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f584419eeb0 con 0x7f58441086d0 2024-05-20T17:06:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.128+0000 7f5839ffb700 1 -- 172.21.15.6:0/332992635 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f583c00f460 con 0x7f58441086d0 2024-05-20T17:06:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.128+0000 7f5839ffb700 1 -- 172.21.15.6:0/332992635 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c009e60 con 0x7f58441086d0 2024-05-20T17:06:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.128+0000 7f584b1eb700 1 -- 172.21.15.6:0/332992635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f584419f390 con 0x7f58441086d0 2024-05-20T17:06:08.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.129+0000 7f584b1eb700 1 -- 172.21.15.6:0/332992635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5844062d50 con 0x7f58441086d0 2024-05-20T17:06:08.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.130+0000 7f5839ffb700 1 -- 172.21.15.6:0/332992635 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f583c029070 con 0x7f58441086d0 2024-05-20T17:06:08.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.131+0000 7f5839ffb700 1 --2- 172.21.15.6:0/332992635 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f582c0a2cb0 0x7f582c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:08.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.131+0000 7f5848f87700 1 --2- 172.21.15.6:0/332992635 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f582c0a2cb0 0x7f582c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:08.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.131+0000 7f5839ffb700 1 -- 172.21.15.6:0/332992635 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f583c0d0480 con 0x7f58441086d0 2024-05-20T17:06:08.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.131+0000 7f5839ffb700 1 --2- 172.21.15.6:0/332992635 >> [v2:172.21.15.62:6816/598452691,v1:172.21.15.62:6817/598452691] conn(0x7f582c0ade60 0x7f582c0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:08.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.131+0000 7f5839ffb700 1 -- 172.21.15.6:0/332992635 --> [v2:172.21.15.62:6816/598452691,v1:172.21.15.62:6817/598452691] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f582c0b0a20 con 0x7f582c0ade60 2024-05-20T17:06:08.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.131+0000 7f5839ffb700 1 -- 172.21.15.6:0/332992635 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f583c0d08d0 con 0x7f58441086d0 2024-05-20T17:06:08.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.132+0000 7f5848f87700 1 --2- 172.21.15.6:0/332992635 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f582c0a2cb0 0x7f582c0a51c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5840009550 tx=0x7f58400091f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:08.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.132+0000 7f583bfff700 1 --2- 172.21.15.6:0/332992635 >> [v2:172.21.15.62:6816/598452691,v1:172.21.15.62:6817/598452691] conn(0x7f582c0ade60 0x7f582c0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:08.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.132+0000 7f583bfff700 1 --2- 172.21.15.6:0/332992635 >> [v2:172.21.15.62:6816/598452691,v1:172.21.15.62:6817/598452691] conn(0x7f582c0ade60 0x7f582c0b0350 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:08.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.133+0000 7f5839ffb700 1 -- 172.21.15.6:0/332992635 <== osd.7 v2:172.21.15.62:6816/598452691 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f582c0b0a20 con 0x7f582c0ade60 2024-05-20T17:06:08.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.150+0000 7f584b1eb700 1 -- 172.21.15.6:0/332992635 --> [v2:172.21.15.62:6816/598452691,v1:172.21.15.62:6817/598452691] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5844063150 con 0x7f582c0ade60 2024-05-20T17:06:08.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.150+0000 7f5839ffb700 1 -- 172.21.15.6:0/332992635 <== osd.7 v2:172.21.15.62:6816/598452691 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5844063150 con 0x7f582c0ade60 2024-05-20T17:06:08.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.151+0000 7f584b1eb700 1 -- 172.21.15.6:0/332992635 >> [v2:172.21.15.62:6816/598452691,v1:172.21.15.62:6817/598452691] conn(0x7f582c0ade60 msgr2=0x7f582c0b0350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:08.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.151+0000 7f584b1eb700 1 --2- 172.21.15.6:0/332992635 >> [v2:172.21.15.62:6816/598452691,v1:172.21.15.62:6817/598452691] conn(0x7f582c0ade60 0x7f582c0b0350 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:08.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.151+0000 7f584b1eb700 1 -- 172.21.15.6:0/332992635 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f582c0a2cb0 msgr2=0x7f582c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:08.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.151+0000 7f584b1eb700 1 --2- 172.21.15.6:0/332992635 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f582c0a2cb0 0x7f582c0a51c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5840009550 tx=0x7f58400091f0 comp rx=0 tx=0).stop 2024-05-20T17:06:08.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.151+0000 7f584b1eb700 1 -- 172.21.15.6:0/332992635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58441086d0 msgr2=0x7f584419e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:08.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.151+0000 7f584b1eb700 1 --2- 172.21.15.6:0/332992635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58441086d0 0x7f584419e580 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f583c0059d0 tx=0x7f583c0045e0 comp rx=0 tx=0).stop 2024-05-20T17:06:08.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.151+0000 7f5849788700 1 -- 172.21.15.6:0/332992635 reap_dead start 2024-05-20T17:06:08.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.151+0000 7f584b1eb700 1 -- 172.21.15.6:0/332992635 shutdown_connections 2024-05-20T17:06:08.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.151+0000 7f584b1eb700 1 -- 172.21.15.6:0/332992635 >> 172.21.15.6:0/332992635 conn(0x7f58440fed20 msgr2=0x7f58441074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:08.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.151+0000 7f584b1eb700 1 -- 172.21.15.6:0/332992635 shutdown_connections 2024-05-20T17:06:08.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:08.151+0000 7f584b1eb700 1 -- 172.21.15.6:0/332992635 wait complete. 2024-05-20T17:06:09.874 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:09 smithi006 ceph-mon[32486]: pgmap v335: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-20T17:06:09.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.989+0000 7f8de2e67700 1 -- 172.21.15.6:0/3248044700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc102190 msgr2=0x7f8ddc10e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:09.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.989+0000 7f8de2e67700 1 --2- 172.21.15.6:0/3248044700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc102190 0x7f8ddc10e710 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8dd400c180 tx=0x7f8dd400c490 comp rx=0 tx=0).stop 2024-05-20T17:06:09.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.989+0000 7f8de2e67700 1 -- 172.21.15.6:0/3248044700 shutdown_connections 2024-05-20T17:06:09.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.989+0000 7f8de2e67700 1 --2- 172.21.15.6:0/3248044700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc102190 0x7f8ddc10e710 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:09.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.989+0000 7f8de2e67700 1 --2- 172.21.15.6:0/3248044700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ddc107870 0x7f8ddc107c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:09.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.989+0000 7f8de2e67700 1 --2- 172.21.15.6:0/3248044700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ddc101840 0x7f8ddc101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:09.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.990+0000 7f8de2e67700 1 -- 172.21.15.6:0/3248044700 >> 172.21.15.6:0/3248044700 conn(0x7f8ddc0fd360 msgr2=0x7f8ddc0ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:09.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.990+0000 7f8de2e67700 1 -- 172.21.15.6:0/3248044700 shutdown_connections 2024-05-20T17:06:09.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.990+0000 7f8de2e67700 1 -- 172.21.15.6:0/3248044700 wait complete. 2024-05-20T17:06:09.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.990+0000 7f8de2e67700 1 Processor -- start 2024-05-20T17:06:09.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.990+0000 7f8de2e67700 1 -- start start 2024-05-20T17:06:09.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.991+0000 7f8de2e67700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ddc101840 0x7f8ddc19f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:09.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.991+0000 7f8de2e67700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc102190 0x7f8ddc19fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:09.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.991+0000 7f8de2e67700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ddc107870 0x7f8ddc199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:09.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.991+0000 7f8de2e67700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc111160 con 0x7f8ddc102190 2024-05-20T17:06:09.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.991+0000 7f8de2e67700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc110fe0 con 0x7f8ddc107870 2024-05-20T17:06:09.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.991+0000 7f8de2e67700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc1112e0 con 0x7f8ddc101840 2024-05-20T17:06:09.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.991+0000 7f8ddbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc102190 0x7f8ddc19fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:09.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.991+0000 7f8ddbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc102190 0x7f8ddc19fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49266/0 (socket says 172.21.15.6:49266) 2024-05-20T17:06:09.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.991+0000 7f8ddbfff700 1 -- 172.21.15.6:0/2201060689 learned_addr learned my addr 172.21.15.6:0/2201060689 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:09.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.991+0000 7f8de0c03700 1 --2- 172.21.15.6:0/2201060689 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ddc101840 0x7f8ddc19f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:09.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.991+0000 7f8de1404700 1 --2- 172.21.15.6:0/2201060689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ddc107870 0x7f8ddc199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:09.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.991+0000 7f8ddbfff700 1 -- 172.21.15.6:0/2201060689 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ddc101840 msgr2=0x7f8ddc19f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:09.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.991+0000 7f8ddbfff700 1 --2- 172.21.15.6:0/2201060689 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ddc101840 0x7f8ddc19f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:09.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.991+0000 7f8ddbfff700 1 -- 172.21.15.6:0/2201060689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ddc107870 msgr2=0x7f8ddc199b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:09.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.991+0000 7f8ddbfff700 1 --2- 172.21.15.6:0/2201060689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ddc107870 0x7f8ddc199b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:09.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.991+0000 7f8ddbfff700 1 -- 172.21.15.6:0/2201060689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ddc19a270 con 0x7f8ddc102190 2024-05-20T17:06:09.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.991+0000 7f8de1404700 1 --2- 172.21.15.6:0/2201060689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ddc107870 0x7f8ddc199b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:06:09.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.991+0000 7f8ddbfff700 1 --2- 172.21.15.6:0/2201060689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc102190 0x7f8ddc19fef0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800e9f0 tx=0x7f8dc800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:09.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.992+0000 7f8dd9ffb700 1 -- 172.21.15.6:0/2201060689 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc800c9c0 con 0x7f8ddc102190 2024-05-20T17:06:09.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.992+0000 7f8de2e67700 1 -- 172.21.15.6:0/2201060689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ddc19a560 con 0x7f8ddc102190 2024-05-20T17:06:09.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.992+0000 7f8dd9ffb700 1 -- 172.21.15.6:0/2201060689 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8dc800cb60 con 0x7f8ddc102190 2024-05-20T17:06:09.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.992+0000 7f8dd9ffb700 1 -- 172.21.15.6:0/2201060689 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8018680 con 0x7f8ddc102190 2024-05-20T17:06:09.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.992+0000 7f8de2e67700 1 -- 172.21.15.6:0/2201060689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ddc1a6760 con 0x7f8ddc102190 2024-05-20T17:06:09.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.993+0000 7f8de2e67700 1 -- 172.21.15.6:0/2201060689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ddc062d50 con 0x7f8ddc102190 2024-05-20T17:06:09.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.995+0000 7f8dd9ffb700 1 -- 172.21.15.6:0/2201060689 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f8dc8018af0 con 0x7f8ddc102190 2024-05-20T17:06:09.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.995+0000 7f8dd9ffb700 1 --2- 172.21.15.6:0/2201060689 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8dcc0a2d30 0x7f8dcc0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:09.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.995+0000 7f8de0c03700 1 --2- 172.21.15.6:0/2201060689 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8dcc0a2d30 0x7f8dcc0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:09.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.996+0000 7f8dd9ffb700 1 -- 172.21.15.6:0/2201060689 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f8dc80cfc80 con 0x7f8ddc102190 2024-05-20T17:06:09.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.996+0000 7f8dd9ffb700 1 --2- 172.21.15.6:0/2201060689 >> [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798] conn(0x7f8dcc0adee0 0x7f8dcc0b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:09.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.996+0000 7f8dd9ffb700 1 -- 172.21.15.6:0/2201060689 --> [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8dcc0b0aa0 con 0x7f8dcc0adee0 2024-05-20T17:06:09.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.996+0000 7f8dd9ffb700 1 -- 172.21.15.6:0/2201060689 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f8dc80d00d0 con 0x7f8ddc102190 2024-05-20T17:06:09.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.996+0000 7f8de1404700 1 --2- 172.21.15.6:0/2201060689 >> [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798] conn(0x7f8dcc0adee0 0x7f8dcc0b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:09.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.996+0000 7f8de0c03700 1 --2- 172.21.15.6:0/2201060689 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8dcc0a2d30 0x7f8dcc0a5240 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc102980 tx=0x7f8dd0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:09.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.996+0000 7f8de1404700 1 --2- 172.21.15.6:0/2201060689 >> [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798] conn(0x7f8dcc0adee0 0x7f8dcc0b03d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:09.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:09.997+0000 7f8dd9ffb700 1 -- 172.21.15.6:0/2201060689 <== osd.0 v2:172.21.15.6:6802/25625798 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8dcc0b0aa0 con 0x7f8dcc0adee0 2024-05-20T17:06:10.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:10.014+0000 7f8de2e67700 1 -- 172.21.15.6:0/2201060689 --> [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8ddc063150 con 0x7f8dcc0adee0 2024-05-20T17:06:10.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:10.014+0000 7f8dd9ffb700 1 -- 172.21.15.6:0/2201060689 <== osd.0 v2:172.21.15.6:6802/25625798 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8ddc063150 con 0x7f8dcc0adee0 2024-05-20T17:06:10.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:10.014+0000 7f8de2e67700 1 -- 172.21.15.6:0/2201060689 >> [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798] conn(0x7f8dcc0adee0 msgr2=0x7f8dcc0b03d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:10.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:10.014+0000 7f8de2e67700 1 --2- 172.21.15.6:0/2201060689 >> [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798] conn(0x7f8dcc0adee0 0x7f8dcc0b03d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:10.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:10.015+0000 7f8de2e67700 1 -- 172.21.15.6:0/2201060689 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8dcc0a2d30 msgr2=0x7f8dcc0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:10.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:10.015+0000 7f8de2e67700 1 --2- 172.21.15.6:0/2201060689 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8dcc0a2d30 0x7f8dcc0a5240 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc102980 tx=0x7f8dd0009260 comp rx=0 tx=0).stop 2024-05-20T17:06:10.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:10.015+0000 7f8de2e67700 1 -- 172.21.15.6:0/2201060689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc102190 msgr2=0x7f8ddc19fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:10.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:10.015+0000 7f8de2e67700 1 --2- 172.21.15.6:0/2201060689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc102190 0x7f8ddc19fef0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800e9f0 tx=0x7f8dc800ed00 comp rx=0 tx=0).stop 2024-05-20T17:06:10.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:10.015+0000 7f8de1404700 1 -- 172.21.15.6:0/2201060689 reap_dead start 2024-05-20T17:06:10.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:10.015+0000 7f8de2e67700 1 -- 172.21.15.6:0/2201060689 shutdown_connections 2024-05-20T17:06:10.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:10.015+0000 7f8de2e67700 1 -- 172.21.15.6:0/2201060689 >> 172.21.15.6:0/2201060689 conn(0x7f8ddc0fd360 msgr2=0x7f8ddc104ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:10.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:10.015+0000 7f8de2e67700 1 -- 172.21.15.6:0/2201060689 shutdown_connections 2024-05-20T17:06:10.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:10.015+0000 7f8de2e67700 1 -- 172.21.15.6:0/2201060689 wait complete. 2024-05-20T17:06:10.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:09 smithi062 ceph-mon[35425]: pgmap v335: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-20T17:06:10.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:09 smithi171 ceph-mon[35901]: pgmap v335: 129 pgs: 129 active+clean; 644 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-20T17:06:10.488 INFO:teuthology.orchestra.run.smithi006.stdout:223338299439 2024-05-20T17:06:10.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-20T17:06:11.189 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:06:11.797 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:11 smithi006 ceph-mon[32486]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-20T17:06:11.886 INFO:teuthology.orchestra.run.smithi006.stdout:34359738453 2024-05-20T17:06:11.886 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-20T17:06:12.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:11 smithi062 ceph-mon[35425]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-20T17:06:12.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:11 smithi171 ceph-mon[35901]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-20T17:06:13.264 INFO:teuthology.orchestra.run.smithi006.stdout:55834574927 2024-05-20T17:06:13.264 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-20T17:06:13.734 INFO:teuthology.orchestra.run.smithi006.stdout:347892351003 2024-05-20T17:06:13.734 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-05-20T17:06:13.941 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:13 smithi006 ceph-mon[32486]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-20T17:06:14.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:13 smithi062 ceph-mon[35425]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-20T17:06:14.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.952+0000 7f6276a9c700 1 -- 172.21.15.6:0/2881856000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6270104c30 msgr2=0x7f627010d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:14.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.952+0000 7f6276a9c700 1 --2- 172.21.15.6:0/2881856000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6270104c30 0x7f627010d180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f625c009990 tx=0x7f625c009ca0 comp rx=0 tx=0).stop 2024-05-20T17:06:14.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.953+0000 7f6276a9c700 1 -- 172.21.15.6:0/2881856000 shutdown_connections 2024-05-20T17:06:14.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.953+0000 7f6276a9c700 1 --2- 172.21.15.6:0/2881856000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f627010d750 0x7f627010fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:14.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.953+0000 7f6276a9c700 1 --2- 172.21.15.6:0/2881856000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62701042e0 0x7f62701046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:14.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.953+0000 7f6276a9c700 1 --2- 172.21.15.6:0/2881856000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6270104c30 0x7f627010d180 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:14.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.953+0000 7f6276a9c700 1 -- 172.21.15.6:0/2881856000 >> 172.21.15.6:0/2881856000 conn(0x7f62700fdc40 msgr2=0x7f6270100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:14.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.953+0000 7f6276a9c700 1 -- 172.21.15.6:0/2881856000 shutdown_connections 2024-05-20T17:06:14.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.953+0000 7f6276a9c700 1 -- 172.21.15.6:0/2881856000 wait complete. 2024-05-20T17:06:14.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.953+0000 7f6276a9c700 1 Processor -- start 2024-05-20T17:06:14.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.953+0000 7f6276a9c700 1 -- start start 2024-05-20T17:06:14.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.954+0000 7f6276a9c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62701042e0 0x7f6270101fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:14.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.954+0000 7f6276a9c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6270104c30 0x7f6270102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:14.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.954+0000 7f6276a9c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f627010d750 0x7f6270102a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:14.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.954+0000 7f6276a9c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f62701132b0 con 0x7f62701042e0 2024-05-20T17:06:14.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.954+0000 7f6276a9c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6270113130 con 0x7f6270104c30 2024-05-20T17:06:14.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.954+0000 7f6276a9c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6270113430 con 0x7f627010d750 2024-05-20T17:06:14.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.954+0000 7f6274838700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62701042e0 0x7f6270101fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:14.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.954+0000 7f6274838700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62701042e0 0x7f6270101fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44248/0 (socket says 172.21.15.6:44248) 2024-05-20T17:06:14.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.954+0000 7f6274838700 1 -- 172.21.15.6:0/2384678426 learned_addr learned my addr 172.21.15.6:0/2384678426 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:14.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.954+0000 7f626ffff700 1 --2- 172.21.15.6:0/2384678426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6270104c30 0x7f6270102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:14.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.954+0000 7f6274838700 1 -- 172.21.15.6:0/2384678426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f627010d750 msgr2=0x7f6270102a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:14.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.954+0000 7f6275039700 1 --2- 172.21.15.6:0/2384678426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f627010d750 0x7f6270102a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:14.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.954+0000 7f6274838700 1 --2- 172.21.15.6:0/2384678426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f627010d750 0x7f6270102a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:14.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.954+0000 7f6274838700 1 -- 172.21.15.6:0/2384678426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6270104c30 msgr2=0x7f6270102510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:14.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.954+0000 7f6274838700 1 --2- 172.21.15.6:0/2384678426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6270104c30 0x7f6270102510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:14.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.954+0000 7f6274838700 1 -- 172.21.15.6:0/2384678426 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62701a7fc0 con 0x7f62701042e0 2024-05-20T17:06:14.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.954+0000 7f626ffff700 1 --2- 172.21.15.6:0/2384678426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6270104c30 0x7f6270102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:06:14.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.954+0000 7f6275039700 1 --2- 172.21.15.6:0/2384678426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f627010d750 0x7f6270102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:06:14.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.954+0000 7f6274838700 1 --2- 172.21.15.6:0/2384678426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62701042e0 0x7f6270101fd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f626400c920 tx=0x7f626400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:14.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.955+0000 7f626dffb700 1 -- 172.21.15.6:0/2384678426 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6264007b00 con 0x7f62701042e0 2024-05-20T17:06:14.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.955+0000 7f626dffb700 1 -- 172.21.15.6:0/2384678426 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6264004ce0 con 0x7f62701042e0 2024-05-20T17:06:14.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.955+0000 7f6276a9c700 1 -- 172.21.15.6:0/2384678426 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62701a82b0 con 0x7f62701042e0 2024-05-20T17:06:14.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.955+0000 7f626dffb700 1 -- 172.21.15.6:0/2384678426 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6264005600 con 0x7f62701042e0 2024-05-20T17:06:14.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.955+0000 7f6276a9c700 1 -- 172.21.15.6:0/2384678426 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62701a87f0 con 0x7f62701042e0 2024-05-20T17:06:14.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.956+0000 7f6276a9c700 1 -- 172.21.15.6:0/2384678426 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6270062d50 con 0x7f62701042e0 2024-05-20T17:06:14.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.957+0000 7f626dffb700 1 -- 172.21.15.6:0/2384678426 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f6264007ca0 con 0x7f62701042e0 2024-05-20T17:06:14.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.958+0000 7f626dffb700 1 --2- 172.21.15.6:0/2384678426 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f62600a2cb0 0x7f62600a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:14.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.958+0000 7f626dffb700 1 -- 172.21.15.6:0/2384678426 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f62640cf580 con 0x7f62701042e0 2024-05-20T17:06:14.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.958+0000 7f626ffff700 1 --2- 172.21.15.6:0/2384678426 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f62600a2cb0 0x7f62600a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:14.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.958+0000 7f626dffb700 1 --2- 172.21.15.6:0/2384678426 >> [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023] conn(0x7f62600ade60 0x7f62600b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:14.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.958+0000 7f626dffb700 1 -- 172.21.15.6:0/2384678426 --> [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f62600b0a20 con 0x7f62600ade60 2024-05-20T17:06:14.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.958+0000 7f626dffb700 1 -- 172.21.15.6:0/2384678426 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f62640cf9d0 con 0x7f62701042e0 2024-05-20T17:06:14.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.958+0000 7f6275039700 1 --2- 172.21.15.6:0/2384678426 >> [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023] conn(0x7f62600ade60 0x7f62600b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:14.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.959+0000 7f626ffff700 1 --2- 172.21.15.6:0/2384678426 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f62600a2cb0 0x7f62600a51c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f625c00b5c0 tx=0x7f625c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:14.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.959+0000 7f6275039700 1 --2- 172.21.15.6:0/2384678426 >> [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023] conn(0x7f62600ade60 0x7f62600b0350 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:14.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.960+0000 7f626dffb700 1 -- 172.21.15.6:0/2384678426 <== osd.6 v2:172.21.15.6:6818/3806628023 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f62600b0a20 con 0x7f62600ade60 2024-05-20T17:06:14.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.976+0000 7f6276a9c700 1 -- 172.21.15.6:0/2384678426 --> [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6270063150 con 0x7f62600ade60 2024-05-20T17:06:14.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.976+0000 7f626dffb700 1 -- 172.21.15.6:0/2384678426 <== osd.6 v2:172.21.15.6:6818/3806628023 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6270063150 con 0x7f62600ade60 2024-05-20T17:06:14.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.977+0000 7f6276a9c700 1 -- 172.21.15.6:0/2384678426 >> [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023] conn(0x7f62600ade60 msgr2=0x7f62600b0350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:14.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.977+0000 7f6276a9c700 1 --2- 172.21.15.6:0/2384678426 >> [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023] conn(0x7f62600ade60 0x7f62600b0350 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:14.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.977+0000 7f6276a9c700 1 -- 172.21.15.6:0/2384678426 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f62600a2cb0 msgr2=0x7f62600a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:14.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.977+0000 7f6276a9c700 1 --2- 172.21.15.6:0/2384678426 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f62600a2cb0 0x7f62600a51c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f625c00b5c0 tx=0x7f625c005fb0 comp rx=0 tx=0).stop 2024-05-20T17:06:14.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.977+0000 7f6276a9c700 1 -- 172.21.15.6:0/2384678426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62701042e0 msgr2=0x7f6270101fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:14.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.977+0000 7f6276a9c700 1 --2- 172.21.15.6:0/2384678426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62701042e0 0x7f6270101fd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f626400c920 tx=0x7f626400cce0 comp rx=0 tx=0).stop 2024-05-20T17:06:14.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.977+0000 7f6275039700 1 -- 172.21.15.6:0/2384678426 reap_dead start 2024-05-20T17:06:14.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.977+0000 7f6276a9c700 1 -- 172.21.15.6:0/2384678426 shutdown_connections 2024-05-20T17:06:14.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.977+0000 7f6276a9c700 1 -- 172.21.15.6:0/2384678426 >> 172.21.15.6:0/2384678426 conn(0x7f62700fdc40 msgr2=0x7f62700ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:14.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.977+0000 7f6276a9c700 1 -- 172.21.15.6:0/2384678426 shutdown_connections 2024-05-20T17:06:14.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:13.977+0000 7f6276a9c700 1 -- 172.21.15.6:0/2384678426 wait complete. 2024-05-20T17:06:14.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:13 smithi171 ceph-mon[35901]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-20T17:06:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.657+0000 7f3d7d81c700 1 -- 172.21.15.6:0/2587082876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d7810d750 msgr2=0x7f3d7810fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.657+0000 7f3d7d81c700 1 --2- 172.21.15.6:0/2587082876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d7810d750 0x7f3d7810fc30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3d70009990 tx=0x7f3d70009ca0 comp rx=0 tx=0).stop 2024-05-20T17:06:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.657+0000 7f3d7d81c700 1 -- 172.21.15.6:0/2587082876 shutdown_connections 2024-05-20T17:06:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.658+0000 7f3d7d81c700 1 --2- 172.21.15.6:0/2587082876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d7810d750 0x7f3d7810fc30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.658+0000 7f3d7d81c700 1 --2- 172.21.15.6:0/2587082876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d781042e0 0x7f3d781046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.658+0000 7f3d7d81c700 1 --2- 172.21.15.6:0/2587082876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d78104c30 0x7f3d7810d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.658+0000 7f3d7d81c700 1 -- 172.21.15.6:0/2587082876 >> 172.21.15.6:0/2587082876 conn(0x7f3d780fdc40 msgr2=0x7f3d78100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.658+0000 7f3d7d81c700 1 -- 172.21.15.6:0/2587082876 shutdown_connections 2024-05-20T17:06:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.658+0000 7f3d7d81c700 1 -- 172.21.15.6:0/2587082876 wait complete. 2024-05-20T17:06:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.658+0000 7f3d7d81c700 1 Processor -- start 2024-05-20T17:06:14.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.659+0000 7f3d7d81c700 1 -- start start 2024-05-20T17:06:14.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.659+0000 7f3d7d81c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d781042e0 0x7f3d78101fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:14.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.659+0000 7f3d7d81c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d78104c30 0x7f3d78102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:14.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.659+0000 7f3d7d81c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d7810d750 0x7f3d78102a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:14.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.659+0000 7f3d7d81c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781132b0 con 0x7f3d7810d750 2024-05-20T17:06:14.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.659+0000 7f3d7d81c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3d78113130 con 0x7f3d781042e0 2024-05-20T17:06:14.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.659+0000 7f3d7d81c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3d78113430 con 0x7f3d78104c30 2024-05-20T17:06:14.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.659+0000 7f3d777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d7810d750 0x7f3d78102a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:14.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.659+0000 7f3d777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d7810d750 0x7f3d78102a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44240/0 (socket says 172.21.15.6:44240) 2024-05-20T17:06:14.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.659+0000 7f3d777fe700 1 -- 172.21.15.6:0/1301903632 learned_addr learned my addr 172.21.15.6:0/1301903632 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:14.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.659+0000 7f3d76ffd700 1 --2- 172.21.15.6:0/1301903632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d781042e0 0x7f3d78101fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:14.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.659+0000 7f3d767fc700 1 --2- 172.21.15.6:0/1301903632 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d78104c30 0x7f3d78102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:14.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.660+0000 7f3d777fe700 1 -- 172.21.15.6:0/1301903632 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d78104c30 msgr2=0x7f3d78102510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:14.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.660+0000 7f3d777fe700 1 --2- 172.21.15.6:0/1301903632 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d78104c30 0x7f3d78102510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.660+0000 7f3d777fe700 1 -- 172.21.15.6:0/1301903632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d781042e0 msgr2=0x7f3d78101fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.660+0000 7f3d777fe700 1 --2- 172.21.15.6:0/1301903632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d781042e0 0x7f3d78101fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.660+0000 7f3d777fe700 1 -- 172.21.15.6:0/1301903632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d781a7f40 con 0x7f3d7810d750 2024-05-20T17:06:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.660+0000 7f3d777fe700 1 --2- 172.21.15.6:0/1301903632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d7810d750 0x7f3d78102a50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3d70005f50 tx=0x7f3d700057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.660+0000 7f3d7c81a700 1 -- 172.21.15.6:0/1301903632 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70027070 con 0x7f3d7810d750 2024-05-20T17:06:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.660+0000 7f3d7d81c700 1 -- 172.21.15.6:0/1301903632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d781a81d0 con 0x7f3d7810d750 2024-05-20T17:06:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.660+0000 7f3d7c81a700 1 -- 172.21.15.6:0/1301903632 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3d70003f10 con 0x7f3d7810d750 2024-05-20T17:06:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.660+0000 7f3d7c81a700 1 -- 172.21.15.6:0/1301903632 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70022c20 con 0x7f3d7810d750 2024-05-20T17:06:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.660+0000 7f3d7d81c700 1 -- 172.21.15.6:0/1301903632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d781a8680 con 0x7f3d7810d750 2024-05-20T17:06:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.661+0000 7f3d7d81c700 1 -- 172.21.15.6:0/1301903632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d78062d50 con 0x7f3d7810d750 2024-05-20T17:06:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.663+0000 7f3d7c81a700 1 -- 172.21.15.6:0/1301903632 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f3d7002a070 con 0x7f3d7810d750 2024-05-20T17:06:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.664+0000 7f3d7c81a700 1 --2- 172.21.15.6:0/1301903632 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3d640a2d30 0x7f3d640a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.664+0000 7f3d76ffd700 1 --2- 172.21.15.6:0/1301903632 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3d640a2d30 0x7f3d640a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.664+0000 7f3d7c81a700 1 -- 172.21.15.6:0/1301903632 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f3d700d0d20 con 0x7f3d7810d750 2024-05-20T17:06:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.664+0000 7f3d7c81a700 1 --2- 172.21.15.6:0/1301903632 >> [v2:172.21.15.62:6808/1161846805,v1:172.21.15.62:6809/1161846805] conn(0x7f3d640adee0 0x7f3d640b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.664+0000 7f3d7c81a700 1 -- 172.21.15.6:0/1301903632 --> [v2:172.21.15.62:6808/1161846805,v1:172.21.15.62:6809/1161846805] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d640b0aa0 con 0x7f3d640adee0 2024-05-20T17:06:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.664+0000 7f3d7c81a700 1 -- 172.21.15.6:0/1301903632 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f3d700d1160 con 0x7f3d7810d750 2024-05-20T17:06:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.664+0000 7f3d76ffd700 1 --2- 172.21.15.6:0/1301903632 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3d640a2d30 0x7f3d640a5240 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009550 tx=0x7f3d680091f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.664+0000 7f3d767fc700 1 --2- 172.21.15.6:0/1301903632 >> [v2:172.21.15.62:6808/1161846805,v1:172.21.15.62:6809/1161846805] conn(0x7f3d640adee0 0x7f3d640b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.665+0000 7f3d767fc700 1 --2- 172.21.15.6:0/1301903632 >> [v2:172.21.15.62:6808/1161846805,v1:172.21.15.62:6809/1161846805] conn(0x7f3d640adee0 0x7f3d640b03d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.666+0000 7f3d7c81a700 1 -- 172.21.15.6:0/1301903632 <== osd.4 v2:172.21.15.62:6808/1161846805 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d640b0aa0 con 0x7f3d640adee0 2024-05-20T17:06:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.683+0000 7f3d7d81c700 1 -- 172.21.15.6:0/1301903632 --> [v2:172.21.15.62:6808/1161846805,v1:172.21.15.62:6809/1161846805] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3d780631d0 con 0x7f3d640adee0 2024-05-20T17:06:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.684+0000 7f3d7c81a700 1 -- 172.21.15.6:0/1301903632 <== osd.4 v2:172.21.15.62:6808/1161846805 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3d780631d0 con 0x7f3d640adee0 2024-05-20T17:06:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.684+0000 7f3d7d81c700 1 -- 172.21.15.6:0/1301903632 >> [v2:172.21.15.62:6808/1161846805,v1:172.21.15.62:6809/1161846805] conn(0x7f3d640adee0 msgr2=0x7f3d640b03d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.684+0000 7f3d7d81c700 1 --2- 172.21.15.6:0/1301903632 >> [v2:172.21.15.62:6808/1161846805,v1:172.21.15.62:6809/1161846805] conn(0x7f3d640adee0 0x7f3d640b03d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.684+0000 7f3d7d81c700 1 -- 172.21.15.6:0/1301903632 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3d640a2d30 msgr2=0x7f3d640a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.684+0000 7f3d7d81c700 1 --2- 172.21.15.6:0/1301903632 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3d640a2d30 0x7f3d640a5240 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009550 tx=0x7f3d680091f0 comp rx=0 tx=0).stop 2024-05-20T17:06:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.684+0000 7f3d7d81c700 1 -- 172.21.15.6:0/1301903632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d7810d750 msgr2=0x7f3d78102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.684+0000 7f3d7d81c700 1 --2- 172.21.15.6:0/1301903632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d7810d750 0x7f3d78102a50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3d70005f50 tx=0x7f3d700057c0 comp rx=0 tx=0).stop 2024-05-20T17:06:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.684+0000 7f3d777fe700 1 -- 172.21.15.6:0/1301903632 reap_dead start 2024-05-20T17:06:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.684+0000 7f3d7d81c700 1 -- 172.21.15.6:0/1301903632 shutdown_connections 2024-05-20T17:06:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.684+0000 7f3d7d81c700 1 -- 172.21.15.6:0/1301903632 >> 172.21.15.6:0/1301903632 conn(0x7f3d780fdc40 msgr2=0x7f3d780ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.684+0000 7f3d7d81c700 1 -- 172.21.15.6:0/1301903632 shutdown_connections 2024-05-20T17:06:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:12.684+0000 7f3d7d81c700 1 -- 172.21.15.6:0/1301903632 wait complete. 2024-05-20T17:06:15.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.060+0000 7fe491010700 1 -- 172.21.15.6:0/2224565514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe48c101fb0 msgr2=0x7fe48c10ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.060+0000 7fe491010700 1 --2- 172.21.15.6:0/2224565514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe48c101fb0 0x7fe48c10ffa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe48400b0a0 tx=0x7fe48400b3b0 comp rx=0 tx=0).stop 2024-05-20T17:06:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.060+0000 7fe491010700 1 -- 172.21.15.6:0/2224565514 shutdown_connections 2024-05-20T17:06:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.060+0000 7fe491010700 1 --2- 172.21.15.6:0/2224565514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe48c101fb0 0x7fe48c10ffa0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.060+0000 7fe491010700 1 --2- 172.21.15.6:0/2224565514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe48c109260 0x7fe48c109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.060+0000 7fe491010700 1 --2- 172.21.15.6:0/2224565514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe48c101660 0x7fe48c101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.060+0000 7fe491010700 1 -- 172.21.15.6:0/2224565514 >> 172.21.15.6:0/2224565514 conn(0x7fe48c0fd570 msgr2=0x7fe48c0ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.060+0000 7fe491010700 1 -- 172.21.15.6:0/2224565514 shutdown_connections 2024-05-20T17:06:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.060+0000 7fe491010700 1 -- 172.21.15.6:0/2224565514 wait complete. 2024-05-20T17:06:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.061+0000 7fe491010700 1 Processor -- start 2024-05-20T17:06:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.061+0000 7fe491010700 1 -- start start 2024-05-20T17:06:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.062+0000 7fe491010700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe48c101660 0x7fe48c19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.062+0000 7fe491010700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe48c101fb0 0x7fe48c19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:15.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.062+0000 7fe491010700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe48c109260 0x7fe48c199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:15.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.062+0000 7fe491010700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c113300 con 0x7fe48c101fb0 2024-05-20T17:06:15.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.062+0000 7fe491010700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c113180 con 0x7fe48c101660 2024-05-20T17:06:15.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.062+0000 7fe491010700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c113480 con 0x7fe48c109260 2024-05-20T17:06:15.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.062+0000 7fe48259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe48c101fb0 0x7fe48c19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:15.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.062+0000 7fe48259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe48c101fb0 0x7fe48c19fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44264/0 (socket says 172.21.15.6:44264) 2024-05-20T17:06:15.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.062+0000 7fe48259c700 1 -- 172.21.15.6:0/1322527519 learned_addr learned my addr 172.21.15.6:0/1322527519 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:15.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.062+0000 7fe48ad9d700 1 --2- 172.21.15.6:0/1322527519 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe48c101660 0x7fe48c19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:15.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.062+0000 7fe48b59e700 1 --2- 172.21.15.6:0/1322527519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe48c109260 0x7fe48c199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:15.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.062+0000 7fe48259c700 1 -- 172.21.15.6:0/1322527519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe48c109260 msgr2=0x7fe48c199a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:15.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.062+0000 7fe48259c700 1 --2- 172.21.15.6:0/1322527519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe48c109260 0x7fe48c199a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:15.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.062+0000 7fe48259c700 1 -- 172.21.15.6:0/1322527519 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe48c101660 msgr2=0x7fe48c19f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:15.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.062+0000 7fe48259c700 1 --2- 172.21.15.6:0/1322527519 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe48c101660 0x7fe48c19f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.062+0000 7fe48259c700 1 -- 172.21.15.6:0/1322527519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48c19a0f0 con 0x7fe48c101fb0 2024-05-20T17:06:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.062+0000 7fe48b59e700 1 --2- 172.21.15.6:0/1322527519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe48c109260 0x7fe48c199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:06:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.062+0000 7fe48259c700 1 --2- 172.21.15.6:0/1322527519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe48c101fb0 0x7fe48c19fd60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe47400d980 tx=0x7fe47400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.063+0000 7fe488d99700 1 -- 172.21.15.6:0/1322527519 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe474017070 con 0x7fe48c101fb0 2024-05-20T17:06:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.063+0000 7fe491010700 1 -- 172.21.15.6:0/1322527519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe48c19a3e0 con 0x7fe48c101fb0 2024-05-20T17:06:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.063+0000 7fe488d99700 1 -- 172.21.15.6:0/1322527519 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe474009de0 con 0x7fe48c101fb0 2024-05-20T17:06:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.063+0000 7fe488d99700 1 -- 172.21.15.6:0/1322527519 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47400f3c0 con 0x7fe48c101fb0 2024-05-20T17:06:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.063+0000 7fe491010700 1 -- 172.21.15.6:0/1322527519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe48c1a66b0 con 0x7fe48c101fb0 2024-05-20T17:06:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.063+0000 7fe491010700 1 -- 172.21.15.6:0/1322527519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe48c10aa40 con 0x7fe48c101fb0 2024-05-20T17:06:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.066+0000 7fe488d99700 1 -- 172.21.15.6:0/1322527519 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fe474009930 con 0x7fe48c101fb0 2024-05-20T17:06:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.066+0000 7fe488d99700 1 --2- 172.21.15.6:0/1322527519 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe4780a2cb0 0x7fe4780a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.066+0000 7fe48ad9d700 1 --2- 172.21.15.6:0/1322527519 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe4780a2cb0 0x7fe4780a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.066+0000 7fe488d99700 1 -- 172.21.15.6:0/1322527519 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fe4740cf6d0 con 0x7fe48c101fb0 2024-05-20T17:06:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.067+0000 7fe488d99700 1 --2- 172.21.15.6:0/1322527519 >> [v2:172.21.15.171:6816/1159983887,v1:172.21.15.171:6817/1159983887] conn(0x7fe4780ade60 0x7fe4780b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.067+0000 7fe488d99700 1 -- 172.21.15.6:0/1322527519 --> [v2:172.21.15.171:6816/1159983887,v1:172.21.15.171:6817/1159983887] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe474023e50 con 0x7fe4780ade60 2024-05-20T17:06:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.067+0000 7fe488d99700 1 -- 172.21.15.6:0/1322527519 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fe4740cfa80 con 0x7fe48c101fb0 2024-05-20T17:06:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.067+0000 7fe48ad9d700 1 --2- 172.21.15.6:0/1322527519 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe4780a2cb0 0x7fe4780a51c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe48c19ab80 tx=0x7fe47c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.067+0000 7fe48b59e700 1 --2- 172.21.15.6:0/1322527519 >> [v2:172.21.15.171:6816/1159983887,v1:172.21.15.171:6817/1159983887] conn(0x7fe4780ade60 0x7fe4780b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.067+0000 7fe48b59e700 1 --2- 172.21.15.6:0/1322527519 >> [v2:172.21.15.171:6816/1159983887,v1:172.21.15.171:6817/1159983887] conn(0x7fe4780ade60 0x7fe4780b0350 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.068+0000 7fe488d99700 1 -- 172.21.15.6:0/1322527519 <== osd.8 v2:172.21.15.171:6816/1159983887 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe474023e50 con 0x7fe4780ade60 2024-05-20T17:06:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.085+0000 7fe491010700 1 -- 172.21.15.6:0/1322527519 --> [v2:172.21.15.171:6816/1159983887,v1:172.21.15.171:6817/1159983887] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe48c104980 con 0x7fe4780ade60 2024-05-20T17:06:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.085+0000 7fe488d99700 1 -- 172.21.15.6:0/1322527519 <== osd.8 v2:172.21.15.171:6816/1159983887 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe48c104980 con 0x7fe4780ade60 2024-05-20T17:06:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.086+0000 7fe491010700 1 -- 172.21.15.6:0/1322527519 >> [v2:172.21.15.171:6816/1159983887,v1:172.21.15.171:6817/1159983887] conn(0x7fe4780ade60 msgr2=0x7fe4780b0350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.086+0000 7fe491010700 1 --2- 172.21.15.6:0/1322527519 >> [v2:172.21.15.171:6816/1159983887,v1:172.21.15.171:6817/1159983887] conn(0x7fe4780ade60 0x7fe4780b0350 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.086+0000 7fe491010700 1 -- 172.21.15.6:0/1322527519 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe4780a2cb0 msgr2=0x7fe4780a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.086+0000 7fe491010700 1 --2- 172.21.15.6:0/1322527519 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe4780a2cb0 0x7fe4780a51c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe48c19ab80 tx=0x7fe47c009260 comp rx=0 tx=0).stop 2024-05-20T17:06:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.086+0000 7fe491010700 1 -- 172.21.15.6:0/1322527519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe48c101fb0 msgr2=0x7fe48c19fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.086+0000 7fe491010700 1 --2- 172.21.15.6:0/1322527519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe48c101fb0 0x7fe48c19fd60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe47400d980 tx=0x7fe47400dc90 comp rx=0 tx=0).stop 2024-05-20T17:06:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.086+0000 7fe48b59e700 1 -- 172.21.15.6:0/1322527519 reap_dead start 2024-05-20T17:06:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.086+0000 7fe491010700 1 -- 172.21.15.6:0/1322527519 shutdown_connections 2024-05-20T17:06:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.086+0000 7fe491010700 1 -- 172.21.15.6:0/1322527519 >> 172.21.15.6:0/1322527519 conn(0x7fe48c0fd570 msgr2=0x7fe48c109fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.086+0000 7fe491010700 1 -- 172.21.15.6:0/1322527519 shutdown_connections 2024-05-20T17:06:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:14.086+0000 7fe491010700 1 -- 172.21.15.6:0/1322527519 wait complete. 2024-05-20T17:06:15.726 INFO:teuthology.orchestra.run.smithi006.stdout:257698037804 2024-05-20T17:06:15.726 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-05-20T17:06:15.931 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:15 smithi006 ceph-mon[32486]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-20T17:06:16.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:15 smithi062 ceph-mon[35425]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-20T17:06:16.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:15 smithi171 ceph-mon[35901]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-20T17:06:16.273 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:06:16.274 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:06:16.589 INFO:teuthology.orchestra.run.smithi006.stdout:146028888129 2024-05-20T17:06:16.590 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-20T17:06:17.142 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:06:17.683 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:17 smithi006 ceph-mon[32486]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-05-20T17:06:18.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:17 smithi062 ceph-mon[35425]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-05-20T17:06:18.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:17 smithi171 ceph-mon[35901]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-05-20T17:06:18.653 INFO:teuthology.orchestra.run.smithi006.stdout:201863462966 2024-05-20T17:06:18.654 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-20T17:06:19.514 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:06:19.514 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:06:19.516 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:06:19.834 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:19 smithi006 ceph-mon[32486]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-20T17:06:19.846 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:06:20.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:19 smithi062 ceph-mon[35425]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-20T17:06:20.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:19 smithi171 ceph-mon[35901]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-20T17:06:20.894 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:06:20.900 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:06:21.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:21 smithi006 ceph-mon[32486]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-20T17:06:22.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:21 smithi062 ceph-mon[35425]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-20T17:06:22.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:21 smithi171 ceph-mon[35901]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-20T17:06:22.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.193+0000 7f2f967b2700 1 -- 172.21.15.6:0/1420841711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f90107d80 msgr2=0x7f2f90108190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:22.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.193+0000 7f2f967b2700 1 --2- 172.21.15.6:0/1420841711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f90107d80 0x7f2f90108190 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2f840099c0 tx=0x7f2f84009cd0 comp rx=0 tx=0).stop 2024-05-20T17:06:22.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.194+0000 7f2f967b2700 1 -- 172.21.15.6:0/1420841711 shutdown_connections 2024-05-20T17:06:22.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.194+0000 7f2f967b2700 1 --2- 172.21.15.6:0/1420841711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f901086d0 0x7f2f90110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:22.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.194+0000 7f2f967b2700 1 --2- 172.21.15.6:0/1420841711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f90103450 0x7f2f90103860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:22.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.194+0000 7f2f967b2700 1 --2- 172.21.15.6:0/1420841711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f90107d80 0x7f2f90108190 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:22.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.194+0000 7f2f967b2700 1 -- 172.21.15.6:0/1420841711 >> 172.21.15.6:0/1420841711 conn(0x7f2f900fed20 msgr2=0x7f2f90101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:22.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.194+0000 7f2f967b2700 1 -- 172.21.15.6:0/1420841711 shutdown_connections 2024-05-20T17:06:22.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.194+0000 7f2f967b2700 1 -- 172.21.15.6:0/1420841711 wait complete. 2024-05-20T17:06:22.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.194+0000 7f2f967b2700 1 Processor -- start 2024-05-20T17:06:22.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.195+0000 7f2f967b2700 1 -- start start 2024-05-20T17:06:22.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.195+0000 7f2f967b2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f90103450 0x7f2f90075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:22.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.195+0000 7f2f967b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f90107d80 0x7f2f90075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:22.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.195+0000 7f2f967b2700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f901086d0 0x7f2f900764d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:22.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.195+0000 7f2f967b2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2f901132e0 con 0x7f2f90107d80 2024-05-20T17:06:22.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.195+0000 7f2f967b2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2f90113160 con 0x7f2f90103450 2024-05-20T17:06:22.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.195+0000 7f2f967b2700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2f90113460 con 0x7f2f901086d0 2024-05-20T17:06:22.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.195+0000 7f2f8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f90107d80 0x7f2f90075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:22.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.195+0000 7f2f8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f90107d80 0x7f2f90075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59516/0 (socket says 172.21.15.6:59516) 2024-05-20T17:06:22.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.195+0000 7f2f8f7fe700 1 -- 172.21.15.6:0/3256956901 learned_addr learned my addr 172.21.15.6:0/3256956901 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:22.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.195+0000 7f2f8ffff700 1 --2- 172.21.15.6:0/3256956901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f90103450 0x7f2f90075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:22.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.195+0000 7f2f94d4f700 1 --2- 172.21.15.6:0/3256956901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f901086d0 0x7f2f900764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:22.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.195+0000 7f2f8f7fe700 1 -- 172.21.15.6:0/3256956901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f901086d0 msgr2=0x7f2f900764d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:22.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.195+0000 7f2f8f7fe700 1 --2- 172.21.15.6:0/3256956901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f901086d0 0x7f2f900764d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:22.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.195+0000 7f2f8f7fe700 1 -- 172.21.15.6:0/3256956901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f90103450 msgr2=0x7f2f90075a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:22.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.195+0000 7f2f8f7fe700 1 --2- 172.21.15.6:0/3256956901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f90103450 0x7f2f90075a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:22.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.195+0000 7f2f8f7fe700 1 -- 172.21.15.6:0/3256956901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f901a80f0 con 0x7f2f90107d80 2024-05-20T17:06:22.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.196+0000 7f2f8f7fe700 1 --2- 172.21.15.6:0/3256956901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f90107d80 0x7f2f90075f90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400c010 tx=0x7f2f840047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:22.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.196+0000 7f2f8d7fa700 1 -- 172.21.15.6:0/3256956901 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f84003680 con 0x7f2f90107d80 2024-05-20T17:06:22.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.196+0000 7f2f967b2700 1 -- 172.21.15.6:0/3256956901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f901a8380 con 0x7f2f90107d80 2024-05-20T17:06:22.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.196+0000 7f2f8d7fa700 1 -- 172.21.15.6:0/3256956901 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2f84004ce0 con 0x7f2f90107d80 2024-05-20T17:06:22.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.196+0000 7f2f8d7fa700 1 -- 172.21.15.6:0/3256956901 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f84003d00 con 0x7f2f90107d80 2024-05-20T17:06:22.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.196+0000 7f2f967b2700 1 -- 172.21.15.6:0/3256956901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f901a8770 con 0x7f2f90107d80 2024-05-20T17:06:22.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.197+0000 7f2f967b2700 1 -- 172.21.15.6:0/3256956901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2f90062d10 con 0x7f2f90107d80 2024-05-20T17:06:22.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.198+0000 7f2f8d7fa700 1 -- 172.21.15.6:0/3256956901 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f2f84004830 con 0x7f2f90107d80 2024-05-20T17:06:22.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.199+0000 7f2f8d7fa700 1 --2- 172.21.15.6:0/3256956901 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2f780a2cb0 0x7f2f780a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:22.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.199+0000 7f2f8ffff700 1 --2- 172.21.15.6:0/3256956901 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2f780a2cb0 0x7f2f780a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:22.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.199+0000 7f2f8d7fa700 1 -- 172.21.15.6:0/3256956901 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f2f840d0da0 con 0x7f2f90107d80 2024-05-20T17:06:22.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.199+0000 7f2f8d7fa700 1 --2- 172.21.15.6:0/3256956901 >> [v2:172.21.15.171:6800/56436737,v1:172.21.15.171:6801/56436737] conn(0x7f2f780adde0 0x7f2f780b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:22.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.199+0000 7f2f8d7fa700 1 -- 172.21.15.6:0/3256956901 --> [v2:172.21.15.171:6800/56436737,v1:172.21.15.171:6801/56436737] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f840095d0 con 0x7f2f780adde0 2024-05-20T17:06:22.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.199+0000 7f2f8d7fa700 1 -- 172.21.15.6:0/3256956901 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f2f840d11f0 con 0x7f2f90107d80 2024-05-20T17:06:22.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.200+0000 7f2f8ffff700 1 --2- 172.21.15.6:0/3256956901 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2f780a2cb0 0x7f2f780a51c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2f80005950 tx=0x7f2f8000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:22.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.200+0000 7f2f94d4f700 1 --2- 172.21.15.6:0/3256956901 >> [v2:172.21.15.171:6800/56436737,v1:172.21.15.171:6801/56436737] conn(0x7f2f780adde0 0x7f2f780b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:22.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.200+0000 7f2f94d4f700 1 --2- 172.21.15.6:0/3256956901 >> [v2:172.21.15.171:6800/56436737,v1:172.21.15.171:6801/56436737] conn(0x7f2f780adde0 0x7f2f780b02d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:22.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.201+0000 7f2f8d7fa700 1 -- 172.21.15.6:0/3256956901 <== osd.2 v2:172.21.15.171:6800/56436737 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2f840095d0 con 0x7f2f780adde0 2024-05-20T17:06:22.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.218+0000 7f2f967b2700 1 -- 172.21.15.6:0/3256956901 --> [v2:172.21.15.171:6800/56436737,v1:172.21.15.171:6801/56436737] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2f90063110 con 0x7f2f780adde0 2024-05-20T17:06:22.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.218+0000 7f2f8d7fa700 1 -- 172.21.15.6:0/3256956901 <== osd.2 v2:172.21.15.171:6800/56436737 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2f90063110 con 0x7f2f780adde0 2024-05-20T17:06:22.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.219+0000 7f2f967b2700 1 -- 172.21.15.6:0/3256956901 >> [v2:172.21.15.171:6800/56436737,v1:172.21.15.171:6801/56436737] conn(0x7f2f780adde0 msgr2=0x7f2f780b02d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:22.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.219+0000 7f2f967b2700 1 --2- 172.21.15.6:0/3256956901 >> [v2:172.21.15.171:6800/56436737,v1:172.21.15.171:6801/56436737] conn(0x7f2f780adde0 0x7f2f780b02d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:22.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.219+0000 7f2f967b2700 1 -- 172.21.15.6:0/3256956901 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2f780a2cb0 msgr2=0x7f2f780a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:22.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.219+0000 7f2f967b2700 1 --2- 172.21.15.6:0/3256956901 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2f780a2cb0 0x7f2f780a51c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2f80005950 tx=0x7f2f8000b410 comp rx=0 tx=0).stop 2024-05-20T17:06:22.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.219+0000 7f2f967b2700 1 -- 172.21.15.6:0/3256956901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f90107d80 msgr2=0x7f2f90075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:22.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.219+0000 7f2f967b2700 1 --2- 172.21.15.6:0/3256956901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f90107d80 0x7f2f90075f90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400c010 tx=0x7f2f840047b0 comp rx=0 tx=0).stop 2024-05-20T17:06:22.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.219+0000 7f2f94d4f700 1 -- 172.21.15.6:0/3256956901 reap_dead start 2024-05-20T17:06:22.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.219+0000 7f2f967b2700 1 -- 172.21.15.6:0/3256956901 shutdown_connections 2024-05-20T17:06:22.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.219+0000 7f2f967b2700 1 -- 172.21.15.6:0/3256956901 >> 172.21.15.6:0/3256956901 conn(0x7f2f900fed20 msgr2=0x7f2f90109630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:22.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.219+0000 7f2f967b2700 1 -- 172.21.15.6:0/3256956901 shutdown_connections 2024-05-20T17:06:22.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:22.219+0000 7f2f967b2700 1 -- 172.21.15.6:0/3256956901 wait complete. 2024-05-20T17:06:22.938 INFO:teuthology.orchestra.run.smithi006.stdout:77309411404 2024-05-20T17:06:22.938 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-20T17:06:23.750 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:23 smithi006 ceph-mon[32486]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 9 op/s 2024-05-20T17:06:24.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:23 smithi062 ceph-mon[35425]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 9 op/s 2024-05-20T17:06:24.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:23 smithi171 ceph-mon[35901]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 9 op/s 2024-05-20T17:06:24.580 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:06:24.580 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:06:25.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.938+0000 7f74133f5700 1 -- 172.21.15.6:0/967982913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f740c1042e0 msgr2=0x7f740c1046f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:25.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.938+0000 7f74133f5700 1 --2- 172.21.15.6:0/967982913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f740c1042e0 0x7f740c1046f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7408009990 tx=0x7f7408009ca0 comp rx=0 tx=0).stop 2024-05-20T17:06:25.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.938+0000 7f74133f5700 1 -- 172.21.15.6:0/967982913 shutdown_connections 2024-05-20T17:06:25.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.938+0000 7f74133f5700 1 --2- 172.21.15.6:0/967982913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f740c10d750 0x7f740c10fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:25.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.938+0000 7f74133f5700 1 --2- 172.21.15.6:0/967982913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f740c1042e0 0x7f740c1046f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:25.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.938+0000 7f74133f5700 1 --2- 172.21.15.6:0/967982913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f740c104c30 0x7f740c10d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:25.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.938+0000 7f74133f5700 1 -- 172.21.15.6:0/967982913 >> 172.21.15.6:0/967982913 conn(0x7f740c0fdc40 msgr2=0x7f740c100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:25.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.938+0000 7f74133f5700 1 -- 172.21.15.6:0/967982913 shutdown_connections 2024-05-20T17:06:25.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.938+0000 7f74133f5700 1 -- 172.21.15.6:0/967982913 wait complete. 2024-05-20T17:06:25.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.939+0000 7f74133f5700 1 Processor -- start 2024-05-20T17:06:25.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.939+0000 7f74133f5700 1 -- start start 2024-05-20T17:06:25.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.939+0000 7f74133f5700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f740c1042e0 0x7f740c19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:25.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.940+0000 7f74133f5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f740c104c30 0x7f740c19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:25.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.940+0000 7f74133f5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f740c10d750 0x7f740c199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:25.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.940+0000 7f7410990700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f740c104c30 0x7f740c19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.940+0000 7f7411992700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f740c10d750 0x7f740c199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.940+0000 7f74133f5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f740c1132a0 con 0x7f740c10d750 2024-05-20T17:06:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.940+0000 7f7410990700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f740c104c30 0x7f740c19fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.6:47320/0 (socket says 172.21.15.6:47320) 2024-05-20T17:06:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.940+0000 7f74133f5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f740c113120 con 0x7f740c104c30 2024-05-20T17:06:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.940+0000 7f74133f5700 1 -- 172.21.15.6:0/1181494141 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f740c113420 con 0x7f740c1042e0 2024-05-20T17:06:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.940+0000 7f7410990700 1 -- 172.21.15.6:0/1181494141 learned_addr learned my addr 172.21.15.6:0/1181494141 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.940+0000 7f7411191700 1 --2- 172.21.15.6:0/1181494141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f740c1042e0 0x7f740c19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.940+0000 7f7411992700 1 -- 172.21.15.6:0/1181494141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f740c1042e0 msgr2=0x7f740c19f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.940+0000 7f7411992700 1 --2- 172.21.15.6:0/1181494141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f740c1042e0 0x7f740c19f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.940+0000 7f7411992700 1 -- 172.21.15.6:0/1181494141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f740c104c30 msgr2=0x7f740c19fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:25.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.940+0000 7f7411992700 1 --2- 172.21.15.6:0/1181494141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f740c104c30 0x7f740c19fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:25.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.940+0000 7f7411992700 1 -- 172.21.15.6:0/1181494141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740c19a0f0 con 0x7f740c10d750 2024-05-20T17:06:25.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.940+0000 7f7410990700 1 --2- 172.21.15.6:0/1181494141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f740c104c30 0x7f740c19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:06:25.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.940+0000 7f7411992700 1 --2- 172.21.15.6:0/1181494141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f740c10d750 0x7f740c199a40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f740400efc0 tx=0x7f740400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:25.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.941+0000 7f73fe7fc700 1 -- 172.21.15.6:0/1181494141 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74040092e0 con 0x7f740c10d750 2024-05-20T17:06:25.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.941+0000 7f74133f5700 1 -- 172.21.15.6:0/1181494141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f740c19a380 con 0x7f740c10d750 2024-05-20T17:06:25.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.941+0000 7f74133f5700 1 -- 172.21.15.6:0/1181494141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f740c1a66b0 con 0x7f740c10d750 2024-05-20T17:06:25.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.941+0000 7f73fe7fc700 1 -- 172.21.15.6:0/1181494141 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7404004bb0 con 0x7f740c10d750 2024-05-20T17:06:25.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.941+0000 7f73fe7fc700 1 -- 172.21.15.6:0/1181494141 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7404004020 con 0x7f740c10d750 2024-05-20T17:06:25.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.943+0000 7f74133f5700 1 -- 172.21.15.6:0/1181494141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f740c050170 con 0x7f740c10d750 2024-05-20T17:06:25.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.943+0000 7f73fe7fc700 1 -- 172.21.15.6:0/1181494141 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f740401b030 con 0x7f740c10d750 2024-05-20T17:06:25.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.944+0000 7f73fe7fc700 1 --2- 172.21.15.6:0/1181494141 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f73f80a2d30 0x7f73f80a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:25.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.944+0000 7f7411191700 1 --2- 172.21.15.6:0/1181494141 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f73f80a2d30 0x7f73f80a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:25.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.944+0000 7f73fe7fc700 1 -- 172.21.15.6:0/1181494141 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f74040cef20 con 0x7f740c10d750 2024-05-20T17:06:25.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.945+0000 7f7411191700 1 --2- 172.21.15.6:0/1181494141 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f73f80a2d30 0x7f73f80a5240 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f740800b2e0 tx=0x7f7408005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:25.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:25.949+0000 7f73fe7fc700 1 -- 172.21.15.6:0/1181494141 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7404022020 con 0x7f740c10d750 2024-05-20T17:06:25.950 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:25 smithi006 ceph-mon[32486]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-05-20T17:06:26.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:25 smithi062 ceph-mon[35425]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-05-20T17:06:26.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:25 smithi171 ceph-mon[35901]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-05-20T17:06:26.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.158+0000 7f74133f5700 1 -- 172.21.15.6:0/1181494141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f740c02dc60 con 0x7f740c10d750 2024-05-20T17:06:26.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.159+0000 7f73fe7fc700 1 -- 172.21.15.6:0/1181494141 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7404010040 con 0x7f740c10d750 2024-05-20T17:06:26.159 INFO:teuthology.orchestra.run.smithi006.stdout:111669149768 2024-05-20T17:06:26.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.161+0000 7f74133f5700 1 -- 172.21.15.6:0/1181494141 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f73f80a2d30 msgr2=0x7f73f80a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:26.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.161+0000 7f74133f5700 1 --2- 172.21.15.6:0/1181494141 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f73f80a2d30 0x7f73f80a5240 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f740800b2e0 tx=0x7f7408005960 comp rx=0 tx=0).stop 2024-05-20T17:06:26.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.161+0000 7f74133f5700 1 -- 172.21.15.6:0/1181494141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f740c10d750 msgr2=0x7f740c199a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:26.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.161+0000 7f74133f5700 1 --2- 172.21.15.6:0/1181494141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f740c10d750 0x7f740c199a40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f740400efc0 tx=0x7f740400c3a0 comp rx=0 tx=0).stop 2024-05-20T17:06:26.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.161+0000 7f74133f5700 1 -- 172.21.15.6:0/1181494141 shutdown_connections 2024-05-20T17:06:26.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.161+0000 7f74133f5700 1 --2- 172.21.15.6:0/1181494141 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f73f80a2d30 0x7f73f80a5240 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:26.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.161+0000 7f74133f5700 1 --2- 172.21.15.6:0/1181494141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f740c10d750 0x7f740c199a40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:26.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.161+0000 7f74133f5700 1 --2- 172.21.15.6:0/1181494141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f740c1042e0 0x7f740c19f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:26.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.161+0000 7f74133f5700 1 --2- 172.21.15.6:0/1181494141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f740c104c30 0x7f740c19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:26.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.161+0000 7f74133f5700 1 -- 172.21.15.6:0/1181494141 >> 172.21.15.6:0/1181494141 conn(0x7f740c0fdc40 msgr2=0x7f740c0fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:26.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.161+0000 7f74133f5700 1 -- 172.21.15.6:0/1181494141 shutdown_connections 2024-05-20T17:06:26.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.161+0000 7f74133f5700 1 -- 172.21.15.6:0/1181494141 wait complete. 2024-05-20T17:06:26.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.277+0000 7fd8e23db700 1 -- 172.21.15.6:0/3563786680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8dc108720 msgr2=0x7fd8dc1100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:26.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.277+0000 7fd8e23db700 1 --2- 172.21.15.6:0/3563786680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8dc108720 0x7fd8dc1100c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400b0d0 tx=0x7fd8d400b3e0 comp rx=0 tx=0).stop 2024-05-20T17:06:26.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.278+0000 7fd8e23db700 1 -- 172.21.15.6:0/3563786680 shutdown_connections 2024-05-20T17:06:26.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.278+0000 7fd8e23db700 1 --2- 172.21.15.6:0/3563786680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8dc108720 0x7fd8dc1100c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:26.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.278+0000 7fd8e23db700 1 --2- 172.21.15.6:0/3563786680 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8dc1019b0 0x7fd8dc101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:26.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.278+0000 7fd8e23db700 1 --2- 172.21.15.6:0/3563786680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8dc107dd0 0x7fd8dc1081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:26.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.278+0000 7fd8e23db700 1 -- 172.21.15.6:0/3563786680 >> 172.21.15.6:0/3563786680 conn(0x7fd8dc0fd570 msgr2=0x7fd8dc0ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:26.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.278+0000 7fd8e23db700 1 -- 172.21.15.6:0/3563786680 shutdown_connections 2024-05-20T17:06:26.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.278+0000 7fd8e23db700 1 -- 172.21.15.6:0/3563786680 wait complete. 2024-05-20T17:06:26.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.278+0000 7fd8e23db700 1 Processor -- start 2024-05-20T17:06:26.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.278+0000 7fd8e23db700 1 -- start start 2024-05-20T17:06:26.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.279+0000 7fd8e23db700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8dc1019b0 0x7fd8dc102900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:26.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.279+0000 7fd8e23db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8dc107dd0 0x7fd8dc102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:26.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.279+0000 7fd8e23db700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8dc108720 0x7fd8dc103380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:26.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.279+0000 7fd8e23db700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc1133b0 con 0x7fd8dc107dd0 2024-05-20T17:06:26.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.279+0000 7fd8e23db700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc113230 con 0x7fd8dc1019b0 2024-05-20T17:06:26.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.279+0000 7fd8e23db700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc113530 con 0x7fd8dc108720 2024-05-20T17:06:26.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.279+0000 7fd8d3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8dc107dd0 0x7fd8dc102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:26.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.279+0000 7fd8d3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8dc107dd0 0x7fd8dc102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59528/0 (socket says 172.21.15.6:59528) 2024-05-20T17:06:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.279+0000 7fd8d3fff700 1 -- 172.21.15.6:0/1188302546 learned_addr learned my addr 172.21.15.6:0/1188302546 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.279+0000 7fd8e0978700 1 --2- 172.21.15.6:0/1188302546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8dc108720 0x7fd8dc103380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.279+0000 7fd8dbfff700 1 --2- 172.21.15.6:0/1188302546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8dc1019b0 0x7fd8dc102900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.279+0000 7fd8d3fff700 1 -- 172.21.15.6:0/1188302546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8dc108720 msgr2=0x7fd8dc103380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.279+0000 7fd8d3fff700 1 --2- 172.21.15.6:0/1188302546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8dc108720 0x7fd8dc103380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.279+0000 7fd8d3fff700 1 -- 172.21.15.6:0/1188302546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8dc1019b0 msgr2=0x7fd8dc102900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.279+0000 7fd8d3fff700 1 --2- 172.21.15.6:0/1188302546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8dc1019b0 0x7fd8dc102900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.279+0000 7fd8d3fff700 1 -- 172.21.15.6:0/1188302546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8dc1a8100 con 0x7fd8dc107dd0 2024-05-20T17:06:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.279+0000 7fd8d3fff700 1 --2- 172.21.15.6:0/1188302546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8dc107dd0 0x7fd8dc102e40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd8c400d950 tx=0x7fd8c400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.280+0000 7fd8d9ffb700 1 -- 172.21.15.6:0/1188302546 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4017070 con 0x7fd8dc107dd0 2024-05-20T17:06:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.280+0000 7fd8d9ffb700 1 -- 172.21.15.6:0/1188302546 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd8c4005020 con 0x7fd8dc107dd0 2024-05-20T17:06:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.280+0000 7fd8d9ffb700 1 -- 172.21.15.6:0/1188302546 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c400fa90 con 0x7fd8dc107dd0 2024-05-20T17:06:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.280+0000 7fd8e23db700 1 -- 172.21.15.6:0/1188302546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8dc1a83f0 con 0x7fd8dc107dd0 2024-05-20T17:06:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.280+0000 7fd8e23db700 1 -- 172.21.15.6:0/1188302546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8dc1a88e0 con 0x7fd8dc107dd0 2024-05-20T17:06:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.281+0000 7fd8e23db700 1 -- 172.21.15.6:0/1188302546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8dc050170 con 0x7fd8dc107dd0 2024-05-20T17:06:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.283+0000 7fd8d9ffb700 1 -- 172.21.15.6:0/1188302546 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fd8c40051d0 con 0x7fd8dc107dd0 2024-05-20T17:06:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.283+0000 7fd8d9ffb700 1 --2- 172.21.15.6:0/1188302546 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd8c80a2d30 0x7fd8c80a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.284+0000 7fd8dbfff700 1 --2- 172.21.15.6:0/1188302546 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd8c80a2d30 0x7fd8c80a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:26.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.284+0000 7fd8d9ffb700 1 -- 172.21.15.6:0/1188302546 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fd8c40cefc0 con 0x7fd8dc107dd0 2024-05-20T17:06:26.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.284+0000 7fd8dbfff700 1 --2- 172.21.15.6:0/1188302546 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd8c80a2d30 0x7fd8c80a5240 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc005950 tx=0x7fd8cc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:26.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.287+0000 7fd8d9ffb700 1 -- 172.21.15.6:0/1188302546 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd8c409bae0 con 0x7fd8dc107dd0 2024-05-20T17:06:26.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.497+0000 7fd8e23db700 1 -- 172.21.15.6:0/1188302546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd8dc02dc60 con 0x7fd8dc107dd0 2024-05-20T17:06:26.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.497+0000 7fd8d9ffb700 1 -- 172.21.15.6:0/1188302546 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd8c409b3e0 con 0x7fd8dc107dd0 2024-05-20T17:06:26.498 INFO:teuthology.orchestra.run.smithi006.stdout:167503724606 2024-05-20T17:06:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.499+0000 7fd8e23db700 1 -- 172.21.15.6:0/1188302546 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd8c80a2d30 msgr2=0x7fd8c80a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.499+0000 7fd8e23db700 1 --2- 172.21.15.6:0/1188302546 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd8c80a2d30 0x7fd8c80a5240 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc005950 tx=0x7fd8cc00b410 comp rx=0 tx=0).stop 2024-05-20T17:06:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.499+0000 7fd8e23db700 1 -- 172.21.15.6:0/1188302546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8dc107dd0 msgr2=0x7fd8dc102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.499+0000 7fd8e23db700 1 --2- 172.21.15.6:0/1188302546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8dc107dd0 0x7fd8dc102e40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd8c400d950 tx=0x7fd8c400dc60 comp rx=0 tx=0).stop 2024-05-20T17:06:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.499+0000 7fd8e23db700 1 -- 172.21.15.6:0/1188302546 shutdown_connections 2024-05-20T17:06:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.499+0000 7fd8e23db700 1 --2- 172.21.15.6:0/1188302546 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd8c80a2d30 0x7fd8c80a5240 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.499+0000 7fd8e23db700 1 --2- 172.21.15.6:0/1188302546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8dc108720 0x7fd8dc103380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.499+0000 7fd8e23db700 1 --2- 172.21.15.6:0/1188302546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8dc1019b0 0x7fd8dc102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.499+0000 7fd8e23db700 1 --2- 172.21.15.6:0/1188302546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8dc107dd0 0x7fd8dc102e40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.499+0000 7fd8e23db700 1 -- 172.21.15.6:0/1188302546 >> 172.21.15.6:0/1188302546 conn(0x7fd8dc0fd570 msgr2=0x7fd8dc1074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:26.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.499+0000 7fd8e23db700 1 -- 172.21.15.6:0/1188302546 shutdown_connections 2024-05-20T17:06:26.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:26.500+0000 7fd8e23db700 1 -- 172.21.15.6:0/1188302546 wait complete. 2024-05-20T17:06:26.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:26 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1181494141' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-20T17:06:26.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:26 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1188302546' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-20T17:06:27.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:26 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1181494141' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-20T17:06:27.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:26 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1188302546' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-20T17:06:27.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:26 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1181494141' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-20T17:06:27.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:26 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1188302546' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-20T17:06:27.955 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:27 smithi006 ceph-mon[32486]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-20T17:06:28.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:27 smithi062 ceph-mon[35425]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-20T17:06:28.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:27 smithi171 ceph-mon[35901]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-20T17:06:29.879 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:29 smithi006 ceph-mon[32486]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-20T17:06:30.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:29 smithi062 ceph-mon[35425]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-20T17:06:30.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:29 smithi171 ceph-mon[35901]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-20T17:06:30.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.996+0000 7f595a7a6700 1 -- 172.21.15.6:0/512276814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f595410d750 msgr2=0x7f595410fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:30.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.996+0000 7f595a7a6700 1 --2- 172.21.15.6:0/512276814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f595410d750 0x7f595410fc60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f594c00b0a0 tx=0x7f594c00b3b0 comp rx=0 tx=0).stop 2024-05-20T17:06:30.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.996+0000 7f595a7a6700 1 -- 172.21.15.6:0/512276814 shutdown_connections 2024-05-20T17:06:30.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.996+0000 7f595a7a6700 1 --2- 172.21.15.6:0/512276814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f595410d750 0x7f595410fc60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:30.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.996+0000 7f595a7a6700 1 --2- 172.21.15.6:0/512276814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59541042e0 0x7f59541046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:30.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.996+0000 7f595a7a6700 1 --2- 172.21.15.6:0/512276814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5954104c30 0x7f595410d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:30.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.996+0000 7f595a7a6700 1 -- 172.21.15.6:0/512276814 >> 172.21.15.6:0/512276814 conn(0x7f59540fdc70 msgr2=0x7f5954100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:30.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.996+0000 7f595a7a6700 1 -- 172.21.15.6:0/512276814 shutdown_connections 2024-05-20T17:06:30.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.996+0000 7f595a7a6700 1 -- 172.21.15.6:0/512276814 wait complete. 2024-05-20T17:06:30.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.997+0000 7f595a7a6700 1 Processor -- start 2024-05-20T17:06:30.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.997+0000 7f595a7a6700 1 -- start start 2024-05-20T17:06:30.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.997+0000 7f595a7a6700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59541042e0 0x7f595419f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:30.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.997+0000 7f595a7a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5954104c30 0x7f595419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:30.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.997+0000 7f595a7a6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f595410d750 0x7f5954199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:30.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.997+0000 7f595a7a6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5954113300 con 0x7f5954104c30 2024-05-20T17:06:30.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.997+0000 7f595a7a6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5954113180 con 0x7f595410d750 2024-05-20T17:06:30.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.997+0000 7f595a7a6700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5954113480 con 0x7f59541042e0 2024-05-20T17:06:30.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.998+0000 7f59537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5954104c30 0x7f595419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:30.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.998+0000 7f59537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5954104c30 0x7f595419fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59548/0 (socket says 172.21.15.6:59548) 2024-05-20T17:06:30.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.998+0000 7f59537fe700 1 -- 172.21.15.6:0/408413853 learned_addr learned my addr 172.21.15.6:0/408413853 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:30.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.998+0000 7f5958d43700 1 --2- 172.21.15.6:0/408413853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f595410d750 0x7f5954199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:30.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.998+0000 7f5953fff700 1 --2- 172.21.15.6:0/408413853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59541042e0 0x7f595419f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:30.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.998+0000 7f59537fe700 1 -- 172.21.15.6:0/408413853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59541042e0 msgr2=0x7f595419f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:30.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.998+0000 7f59537fe700 1 --2- 172.21.15.6:0/408413853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59541042e0 0x7f595419f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.998+0000 7f59537fe700 1 -- 172.21.15.6:0/408413853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f595410d750 msgr2=0x7f5954199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.998+0000 7f59537fe700 1 --2- 172.21.15.6:0/408413853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f595410d750 0x7f5954199a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.998+0000 7f59537fe700 1 -- 172.21.15.6:0/408413853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595419a0b0 con 0x7f5954104c30 2024-05-20T17:06:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.998+0000 7f5958d43700 1 --2- 172.21.15.6:0/408413853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f595410d750 0x7f5954199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:06:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.998+0000 7f59537fe700 1 --2- 172.21.15.6:0/408413853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5954104c30 0x7f595419fd20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f594800d980 tx=0x7f594800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.998+0000 7f59517fa700 1 -- 172.21.15.6:0/408413853 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5948017070 con 0x7f5954104c30 2024-05-20T17:06:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.998+0000 7f59517fa700 1 -- 172.21.15.6:0/408413853 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5948010460 con 0x7f5954104c30 2024-05-20T17:06:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.998+0000 7f59517fa700 1 -- 172.21.15.6:0/408413853 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594800de60 con 0x7f5954104c30 2024-05-20T17:06:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.998+0000 7f595a7a6700 1 -- 172.21.15.6:0/408413853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f595419a3a0 con 0x7f5954104c30 2024-05-20T17:06:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:29.998+0000 7f595a7a6700 1 -- 172.21.15.6:0/408413853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59541a6670 con 0x7f5954104c30 2024-05-20T17:06:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.000+0000 7f595a7a6700 1 -- 172.21.15.6:0/408413853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5954050170 con 0x7f5954104c30 2024-05-20T17:06:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.001+0000 7f59517fa700 1 -- 172.21.15.6:0/408413853 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f5948010610 con 0x7f5954104c30 2024-05-20T17:06:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.002+0000 7f59517fa700 1 --2- 172.21.15.6:0/408413853 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f593c0a2d30 0x7f593c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.002+0000 7f5953fff700 1 --2- 172.21.15.6:0/408413853 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f593c0a2d30 0x7f593c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:30.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.002+0000 7f59517fa700 1 -- 172.21.15.6:0/408413853 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f59480cf010 con 0x7f5954104c30 2024-05-20T17:06:30.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.003+0000 7f5953fff700 1 --2- 172.21.15.6:0/408413853 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f593c0a2d30 0x7f593c0a5240 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5944005fd0 tx=0x7f5944005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:30.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.006+0000 7f59517fa700 1 -- 172.21.15.6:0/408413853 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f594809bb30 con 0x7f5954104c30 2024-05-20T17:06:30.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.212+0000 7f595a7a6700 1 -- 172.21.15.6:0/408413853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f595402dc60 con 0x7f5954104c30 2024-05-20T17:06:30.517 INFO:teuthology.orchestra.run.smithi006.stdout:347892351007 2024-05-20T17:06:30.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.213+0000 7f59517fa700 1 -- 172.21.15.6:0/408413853 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f594809b430 con 0x7f5954104c30 2024-05-20T17:06:30.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.215+0000 7f595a7a6700 1 -- 172.21.15.6:0/408413853 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f593c0a2d30 msgr2=0x7f593c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:30.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.215+0000 7f595a7a6700 1 --2- 172.21.15.6:0/408413853 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f593c0a2d30 0x7f593c0a5240 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5944005fd0 tx=0x7f5944005dd0 comp rx=0 tx=0).stop 2024-05-20T17:06:30.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.215+0000 7f595a7a6700 1 -- 172.21.15.6:0/408413853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5954104c30 msgr2=0x7f595419fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:30.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.215+0000 7f595a7a6700 1 --2- 172.21.15.6:0/408413853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5954104c30 0x7f595419fd20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f594800d980 tx=0x7f594800dd40 comp rx=0 tx=0).stop 2024-05-20T17:06:30.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.215+0000 7f595a7a6700 1 -- 172.21.15.6:0/408413853 shutdown_connections 2024-05-20T17:06:30.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.215+0000 7f595a7a6700 1 --2- 172.21.15.6:0/408413853 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f593c0a2d30 0x7f593c0a5240 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:30.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.215+0000 7f595a7a6700 1 --2- 172.21.15.6:0/408413853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f595410d750 0x7f5954199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:30.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.215+0000 7f595a7a6700 1 --2- 172.21.15.6:0/408413853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59541042e0 0x7f595419f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:30.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.215+0000 7f595a7a6700 1 --2- 172.21.15.6:0/408413853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5954104c30 0x7f595419fd20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:30.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.215+0000 7f595a7a6700 1 -- 172.21.15.6:0/408413853 >> 172.21.15.6:0/408413853 conn(0x7f59540fdc70 msgr2=0x7f59540ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:30.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.215+0000 7f595a7a6700 1 -- 172.21.15.6:0/408413853 shutdown_connections 2024-05-20T17:06:30.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:30.215+0000 7f595a7a6700 1 -- 172.21.15.6:0/408413853 wait complete. 2024-05-20T17:06:30.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:30 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/408413853' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-20T17:06:31.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:30 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/408413853' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-20T17:06:31.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:30 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/408413853' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-20T17:06:31.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.170+0000 7fcd0d9aa700 1 -- 172.21.15.6:0/140223342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd081075c0 msgr2=0x7fcd0810ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:31.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.170+0000 7fcd0d9aa700 1 --2- 172.21.15.6:0/140223342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd081075c0 0x7fcd0810ef20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcd0000b0d0 tx=0x7fcd0000b3e0 comp rx=0 tx=0).stop 2024-05-20T17:06:31.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.170+0000 7fcd0d9aa700 1 -- 172.21.15.6:0/140223342 shutdown_connections 2024-05-20T17:06:31.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.170+0000 7fcd0d9aa700 1 --2- 172.21.15.6:0/140223342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd081075c0 0x7fcd0810ef20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:31.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.170+0000 7fcd0d9aa700 1 --2- 172.21.15.6:0/140223342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd08102340 0x7fcd08102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:31.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.170+0000 7fcd0d9aa700 1 --2- 172.21.15.6:0/140223342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd08106c70 0x7fcd08107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:31.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.170+0000 7fcd0d9aa700 1 -- 172.21.15.6:0/140223342 >> 172.21.15.6:0/140223342 conn(0x7fcd080fdc40 msgr2=0x7fcd08100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:31.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.171+0000 7fcd0d9aa700 1 -- 172.21.15.6:0/140223342 shutdown_connections 2024-05-20T17:06:31.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.171+0000 7fcd0d9aa700 1 -- 172.21.15.6:0/140223342 wait complete. 2024-05-20T17:06:31.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.171+0000 7fcd0d9aa700 1 Processor -- start 2024-05-20T17:06:31.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.171+0000 7fcd0d9aa700 1 -- start start 2024-05-20T17:06:31.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.172+0000 7fcd0d9aa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd08102340 0x7fcd0819f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:31.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.172+0000 7fcd0d9aa700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd08106c70 0x7fcd0819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:31.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.172+0000 7fcd0d9aa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd081075c0 0x7fcd08199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.172+0000 7fcd0d9aa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcd081121f0 con 0x7fcd081075c0 2024-05-20T17:06:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.172+0000 7fcd0d9aa700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fcd08112070 con 0x7fcd08102340 2024-05-20T17:06:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.172+0000 7fcd0d9aa700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcd08112370 con 0x7fcd08106c70 2024-05-20T17:06:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.172+0000 7fcd077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd081075c0 0x7fcd08199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.172+0000 7fcd06ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd08102340 0x7fcd0819f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.172+0000 7fcd077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd081075c0 0x7fcd08199a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36074/0 (socket says 172.21.15.6:36074) 2024-05-20T17:06:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.172+0000 7fcd077fe700 1 -- 172.21.15.6:0/2002957635 learned_addr learned my addr 172.21.15.6:0/2002957635 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.172+0000 7fcd067fc700 1 --2- 172.21.15.6:0/2002957635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd08106c70 0x7fcd0819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.172+0000 7fcd077fe700 1 -- 172.21.15.6:0/2002957635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd08106c70 msgr2=0x7fcd0819fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.172+0000 7fcd077fe700 1 --2- 172.21.15.6:0/2002957635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd08106c70 0x7fcd0819fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:31.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.172+0000 7fcd077fe700 1 -- 172.21.15.6:0/2002957635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd08102340 msgr2=0x7fcd0819f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:31.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.172+0000 7fcd077fe700 1 --2- 172.21.15.6:0/2002957635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd08102340 0x7fcd0819f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:31.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.172+0000 7fcd077fe700 1 -- 172.21.15.6:0/2002957635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0819a060 con 0x7fcd081075c0 2024-05-20T17:06:31.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.173+0000 7fcd077fe700 1 --2- 172.21.15.6:0/2002957635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd081075c0 0x7fcd08199a20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcd000095c0 tx=0x7fcd00007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:31.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.173+0000 7fcd0c9a8700 1 -- 172.21.15.6:0/2002957635 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0001f070 con 0x7fcd081075c0 2024-05-20T17:06:31.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.173+0000 7fcd0d9aa700 1 -- 172.21.15.6:0/2002957635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd0819a2f0 con 0x7fcd081075c0 2024-05-20T17:06:31.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.173+0000 7fcd0c9a8700 1 -- 172.21.15.6:0/2002957635 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcd00007e20 con 0x7fcd081075c0 2024-05-20T17:06:31.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.173+0000 7fcd0c9a8700 1 -- 172.21.15.6:0/2002957635 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0001b4a0 con 0x7fcd081075c0 2024-05-20T17:06:31.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.173+0000 7fcd0d9aa700 1 -- 172.21.15.6:0/2002957635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd0819a820 con 0x7fcd081075c0 2024-05-20T17:06:31.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.174+0000 7fcd0d9aa700 1 -- 172.21.15.6:0/2002957635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd08050170 con 0x7fcd081075c0 2024-05-20T17:06:31.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.175+0000 7fcd0c9a8700 1 -- 172.21.15.6:0/2002957635 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fcd00022070 con 0x7fcd081075c0 2024-05-20T17:06:31.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.176+0000 7fcd0c9a8700 1 --2- 172.21.15.6:0/2002957635 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fccf40a2cb0 0x7fccf40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:31.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.177+0000 7fcd06ffd700 1 --2- 172.21.15.6:0/2002957635 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fccf40a2cb0 0x7fccf40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:31.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.177+0000 7fcd0c9a8700 1 -- 172.21.15.6:0/2002957635 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fcd0000f020 con 0x7fcd081075c0 2024-05-20T17:06:31.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.177+0000 7fcd06ffd700 1 --2- 172.21.15.6:0/2002957635 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fccf40a2cb0 0x7fccf40a51c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcd0819ab60 tx=0x7fccf80073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:31.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.181+0000 7fcd0c9a8700 1 -- 172.21.15.6:0/2002957635 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcd00029020 con 0x7fcd081075c0 2024-05-20T17:06:31.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.390+0000 7fcd0d9aa700 1 -- 172.21.15.6:0/2002957635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fcd0802dc60 con 0x7fcd081075c0 2024-05-20T17:06:31.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.390+0000 7fcd0c9a8700 1 -- 172.21.15.6:0/2002957635 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fcd0009d600 con 0x7fcd081075c0 2024-05-20T17:06:31.391 INFO:teuthology.orchestra.run.smithi006.stdout:313532612644 2024-05-20T17:06:31.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.392+0000 7fcd0d9aa700 1 -- 172.21.15.6:0/2002957635 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fccf40a2cb0 msgr2=0x7fccf40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:31.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.392+0000 7fcd0d9aa700 1 --2- 172.21.15.6:0/2002957635 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fccf40a2cb0 0x7fccf40a51c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcd0819ab60 tx=0x7fccf80073d0 comp rx=0 tx=0).stop 2024-05-20T17:06:31.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.392+0000 7fcd0d9aa700 1 -- 172.21.15.6:0/2002957635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd081075c0 msgr2=0x7fcd08199a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:31.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.392+0000 7fcd0d9aa700 1 --2- 172.21.15.6:0/2002957635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd081075c0 0x7fcd08199a20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcd000095c0 tx=0x7fcd00007a20 comp rx=0 tx=0).stop 2024-05-20T17:06:31.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.393+0000 7fcd0d9aa700 1 -- 172.21.15.6:0/2002957635 shutdown_connections 2024-05-20T17:06:31.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.393+0000 7fcd0d9aa700 1 --2- 172.21.15.6:0/2002957635 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fccf40a2cb0 0x7fccf40a51c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:31.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.393+0000 7fcd0d9aa700 1 --2- 172.21.15.6:0/2002957635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd081075c0 0x7fcd08199a20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:31.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.393+0000 7fcd0d9aa700 1 --2- 172.21.15.6:0/2002957635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd08102340 0x7fcd0819f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:31.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.393+0000 7fcd0d9aa700 1 --2- 172.21.15.6:0/2002957635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd08106c70 0x7fcd0819fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:31.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.393+0000 7fcd0d9aa700 1 -- 172.21.15.6:0/2002957635 >> 172.21.15.6:0/2002957635 conn(0x7fcd080fdc40 msgr2=0x7fcd0806a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:31.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.393+0000 7fcd0d9aa700 1 -- 172.21.15.6:0/2002957635 shutdown_connections 2024-05-20T17:06:31.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:31.393+0000 7fcd0d9aa700 1 -- 172.21.15.6:0/2002957635 wait complete. 2024-05-20T17:06:32.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:31 smithi062 ceph-mon[35425]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:06:32.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:31 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2002957635' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-20T17:06:32.027 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:31 smithi006 ceph-mon[32486]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:06:32.027 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:31 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2002957635' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-20T17:06:32.055 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892351003 got 347892351007 for osd.11 2024-05-20T17:06:32.055 DEBUG:teuthology.parallel:result is None 2024-05-20T17:06:32.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:31 smithi171 ceph-mon[35901]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:06:32.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:31 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2002957635' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-20T17:06:33.298 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149762 got 111669149768 for osd.3 2024-05-20T17:06:33.298 DEBUG:teuthology.parallel:result is None 2024-05-20T17:06:33.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:33 smithi006 ceph-mon[32486]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:06:34.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:33 smithi062 ceph-mon[35425]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:06:34.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:33 smithi171 ceph-mon[35901]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:06:34.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.197+0000 7fd6055b8700 1 -- 172.21.15.6:0/3371276541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6001086d0 msgr2=0x7fd600110030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:34.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.197+0000 7fd6055b8700 1 --2- 172.21.15.6:0/3371276541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6001086d0 0x7fd600110030 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80099c0 tx=0x7fd5f8009cd0 comp rx=0 tx=0).stop 2024-05-20T17:06:34.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.197+0000 7fd6055b8700 1 -- 172.21.15.6:0/3371276541 shutdown_connections 2024-05-20T17:06:34.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.197+0000 7fd6055b8700 1 --2- 172.21.15.6:0/3371276541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6001086d0 0x7fd600110030 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:34.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.197+0000 7fd6055b8700 1 --2- 172.21.15.6:0/3371276541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd600103450 0x7fd600103860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:34.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.197+0000 7fd6055b8700 1 --2- 172.21.15.6:0/3371276541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd600107d80 0x7fd600108190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:34.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.197+0000 7fd6055b8700 1 -- 172.21.15.6:0/3371276541 >> 172.21.15.6:0/3371276541 conn(0x7fd6000fed20 msgr2=0x7fd600101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:34.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.197+0000 7fd6055b8700 1 -- 172.21.15.6:0/3371276541 shutdown_connections 2024-05-20T17:06:34.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.197+0000 7fd6055b8700 1 -- 172.21.15.6:0/3371276541 wait complete. 2024-05-20T17:06:34.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.197+0000 7fd6055b8700 1 Processor -- start 2024-05-20T17:06:34.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.198+0000 7fd6055b8700 1 -- start start 2024-05-20T17:06:34.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.198+0000 7fd6055b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd600103450 0x7fd60019f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:34.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.198+0000 7fd6055b8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd600107d80 0x7fd60019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:34.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.198+0000 7fd6055b8700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6001086d0 0x7fd6001999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:34.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.198+0000 7fd6055b8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd600113300 con 0x7fd600103450 2024-05-20T17:06:34.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.198+0000 7fd6055b8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd600113180 con 0x7fd600107d80 2024-05-20T17:06:34.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.198+0000 7fd6055b8700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd600113480 con 0x7fd6001086d0 2024-05-20T17:06:34.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.198+0000 7fd5feffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd600103450 0x7fd60019f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:34.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.198+0000 7fd5feffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd600103450 0x7fd60019f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36098/0 (socket says 172.21.15.6:36098) 2024-05-20T17:06:34.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.198+0000 7fd5feffd700 1 -- 172.21.15.6:0/3563112613 learned_addr learned my addr 172.21.15.6:0/3563112613 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:34.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.198+0000 7fd5ff7fe700 1 --2- 172.21.15.6:0/3563112613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6001086d0 0x7fd6001999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:34.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.198+0000 7fd5fe7fc700 1 --2- 172.21.15.6:0/3563112613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd600107d80 0x7fd60019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:34.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.199+0000 7fd5feffd700 1 -- 172.21.15.6:0/3563112613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6001086d0 msgr2=0x7fd6001999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:34.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.199+0000 7fd5feffd700 1 --2- 172.21.15.6:0/3563112613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6001086d0 0x7fd6001999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:34.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.199+0000 7fd5feffd700 1 -- 172.21.15.6:0/3563112613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd600107d80 msgr2=0x7fd60019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:34.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.199+0000 7fd5feffd700 1 --2- 172.21.15.6:0/3563112613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd600107d80 0x7fd60019fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:34.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.199+0000 7fd5feffd700 1 -- 172.21.15.6:0/3563112613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60019a090 con 0x7fd600103450 2024-05-20T17:06:34.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.199+0000 7fd5feffd700 1 --2- 172.21.15.6:0/3563112613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd600103450 0x7fd60019f7c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd5f00060b0 tx=0x7fd5f00117c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:34.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.199+0000 7fd5f7fff700 1 -- 172.21.15.6:0/3563112613 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f001e070 con 0x7fd600103450 2024-05-20T17:06:34.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.199+0000 7fd5f7fff700 1 -- 172.21.15.6:0/3563112613 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd5f0019aa0 con 0x7fd600103450 2024-05-20T17:06:34.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.199+0000 7fd6055b8700 1 -- 172.21.15.6:0/3563112613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60019a380 con 0x7fd600103450 2024-05-20T17:06:34.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.199+0000 7fd5f7fff700 1 -- 172.21.15.6:0/3563112613 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0016c20 con 0x7fd600103450 2024-05-20T17:06:34.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.199+0000 7fd6055b8700 1 -- 172.21.15.6:0/3563112613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd600075980 con 0x7fd600103450 2024-05-20T17:06:34.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.201+0000 7fd6055b8700 1 -- 172.21.15.6:0/3563112613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd600050170 con 0x7fd600103450 2024-05-20T17:06:34.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.202+0000 7fd5f7fff700 1 -- 172.21.15.6:0/3563112613 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fd5f0021070 con 0x7fd600103450 2024-05-20T17:06:34.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.203+0000 7fd5f7fff700 1 --2- 172.21.15.6:0/3563112613 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd5ec0a2d30 0x7fd5ec0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:34.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.203+0000 7fd5fe7fc700 1 --2- 172.21.15.6:0/3563112613 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd5ec0a2d30 0x7fd5ec0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:34.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.203+0000 7fd5f7fff700 1 -- 172.21.15.6:0/3563112613 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fd5f00d2fc0 con 0x7fd600103450 2024-05-20T17:06:34.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.204+0000 7fd5fe7fc700 1 --2- 172.21.15.6:0/3563112613 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd5ec0a2d30 0x7fd5ec0a5240 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd6001069c0 tx=0x7fd5e800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:34.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.208+0000 7fd5f7fff700 1 -- 172.21.15.6:0/3563112613 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd5f0016070 con 0x7fd600103450 2024-05-20T17:06:34.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.418+0000 7fd6055b8700 1 -- 172.21.15.6:0/3563112613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd60002dc60 con 0x7fd600103450 2024-05-20T17:06:34.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.419+0000 7fd5f7fff700 1 -- 172.21.15.6:0/3563112613 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd5f009fa00 con 0x7fd600103450 2024-05-20T17:06:34.419 INFO:teuthology.orchestra.run.smithi006.stdout:201863462969 2024-05-20T17:06:34.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.421+0000 7fd6055b8700 1 -- 172.21.15.6:0/3563112613 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd5ec0a2d30 msgr2=0x7fd5ec0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:34.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.421+0000 7fd6055b8700 1 --2- 172.21.15.6:0/3563112613 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd5ec0a2d30 0x7fd5ec0a5240 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd6001069c0 tx=0x7fd5e800b410 comp rx=0 tx=0).stop 2024-05-20T17:06:34.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.421+0000 7fd6055b8700 1 -- 172.21.15.6:0/3563112613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd600103450 msgr2=0x7fd60019f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:34.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.421+0000 7fd6055b8700 1 --2- 172.21.15.6:0/3563112613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd600103450 0x7fd60019f7c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd5f00060b0 tx=0x7fd5f00117c0 comp rx=0 tx=0).stop 2024-05-20T17:06:34.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.421+0000 7fd6055b8700 1 -- 172.21.15.6:0/3563112613 shutdown_connections 2024-05-20T17:06:34.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.421+0000 7fd6055b8700 1 --2- 172.21.15.6:0/3563112613 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd5ec0a2d30 0x7fd5ec0a5240 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:34.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.421+0000 7fd6055b8700 1 --2- 172.21.15.6:0/3563112613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6001086d0 0x7fd6001999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:34.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.421+0000 7fd6055b8700 1 --2- 172.21.15.6:0/3563112613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd600103450 0x7fd60019f7c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:34.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.421+0000 7fd6055b8700 1 --2- 172.21.15.6:0/3563112613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd600107d80 0x7fd60019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:34.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.421+0000 7fd6055b8700 1 -- 172.21.15.6:0/3563112613 >> 172.21.15.6:0/3563112613 conn(0x7fd6000fed20 msgr2=0x7fd6001074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:34.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.422+0000 7fd6055b8700 1 -- 172.21.15.6:0/3563112613 shutdown_connections 2024-05-20T17:06:34.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:34.422+0000 7fd6055b8700 1 -- 172.21.15.6:0/3563112613 wait complete. 2024-05-20T17:06:34.753 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612638 got 313532612644 for osd.10 2024-05-20T17:06:34.753 DEBUG:teuthology.parallel:result is None 2024-05-20T17:06:35.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:34 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3563112613' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-20T17:06:35.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:34 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3563112613' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-20T17:06:35.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:34 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3563112613' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-20T17:06:35.199 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724602 got 167503724606 for osd.5 2024-05-20T17:06:35.199 DEBUG:teuthology.parallel:result is None 2024-05-20T17:06:35.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.868+0000 7fd4c20d4700 1 -- 172.21.15.6:0/3334372055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4bc108180 msgr2=0x7fd4bc108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:35.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.868+0000 7fd4c20d4700 1 --2- 172.21.15.6:0/3334372055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4bc108180 0x7fd4bc108590 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009990 tx=0x7fd4a4009ca0 comp rx=0 tx=0).stop 2024-05-20T17:06:35.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.868+0000 7fd4c20d4700 1 -- 172.21.15.6:0/3334372055 shutdown_connections 2024-05-20T17:06:35.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.868+0000 7fd4c20d4700 1 --2- 172.21.15.6:0/3334372055 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4bc101f60 0x7fd4bc10fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:35.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.868+0000 7fd4c20d4700 1 --2- 172.21.15.6:0/3334372055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4bc108180 0x7fd4bc108590 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:35.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.868+0000 7fd4c20d4700 1 --2- 172.21.15.6:0/3334372055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4bc101610 0x7fd4bc101a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:35.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.868+0000 7fd4c20d4700 1 -- 172.21.15.6:0/3334372055 >> 172.21.15.6:0/3334372055 conn(0x7fd4bc0fd360 msgr2=0x7fd4bc0ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:35.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.868+0000 7fd4c20d4700 1 -- 172.21.15.6:0/3334372055 shutdown_connections 2024-05-20T17:06:35.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.868+0000 7fd4c20d4700 1 -- 172.21.15.6:0/3334372055 wait complete. 2024-05-20T17:06:35.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.869+0000 7fd4c20d4700 1 Processor -- start 2024-05-20T17:06:35.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.869+0000 7fd4c20d4700 1 -- start start 2024-05-20T17:06:35.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.869+0000 7fd4c20d4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4bc101610 0x7fd4bc199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:35.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.869+0000 7fd4c20d4700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4bc101f60 0x7fd4bc19a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:35.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.869+0000 7fd4c20d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4bc108180 0x7fd4bc19e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:35.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.869+0000 7fd4c20d4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd4bc113410 con 0x7fd4bc108180 2024-05-20T17:06:35.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.869+0000 7fd4c20d4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd4bc113290 con 0x7fd4bc101610 2024-05-20T17:06:35.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.869+0000 7fd4c20d4700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd4bc113590 con 0x7fd4bc101f60 2024-05-20T17:06:35.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.869+0000 7fd4bbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4bc108180 0x7fd4bc19e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.869+0000 7fd4bbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4bc108180 0x7fd4bc19e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36114/0 (socket says 172.21.15.6:36114) 2024-05-20T17:06:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.869+0000 7fd4bbfff700 1 -- 172.21.15.6:0/864916489 learned_addr learned my addr 172.21.15.6:0/864916489 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.870+0000 7fd4bb7fe700 1 --2- 172.21.15.6:0/864916489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4bc101610 0x7fd4bc199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.870+0000 7fd4baffd700 1 --2- 172.21.15.6:0/864916489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4bc101f60 0x7fd4bc19a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.870+0000 7fd4bbfff700 1 -- 172.21.15.6:0/864916489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4bc101f60 msgr2=0x7fd4bc19a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.870+0000 7fd4bbfff700 1 --2- 172.21.15.6:0/864916489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4bc101f60 0x7fd4bc19a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.870+0000 7fd4bbfff700 1 -- 172.21.15.6:0/864916489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4bc101610 msgr2=0x7fd4bc199de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.870+0000 7fd4bbfff700 1 --2- 172.21.15.6:0/864916489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4bc101610 0x7fd4bc199de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.870+0000 7fd4bbfff700 1 -- 172.21.15.6:0/864916489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4bc19ec00 con 0x7fd4bc108180 2024-05-20T17:06:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.870+0000 7fd4bbfff700 1 --2- 172.21.15.6:0/864916489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4bc108180 0x7fd4bc19e610 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4007d70 tx=0x7fd4b400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:35.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.870+0000 7fd4b8ff9700 1 -- 172.21.15.6:0/864916489 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4016020 con 0x7fd4bc108180 2024-05-20T17:06:35.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.870+0000 7fd4b8ff9700 1 -- 172.21.15.6:0/864916489 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd4b400ac90 con 0x7fd4bc108180 2024-05-20T17:06:35.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.870+0000 7fd4c20d4700 1 -- 172.21.15.6:0/864916489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4bc19eef0 con 0x7fd4bc108180 2024-05-20T17:06:35.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.870+0000 7fd4b8ff9700 1 -- 172.21.15.6:0/864916489 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40115e0 con 0x7fd4bc108180 2024-05-20T17:06:35.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.870+0000 7fd4c20d4700 1 -- 172.21.15.6:0/864916489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4bc19f430 con 0x7fd4bc108180 2024-05-20T17:06:35.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.872+0000 7fd4c20d4700 1 -- 172.21.15.6:0/864916489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4bc050170 con 0x7fd4bc108180 2024-05-20T17:06:35.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.873+0000 7fd4b8ff9700 1 -- 172.21.15.6:0/864916489 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fd4b4019020 con 0x7fd4bc108180 2024-05-20T17:06:35.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.874+0000 7fd4b8ff9700 1 --2- 172.21.15.6:0/864916489 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd4a80a2d30 0x7fd4a80a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:35.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.874+0000 7fd4bb7fe700 1 --2- 172.21.15.6:0/864916489 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd4a80a2d30 0x7fd4a80a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:35.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.874+0000 7fd4b8ff9700 1 -- 172.21.15.6:0/864916489 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fd4b40cf810 con 0x7fd4bc108180 2024-05-20T17:06:35.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.874+0000 7fd4bb7fe700 1 --2- 172.21.15.6:0/864916489 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd4a80a2d30 0x7fd4a80a5240 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4006010 tx=0x7fd4a4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:35.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:35.878+0000 7fd4b8ff9700 1 -- 172.21.15.6:0/864916489 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd4b4020020 con 0x7fd4bc108180 2024-05-20T17:06:36.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:35 smithi062 ceph-mon[35425]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:06:36.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:36.086+0000 7fd4c20d4700 1 -- 172.21.15.6:0/864916489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fd4bc19b140 con 0x7fd4bc108180 2024-05-20T17:06:36.087 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:35 smithi006 ceph-mon[32486]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:06:36.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:36.086+0000 7fd4b8ff9700 1 -- 172.21.15.6:0/864916489 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd4b409c360 con 0x7fd4bc108180 2024-05-20T17:06:36.087 INFO:teuthology.orchestra.run.smithi006.stdout:292057776170 2024-05-20T17:06:36.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:36.089+0000 7fd4c20d4700 1 -- 172.21.15.6:0/864916489 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd4a80a2d30 msgr2=0x7fd4a80a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:36.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:36.089+0000 7fd4c20d4700 1 --2- 172.21.15.6:0/864916489 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd4a80a2d30 0x7fd4a80a5240 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4006010 tx=0x7fd4a4005960 comp rx=0 tx=0).stop 2024-05-20T17:06:36.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:36.089+0000 7fd4c20d4700 1 -- 172.21.15.6:0/864916489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4bc108180 msgr2=0x7fd4bc19e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:36.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:36.089+0000 7fd4c20d4700 1 --2- 172.21.15.6:0/864916489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4bc108180 0x7fd4bc19e610 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4007d70 tx=0x7fd4b400a340 comp rx=0 tx=0).stop 2024-05-20T17:06:36.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:36.089+0000 7fd4c20d4700 1 -- 172.21.15.6:0/864916489 shutdown_connections 2024-05-20T17:06:36.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:36.089+0000 7fd4c20d4700 1 --2- 172.21.15.6:0/864916489 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd4a80a2d30 0x7fd4a80a5240 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:36.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:36.089+0000 7fd4c20d4700 1 --2- 172.21.15.6:0/864916489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4bc108180 0x7fd4bc19e610 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:36.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:36.089+0000 7fd4c20d4700 1 --2- 172.21.15.6:0/864916489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4bc101610 0x7fd4bc199de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:36.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:36.089+0000 7fd4c20d4700 1 --2- 172.21.15.6:0/864916489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4bc101f60 0x7fd4bc19a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:36.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:36.089+0000 7fd4c20d4700 1 -- 172.21.15.6:0/864916489 >> 172.21.15.6:0/864916489 conn(0x7fd4bc0fd360 msgr2=0x7fd4bc105fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:36.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:36.089+0000 7fd4c20d4700 1 -- 172.21.15.6:0/864916489 shutdown_connections 2024-05-20T17:06:36.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:36.089+0000 7fd4c20d4700 1 -- 172.21.15.6:0/864916489 wait complete. 2024-05-20T17:06:36.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:35 smithi171 ceph-mon[35901]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:06:36.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:36 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/864916489' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-20T17:06:37.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:36 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/864916489' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-20T17:06:37.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:36 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/864916489' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-20T17:06:37.410 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776163 got 292057776170 for osd.9 2024-05-20T17:06:37.411 DEBUG:teuthology.parallel:result is None 2024-05-20T17:06:38.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:37 smithi062 ceph-mon[35425]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:06:38.077 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:37 smithi006 ceph-mon[32486]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:06:38.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:37 smithi171 ceph-mon[35901]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:06:38.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.340+0000 7fd1f09ba700 1 -- 172.21.15.6:0/3909168980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ec106c90 msgr2=0x7fd1ec1070a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.340+0000 7fd1f09ba700 1 --2- 172.21.15.6:0/3909168980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ec106c90 0x7fd1ec1070a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00099c0 tx=0x7fd1e0009cd0 comp rx=0 tx=0).stop 2024-05-20T17:06:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.341+0000 7fd1f09ba700 1 -- 172.21.15.6:0/3909168980 shutdown_connections 2024-05-20T17:06:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.341+0000 7fd1f09ba700 1 --2- 172.21.15.6:0/3909168980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1ec1075e0 0x7fd1ec10ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.341+0000 7fd1f09ba700 1 --2- 172.21.15.6:0/3909168980 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1ec102360 0x7fd1ec102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.341+0000 7fd1f09ba700 1 --2- 172.21.15.6:0/3909168980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ec106c90 0x7fd1ec1070a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.341+0000 7fd1f09ba700 1 -- 172.21.15.6:0/3909168980 >> 172.21.15.6:0/3909168980 conn(0x7fd1ec0fddb0 msgr2=0x7fd1ec1001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.341+0000 7fd1f09ba700 1 -- 172.21.15.6:0/3909168980 shutdown_connections 2024-05-20T17:06:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.341+0000 7fd1f09ba700 1 -- 172.21.15.6:0/3909168980 wait complete. 2024-05-20T17:06:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.342+0000 7fd1f09ba700 1 Processor -- start 2024-05-20T17:06:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.342+0000 7fd1f09ba700 1 -- start start 2024-05-20T17:06:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.342+0000 7fd1f09ba700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1ec102360 0x7fd1ec198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.342+0000 7fd1f09ba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ec106c90 0x7fd1ec198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.342+0000 7fd1f09ba700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1ec1075e0 0x7fd1ec1993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.342+0000 7fd1f09ba700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ec1121f0 con 0x7fd1ec106c90 2024-05-20T17:06:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.342+0000 7fd1f09ba700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ec112070 con 0x7fd1ec102360 2024-05-20T17:06:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.342+0000 7fd1f09ba700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ec112370 con 0x7fd1ec1075e0 2024-05-20T17:06:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.342+0000 7fd1e9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ec106c90 0x7fd1ec198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.342+0000 7fd1e9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ec106c90 0x7fd1ec198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36124/0 (socket says 172.21.15.6:36124) 2024-05-20T17:06:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.342+0000 7fd1e9d9b700 1 -- 172.21.15.6:0/818005386 learned_addr learned my addr 172.21.15.6:0/818005386 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.342+0000 7fd1ead9d700 1 --2- 172.21.15.6:0/818005386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1ec1075e0 0x7fd1ec1993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.342+0000 7fd1ea59c700 1 --2- 172.21.15.6:0/818005386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1ec102360 0x7fd1ec198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.343+0000 7fd1e9d9b700 1 -- 172.21.15.6:0/818005386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1ec1075e0 msgr2=0x7fd1ec1993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.343+0000 7fd1e9d9b700 1 --2- 172.21.15.6:0/818005386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1ec1075e0 0x7fd1ec1993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.343+0000 7fd1e9d9b700 1 -- 172.21.15.6:0/818005386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1ec102360 msgr2=0x7fd1ec198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.343+0000 7fd1e9d9b700 1 --2- 172.21.15.6:0/818005386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1ec102360 0x7fd1ec198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.343+0000 7fd1e9d9b700 1 -- 172.21.15.6:0/818005386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ec1a8060 con 0x7fd1ec106c90 2024-05-20T17:06:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.343+0000 7fd1ea59c700 1 --2- 172.21.15.6:0/818005386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1ec102360 0x7fd1ec198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:06:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.343+0000 7fd1e9d9b700 1 --2- 172.21.15.6:0/818005386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ec106c90 0x7fd1ec198ea0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00059d0 tx=0x7fd1e00057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.343+0000 7fd1db7fe700 1 -- 172.21.15.6:0/818005386 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0027070 con 0x7fd1ec106c90 2024-05-20T17:06:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.343+0000 7fd1f09ba700 1 -- 172.21.15.6:0/818005386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1ec1a82f0 con 0x7fd1ec106c90 2024-05-20T17:06:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.343+0000 7fd1db7fe700 1 -- 172.21.15.6:0/818005386 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd1e0003f50 con 0x7fd1ec106c90 2024-05-20T17:06:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.343+0000 7fd1db7fe700 1 -- 172.21.15.6:0/818005386 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0022cf0 con 0x7fd1ec106c90 2024-05-20T17:06:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.343+0000 7fd1f09ba700 1 -- 172.21.15.6:0/818005386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1ec1a87a0 con 0x7fd1ec106c90 2024-05-20T17:06:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.344+0000 7fd1f09ba700 1 -- 172.21.15.6:0/818005386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1ec103810 con 0x7fd1ec106c90 2024-05-20T17:06:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.346+0000 7fd1db7fe700 1 -- 172.21.15.6:0/818005386 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fd1e002a070 con 0x7fd1ec106c90 2024-05-20T17:06:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.346+0000 7fd1db7fe700 1 --2- 172.21.15.6:0/818005386 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd1d40a2cb0 0x7fd1d40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.346+0000 7fd1db7fe700 1 -- 172.21.15.6:0/818005386 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fd1e00d0350 con 0x7fd1ec106c90 2024-05-20T17:06:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.346+0000 7fd1ea59c700 1 --2- 172.21.15.6:0/818005386 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd1d40a2cb0 0x7fd1d40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.347+0000 7fd1ea59c700 1 --2- 172.21.15.6:0/818005386 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd1d40a2cb0 0x7fd1d40a51c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00bc10 tx=0x7fd1dc00b5f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.351+0000 7fd1db7fe700 1 -- 172.21.15.6:0/818005386 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd1e005e850 con 0x7fd1ec106c90 2024-05-20T17:06:38.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.572+0000 7fd1f09ba700 1 -- 172.21.15.6:0/818005386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd1ec02dc60 con 0x7fd1ec106c90 2024-05-20T17:06:38.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.573+0000 7fd1db7fe700 1 -- 172.21.15.6:0/818005386 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd1e0013070 con 0x7fd1ec106c90 2024-05-20T17:06:38.573 INFO:teuthology.orchestra.run.smithi006.stdout:223338299445 2024-05-20T17:06:38.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.575+0000 7fd1f09ba700 1 -- 172.21.15.6:0/818005386 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd1d40a2cb0 msgr2=0x7fd1d40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:38.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.575+0000 7fd1f09ba700 1 --2- 172.21.15.6:0/818005386 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd1d40a2cb0 0x7fd1d40a51c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00bc10 tx=0x7fd1dc00b5f0 comp rx=0 tx=0).stop 2024-05-20T17:06:38.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.575+0000 7fd1f09ba700 1 -- 172.21.15.6:0/818005386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ec106c90 msgr2=0x7fd1ec198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:38.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.575+0000 7fd1f09ba700 1 --2- 172.21.15.6:0/818005386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ec106c90 0x7fd1ec198ea0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00059d0 tx=0x7fd1e00057c0 comp rx=0 tx=0).stop 2024-05-20T17:06:38.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.575+0000 7fd1f09ba700 1 -- 172.21.15.6:0/818005386 shutdown_connections 2024-05-20T17:06:38.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.575+0000 7fd1f09ba700 1 --2- 172.21.15.6:0/818005386 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd1d40a2cb0 0x7fd1d40a51c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:38.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.575+0000 7fd1f09ba700 1 --2- 172.21.15.6:0/818005386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1ec1075e0 0x7fd1ec1993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:38.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.575+0000 7fd1f09ba700 1 --2- 172.21.15.6:0/818005386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1ec102360 0x7fd1ec198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:38.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.575+0000 7fd1f09ba700 1 --2- 172.21.15.6:0/818005386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ec106c90 0x7fd1ec198ea0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:38.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.575+0000 7fd1f09ba700 1 -- 172.21.15.6:0/818005386 >> 172.21.15.6:0/818005386 conn(0x7fd1ec0fddb0 msgr2=0x7fd1ec108540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:38.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.575+0000 7fd1f09ba700 1 -- 172.21.15.6:0/818005386 shutdown_connections 2024-05-20T17:06:38.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:38.575+0000 7fd1f09ba700 1 -- 172.21.15.6:0/818005386 wait complete. 2024-05-20T17:06:38.699 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462966 got 201863462969 for osd.6 2024-05-20T17:06:38.699 DEBUG:teuthology.parallel:result is None 2024-05-20T17:06:39.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:38 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/818005386' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-20T17:06:39.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:38 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/818005386' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-20T17:06:39.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:38 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/818005386' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-20T17:06:39.357 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299439 got 223338299445 for osd.7 2024-05-20T17:06:39.357 DEBUG:teuthology.parallel:result is None 2024-05-20T17:06:40.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:39 smithi062 ceph-mon[35425]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:06:40.108 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:39 smithi006 ceph-mon[32486]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:06:40.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:39 smithi171 ceph-mon[35901]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:06:40.141 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:06:41.973 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:41 smithi006 ceph-mon[32486]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:06:41.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.991+0000 7f926a415700 1 -- 172.21.15.6:0/4194910012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92641023d0 msgr2=0x7f92641027e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:41.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.991+0000 7f926a415700 1 --2- 172.21.15.6:0/4194910012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92641023d0 0x7f92641027e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f92540099c0 tx=0x7f9254009cd0 comp rx=0 tx=0).stop 2024-05-20T17:06:41.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.991+0000 7f926a415700 1 -- 172.21.15.6:0/4194910012 shutdown_connections 2024-05-20T17:06:41.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.991+0000 7f926a415700 1 --2- 172.21.15.6:0/4194910012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9264107600 0x7f926410ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:41.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.991+0000 7f926a415700 1 --2- 172.21.15.6:0/4194910012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92641023d0 0x7f92641027e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:41.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.991+0000 7f926a415700 1 --2- 172.21.15.6:0/4194910012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9264106cb0 0x7f92641070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:41.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.991+0000 7f926a415700 1 -- 172.21.15.6:0/4194910012 >> 172.21.15.6:0/4194910012 conn(0x7f9264077c80 msgr2=0x7f92640780c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:41.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.991+0000 7f926a415700 1 -- 172.21.15.6:0/4194910012 shutdown_connections 2024-05-20T17:06:41.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.991+0000 7f926a415700 1 -- 172.21.15.6:0/4194910012 wait complete. 2024-05-20T17:06:41.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.992+0000 7f926a415700 1 Processor -- start 2024-05-20T17:06:41.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.992+0000 7f926a415700 1 -- start start 2024-05-20T17:06:41.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.992+0000 7f926a415700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92641023d0 0x7f926419e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:41.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.992+0000 7f926a415700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9264106cb0 0x7f926419edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:41.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.992+0000 7f926a415700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9264107600 0x7f9264198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:41.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.992+0000 7f926a415700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9264112230 con 0x7f92641023d0 2024-05-20T17:06:41.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.992+0000 7f926a415700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f92641120b0 con 0x7f9264107600 2024-05-20T17:06:41.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.992+0000 7f926a415700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f92641123b0 con 0x7f9264106cb0 2024-05-20T17:06:41.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.993+0000 7f9263fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92641023d0 0x7f926419e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:41.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.993+0000 7f92689b2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9264107600 0x7f9264198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:41.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.993+0000 7f9263fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92641023d0 0x7f926419e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36830/0 (socket says 172.21.15.6:36830) 2024-05-20T17:06:41.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.993+0000 7f92689b2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9264107600 0x7f9264198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.6:48928/0 (socket says 172.21.15.6:48928) 2024-05-20T17:06:41.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.993+0000 7f9263fff700 1 -- 172.21.15.6:0/2521166030 learned_addr learned my addr 172.21.15.6:0/2521166030 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:41.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.993+0000 7f92637fe700 1 --2- 172.21.15.6:0/2521166030 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9264106cb0 0x7f926419edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:41.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.993+0000 7f9263fff700 1 -- 172.21.15.6:0/2521166030 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9264106cb0 msgr2=0x7f926419edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:41.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.993+0000 7f9263fff700 1 --2- 172.21.15.6:0/2521166030 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9264106cb0 0x7f926419edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:41.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.993+0000 7f9263fff700 1 -- 172.21.15.6:0/2521166030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9264107600 msgr2=0x7f9264198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:41.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.993+0000 7f9263fff700 1 --2- 172.21.15.6:0/2521166030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9264107600 0x7f9264198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:41.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.993+0000 7f9263fff700 1 -- 172.21.15.6:0/2521166030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9264199140 con 0x7f92641023d0 2024-05-20T17:06:41.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.993+0000 7f9263fff700 1 --2- 172.21.15.6:0/2521166030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92641023d0 0x7f926419e870 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f92540059d0 tx=0x7f92540057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:41.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.993+0000 7f92617fa700 1 -- 172.21.15.6:0/2521166030 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9254027070 con 0x7f92641023d0 2024-05-20T17:06:41.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.993+0000 7f92617fa700 1 -- 172.21.15.6:0/2521166030 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9254003f50 con 0x7f92641023d0 2024-05-20T17:06:41.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.993+0000 7f926a415700 1 -- 172.21.15.6:0/2521166030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92641993d0 con 0x7f92641023d0 2024-05-20T17:06:41.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.994+0000 7f92617fa700 1 -- 172.21.15.6:0/2521166030 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9254022c30 con 0x7f92641023d0 2024-05-20T17:06:41.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.994+0000 7f926a415700 1 -- 172.21.15.6:0/2521166030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9264199860 con 0x7f92641023d0 2024-05-20T17:06:41.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.995+0000 7f926a415700 1 -- 172.21.15.6:0/2521166030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9264050170 con 0x7f92641023d0 2024-05-20T17:06:41.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.997+0000 7f92617fa700 1 -- 172.21.15.6:0/2521166030 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f925402a070 con 0x7f92641023d0 2024-05-20T17:06:41.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.997+0000 7f92617fa700 1 --2- 172.21.15.6:0/2521166030 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f924c0a2cb0 0x7f924c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:41.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.998+0000 7f92637fe700 1 --2- 172.21.15.6:0/2521166030 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f924c0a2cb0 0x7f924c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:41.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.998+0000 7f92617fa700 1 -- 172.21.15.6:0/2521166030 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f92540d0c60 con 0x7f92641023d0 2024-05-20T17:06:41.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:41.998+0000 7f92637fe700 1 --2- 172.21.15.6:0/2521166030 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f924c0a2cb0 0x7f924c0a51c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f926406a7b0 tx=0x7f925800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:42.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.001+0000 7f92617fa700 1 -- 172.21.15.6:0/2521166030 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9254013070 con 0x7f92641023d0 2024-05-20T17:06:42.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:41 smithi062 ceph-mon[35425]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:06:42.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:41 smithi171 ceph-mon[35901]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:06:42.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.231+0000 7f35cc921700 1 -- 172.21.15.6:0/386310856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c81042e0 msgr2=0x7f35c81046f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:42.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.231+0000 7f35cc921700 1 --2- 172.21.15.6:0/386310856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c81042e0 0x7f35c81046f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009990 tx=0x7f35b8009ca0 comp rx=0 tx=0).stop 2024-05-20T17:06:42.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.231+0000 7f35cc921700 1 -- 172.21.15.6:0/386310856 shutdown_connections 2024-05-20T17:06:42.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.231+0000 7f35cc921700 1 --2- 172.21.15.6:0/386310856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35c810d750 0x7f35c810fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:42.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.231+0000 7f35cc921700 1 --2- 172.21.15.6:0/386310856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c81042e0 0x7f35c81046f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:42.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.231+0000 7f35cc921700 1 --2- 172.21.15.6:0/386310856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c8104c30 0x7f35c810d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:42.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.231+0000 7f35cc921700 1 -- 172.21.15.6:0/386310856 >> 172.21.15.6:0/386310856 conn(0x7f35c80fdc40 msgr2=0x7f35c8100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:42.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.231+0000 7f35cc921700 1 -- 172.21.15.6:0/386310856 shutdown_connections 2024-05-20T17:06:42.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.232+0000 7f35cc921700 1 -- 172.21.15.6:0/386310856 wait complete. 2024-05-20T17:06:42.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.232+0000 7f35cc921700 1 Processor -- start 2024-05-20T17:06:42.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.233+0000 7f35cc921700 1 -- start start 2024-05-20T17:06:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.233+0000 7f35cc921700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35c81042e0 0x7f35c819f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.233+0000 7f35cc921700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c8104c30 0x7f35c819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.233+0000 7f35cc921700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c810d750 0x7f35c8199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.233+0000 7f35cc921700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f35c81132a0 con 0x7f35c810d750 2024-05-20T17:06:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.233+0000 7f35cc921700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f35c8113120 con 0x7f35c8104c30 2024-05-20T17:06:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.233+0000 7f35cc921700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f35c8113420 con 0x7f35c81042e0 2024-05-20T17:06:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.233+0000 7f35c6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c810d750 0x7f35c8199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.233+0000 7f35c6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c810d750 0x7f35c8199a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36860/0 (socket says 172.21.15.6:36860) 2024-05-20T17:06:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.233+0000 7f35c6d9d700 1 -- 172.21.15.6:0/3452028920 learned_addr learned my addr 172.21.15.6:0/3452028920 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:42.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.233+0000 7f35c659c700 1 --2- 172.21.15.6:0/3452028920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35c81042e0 0x7f35c819f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.233+0000 7f35c5d9b700 1 --2- 172.21.15.6:0/3452028920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c8104c30 0x7f35c819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.234+0000 7f35c6d9d700 1 -- 172.21.15.6:0/3452028920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35c81042e0 msgr2=0x7f35c819f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.234+0000 7f35c6d9d700 1 --2- 172.21.15.6:0/3452028920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35c81042e0 0x7f35c819f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.234+0000 7f35c6d9d700 1 -- 172.21.15.6:0/3452028920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c8104c30 msgr2=0x7f35c819fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.234+0000 7f35c6d9d700 1 --2- 172.21.15.6:0/3452028920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c8104c30 0x7f35c819fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:42.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.234+0000 7f35c6d9d700 1 -- 172.21.15.6:0/3452028920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c819a0f0 con 0x7f35c810d750 2024-05-20T17:06:42.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.234+0000 7f35c6d9d700 1 --2- 172.21.15.6:0/3452028920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c810d750 0x7f35c8199a40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f35c000ada0 tx=0x7f35c000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:42.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.234+0000 7f35b77fe700 1 -- 172.21.15.6:0/3452028920 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c0017020 con 0x7f35c810d750 2024-05-20T17:06:42.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.234+0000 7f35cc921700 1 -- 172.21.15.6:0/3452028920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c819a3e0 con 0x7f35c810d750 2024-05-20T17:06:42.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.234+0000 7f35b77fe700 1 -- 172.21.15.6:0/3452028920 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35c000cd80 con 0x7f35c810d750 2024-05-20T17:06:42.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.234+0000 7f35b77fe700 1 -- 172.21.15.6:0/3452028920 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c0005260 con 0x7f35c810d750 2024-05-20T17:06:42.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.234+0000 7f35cc921700 1 -- 172.21.15.6:0/3452028920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c81a66b0 con 0x7f35c810d750 2024-05-20T17:06:42.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.235+0000 7f35cc921700 1 -- 172.21.15.6:0/3452028920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35c806ad70 con 0x7f35c810d750 2024-05-20T17:06:42.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.237+0000 7f35b77fe700 1 -- 172.21.15.6:0/3452028920 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f35c000c8d0 con 0x7f35c810d750 2024-05-20T17:06:42.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.238+0000 7f35b77fe700 1 --2- 172.21.15.6:0/3452028920 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f35b00a2cb0 0x7f35b00a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:42.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.238+0000 7f35b77fe700 1 -- 172.21.15.6:0/3452028920 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f35c00cebc0 con 0x7f35c810d750 2024-05-20T17:06:42.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.238+0000 7f35c659c700 1 --2- 172.21.15.6:0/3452028920 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f35b00a2cb0 0x7f35b00a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:42.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.239+0000 7f35c659c700 1 --2- 172.21.15.6:0/3452028920 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f35b00a2cb0 0x7f35b00a51c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f35b800b5c0 tx=0x7f35b801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:42.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.243+0000 7f35b77fe700 1 -- 172.21.15.6:0/3452028920 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f35c0021020 con 0x7f35c810d750 2024-05-20T17:06:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.247+0000 7f926a415700 1 -- 172.21.15.6:0/2521166030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f926402dc60 con 0x7f92641023d0 2024-05-20T17:06:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.247+0000 7f92617fa700 1 -- 172.21.15.6:0/2521166030 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f925409d790 con 0x7f92641023d0 2024-05-20T17:06:42.248 INFO:teuthology.orchestra.run.smithi006.stdout:257698037809 2024-05-20T17:06:42.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.251+0000 7f926a415700 1 -- 172.21.15.6:0/2521166030 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f924c0a2cb0 msgr2=0x7f924c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:42.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.251+0000 7f926a415700 1 --2- 172.21.15.6:0/2521166030 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f924c0a2cb0 0x7f924c0a51c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f926406a7b0 tx=0x7f925800b410 comp rx=0 tx=0).stop 2024-05-20T17:06:42.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.251+0000 7f926a415700 1 -- 172.21.15.6:0/2521166030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92641023d0 msgr2=0x7f926419e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:42.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.251+0000 7f926a415700 1 --2- 172.21.15.6:0/2521166030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92641023d0 0x7f926419e870 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f92540059d0 tx=0x7f92540057c0 comp rx=0 tx=0).stop 2024-05-20T17:06:42.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.251+0000 7f926a415700 1 -- 172.21.15.6:0/2521166030 shutdown_connections 2024-05-20T17:06:42.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.251+0000 7f926a415700 1 --2- 172.21.15.6:0/2521166030 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f924c0a2cb0 0x7f924c0a51c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:42.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.251+0000 7f926a415700 1 --2- 172.21.15.6:0/2521166030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9264107600 0x7f9264198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:42.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.251+0000 7f926a415700 1 --2- 172.21.15.6:0/2521166030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92641023d0 0x7f926419e870 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:42.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.251+0000 7f926a415700 1 --2- 172.21.15.6:0/2521166030 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9264106cb0 0x7f926419edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:42.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.251+0000 7f926a415700 1 -- 172.21.15.6:0/2521166030 >> 172.21.15.6:0/2521166030 conn(0x7f9264077c80 msgr2=0x7f92640ffe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:42.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.251+0000 7f926a415700 1 -- 172.21.15.6:0/2521166030 shutdown_connections 2024-05-20T17:06:42.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.251+0000 7f926a415700 1 -- 172.21.15.6:0/2521166030 wait complete. 2024-05-20T17:06:42.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.457+0000 7f35cc921700 1 -- 172.21.15.6:0/3452028920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f35c819af70 con 0x7f35c810d750 2024-05-20T17:06:42.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.458+0000 7f35b77fe700 1 -- 172.21.15.6:0/3452028920 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f35c009b6f0 con 0x7f35c810d750 2024-05-20T17:06:42.458 INFO:teuthology.orchestra.run.smithi006.stdout:146028888134 2024-05-20T17:06:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.460+0000 7f35cc921700 1 -- 172.21.15.6:0/3452028920 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f35b00a2cb0 msgr2=0x7f35b00a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.460+0000 7f35cc921700 1 --2- 172.21.15.6:0/3452028920 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f35b00a2cb0 0x7f35b00a51c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f35b800b5c0 tx=0x7f35b801a040 comp rx=0 tx=0).stop 2024-05-20T17:06:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.460+0000 7f35cc921700 1 -- 172.21.15.6:0/3452028920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c810d750 msgr2=0x7f35c8199a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.460+0000 7f35cc921700 1 --2- 172.21.15.6:0/3452028920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c810d750 0x7f35c8199a40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f35c000ada0 tx=0x7f35c000c330 comp rx=0 tx=0).stop 2024-05-20T17:06:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.460+0000 7f35cc921700 1 -- 172.21.15.6:0/3452028920 shutdown_connections 2024-05-20T17:06:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.460+0000 7f35cc921700 1 --2- 172.21.15.6:0/3452028920 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f35b00a2cb0 0x7f35b00a51c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.460+0000 7f35cc921700 1 --2- 172.21.15.6:0/3452028920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c810d750 0x7f35c8199a40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.460+0000 7f35cc921700 1 --2- 172.21.15.6:0/3452028920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35c81042e0 0x7f35c819f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.460+0000 7f35cc921700 1 --2- 172.21.15.6:0/3452028920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35c8104c30 0x7f35c819fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.460+0000 7f35cc921700 1 -- 172.21.15.6:0/3452028920 >> 172.21.15.6:0/3452028920 conn(0x7f35c80fdc40 msgr2=0x7f35c80fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.460+0000 7f35cc921700 1 -- 172.21.15.6:0/3452028920 shutdown_connections 2024-05-20T17:06:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:42.460+0000 7f35cc921700 1 -- 172.21.15.6:0/3452028920 wait complete. 2024-05-20T17:06:42.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:42 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2521166030' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-20T17:06:42.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:42 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3452028920' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-20T17:06:42.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-05-20T17:06:42.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-20T17:06:42.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:42 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-05-20T17:06:43.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:42 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2521166030' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-20T17:06:43.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:42 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3452028920' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-20T17:06:43.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-05-20T17:06:43.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-20T17:06:43.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:42 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-05-20T17:06:43.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:42 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2521166030' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-20T17:06:43.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:42 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3452028920' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-20T17:06:43.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-05-20T17:06:43.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-20T17:06:43.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:42 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-05-20T17:06:44.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:43 smithi062 ceph-mon[35425]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:06:44.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:43 smithi062 ceph-mon[35425]: mgrmap e18: x(active, since 9m), standbys: y, z 2024-05-20T17:06:44.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-05-20T17:06:44.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-20T17:06:44.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:43 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-05-20T17:06:44.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:43 smithi062 ceph-mon[35425]: osdmap e93: 12 total, 12 up, 12 in 2024-05-20T17:06:44.081 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:43 smithi006 ceph-mon[32486]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:06:44.082 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:43 smithi006 ceph-mon[32486]: mgrmap e18: x(active, since 9m), standbys: y, z 2024-05-20T17:06:44.082 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-05-20T17:06:44.082 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-20T17:06:44.082 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:43 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-05-20T17:06:44.082 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:43 smithi006 ceph-mon[32486]: osdmap e93: 12 total, 12 up, 12 in 2024-05-20T17:06:44.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:43 smithi171 ceph-mon[35901]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:06:44.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:43 smithi171 ceph-mon[35901]: mgrmap e18: x(active, since 9m), standbys: y, z 2024-05-20T17:06:44.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-05-20T17:06:44.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-20T17:06:44.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:43 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-05-20T17:06:44.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:43 smithi171 ceph-mon[35901]: osdmap e93: 12 total, 12 up, 12 in 2024-05-20T17:06:44.868 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888129 got 146028888134 for osd.4 2024-05-20T17:06:44.868 DEBUG:teuthology.parallel:result is None 2024-05-20T17:06:45.438 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037804 got 257698037809 for osd.8 2024-05-20T17:06:45.439 DEBUG:teuthology.parallel:result is None 2024-05-20T17:06:45.664 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:45 smithi006 ceph-mon[32486]: pgmap v354: 129 pgs: 1 peering, 128 active+clean; 646 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 409 B/s wr, 10 op/s 2024-05-20T17:06:45.664 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:45 smithi006 ceph-mon[32486]: osdmap e94: 12 total, 12 up, 12 in 2024-05-20T17:06:45.664 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:45 smithi006 ceph-mon[32486]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-20T17:06:45.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:45 smithi171 ceph-mon[35901]: pgmap v354: 129 pgs: 1 peering, 128 active+clean; 646 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 409 B/s wr, 10 op/s 2024-05-20T17:06:45.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:45 smithi171 ceph-mon[35901]: osdmap e94: 12 total, 12 up, 12 in 2024-05-20T17:06:45.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:45 smithi171 ceph-mon[35901]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-20T17:06:45.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.897+0000 7fd20d2a1700 1 -- 172.21.15.6:0/3824415107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd208107d90 msgr2=0x7fd2081081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:45.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.897+0000 7fd20d2a1700 1 --2- 172.21.15.6:0/3824415107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd208107d90 0x7fd2081081a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0099c0 tx=0x7fd1fc009cd0 comp rx=0 tx=0).stop 2024-05-20T17:06:45.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.897+0000 7fd20d2a1700 1 -- 172.21.15.6:0/3824415107 shutdown_connections 2024-05-20T17:06:45.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.897+0000 7fd20d2a1700 1 --2- 172.21.15.6:0/3824415107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2081086e0 0x7fd208110040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.897+0000 7fd20d2a1700 1 --2- 172.21.15.6:0/3824415107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd208103460 0x7fd208103870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.897+0000 7fd20d2a1700 1 --2- 172.21.15.6:0/3824415107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd208107d90 0x7fd2081081a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.897+0000 7fd20d2a1700 1 -- 172.21.15.6:0/3824415107 >> 172.21.15.6:0/3824415107 conn(0x7fd2080fed50 msgr2=0x7fd2081011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.897+0000 7fd20d2a1700 1 -- 172.21.15.6:0/3824415107 shutdown_connections 2024-05-20T17:06:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.897+0000 7fd20d2a1700 1 -- 172.21.15.6:0/3824415107 wait complete. 2024-05-20T17:06:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.897+0000 7fd20d2a1700 1 Processor -- start 2024-05-20T17:06:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.898+0000 7fd20d2a1700 1 -- start start 2024-05-20T17:06:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.898+0000 7fd20d2a1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd208103460 0x7fd208199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.898+0000 7fd20d2a1700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd208107d90 0x7fd20819a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.898+0000 7fd20d2a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2081086e0 0x7fd20819e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.898+0000 7fd20d2a1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd2081132f0 con 0x7fd2081086e0 2024-05-20T17:06:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.898+0000 7fd20d2a1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd208113170 con 0x7fd208103460 2024-05-20T17:06:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.898+0000 7fd20d2a1700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd208113470 con 0x7fd208107d90 2024-05-20T17:06:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.898+0000 7fd2077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2081086e0 0x7fd20819e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.898+0000 7fd2077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2081086e0 0x7fd20819e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36882/0 (socket says 172.21.15.6:36882) 2024-05-20T17:06:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.898+0000 7fd2077fe700 1 -- 172.21.15.6:0/3909770862 learned_addr learned my addr 172.21.15.6:0/3909770862 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.898+0000 7fd206ffd700 1 --2- 172.21.15.6:0/3909770862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd208103460 0x7fd208199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.898+0000 7fd2067fc700 1 --2- 172.21.15.6:0/3909770862 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd208107d90 0x7fd20819a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.898+0000 7fd2077fe700 1 -- 172.21.15.6:0/3909770862 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd208107d90 msgr2=0x7fd20819a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.898+0000 7fd2077fe700 1 --2- 172.21.15.6:0/3909770862 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd208107d90 0x7fd20819a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.898+0000 7fd2077fe700 1 -- 172.21.15.6:0/3909770862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd208103460 msgr2=0x7fd208199d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.898+0000 7fd2077fe700 1 --2- 172.21.15.6:0/3909770862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd208103460 0x7fd208199d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.898+0000 7fd2077fe700 1 -- 172.21.15.6:0/3909770862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20819eb40 con 0x7fd2081086e0 2024-05-20T17:06:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.898+0000 7fd206ffd700 1 --2- 172.21.15.6:0/3909770862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd208103460 0x7fd208199d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:06:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.899+0000 7fd2077fe700 1 --2- 172.21.15.6:0/3909770862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2081086e0 0x7fd20819e550 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd200007d70 tx=0x7fd20000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.899+0000 7fd1effff700 1 -- 172.21.15.6:0/3909770862 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd200016020 con 0x7fd2081086e0 2024-05-20T17:06:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.899+0000 7fd20d2a1700 1 -- 172.21.15.6:0/3909770862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20819ee30 con 0x7fd2081086e0 2024-05-20T17:06:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.899+0000 7fd1effff700 1 -- 172.21.15.6:0/3909770862 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd20000ad40 con 0x7fd2081086e0 2024-05-20T17:06:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.899+0000 7fd1effff700 1 -- 172.21.15.6:0/3909770862 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd200011620 con 0x7fd2081086e0 2024-05-20T17:06:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.899+0000 7fd20d2a1700 1 -- 172.21.15.6:0/3909770862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd20819f2f0 con 0x7fd2081086e0 2024-05-20T17:06:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.900+0000 7fd20d2a1700 1 -- 172.21.15.6:0/3909770862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd208050170 con 0x7fd2081086e0 2024-05-20T17:06:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.901+0000 7fd1effff700 1 -- 172.21.15.6:0/3909770862 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fd200019020 con 0x7fd2081086e0 2024-05-20T17:06:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.902+0000 7fd1effff700 1 --2- 172.21.15.6:0/3909770862 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd1f00a2c20 0x7fd1f00a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.902+0000 7fd206ffd700 1 --2- 172.21.15.6:0/3909770862 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd1f00a2c20 0x7fd1f00a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.902+0000 7fd1effff700 1 -- 172.21.15.6:0/3909770862 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fd2000cf7c0 con 0x7fd2081086e0 2024-05-20T17:06:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.902+0000 7fd206ffd700 1 --2- 172.21.15.6:0/3909770862 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd1f00a2c20 0x7fd1f00a5130 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8005950 tx=0x7fd1f80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:45.906+0000 7fd1effff700 1 -- 172.21.15.6:0/3909770862 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd200020020 con 0x7fd2081086e0 2024-05-20T17:06:46.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:45 smithi062 ceph-mon[35425]: pgmap v354: 129 pgs: 1 peering, 128 active+clean; 646 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 409 B/s wr, 10 op/s 2024-05-20T17:06:46.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:45 smithi062 ceph-mon[35425]: osdmap e94: 12 total, 12 up, 12 in 2024-05-20T17:06:46.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:45 smithi062 ceph-mon[35425]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-20T17:06:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.114+0000 7fd20d2a1700 1 -- 172.21.15.6:0/3909770862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd20819b080 con 0x7fd2081086e0 2024-05-20T17:06:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.115+0000 7fd1effff700 1 -- 172.21.15.6:0/3909770862 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd20009c370 con 0x7fd2081086e0 2024-05-20T17:06:46.115 INFO:teuthology.orchestra.run.smithi006.stdout:34359738460 2024-05-20T17:06:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.117+0000 7fd20d2a1700 1 -- 172.21.15.6:0/3909770862 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd1f00a2c20 msgr2=0x7fd1f00a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.117+0000 7fd20d2a1700 1 --2- 172.21.15.6:0/3909770862 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd1f00a2c20 0x7fd1f00a5130 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8005950 tx=0x7fd1f80058e0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.117+0000 7fd20d2a1700 1 -- 172.21.15.6:0/3909770862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2081086e0 msgr2=0x7fd20819e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.117+0000 7fd20d2a1700 1 --2- 172.21.15.6:0/3909770862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2081086e0 0x7fd20819e550 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd200007d70 tx=0x7fd20000a340 comp rx=0 tx=0).stop 2024-05-20T17:06:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.117+0000 7fd20d2a1700 1 -- 172.21.15.6:0/3909770862 shutdown_connections 2024-05-20T17:06:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.117+0000 7fd20d2a1700 1 --2- 172.21.15.6:0/3909770862 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd1f00a2c20 0x7fd1f00a5130 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.117+0000 7fd20d2a1700 1 --2- 172.21.15.6:0/3909770862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2081086e0 0x7fd20819e550 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.117+0000 7fd20d2a1700 1 --2- 172.21.15.6:0/3909770862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd208103460 0x7fd208199d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.117+0000 7fd20d2a1700 1 --2- 172.21.15.6:0/3909770862 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd208107d90 0x7fd20819a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.117+0000 7fd20d2a1700 1 -- 172.21.15.6:0/3909770862 >> 172.21.15.6:0/3909770862 conn(0x7fd2080fed50 msgr2=0x7fd208109640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.117+0000 7fd20d2a1700 1 -- 172.21.15.6:0/3909770862 shutdown_connections 2024-05-20T17:06:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.117+0000 7fd20d2a1700 1 -- 172.21.15.6:0/3909770862 wait complete. 2024-05-20T17:06:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.167+0000 7ff2d08d2700 1 -- 172.21.15.6:0/862483041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2cc104c30 msgr2=0x7ff2cc10d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.167+0000 7ff2d08d2700 1 --2- 172.21.15.6:0/862483041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2cc104c30 0x7ff2cc10d180 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009990 tx=0x7ff2b4009ca0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.167+0000 7ff2d08d2700 1 -- 172.21.15.6:0/862483041 shutdown_connections 2024-05-20T17:06:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.167+0000 7ff2d08d2700 1 --2- 172.21.15.6:0/862483041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2cc10d750 0x7ff2cc10fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.167+0000 7ff2d08d2700 1 --2- 172.21.15.6:0/862483041 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2cc1042e0 0x7ff2cc1046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.167+0000 7ff2d08d2700 1 --2- 172.21.15.6:0/862483041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2cc104c30 0x7ff2cc10d180 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.167+0000 7ff2d08d2700 1 -- 172.21.15.6:0/862483041 >> 172.21.15.6:0/862483041 conn(0x7ff2cc0fdc40 msgr2=0x7ff2cc100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.167+0000 7ff2d08d2700 1 -- 172.21.15.6:0/862483041 shutdown_connections 2024-05-20T17:06:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.167+0000 7ff2d08d2700 1 -- 172.21.15.6:0/862483041 wait complete. 2024-05-20T17:06:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.168+0000 7ff2d08d2700 1 Processor -- start 2024-05-20T17:06:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.168+0000 7ff2d08d2700 1 -- start start 2024-05-20T17:06:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.169+0000 7ff2d08d2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2cc1042e0 0x7ff2cc19f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.169+0000 7ff2d08d2700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2cc104c30 0x7ff2cc19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.169+0000 7ff2d08d2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2cc10d750 0x7ff2cc199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:46.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.169+0000 7ff2d08d2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff2cc1132b0 con 0x7ff2cc1042e0 2024-05-20T17:06:46.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.169+0000 7ff2d08d2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff2cc113130 con 0x7ff2cc10d750 2024-05-20T17:06:46.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.169+0000 7ff2d08d2700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff2cc113430 con 0x7ff2cc104c30 2024-05-20T17:06:46.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.169+0000 7ff2ca59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2cc1042e0 0x7ff2cc19f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:46.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.169+0000 7ff2ca59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2cc1042e0 0x7ff2cc19f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36896/0 (socket says 172.21.15.6:36896) 2024-05-20T17:06:46.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.169+0000 7ff2ca59c700 1 -- 172.21.15.6:0/2849607145 learned_addr learned my addr 172.21.15.6:0/2849607145 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:46.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.169+0000 7ff2c1d9b700 1 --2- 172.21.15.6:0/2849607145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2cc104c30 0x7ff2cc19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:46.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.169+0000 7ff2ca59c700 1 -- 172.21.15.6:0/2849607145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2cc104c30 msgr2=0x7ff2cc19fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:46.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.169+0000 7ff2ca59c700 1 --2- 172.21.15.6:0/2849607145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2cc104c30 0x7ff2cc19fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.169+0000 7ff2ca59c700 1 -- 172.21.15.6:0/2849607145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2cc10d750 msgr2=0x7ff2cc199a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:46.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.169+0000 7ff2ca59c700 1 --2- 172.21.15.6:0/2849607145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2cc10d750 0x7ff2cc199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.169+0000 7ff2ca59c700 1 -- 172.21.15.6:0/2849607145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2cc19a100 con 0x7ff2cc1042e0 2024-05-20T17:06:46.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.169+0000 7ff2ca59c700 1 --2- 172.21.15.6:0/2849607145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2cc1042e0 0x7ff2cc19f830 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00d950 tx=0x7ff2bc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:46.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.170+0000 7ff2c3fff700 1 -- 172.21.15.6:0/2849607145 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc016070 con 0x7ff2cc1042e0 2024-05-20T17:06:46.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.170+0000 7ff2c3fff700 1 -- 172.21.15.6:0/2849607145 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff2bc009df0 con 0x7ff2cc1042e0 2024-05-20T17:06:46.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.170+0000 7ff2d08d2700 1 -- 172.21.15.6:0/2849607145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2cc19a3f0 con 0x7ff2cc1042e0 2024-05-20T17:06:46.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.170+0000 7ff2c3fff700 1 -- 172.21.15.6:0/2849607145 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc00f3c0 con 0x7ff2cc1042e0 2024-05-20T17:06:46.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.170+0000 7ff2d08d2700 1 -- 172.21.15.6:0/2849607145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2cc1a66c0 con 0x7ff2cc1042e0 2024-05-20T17:06:46.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.171+0000 7ff2d08d2700 1 -- 172.21.15.6:0/2849607145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2cc050170 con 0x7ff2cc1042e0 2024-05-20T17:06:46.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.172+0000 7ff2c3fff700 1 -- 172.21.15.6:0/2849607145 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7ff2bc019070 con 0x7ff2cc1042e0 2024-05-20T17:06:46.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.173+0000 7ff2c3fff700 1 --2- 172.21.15.6:0/2849607145 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff2b80a2c20 0x7ff2b80a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:46.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.173+0000 7ff2c1d9b700 1 --2- 172.21.15.6:0/2849607145 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff2b80a2c20 0x7ff2b80a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:46.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.173+0000 7ff2c3fff700 1 -- 172.21.15.6:0/2849607145 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7ff2bc0cefb0 con 0x7ff2cc1042e0 2024-05-20T17:06:46.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.174+0000 7ff2c1d9b700 1 --2- 172.21.15.6:0/2849607145 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff2b80a2c20 0x7ff2b80a5130 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff2b400b5c0 tx=0x7ff2b4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:46.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.177+0000 7ff2c3fff700 1 -- 172.21.15.6:0/2849607145 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff2bc09bb60 con 0x7ff2cc1042e0 2024-05-20T17:06:46.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.385+0000 7ff2d08d2700 1 -- 172.21.15.6:0/2849607145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff2cc02dc60 con 0x7ff2cc1042e0 2024-05-20T17:06:46.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.386+0000 7ff2c3fff700 1 -- 172.21.15.6:0/2849607145 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff2bc09b460 con 0x7ff2cc1042e0 2024-05-20T17:06:46.386 INFO:teuthology.orchestra.run.smithi006.stdout:77309411408 2024-05-20T17:06:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.388+0000 7ff2d08d2700 1 -- 172.21.15.6:0/2849607145 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff2b80a2c20 msgr2=0x7ff2b80a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.388+0000 7ff2d08d2700 1 --2- 172.21.15.6:0/2849607145 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff2b80a2c20 0x7ff2b80a5130 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff2b400b5c0 tx=0x7ff2b4005960 comp rx=0 tx=0).stop 2024-05-20T17:06:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.388+0000 7ff2d08d2700 1 -- 172.21.15.6:0/2849607145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2cc1042e0 msgr2=0x7ff2cc19f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.388+0000 7ff2d08d2700 1 --2- 172.21.15.6:0/2849607145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2cc1042e0 0x7ff2cc19f830 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00d950 tx=0x7ff2bc00dc60 comp rx=0 tx=0).stop 2024-05-20T17:06:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.388+0000 7ff2d08d2700 1 -- 172.21.15.6:0/2849607145 shutdown_connections 2024-05-20T17:06:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.388+0000 7ff2d08d2700 1 --2- 172.21.15.6:0/2849607145 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff2b80a2c20 0x7ff2b80a5130 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.388+0000 7ff2d08d2700 1 --2- 172.21.15.6:0/2849607145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2cc10d750 0x7ff2cc199a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.388+0000 7ff2d08d2700 1 --2- 172.21.15.6:0/2849607145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2cc1042e0 0x7ff2cc19f830 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.388+0000 7ff2d08d2700 1 --2- 172.21.15.6:0/2849607145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2cc104c30 0x7ff2cc19fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.388+0000 7ff2d08d2700 1 -- 172.21.15.6:0/2849607145 >> 172.21.15.6:0/2849607145 conn(0x7ff2cc0fdc40 msgr2=0x7ff2cc0fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.388+0000 7ff2d08d2700 1 -- 172.21.15.6:0/2849607145 shutdown_connections 2024-05-20T17:06:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.388+0000 7ff2d08d2700 1 -- 172.21.15.6:0/2849607145 wait complete. 2024-05-20T17:06:46.797 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:46 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3909770862' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-20T17:06:46.798 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:46 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2849607145' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-20T17:06:46.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:46 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3909770862' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-20T17:06:46.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:46 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2849607145' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-20T17:06:46.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.912+0000 7f6333295700 1 -- 172.21.15.6:0/1258861059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f632c1075c0 msgr2=0x7f632c10ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:46.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.912+0000 7f6333295700 1 --2- 172.21.15.6:0/1258861059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f632c1075c0 0x7f632c10ef20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f632400b0d0 tx=0x7f632400b3e0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.912+0000 7f6333295700 1 -- 172.21.15.6:0/1258861059 shutdown_connections 2024-05-20T17:06:46.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.912+0000 7f6333295700 1 --2- 172.21.15.6:0/1258861059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f632c1075c0 0x7f632c10ef20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.912+0000 7f6333295700 1 --2- 172.21.15.6:0/1258861059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f632c102340 0x7f632c102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.912+0000 7f6333295700 1 --2- 172.21.15.6:0/1258861059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f632c106c70 0x7f632c107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.912+0000 7f6333295700 1 -- 172.21.15.6:0/1258861059 >> 172.21.15.6:0/1258861059 conn(0x7f632c0fdc70 msgr2=0x7f632c100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:46.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.912+0000 7f6333295700 1 -- 172.21.15.6:0/1258861059 shutdown_connections 2024-05-20T17:06:46.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.913+0000 7f6333295700 1 -- 172.21.15.6:0/1258861059 wait complete. 2024-05-20T17:06:46.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.913+0000 7f6333295700 1 Processor -- start 2024-05-20T17:06:46.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.913+0000 7f6333295700 1 -- start start 2024-05-20T17:06:46.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.913+0000 7f6333295700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f632c102340 0x7f632c19f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:46.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.913+0000 7f6333295700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f632c106c70 0x7f632c19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:46.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.913+0000 7f6333295700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f632c1075c0 0x7f632c199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:46.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.913+0000 7f6333295700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f632c1121f0 con 0x7f632c1075c0 2024-05-20T17:06:46.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.913+0000 7f6333295700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f632c112070 con 0x7f632c106c70 2024-05-20T17:06:46.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.914+0000 7f6333295700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f632c112370 con 0x7f632c102340 2024-05-20T17:06:46.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.914+0000 7f6331832700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f632c1075c0 0x7f632c199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:46.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.914+0000 7f6330830700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f632c106c70 0x7f632c19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:46.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.914+0000 7f6330830700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f632c106c70 0x7f632c19fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.6:48984/0 (socket says 172.21.15.6:48984) 2024-05-20T17:06:46.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.914+0000 7f6331832700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f632c1075c0 0x7f632c199a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36902/0 (socket says 172.21.15.6:36902) 2024-05-20T17:06:46.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.914+0000 7f6330830700 1 -- 172.21.15.6:0/1182928062 learned_addr learned my addr 172.21.15.6:0/1182928062 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:46.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.914+0000 7f6331031700 1 --2- 172.21.15.6:0/1182928062 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f632c102340 0x7f632c19f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:46.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.914+0000 7f6331832700 1 -- 172.21.15.6:0/1182928062 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f632c102340 msgr2=0x7f632c19f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:46.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.914+0000 7f6331832700 1 --2- 172.21.15.6:0/1182928062 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f632c102340 0x7f632c19f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.914+0000 7f6331832700 1 -- 172.21.15.6:0/1182928062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f632c106c70 msgr2=0x7f632c19fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:46.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.914+0000 7f6331832700 1 --2- 172.21.15.6:0/1182928062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f632c106c70 0x7f632c19fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:46.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.914+0000 7f6331832700 1 -- 172.21.15.6:0/1182928062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632c19a110 con 0x7f632c1075c0 2024-05-20T17:06:46.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.914+0000 7f6330830700 1 --2- 172.21.15.6:0/1182928062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f632c106c70 0x7f632c19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:06:46.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.914+0000 7f6331832700 1 --2- 172.21.15.6:0/1182928062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f632c1075c0 0x7f632c199a60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f632400b0d0 tx=0x7f6324007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:46.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.914+0000 7f63227fc700 1 -- 172.21.15.6:0/1182928062 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632401f070 con 0x7f632c1075c0 2024-05-20T17:06:46.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.915+0000 7f63227fc700 1 -- 172.21.15.6:0/1182928062 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6324004c50 con 0x7f632c1075c0 2024-05-20T17:06:46.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.915+0000 7f63227fc700 1 -- 172.21.15.6:0/1182928062 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632401b430 con 0x7f632c1075c0 2024-05-20T17:06:46.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.915+0000 7f6333295700 1 -- 172.21.15.6:0/1182928062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632c19a3a0 con 0x7f632c1075c0 2024-05-20T17:06:46.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.915+0000 7f6333295700 1 -- 172.21.15.6:0/1182928062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f632c1a66d0 con 0x7f632c1075c0 2024-05-20T17:06:46.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.916+0000 7f6333295700 1 -- 172.21.15.6:0/1182928062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f632c050170 con 0x7f632c1075c0 2024-05-20T17:06:46.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.917+0000 7f63227fc700 1 -- 172.21.15.6:0/1182928062 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f6324022070 con 0x7f632c1075c0 2024-05-20T17:06:46.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.918+0000 7f63227fc700 1 --2- 172.21.15.6:0/1182928062 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f63180a2ca0 0x7f63180a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:46.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.918+0000 7f6331031700 1 --2- 172.21.15.6:0/1182928062 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f63180a2ca0 0x7f63180a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:46.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.918+0000 7f63227fc700 1 -- 172.21.15.6:0/1182928062 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f632400f020 con 0x7f632c1075c0 2024-05-20T17:06:46.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.919+0000 7f6331031700 1 --2- 172.21.15.6:0/1182928062 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f63180a2ca0 0x7f63180a51b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f632c19aba0 tx=0x7f6328009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:46.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:46.924+0000 7f63227fc700 1 -- 172.21.15.6:0/1182928062 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6324029020 con 0x7f632c1075c0 2024-05-20T17:06:47.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:46 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3909770862' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-20T17:06:47.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:46 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2849607145' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-20T17:06:47.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:47.151+0000 7f6333295700 1 -- 172.21.15.6:0/1182928062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f632c02dc60 con 0x7f632c1075c0 2024-05-20T17:06:47.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:47.151+0000 7f63227fc700 1 -- 172.21.15.6:0/1182928062 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f632409ceb0 con 0x7f632c1075c0 2024-05-20T17:06:47.152 INFO:teuthology.orchestra.run.smithi006.stdout:55834574935 2024-05-20T17:06:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:47.153+0000 7f6333295700 1 -- 172.21.15.6:0/1182928062 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f63180a2ca0 msgr2=0x7f63180a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:47.153+0000 7f6333295700 1 --2- 172.21.15.6:0/1182928062 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f63180a2ca0 0x7f63180a51b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f632c19aba0 tx=0x7f6328009260 comp rx=0 tx=0).stop 2024-05-20T17:06:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:47.153+0000 7f6333295700 1 -- 172.21.15.6:0/1182928062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f632c1075c0 msgr2=0x7f632c199a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:47.153+0000 7f6333295700 1 --2- 172.21.15.6:0/1182928062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f632c1075c0 0x7f632c199a60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f632400b0d0 tx=0x7f6324007a00 comp rx=0 tx=0).stop 2024-05-20T17:06:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:47.153+0000 7f6333295700 1 -- 172.21.15.6:0/1182928062 shutdown_connections 2024-05-20T17:06:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:47.153+0000 7f6333295700 1 --2- 172.21.15.6:0/1182928062 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f63180a2ca0 0x7f63180a51b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:47.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:47.153+0000 7f6333295700 1 --2- 172.21.15.6:0/1182928062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f632c1075c0 0x7f632c199a60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:47.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:47.153+0000 7f6333295700 1 --2- 172.21.15.6:0/1182928062 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f632c102340 0x7f632c19f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:47.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:47.153+0000 7f6333295700 1 --2- 172.21.15.6:0/1182928062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f632c106c70 0x7f632c19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:47.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:47.153+0000 7f6333295700 1 -- 172.21.15.6:0/1182928062 >> 172.21.15.6:0/1182928062 conn(0x7f632c0fdc70 msgr2=0x7f632c074b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:47.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:47.153+0000 7f6333295700 1 -- 172.21.15.6:0/1182928062 shutdown_connections 2024-05-20T17:06:47.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:47.154+0000 7f6333295700 1 -- 172.21.15.6:0/1182928062 wait complete. 2024-05-20T17:06:47.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:47 smithi171 ceph-mon[35901]: pgmap v356: 129 pgs: 1 peering, 128 active+clean; 646 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-20T17:06:47.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:47 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:47.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:47 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:47.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:47 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1182928062' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-20T17:06:47.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:47 smithi006 ceph-mon[32486]: pgmap v356: 129 pgs: 1 peering, 128 active+clean; 646 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-20T17:06:47.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:47 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:47.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:47 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:47.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:47 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1182928062' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-20T17:06:47.976 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574927 got 55834574935 for osd.1 2024-05-20T17:06:47.976 DEBUG:teuthology.parallel:result is None 2024-05-20T17:06:48.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:47 smithi062 ceph-mon[35425]: pgmap v356: 129 pgs: 1 peering, 128 active+clean; 646 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-20T17:06:48.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:47 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:48.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:47 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:48.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:47 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1182928062' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-20T17:06:48.435 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738453 got 34359738460 for osd.0 2024-05-20T17:06:48.435 DEBUG:teuthology.parallel:result is None 2024-05-20T17:06:48.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:48 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:06:48.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:48 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:06:48.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:48 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:48.879 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:48 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:06:48.879 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:48 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:06:48.879 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:48 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:48.908 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411404 got 77309411408 for osd.2 2024-05-20T17:06:48.908 DEBUG:teuthology.parallel:result is None 2024-05-20T17:06:48.908 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-20T17:06:48.909 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph pg dump --format=json 2024-05-20T17:06:49.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:48 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:06:49.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:48 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:06:49.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:48 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:06:49.163 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:06:49.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:49 smithi171 ceph-mon[35901]: pgmap v357: 129 pgs: 1 peering, 128 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 639 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:06:49.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:49 smithi006 ceph-mon[32486]: pgmap v357: 129 pgs: 1 peering, 128 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 639 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:06:50.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:49 smithi062 ceph-mon[35425]: pgmap v357: 129 pgs: 1 peering, 128 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 639 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:06:50.786 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:50 smithi006 ceph-mon[32486]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-20T17:06:50.786 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:50 smithi006 ceph-mon[32486]: Cluster is now healthy 2024-05-20T17:06:51.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:50 smithi062 ceph-mon[35425]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-20T17:06:51.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:50 smithi062 ceph-mon[35425]: Cluster is now healthy 2024-05-20T17:06:51.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.054+0000 7f2c8ef98700 1 -- 172.21.15.6:0/1137239872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c88101840 msgr2=0x7f2c88101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:51.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.054+0000 7f2c8ef98700 1 --2- 172.21.15.6:0/1137239872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c88101840 0x7f2c88101c50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2c74009990 tx=0x7f2c74009ca0 comp rx=0 tx=0).stop 2024-05-20T17:06:51.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.054+0000 7f2c8ef98700 1 -- 172.21.15.6:0/1137239872 shutdown_connections 2024-05-20T17:06:51.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.054+0000 7f2c8ef98700 1 --2- 172.21.15.6:0/1137239872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c88102190 0x7f2c8810e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:51.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.054+0000 7f2c8ef98700 1 --2- 172.21.15.6:0/1137239872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c88107870 0x7f2c88107c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:51.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.054+0000 7f2c8ef98700 1 --2- 172.21.15.6:0/1137239872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c88101840 0x7f2c88101c50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:51.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.054+0000 7f2c8ef98700 1 -- 172.21.15.6:0/1137239872 >> 172.21.15.6:0/1137239872 conn(0x7f2c880fd3c0 msgr2=0x7f2c880ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:51.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.054+0000 7f2c8ef98700 1 -- 172.21.15.6:0/1137239872 shutdown_connections 2024-05-20T17:06:51.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.054+0000 7f2c8ef98700 1 -- 172.21.15.6:0/1137239872 wait complete. 2024-05-20T17:06:51.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.055+0000 7f2c8ef98700 1 Processor -- start 2024-05-20T17:06:51.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.055+0000 7f2c8ef98700 1 -- start start 2024-05-20T17:06:51.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.055+0000 7f2c8ef98700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c88101840 0x7f2c880fd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:51.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.055+0000 7f2c8ef98700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c88102190 0x7f2c880fdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:51.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.055+0000 7f2c8ef98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c88107870 0x7f2c880fe320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:51.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.055+0000 7f2c8ef98700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2c88111160 con 0x7f2c88107870 2024-05-20T17:06:51.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.055+0000 7f2c8ef98700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2c88110fe0 con 0x7f2c88102190 2024-05-20T17:06:51.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.055+0000 7f2c8ef98700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2c881112e0 con 0x7f2c88101840 2024-05-20T17:06:51.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.055+0000 7f2c8d535700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c88107870 0x7f2c880fe320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:51.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.055+0000 7f2c8d535700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c88107870 0x7f2c880fe320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32986/0 (socket says 172.21.15.6:32986) 2024-05-20T17:06:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.055+0000 7f2c8cd34700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c88101840 0x7f2c880fd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.055+0000 7f2c8d535700 1 -- 172.21.15.6:0/1205851840 learned_addr learned my addr 172.21.15.6:0/1205851840 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.056+0000 7f2c87fff700 1 --2- 172.21.15.6:0/1205851840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c88102190 0x7f2c880fdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.056+0000 7f2c8d535700 1 -- 172.21.15.6:0/1205851840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c88101840 msgr2=0x7f2c880fd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.056+0000 7f2c8d535700 1 --2- 172.21.15.6:0/1205851840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c88101840 0x7f2c880fd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.056+0000 7f2c8d535700 1 -- 172.21.15.6:0/1205851840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c88102190 msgr2=0x7f2c880fdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.056+0000 7f2c8d535700 1 --2- 172.21.15.6:0/1205851840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c88102190 0x7f2c880fdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.056+0000 7f2c8d535700 1 -- 172.21.15.6:0/1205851840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c881a8000 con 0x7f2c88107870 2024-05-20T17:06:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.056+0000 7f2c8cd34700 1 --2- 172.21.15.6:0/1205851840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c88101840 0x7f2c880fd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:06:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.056+0000 7f2c8d535700 1 --2- 172.21.15.6:0/1205851840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c88107870 0x7f2c880fe320 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2c80007d70 tx=0x7f2c8000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.056+0000 7f2c85ffb700 1 -- 172.21.15.6:0/1205851840 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c80016020 con 0x7f2c88107870 2024-05-20T17:06:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.056+0000 7f2c8ef98700 1 -- 172.21.15.6:0/1205851840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c881a82f0 con 0x7f2c88107870 2024-05-20T17:06:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.056+0000 7f2c85ffb700 1 -- 172.21.15.6:0/1205851840 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c8000ac90 con 0x7f2c88107870 2024-05-20T17:06:51.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.056+0000 7f2c85ffb700 1 -- 172.21.15.6:0/1205851840 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c800115e0 con 0x7f2c88107870 2024-05-20T17:06:51.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.056+0000 7f2c8ef98700 1 -- 172.21.15.6:0/1205851840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c881a87b0 con 0x7f2c88107870 2024-05-20T17:06:51.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.057+0000 7f2c8ef98700 1 -- 172.21.15.6:0/1205851840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c88050170 con 0x7f2c88107870 2024-05-20T17:06:51.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.059+0000 7f2c85ffb700 1 -- 172.21.15.6:0/1205851840 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f2c80019020 con 0x7f2c88107870 2024-05-20T17:06:51.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.060+0000 7f2c85ffb700 1 --2- 172.21.15.6:0/1205851840 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2c780a2c20 0x7f2c780a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:51.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.060+0000 7f2c8cd34700 1 --2- 172.21.15.6:0/1205851840 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2c780a2c20 0x7f2c780a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:51.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.060+0000 7f2c85ffb700 1 -- 172.21.15.6:0/1205851840 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f2c800cf8b0 con 0x7f2c88107870 2024-05-20T17:06:51.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.060+0000 7f2c8cd34700 1 --2- 172.21.15.6:0/1205851840 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2c780a2c20 0x7f2c780a5130 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c005950 tx=0x7f2c7c00b510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:51.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.064+0000 7f2c85ffb700 1 -- 172.21.15.6:0/1205851840 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2c80020020 con 0x7f2c88107870 2024-05-20T17:06:51.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:50 smithi171 ceph-mon[35901]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-20T17:06:51.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:50 smithi171 ceph-mon[35901]: Cluster is now healthy 2024-05-20T17:06:51.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.266+0000 7f2c8ef98700 1 -- 172.21.15.6:0/1205851840 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c88062a80 con 0x7f2c780a2c20 2024-05-20T17:06:51.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.276+0000 7f2c85ffb700 1 -- 172.21.15.6:0/1205851840 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340587 (secure 0 0 0) 0x7f2c88062a80 con 0x7f2c780a2c20 2024-05-20T17:06:51.281 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:06:51.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.279+0000 7f2c8ef98700 1 -- 172.21.15.6:0/1205851840 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2c780a2c20 msgr2=0x7f2c780a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:51.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.279+0000 7f2c8ef98700 1 --2- 172.21.15.6:0/1205851840 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2c780a2c20 0x7f2c780a5130 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c005950 tx=0x7f2c7c00b510 comp rx=0 tx=0).stop 2024-05-20T17:06:51.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.279+0000 7f2c8ef98700 1 -- 172.21.15.6:0/1205851840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c88107870 msgr2=0x7f2c880fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:51.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.279+0000 7f2c8ef98700 1 --2- 172.21.15.6:0/1205851840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c88107870 0x7f2c880fe320 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2c80007d70 tx=0x7f2c8000a340 comp rx=0 tx=0).stop 2024-05-20T17:06:51.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.279+0000 7f2c8ef98700 1 -- 172.21.15.6:0/1205851840 shutdown_connections 2024-05-20T17:06:51.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.279+0000 7f2c8ef98700 1 --2- 172.21.15.6:0/1205851840 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2c780a2c20 0x7f2c780a5130 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:51.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.279+0000 7f2c8ef98700 1 --2- 172.21.15.6:0/1205851840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c88107870 0x7f2c880fe320 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:51.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.279+0000 7f2c8ef98700 1 --2- 172.21.15.6:0/1205851840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c88101840 0x7f2c880fd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:51.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.279+0000 7f2c8ef98700 1 --2- 172.21.15.6:0/1205851840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c88102190 0x7f2c880fdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:51.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.279+0000 7f2c8ef98700 1 -- 172.21.15.6:0/1205851840 >> 172.21.15.6:0/1205851840 conn(0x7f2c880fd3c0 msgr2=0x7f2c880fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:51.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.279+0000 7f2c8ef98700 1 -- 172.21.15.6:0/1205851840 shutdown_connections 2024-05-20T17:06:51.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:51.279+0000 7f2c8ef98700 1 -- 172.21.15.6:0/1205851840 wait complete. 2024-05-20T17:06:51.285 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:06:52.017 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:51 smithi171 ceph-mon[35901]: pgmap v358: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:06:52.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:51 smithi062 ceph-mon[35425]: pgmap v358: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:06:52.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:51 smithi006 ceph-mon[32486]: pgmap v358: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:06:52.214 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":358,"stamp":"2024-05-20T17:06:50.114470+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661161,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":903,"num_read_kb":578,"num_write":431,"num_write_kb":3085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":855,"ondisk_log_size":855,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":422,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388908,"kb_used_data":14720,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124552916,"statfs":{"total":1151940427776,"available":1151542185984,"internally_reserved":0,"allocated":15073280,"data_stored":8232137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":390,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":52,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002351"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.591740+0000","last_change":"2024-05-20T17:05:05.110008+0000","last_active":"2024-05-20T17:06:44.591740+0000","last_peered":"2024-05-20T17:06:44.591740+0000","last_clean":"2024-05-20T17:06:44.591740+0000","last_became_active":"2024-05-20T17:05:05.109556+0000","last_became_peered":"2024-05-20T17:05:05.109556+0000","last_unstale":"2024-05-20T17:06:44.591740+0000","last_undegraded":"2024-05-20T17:06:44.591740+0000","last_fullsized":"2024-05-20T17:06:44.591740+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:05:55.733938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"92'4","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.773527+0000","last_change":"2024-05-20T17:05:05.106305+0000","last_active":"2024-05-20T17:06:44.773527+0000","last_peered":"2024-05-20T17:06:44.773527+0000","last_clean":"2024-05-20T17:06:44.773527+0000","last_became_active":"2024-05-20T17:05:05.105520+0000","last_became_peered":"2024-05-20T17:05:05.105520+0000","last_unstale":"2024-05-20T17:06:44.773527+0000","last_undegraded":"2024-05-20T17:06:44.773527+0000","last_fullsized":"2024-05-20T17:06:44.773527+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:28:55.385934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"92'7","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.773404+0000","last_change":"2024-05-20T17:05:05.103165+0000","last_active":"2024-05-20T17:06:44.773404+0000","last_peered":"2024-05-20T17:06:44.773404+0000","last_clean":"2024-05-20T17:06:44.773404+0000","last_became_active":"2024-05-20T17:05:05.102808+0000","last_became_peered":"2024-05-20T17:05:05.102808+0000","last_unstale":"2024-05-20T17:06:44.773404+0000","last_undegraded":"2024-05-20T17:06:44.773404+0000","last_fullsized":"2024-05-20T17:06:44.773404+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:47:14.217973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.724186+0000","last_change":"2024-05-20T17:05:05.108954+0000","last_active":"2024-05-20T17:06:44.724186+0000","last_peered":"2024-05-20T17:06:44.724186+0000","last_clean":"2024-05-20T17:06:44.724186+0000","last_became_active":"2024-05-20T17:05:05.108563+0000","last_became_peered":"2024-05-20T17:05:05.108563+0000","last_unstale":"2024-05-20T17:06:44.724186+0000","last_undegraded":"2024-05-20T17:06:44.724186+0000","last_fullsized":"2024-05-20T17:06:44.724186+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:07:22.929896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.591223+0000","last_change":"2024-05-20T17:05:05.103357+0000","last_active":"2024-05-20T17:06:44.591223+0000","last_peered":"2024-05-20T17:06:44.591223+0000","last_clean":"2024-05-20T17:06:44.591223+0000","last_became_active":"2024-05-20T17:05:05.102990+0000","last_became_peered":"2024-05-20T17:05:05.102990+0000","last_unstale":"2024-05-20T17:06:44.591223+0000","last_undegraded":"2024-05-20T17:06:44.591223+0000","last_fullsized":"2024-05-20T17:06:44.591223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:01.800910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"92'6","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587063+0000","last_change":"2024-05-20T17:05:05.114822+0000","last_active":"2024-05-20T17:06:44.587063+0000","last_peered":"2024-05-20T17:06:44.587063+0000","last_clean":"2024-05-20T17:06:44.587063+0000","last_became_active":"2024-05-20T17:05:05.114402+0000","last_became_peered":"2024-05-20T17:05:05.114402+0000","last_unstale":"2024-05-20T17:06:44.587063+0000","last_undegraded":"2024-05-20T17:06:44.587063+0000","last_fullsized":"2024-05-20T17:06:44.587063+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:03:19.530670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"92'5","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.593574+0000","last_change":"2024-05-20T17:05:05.111478+0000","last_active":"2024-05-20T17:06:44.593574+0000","last_peered":"2024-05-20T17:06:44.593574+0000","last_clean":"2024-05-20T17:06:44.593574+0000","last_became_active":"2024-05-20T17:05:05.111054+0000","last_became_peered":"2024-05-20T17:05:05.111054+0000","last_unstale":"2024-05-20T17:06:44.593574+0000","last_undegraded":"2024-05-20T17:06:44.593574+0000","last_fullsized":"2024-05-20T17:06:44.593574+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:09:52.783885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587266+0000","last_change":"2024-05-20T17:05:05.109706+0000","last_active":"2024-05-20T17:06:44.587266+0000","last_peered":"2024-05-20T17:06:44.587266+0000","last_clean":"2024-05-20T17:06:44.587266+0000","last_became_active":"2024-05-20T17:05:05.109258+0000","last_became_peered":"2024-05-20T17:05:05.109258+0000","last_unstale":"2024-05-20T17:06:44.587266+0000","last_undegraded":"2024-05-20T17:06:44.587266+0000","last_fullsized":"2024-05-20T17:06:44.587266+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:11:48.568541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.633855+0000","last_change":"2024-05-20T17:05:05.097099+0000","last_active":"2024-05-20T17:06:44.633855+0000","last_peered":"2024-05-20T17:06:44.633855+0000","last_clean":"2024-05-20T17:06:44.633855+0000","last_became_active":"2024-05-20T17:05:05.096514+0000","last_became_peered":"2024-05-20T17:05:05.096514+0000","last_unstale":"2024-05-20T17:06:44.633855+0000","last_undegraded":"2024-05-20T17:06:44.633855+0000","last_fullsized":"2024-05-20T17:06:44.633855+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:30:30.472956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"92'16","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587712+0000","last_change":"2024-05-20T17:05:05.114535+0000","last_active":"2024-05-20T17:06:44.587712+0000","last_peered":"2024-05-20T17:06:44.587712+0000","last_clean":"2024-05-20T17:06:44.587712+0000","last_became_active":"2024-05-20T17:05:05.114126+0000","last_became_peered":"2024-05-20T17:05:05.114126+0000","last_unstale":"2024-05-20T17:06:44.587712+0000","last_undegraded":"2024-05-20T17:06:44.587712+0000","last_fullsized":"2024-05-20T17:06:44.587712+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:36:05.541565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"92'6","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594243+0000","last_change":"2024-05-20T17:05:05.115584+0000","last_active":"2024-05-20T17:06:44.594243+0000","last_peered":"2024-05-20T17:06:44.594243+0000","last_clean":"2024-05-20T17:06:44.594243+0000","last_became_active":"2024-05-20T17:05:05.115178+0000","last_became_peered":"2024-05-20T17:05:05.115178+0000","last_unstale":"2024-05-20T17:06:44.594243+0000","last_undegraded":"2024-05-20T17:06:44.594243+0000","last_fullsized":"2024-05-20T17:06:44.594243+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:11:36.593125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.723949+0000","last_change":"2024-05-20T17:05:05.112302+0000","last_active":"2024-05-20T17:06:44.723949+0000","last_peered":"2024-05-20T17:06:44.723949+0000","last_clean":"2024-05-20T17:06:44.723949+0000","last_became_active":"2024-05-20T17:05:05.109423+0000","last_became_peered":"2024-05-20T17:05:05.109423+0000","last_unstale":"2024-05-20T17:06:44.723949+0000","last_undegraded":"2024-05-20T17:06:44.723949+0000","last_fullsized":"2024-05-20T17:06:44.723949+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:43.149894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.589770+0000","last_change":"2024-05-20T17:05:05.094024+0000","last_active":"2024-05-20T17:06:44.589770+0000","last_peered":"2024-05-20T17:06:44.589770+0000","last_clean":"2024-05-20T17:06:44.589770+0000","last_became_active":"2024-05-20T17:05:05.093681+0000","last_became_peered":"2024-05-20T17:05:05.093681+0000","last_unstale":"2024-05-20T17:06:44.589770+0000","last_undegraded":"2024-05-20T17:06:44.589770+0000","last_fullsized":"2024-05-20T17:06:44.589770+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:05:57.768796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"92'7","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.773128+0000","last_change":"2024-05-20T17:05:05.109210+0000","last_active":"2024-05-20T17:06:44.773128+0000","last_peered":"2024-05-20T17:06:44.773128+0000","last_clean":"2024-05-20T17:06:44.773128+0000","last_became_active":"2024-05-20T17:05:05.108819+0000","last_became_peered":"2024-05-20T17:05:05.108819+0000","last_unstale":"2024-05-20T17:06:44.773128+0000","last_undegraded":"2024-05-20T17:06:44.773128+0000","last_fullsized":"2024-05-20T17:06:44.773128+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:47:10.954313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'7","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.773372+0000","last_change":"2024-05-20T17:05:05.107455+0000","last_active":"2024-05-20T17:06:44.773372+0000","last_peered":"2024-05-20T17:06:44.773372+0000","last_clean":"2024-05-20T17:06:44.773372+0000","last_became_active":"2024-05-20T17:05:05.107010+0000","last_became_peered":"2024-05-20T17:05:05.107010+0000","last_unstale":"2024-05-20T17:06:44.773372+0000","last_undegraded":"2024-05-20T17:06:44.773372+0000","last_fullsized":"2024-05-20T17:06:44.773372+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:31:21.445393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.633069+0000","last_change":"2024-05-20T17:05:05.116417+0000","last_active":"2024-05-20T17:06:44.633069+0000","last_peered":"2024-05-20T17:06:44.633069+0000","last_clean":"2024-05-20T17:06:44.633069+0000","last_became_active":"2024-05-20T17:05:05.116018+0000","last_became_peered":"2024-05-20T17:05:05.116018+0000","last_unstale":"2024-05-20T17:06:44.633069+0000","last_undegraded":"2024-05-20T17:06:44.633069+0000","last_fullsized":"2024-05-20T17:06:44.633069+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:16:52.984984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.591333+0000","last_change":"2024-05-20T17:05:05.109029+0000","last_active":"2024-05-20T17:06:44.591333+0000","last_peered":"2024-05-20T17:06:44.591333+0000","last_clean":"2024-05-20T17:06:44.591333+0000","last_became_active":"2024-05-20T17:05:05.108677+0000","last_became_peered":"2024-05-20T17:05:05.108677+0000","last_unstale":"2024-05-20T17:06:44.591333+0000","last_undegraded":"2024-05-20T17:06:44.591333+0000","last_fullsized":"2024-05-20T17:06:44.591333+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:24:36.698549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.719768+0000","last_change":"2024-05-20T17:05:05.104962+0000","last_active":"2024-05-20T17:06:44.719768+0000","last_peered":"2024-05-20T17:06:44.719768+0000","last_clean":"2024-05-20T17:06:44.719768+0000","last_became_active":"2024-05-20T17:05:05.104503+0000","last_became_peered":"2024-05-20T17:05:05.104503+0000","last_unstale":"2024-05-20T17:06:44.719768+0000","last_undegraded":"2024-05-20T17:06:44.719768+0000","last_fullsized":"2024-05-20T17:06:44.719768+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:51.807731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.588744+0000","last_change":"2024-05-20T17:05:05.094714+0000","last_active":"2024-05-20T17:06:44.588744+0000","last_peered":"2024-05-20T17:06:44.588744+0000","last_clean":"2024-05-20T17:06:44.588744+0000","last_became_active":"2024-05-20T17:05:05.094343+0000","last_became_peered":"2024-05-20T17:05:05.094343+0000","last_unstale":"2024-05-20T17:06:44.588744+0000","last_undegraded":"2024-05-20T17:06:44.588744+0000","last_fullsized":"2024-05-20T17:06:44.588744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:17:50.711969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.588207+0000","last_change":"2024-05-20T17:05:09.130195+0000","last_active":"2024-05-20T17:06:44.588207+0000","last_peered":"2024-05-20T17:06:44.588207+0000","last_clean":"2024-05-20T17:06:44.588207+0000","last_became_active":"2024-05-20T17:05:09.129809+0000","last_became_peered":"2024-05-20T17:05:09.129809+0000","last_unstale":"2024-05-20T17:06:44.588207+0000","last_undegraded":"2024-05-20T17:06:44.588207+0000","last_fullsized":"2024-05-20T17:06:44.588207+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:30:23.666443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'13","reported_seq":117,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:45.721278+0000","last_change":"2024-05-20T17:05:04.093762+0000","last_active":"2024-05-20T17:06:45.721278+0000","last_peered":"2024-05-20T17:06:45.721278+0000","last_clean":"2024-05-20T17:06:45.721278+0000","last_became_active":"2024-05-20T17:05:04.093408+0000","last_became_peered":"2024-05-20T17:05:04.093408+0000","last_unstale":"2024-05-20T17:06:45.721278+0000","last_undegraded":"2024-05-20T17:06:45.721278+0000","last_fullsized":"2024-05-20T17:06:45.721278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:38:12.725701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587468+0000","last_change":"2024-05-20T17:05:05.110848+0000","last_active":"2024-05-20T17:06:44.587468+0000","last_peered":"2024-05-20T17:06:44.587468+0000","last_clean":"2024-05-20T17:06:44.587468+0000","last_became_active":"2024-05-20T17:05:05.110467+0000","last_became_peered":"2024-05-20T17:05:05.110467+0000","last_unstale":"2024-05-20T17:06:44.587468+0000","last_undegraded":"2024-05-20T17:06:44.587468+0000","last_fullsized":"2024-05-20T17:06:44.587468+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:09:11.436295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.723591+0000","last_change":"2024-05-20T17:05:09.138726+0000","last_active":"2024-05-20T17:06:44.723591+0000","last_peered":"2024-05-20T17:06:44.723591+0000","last_clean":"2024-05-20T17:06:44.723591+0000","last_became_active":"2024-05-20T17:05:09.138012+0000","last_became_peered":"2024-05-20T17:05:09.138012+0000","last_unstale":"2024-05-20T17:06:44.723591+0000","last_undegraded":"2024-05-20T17:06:44.723591+0000","last_fullsized":"2024-05-20T17:06:44.723591+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:42:40.892912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587651+0000","last_change":"2024-05-20T17:05:04.101591+0000","last_active":"2024-05-20T17:06:44.587651+0000","last_peered":"2024-05-20T17:06:44.587651+0000","last_clean":"2024-05-20T17:06:44.587651+0000","last_became_active":"2024-05-20T17:05:04.101258+0000","last_became_peered":"2024-05-20T17:05:04.101258+0000","last_unstale":"2024-05-20T17:06:44.587651+0000","last_undegraded":"2024-05-20T17:06:44.587651+0000","last_fullsized":"2024-05-20T17:06:44.587651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:13:35.443657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"92'6","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.773392+0000","last_change":"2024-05-20T17:05:05.114726+0000","last_active":"2024-05-20T17:06:44.773392+0000","last_peered":"2024-05-20T17:06:44.773392+0000","last_clean":"2024-05-20T17:06:44.773392+0000","last_became_active":"2024-05-20T17:05:05.114371+0000","last_became_peered":"2024-05-20T17:05:05.114371+0000","last_unstale":"2024-05-20T17:06:44.773392+0000","last_undegraded":"2024-05-20T17:06:44.773392+0000","last_fullsized":"2024-05-20T17:06:44.773392+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:50:37.982368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.723744+0000","last_change":"2024-05-20T17:05:43.630866+0000","last_active":"2024-05-20T17:06:44.723744+0000","last_peered":"2024-05-20T17:06:44.723744+0000","last_clean":"2024-05-20T17:06:44.723744+0000","last_became_active":"2024-05-20T17:05:43.630335+0000","last_became_peered":"2024-05-20T17:05:43.630335+0000","last_unstale":"2024-05-20T17:06:44.723744+0000","last_undegraded":"2024-05-20T17:06:44.723744+0000","last_fullsized":"2024-05-20T17:06:44.723744+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:59:01.805026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":44,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.592015+0000","last_change":"2024-05-20T17:05:04.094198+0000","last_active":"2024-05-20T17:06:44.592015+0000","last_peered":"2024-05-20T17:06:44.592015+0000","last_clean":"2024-05-20T17:06:44.592015+0000","last_became_active":"2024-05-20T17:05:04.092910+0000","last_became_peered":"2024-05-20T17:05:04.092910+0000","last_unstale":"2024-05-20T17:06:44.592015+0000","last_undegraded":"2024-05-20T17:06:44.592015+0000","last_fullsized":"2024-05-20T17:06:44.592015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:48:59.565790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.633349+0000","last_change":"2024-05-20T17:05:05.094554+0000","last_active":"2024-05-20T17:06:44.633349+0000","last_peered":"2024-05-20T17:06:44.633349+0000","last_clean":"2024-05-20T17:06:44.633349+0000","last_became_active":"2024-05-20T17:05:05.092846+0000","last_became_peered":"2024-05-20T17:05:05.092846+0000","last_unstale":"2024-05-20T17:06:44.633349+0000","last_undegraded":"2024-05-20T17:06:44.633349+0000","last_fullsized":"2024-05-20T17:06:44.633349+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:32:00.607173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.723501+0000","last_change":"2024-05-20T17:05:09.129918+0000","last_active":"2024-05-20T17:06:44.723501+0000","last_peered":"2024-05-20T17:06:44.723501+0000","last_clean":"2024-05-20T17:06:44.723501+0000","last_became_active":"2024-05-20T17:05:09.129497+0000","last_became_peered":"2024-05-20T17:05:09.129497+0000","last_unstale":"2024-05-20T17:06:44.723501+0000","last_undegraded":"2024-05-20T17:06:44.723501+0000","last_fullsized":"2024-05-20T17:06:44.723501+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:45:16.189840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.592249+0000","last_change":"2024-05-20T17:05:04.104740+0000","last_active":"2024-05-20T17:06:44.592249+0000","last_peered":"2024-05-20T17:06:44.592249+0000","last_clean":"2024-05-20T17:06:44.592249+0000","last_became_active":"2024-05-20T17:05:04.103297+0000","last_became_peered":"2024-05-20T17:05:04.103297+0000","last_unstale":"2024-05-20T17:06:44.592249+0000","last_undegraded":"2024-05-20T17:06:44.592249+0000","last_fullsized":"2024-05-20T17:06:44.592249+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:48:08.543394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":44,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594899+0000","last_change":"2024-05-20T17:05:05.108681+0000","last_active":"2024-05-20T17:06:44.594899+0000","last_peered":"2024-05-20T17:06:44.594899+0000","last_clean":"2024-05-20T17:06:44.594899+0000","last_became_active":"2024-05-20T17:05:05.108275+0000","last_became_peered":"2024-05-20T17:05:05.108275+0000","last_unstale":"2024-05-20T17:06:44.594899+0000","last_undegraded":"2024-05-20T17:06:44.594899+0000","last_fullsized":"2024-05-20T17:06:44.594899+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:15:26.540948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.588403+0000","last_change":"2024-05-20T17:05:09.125991+0000","last_active":"2024-05-20T17:06:44.588403+0000","last_peered":"2024-05-20T17:06:44.588403+0000","last_clean":"2024-05-20T17:06:44.588403+0000","last_became_active":"2024-05-20T17:05:09.125493+0000","last_became_peered":"2024-05-20T17:05:09.125493+0000","last_unstale":"2024-05-20T17:06:44.588403+0000","last_undegraded":"2024-05-20T17:06:44.588403+0000","last_fullsized":"2024-05-20T17:06:44.588403+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:09:19.603595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"92'7","reported_seq":116,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.679991+0000","last_change":"2024-05-20T17:05:04.100387+0000","last_active":"2024-05-20T17:06:44.679991+0000","last_peered":"2024-05-20T17:06:44.679991+0000","last_clean":"2024-05-20T17:06:44.679991+0000","last_became_active":"2024-05-20T17:05:04.099834+0000","last_became_peered":"2024-05-20T17:05:04.099834+0000","last_unstale":"2024-05-20T17:06:44.679991+0000","last_undegraded":"2024-05-20T17:06:44.679991+0000","last_fullsized":"2024-05-20T17:06:44.679991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:10:18.696925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590567+0000","last_change":"2024-05-20T17:05:05.094015+0000","last_active":"2024-05-20T17:06:44.590567+0000","last_peered":"2024-05-20T17:06:44.590567+0000","last_clean":"2024-05-20T17:06:44.590567+0000","last_became_active":"2024-05-20T17:05:05.093650+0000","last_became_peered":"2024-05-20T17:05:05.093650+0000","last_unstale":"2024-05-20T17:06:44.590567+0000","last_undegraded":"2024-05-20T17:06:44.590567+0000","last_fullsized":"2024-05-20T17:06:44.590567+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:39:46.944348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.588560+0000","last_change":"2024-05-20T17:05:09.122824+0000","last_active":"2024-05-20T17:06:44.588560+0000","last_peered":"2024-05-20T17:06:44.588560+0000","last_clean":"2024-05-20T17:06:44.588560+0000","last_became_active":"2024-05-20T17:05:09.122047+0000","last_became_peered":"2024-05-20T17:05:09.122047+0000","last_unstale":"2024-05-20T17:06:44.588560+0000","last_undegraded":"2024-05-20T17:06:44.588560+0000","last_fullsized":"2024-05-20T17:06:44.588560+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:55:49.843543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":52,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.640701+0000","last_change":"2024-05-20T17:06:44.640701+0000","last_active":"2024-05-20T17:06:44.640701+0000","last_peered":"2024-05-20T17:06:44.640701+0000","last_clean":"2024-05-20T17:06:44.640701+0000","last_became_active":"2024-05-20T17:06:44.634542+0000","last_became_peered":"2024-05-20T17:06:44.634542+0000","last_unstale":"2024-05-20T17:06:44.640701+0000","last_undegraded":"2024-05-20T17:06:44.640701+0000","last_fullsized":"2024-05-20T17:06:44.640701+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:39:58.700196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":23,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.719121+0000","last_change":"2024-05-20T17:05:43.627917+0000","last_active":"2024-05-20T17:06:44.719121+0000","last_peered":"2024-05-20T17:06:44.719121+0000","last_clean":"2024-05-20T17:06:44.719121+0000","last_became_active":"2024-05-20T17:05:43.627522+0000","last_became_peered":"2024-05-20T17:05:43.627522+0000","last_unstale":"2024-05-20T17:06:44.719121+0000","last_undegraded":"2024-05-20T17:06:44.719121+0000","last_fullsized":"2024-05-20T17:06:44.719121+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:13.634781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.591239+0000","last_change":"2024-05-20T17:05:43.948544+0000","last_active":"2024-05-20T17:06:44.591239+0000","last_peered":"2024-05-20T17:06:44.591239+0000","last_clean":"2024-05-20T17:06:44.591239+0000","last_became_active":"2024-05-20T17:05:43.948156+0000","last_became_peered":"2024-05-20T17:05:43.948156+0000","last_unstale":"2024-05-20T17:06:44.591239+0000","last_undegraded":"2024-05-20T17:06:44.591239+0000","last_fullsized":"2024-05-20T17:06:44.591239+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:23:03.437012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,10,0],"acting":[11,4,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.589565+0000","last_change":"2024-05-20T17:05:04.088139+0000","last_active":"2024-05-20T17:06:44.589565+0000","last_peered":"2024-05-20T17:06:44.589565+0000","last_clean":"2024-05-20T17:06:44.589565+0000","last_became_active":"2024-05-20T17:05:04.087746+0000","last_became_peered":"2024-05-20T17:05:04.087746+0000","last_unstale":"2024-05-20T17:06:44.589565+0000","last_undegraded":"2024-05-20T17:06:44.589565+0000","last_fullsized":"2024-05-20T17:06:44.589565+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:27:43.440887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587128+0000","last_change":"2024-05-20T17:05:05.099478+0000","last_active":"2024-05-20T17:06:44.587128+0000","last_peered":"2024-05-20T17:06:44.587128+0000","last_clean":"2024-05-20T17:06:44.587128+0000","last_became_active":"2024-05-20T17:05:05.099058+0000","last_became_peered":"2024-05-20T17:05:05.099058+0000","last_unstale":"2024-05-20T17:06:44.587128+0000","last_undegraded":"2024-05-20T17:06:44.587128+0000","last_fullsized":"2024-05-20T17:06:44.587128+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:41:51.133985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.773396+0000","last_change":"2024-05-20T17:05:09.132210+0000","last_active":"2024-05-20T17:06:44.773396+0000","last_peered":"2024-05-20T17:06:44.773396+0000","last_clean":"2024-05-20T17:06:44.773396+0000","last_became_active":"2024-05-20T17:05:09.131782+0000","last_became_peered":"2024-05-20T17:05:09.131782+0000","last_unstale":"2024-05-20T17:06:44.773396+0000","last_undegraded":"2024-05-20T17:06:44.773396+0000","last_fullsized":"2024-05-20T17:06:44.773396+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:39:13.111988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594081+0000","last_change":"2024-05-20T17:05:04.100091+0000","last_active":"2024-05-20T17:06:44.594081+0000","last_peered":"2024-05-20T17:06:44.594081+0000","last_clean":"2024-05-20T17:06:44.594081+0000","last_became_active":"2024-05-20T17:05:04.099741+0000","last_became_peered":"2024-05-20T17:05:04.099741+0000","last_unstale":"2024-05-20T17:06:44.594081+0000","last_undegraded":"2024-05-20T17:06:44.594081+0000","last_fullsized":"2024-05-20T17:06:44.594081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:58:51.078656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.719066+0000","last_change":"2024-05-20T17:05:05.101320+0000","last_active":"2024-05-20T17:06:44.719066+0000","last_peered":"2024-05-20T17:06:44.719066+0000","last_clean":"2024-05-20T17:06:44.719066+0000","last_became_active":"2024-05-20T17:05:05.100957+0000","last_became_peered":"2024-05-20T17:05:05.100957+0000","last_unstale":"2024-05-20T17:06:44.719066+0000","last_undegraded":"2024-05-20T17:06:44.719066+0000","last_fullsized":"2024-05-20T17:06:44.719066+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:19.765284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587203+0000","last_change":"2024-05-20T17:05:09.131013+0000","last_active":"2024-05-20T17:06:44.587203+0000","last_peered":"2024-05-20T17:06:44.587203+0000","last_clean":"2024-05-20T17:06:44.587203+0000","last_became_active":"2024-05-20T17:05:09.130459+0000","last_became_peered":"2024-05-20T17:05:09.130459+0000","last_unstale":"2024-05-20T17:06:44.587203+0000","last_undegraded":"2024-05-20T17:06:44.587203+0000","last_fullsized":"2024-05-20T17:06:44.587203+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:46.158164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"92'5","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:47.684158+0000","last_change":"2024-05-20T17:05:04.094572+0000","last_active":"2024-05-20T17:06:47.684158+0000","last_peered":"2024-05-20T17:06:47.684158+0000","last_clean":"2024-05-20T17:06:47.684158+0000","last_became_active":"2024-05-20T17:05:04.094170+0000","last_became_peered":"2024-05-20T17:05:04.094170+0000","last_unstale":"2024-05-20T17:06:47.684158+0000","last_undegraded":"2024-05-20T17:06:47.684158+0000","last_fullsized":"2024-05-20T17:06:47.684158+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:31:00.700434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":149,"num_read_kb":149,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.633902+0000","last_change":"2024-05-20T17:05:05.108241+0000","last_active":"2024-05-20T17:06:44.633902+0000","last_peered":"2024-05-20T17:06:44.633902+0000","last_clean":"2024-05-20T17:06:44.633902+0000","last_became_active":"2024-05-20T17:05:05.107515+0000","last_became_peered":"2024-05-20T17:05:05.107515+0000","last_unstale":"2024-05-20T17:06:44.633902+0000","last_undegraded":"2024-05-20T17:06:44.633902+0000","last_fullsized":"2024-05-20T17:06:44.633902+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:41:44.735821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.718991+0000","last_change":"2024-05-20T17:05:09.133897+0000","last_active":"2024-05-20T17:06:44.718991+0000","last_peered":"2024-05-20T17:06:44.718991+0000","last_clean":"2024-05-20T17:06:44.718991+0000","last_became_active":"2024-05-20T17:05:09.128953+0000","last_became_peered":"2024-05-20T17:05:09.128953+0000","last_unstale":"2024-05-20T17:06:44.718991+0000","last_undegraded":"2024-05-20T17:06:44.718991+0000","last_fullsized":"2024-05-20T17:06:44.718991+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:48:01.515930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594230+0000","last_change":"2024-05-20T17:05:04.099314+0000","last_active":"2024-05-20T17:06:44.594230+0000","last_peered":"2024-05-20T17:06:44.594230+0000","last_clean":"2024-05-20T17:06:44.594230+0000","last_became_active":"2024-05-20T17:05:04.098912+0000","last_became_peered":"2024-05-20T17:05:04.098912+0000","last_unstale":"2024-05-20T17:06:44.594230+0000","last_undegraded":"2024-05-20T17:06:44.594230+0000","last_fullsized":"2024-05-20T17:06:44.594230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:42:57.797943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.773516+0000","last_change":"2024-05-20T17:05:05.117909+0000","last_active":"2024-05-20T17:06:44.773516+0000","last_peered":"2024-05-20T17:06:44.773516+0000","last_clean":"2024-05-20T17:06:44.773516+0000","last_became_active":"2024-05-20T17:05:05.117031+0000","last_became_peered":"2024-05-20T17:05:05.117031+0000","last_unstale":"2024-05-20T17:06:44.773516+0000","last_undegraded":"2024-05-20T17:06:44.773516+0000","last_fullsized":"2024-05-20T17:06:44.773516+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:09:29.211373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.724048+0000","last_change":"2024-05-20T17:05:43.850870+0000","last_active":"2024-05-20T17:06:44.724048+0000","last_peered":"2024-05-20T17:06:44.724048+0000","last_clean":"2024-05-20T17:06:44.724048+0000","last_became_active":"2024-05-20T17:05:43.850309+0000","last_became_peered":"2024-05-20T17:05:43.850309+0000","last_unstale":"2024-05-20T17:06:44.724048+0000","last_undegraded":"2024-05-20T17:06:44.724048+0000","last_fullsized":"2024-05-20T17:06:44.724048+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:23:32.213388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594764+0000","last_change":"2024-05-20T17:05:04.101362+0000","last_active":"2024-05-20T17:06:44.594764+0000","last_peered":"2024-05-20T17:06:44.594764+0000","last_clean":"2024-05-20T17:06:44.594764+0000","last_became_active":"2024-05-20T17:05:04.100972+0000","last_became_peered":"2024-05-20T17:05:04.100972+0000","last_unstale":"2024-05-20T17:06:44.594764+0000","last_undegraded":"2024-05-20T17:06:44.594764+0000","last_fullsized":"2024-05-20T17:06:44.594764+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:43:57.245788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.633665+0000","last_change":"2024-05-20T17:05:05.105432+0000","last_active":"2024-05-20T17:06:44.633665+0000","last_peered":"2024-05-20T17:06:44.633665+0000","last_clean":"2024-05-20T17:06:44.633665+0000","last_became_active":"2024-05-20T17:05:05.100514+0000","last_became_peered":"2024-05-20T17:05:05.100514+0000","last_unstale":"2024-05-20T17:06:44.633665+0000","last_undegraded":"2024-05-20T17:06:44.633665+0000","last_fullsized":"2024-05-20T17:06:44.633665+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:39:41.164482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.719085+0000","last_change":"2024-05-20T17:05:09.124544+0000","last_active":"2024-05-20T17:06:44.719085+0000","last_peered":"2024-05-20T17:06:44.719085+0000","last_clean":"2024-05-20T17:06:44.719085+0000","last_became_active":"2024-05-20T17:05:09.123525+0000","last_became_peered":"2024-05-20T17:05:09.123525+0000","last_unstale":"2024-05-20T17:06:44.719085+0000","last_undegraded":"2024-05-20T17:06:44.719085+0000","last_fullsized":"2024-05-20T17:06:44.719085+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:10:26.250112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"92'38","reported_seq":230,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:47.683983+0000","last_change":"2024-05-20T17:05:04.097234+0000","last_active":"2024-05-20T17:06:47.683983+0000","last_peered":"2024-05-20T17:06:47.683983+0000","last_clean":"2024-05-20T17:06:47.683983+0000","last_became_active":"2024-05-20T17:05:04.096532+0000","last_became_peered":"2024-05-20T17:05:04.096532+0000","last_unstale":"2024-05-20T17:06:47.683983+0000","last_undegraded":"2024-05-20T17:06:47.683983+0000","last_fullsized":"2024-05-20T17:06:47.683983+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:07:12.407496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63605,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":161,"num_read_kb":143,"num_write":40,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.591636+0000","last_change":"2024-05-20T17:05:05.113881+0000","last_active":"2024-05-20T17:06:44.591636+0000","last_peered":"2024-05-20T17:06:44.591636+0000","last_clean":"2024-05-20T17:06:44.591636+0000","last_became_active":"2024-05-20T17:05:05.113523+0000","last_became_peered":"2024-05-20T17:05:05.113523+0000","last_unstale":"2024-05-20T17:06:44.591636+0000","last_undegraded":"2024-05-20T17:06:44.591636+0000","last_fullsized":"2024-05-20T17:06:44.591636+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:50:44.206742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.595255+0000","last_change":"2024-05-20T17:05:09.133344+0000","last_active":"2024-05-20T17:06:44.595255+0000","last_peered":"2024-05-20T17:06:44.595255+0000","last_clean":"2024-05-20T17:06:44.595255+0000","last_became_active":"2024-05-20T17:05:09.132914+0000","last_became_peered":"2024-05-20T17:05:09.132914+0000","last_unstale":"2024-05-20T17:06:44.595255+0000","last_undegraded":"2024-05-20T17:06:44.595255+0000","last_fullsized":"2024-05-20T17:06:44.595255+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:56:17.279757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.588343+0000","last_change":"2024-05-20T17:05:04.099029+0000","last_active":"2024-05-20T17:06:44.588343+0000","last_peered":"2024-05-20T17:06:44.588343+0000","last_clean":"2024-05-20T17:06:44.588343+0000","last_became_active":"2024-05-20T17:05:04.098553+0000","last_became_peered":"2024-05-20T17:05:04.098553+0000","last_unstale":"2024-05-20T17:06:44.588343+0000","last_undegraded":"2024-05-20T17:06:44.588343+0000","last_fullsized":"2024-05-20T17:06:44.588343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:12.793008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.589885+0000","last_change":"2024-05-20T17:05:05.107734+0000","last_active":"2024-05-20T17:06:44.589885+0000","last_peered":"2024-05-20T17:06:44.589885+0000","last_clean":"2024-05-20T17:06:44.589885+0000","last_became_active":"2024-05-20T17:05:05.107388+0000","last_became_peered":"2024-05-20T17:05:05.107388+0000","last_unstale":"2024-05-20T17:06:44.589885+0000","last_undegraded":"2024-05-20T17:06:44.589885+0000","last_fullsized":"2024-05-20T17:06:44.589885+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:51.147757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590859+0000","last_change":"2024-05-20T17:05:09.137618+0000","last_active":"2024-05-20T17:06:44.590859+0000","last_peered":"2024-05-20T17:06:44.590859+0000","last_clean":"2024-05-20T17:06:44.590859+0000","last_became_active":"2024-05-20T17:05:09.137172+0000","last_became_peered":"2024-05-20T17:05:09.137172+0000","last_unstale":"2024-05-20T17:06:44.590859+0000","last_undegraded":"2024-05-20T17:06:44.590859+0000","last_fullsized":"2024-05-20T17:06:44.590859+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:17:45.218886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594646+0000","last_change":"2024-05-20T17:05:04.095628+0000","last_active":"2024-05-20T17:06:44.594646+0000","last_peered":"2024-05-20T17:06:44.594646+0000","last_clean":"2024-05-20T17:06:44.594646+0000","last_became_active":"2024-05-20T17:05:04.095187+0000","last_became_peered":"2024-05-20T17:05:04.095187+0000","last_unstale":"2024-05-20T17:06:44.594646+0000","last_undegraded":"2024-05-20T17:06:44.594646+0000","last_fullsized":"2024-05-20T17:06:44.594646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:03:33.601967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"92'15","reported_seq":44,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594068+0000","last_change":"2024-05-20T17:05:05.108321+0000","last_active":"2024-05-20T17:06:44.594068+0000","last_peered":"2024-05-20T17:06:44.594068+0000","last_clean":"2024-05-20T17:06:44.594068+0000","last_became_active":"2024-05-20T17:05:05.107943+0000","last_became_peered":"2024-05-20T17:05:05.107943+0000","last_unstale":"2024-05-20T17:06:44.594068+0000","last_undegraded":"2024-05-20T17:06:44.594068+0000","last_fullsized":"2024-05-20T17:06:44.594068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:12:44.324799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.719362+0000","last_change":"2024-05-20T17:05:09.135210+0000","last_active":"2024-05-20T17:06:44.719362+0000","last_peered":"2024-05-20T17:06:44.719362+0000","last_clean":"2024-05-20T17:06:44.719362+0000","last_became_active":"2024-05-20T17:05:09.134226+0000","last_became_peered":"2024-05-20T17:05:09.134226+0000","last_unstale":"2024-05-20T17:06:44.719362+0000","last_undegraded":"2024-05-20T17:06:44.719362+0000","last_fullsized":"2024-05-20T17:06:44.719362+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:36:22.833036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":109,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.724088+0000","last_change":"2024-05-20T17:05:04.089661+0000","last_active":"2024-05-20T17:06:44.724088+0000","last_peered":"2024-05-20T17:06:44.724088+0000","last_clean":"2024-05-20T17:06:44.724088+0000","last_became_active":"2024-05-20T17:05:04.088939+0000","last_became_peered":"2024-05-20T17:05:04.088939+0000","last_unstale":"2024-05-20T17:06:44.724088+0000","last_undegraded":"2024-05-20T17:06:44.724088+0000","last_fullsized":"2024-05-20T17:06:44.724088+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:48:15.962887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"92'6","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.593766+0000","last_change":"2024-05-20T17:05:05.113827+0000","last_active":"2024-05-20T17:06:44.593766+0000","last_peered":"2024-05-20T17:06:44.593766+0000","last_clean":"2024-05-20T17:06:44.593766+0000","last_became_active":"2024-05-20T17:05:05.111547+0000","last_became_peered":"2024-05-20T17:05:05.111547+0000","last_unstale":"2024-05-20T17:06:44.593766+0000","last_undegraded":"2024-05-20T17:06:44.593766+0000","last_fullsized":"2024-05-20T17:06:44.593766+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:29:13.826983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590048+0000","last_change":"2024-05-20T17:05:09.138814+0000","last_active":"2024-05-20T17:06:44.590048+0000","last_peered":"2024-05-20T17:06:44.590048+0000","last_clean":"2024-05-20T17:06:44.590048+0000","last_became_active":"2024-05-20T17:05:09.138119+0000","last_became_peered":"2024-05-20T17:05:09.138119+0000","last_unstale":"2024-05-20T17:06:44.590048+0000","last_undegraded":"2024-05-20T17:06:44.590048+0000","last_fullsized":"2024-05-20T17:06:44.590048+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:23.323841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":49,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.589886+0000","last_change":"2024-05-20T17:05:04.102468+0000","last_active":"2024-05-20T17:06:44.589886+0000","last_peered":"2024-05-20T17:06:44.589886+0000","last_clean":"2024-05-20T17:06:44.589886+0000","last_became_active":"2024-05-20T17:05:04.102073+0000","last_became_peered":"2024-05-20T17:05:04.102073+0000","last_unstale":"2024-05-20T17:06:44.589886+0000","last_undegraded":"2024-05-20T17:06:44.589886+0000","last_fullsized":"2024-05-20T17:06:44.589886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:42:46.929625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":41,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.593911+0000","last_change":"2024-05-20T17:05:43.850307+0000","last_active":"2024-05-20T17:06:44.593911+0000","last_peered":"2024-05-20T17:06:44.593911+0000","last_clean":"2024-05-20T17:06:44.593911+0000","last_became_active":"2024-05-20T17:05:43.849854+0000","last_became_peered":"2024-05-20T17:05:43.849854+0000","last_unstale":"2024-05-20T17:06:44.593911+0000","last_undegraded":"2024-05-20T17:06:44.593911+0000","last_fullsized":"2024-05-20T17:06:44.593911+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:55:46.179353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.593921+0000","last_change":"2024-05-20T17:05:09.134534+0000","last_active":"2024-05-20T17:06:44.593921+0000","last_peered":"2024-05-20T17:06:44.593921+0000","last_clean":"2024-05-20T17:06:44.593921+0000","last_became_active":"2024-05-20T17:05:09.134097+0000","last_became_peered":"2024-05-20T17:05:09.134097+0000","last_unstale":"2024-05-20T17:06:44.593921+0000","last_undegraded":"2024-05-20T17:06:44.593921+0000","last_fullsized":"2024-05-20T17:06:44.593921+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:43.782343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590466+0000","last_change":"2024-05-20T17:05:04.104314+0000","last_active":"2024-05-20T17:06:44.590466+0000","last_peered":"2024-05-20T17:06:44.590466+0000","last_clean":"2024-05-20T17:06:44.590466+0000","last_became_active":"2024-05-20T17:05:04.103338+0000","last_became_peered":"2024-05-20T17:05:04.103338+0000","last_unstale":"2024-05-20T17:06:44.590466+0000","last_undegraded":"2024-05-20T17:06:44.590466+0000","last_fullsized":"2024-05-20T17:06:44.590466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:32:06.721674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590990+0000","last_change":"2024-05-20T17:05:05.107566+0000","last_active":"2024-05-20T17:06:44.590990+0000","last_peered":"2024-05-20T17:06:44.590990+0000","last_clean":"2024-05-20T17:06:44.590990+0000","last_became_active":"2024-05-20T17:05:05.107190+0000","last_became_peered":"2024-05-20T17:05:05.107190+0000","last_unstale":"2024-05-20T17:06:44.590990+0000","last_undegraded":"2024-05-20T17:06:44.590990+0000","last_fullsized":"2024-05-20T17:06:44.590990+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:55:15.312700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590416+0000","last_change":"2024-05-20T17:05:09.369886+0000","last_active":"2024-05-20T17:06:44.590416+0000","last_peered":"2024-05-20T17:06:44.590416+0000","last_clean":"2024-05-20T17:06:44.590416+0000","last_became_active":"2024-05-20T17:05:09.369254+0000","last_became_peered":"2024-05-20T17:05:09.369254+0000","last_unstale":"2024-05-20T17:06:44.590416+0000","last_undegraded":"2024-05-20T17:06:44.590416+0000","last_fullsized":"2024-05-20T17:06:44.590416+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:54:54.784952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.719446+0000","last_change":"2024-05-20T17:05:04.100182+0000","last_active":"2024-05-20T17:06:44.719446+0000","last_peered":"2024-05-20T17:06:44.719446+0000","last_clean":"2024-05-20T17:06:44.719446+0000","last_became_active":"2024-05-20T17:05:04.099801+0000","last_became_peered":"2024-05-20T17:05:04.099801+0000","last_unstale":"2024-05-20T17:06:44.719446+0000","last_undegraded":"2024-05-20T17:06:44.719446+0000","last_fullsized":"2024-05-20T17:06:44.719446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:34.666869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'4","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587553+0000","last_change":"2024-05-20T17:05:05.111514+0000","last_active":"2024-05-20T17:06:44.587553+0000","last_peered":"2024-05-20T17:06:44.587553+0000","last_clean":"2024-05-20T17:06:44.587553+0000","last_became_active":"2024-05-20T17:05:05.111137+0000","last_became_peered":"2024-05-20T17:05:05.111137+0000","last_unstale":"2024-05-20T17:06:44.587553+0000","last_undegraded":"2024-05-20T17:06:44.587553+0000","last_fullsized":"2024-05-20T17:06:44.587553+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:19:44.677701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.589744+0000","last_change":"2024-05-20T17:05:09.133601+0000","last_active":"2024-05-20T17:06:44.589744+0000","last_peered":"2024-05-20T17:06:44.589744+0000","last_clean":"2024-05-20T17:06:44.589744+0000","last_became_active":"2024-05-20T17:05:09.132297+0000","last_became_peered":"2024-05-20T17:05:09.132297+0000","last_unstale":"2024-05-20T17:06:44.589744+0000","last_undegraded":"2024-05-20T17:06:44.589744+0000","last_fullsized":"2024-05-20T17:06:44.589744+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:06.896380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'5","reported_seq":111,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:47.724380+0000","last_change":"2024-05-20T17:05:04.099522+0000","last_active":"2024-05-20T17:06:47.724380+0000","last_peered":"2024-05-20T17:06:47.724380+0000","last_clean":"2024-05-20T17:06:47.724380+0000","last_became_active":"2024-05-20T17:05:04.098933+0000","last_became_peered":"2024-05-20T17:05:04.098933+0000","last_unstale":"2024-05-20T17:06:47.724380+0000","last_undegraded":"2024-05-20T17:06:47.724380+0000","last_fullsized":"2024-05-20T17:06:47.724380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:14.996617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"92'7","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587266+0000","last_change":"2024-05-20T17:05:05.116526+0000","last_active":"2024-05-20T17:06:44.587266+0000","last_peered":"2024-05-20T17:06:44.587266+0000","last_clean":"2024-05-20T17:06:44.587266+0000","last_became_active":"2024-05-20T17:05:05.116108+0000","last_became_peered":"2024-05-20T17:05:05.116108+0000","last_unstale":"2024-05-20T17:06:44.587266+0000","last_undegraded":"2024-05-20T17:06:44.587266+0000","last_fullsized":"2024-05-20T17:06:44.587266+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:20:03.481555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590089+0000","last_change":"2024-05-20T17:05:09.369912+0000","last_active":"2024-05-20T17:06:44.590089+0000","last_peered":"2024-05-20T17:06:44.590089+0000","last_clean":"2024-05-20T17:06:44.590089+0000","last_became_active":"2024-05-20T17:05:09.369456+0000","last_became_peered":"2024-05-20T17:05:09.369456+0000","last_unstale":"2024-05-20T17:06:44.590089+0000","last_undegraded":"2024-05-20T17:06:44.590089+0000","last_fullsized":"2024-05-20T17:06:44.590089+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:09:11.675548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594238+0000","last_change":"2024-05-20T17:05:05.093045+0000","last_active":"2024-05-20T17:06:44.594238+0000","last_peered":"2024-05-20T17:06:44.594238+0000","last_clean":"2024-05-20T17:06:44.594238+0000","last_became_active":"2024-05-20T17:05:05.092477+0000","last_became_peered":"2024-05-20T17:05:05.092477+0000","last_unstale":"2024-05-20T17:06:44.594238+0000","last_undegraded":"2024-05-20T17:06:44.594238+0000","last_fullsized":"2024-05-20T17:06:44.594238+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:08:43.038885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":110,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:46.726774+0000","last_change":"2024-05-20T17:05:04.100893+0000","last_active":"2024-05-20T17:06:46.726774+0000","last_peered":"2024-05-20T17:06:46.726774+0000","last_clean":"2024-05-20T17:06:46.726774+0000","last_became_active":"2024-05-20T17:05:04.100519+0000","last_became_peered":"2024-05-20T17:05:04.100519+0000","last_unstale":"2024-05-20T17:06:46.726774+0000","last_undegraded":"2024-05-20T17:06:46.726774+0000","last_fullsized":"2024-05-20T17:06:46.726774+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:10:13.764472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":74,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":23,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594008+0000","last_change":"2024-05-20T17:05:09.123689+0000","last_active":"2024-05-20T17:06:44.594008+0000","last_peered":"2024-05-20T17:06:44.594008+0000","last_clean":"2024-05-20T17:06:44.594008+0000","last_became_active":"2024-05-20T17:05:09.123124+0000","last_became_peered":"2024-05-20T17:05:09.123124+0000","last_unstale":"2024-05-20T17:06:44.594008+0000","last_undegraded":"2024-05-20T17:06:44.594008+0000","last_fullsized":"2024-05-20T17:06:44.594008+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:22:45.865765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":23,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.719235+0000","last_change":"2024-05-20T17:05:43.850832+0000","last_active":"2024-05-20T17:06:44.719235+0000","last_peered":"2024-05-20T17:06:44.719235+0000","last_clean":"2024-05-20T17:06:44.719235+0000","last_became_active":"2024-05-20T17:05:43.850352+0000","last_became_peered":"2024-05-20T17:05:43.850352+0000","last_unstale":"2024-05-20T17:06:44.719235+0000","last_undegraded":"2024-05-20T17:06:44.719235+0000","last_fullsized":"2024-05-20T17:06:44.719235+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:48:03.124871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.723886+0000","last_change":"2024-05-20T17:05:04.089427+0000","last_active":"2024-05-20T17:06:44.723886+0000","last_peered":"2024-05-20T17:06:44.723886+0000","last_clean":"2024-05-20T17:06:44.723886+0000","last_became_active":"2024-05-20T17:05:04.088880+0000","last_became_peered":"2024-05-20T17:05:04.088880+0000","last_unstale":"2024-05-20T17:06:44.723886+0000","last_undegraded":"2024-05-20T17:06:44.723886+0000","last_fullsized":"2024-05-20T17:06:44.723886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:16.068072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":353,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.593642+0000","last_change":"2024-05-20T17:03:47.606627+0000","last_active":"2024-05-20T17:06:44.593642+0000","last_peered":"2024-05-20T17:06:44.593642+0000","last_clean":"2024-05-20T17:06:44.593642+0000","last_became_active":"2024-05-20T17:03:47.606105+0000","last_became_peered":"2024-05-20T17:03:47.606105+0000","last_unstale":"2024-05-20T17:06:44.593642+0000","last_undegraded":"2024-05-20T17:06:44.593642+0000","last_fullsized":"2024-05-20T17:06:44.593642+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:00:12.876377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:00:12.876377+0000","last_clean_scrub_stamp":"2024-05-20T17:00:12.876377+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:26:46.526462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590202+0000","last_change":"2024-05-20T17:05:43.764889+0000","last_active":"2024-05-20T17:06:44.590202+0000","last_peered":"2024-05-20T17:06:44.590202+0000","last_clean":"2024-05-20T17:06:44.590202+0000","last_became_active":"2024-05-20T17:05:43.764351+0000","last_became_peered":"2024-05-20T17:05:43.764351+0000","last_unstale":"2024-05-20T17:06:44.590202+0000","last_undegraded":"2024-05-20T17:06:44.590202+0000","last_fullsized":"2024-05-20T17:06:44.590202+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:40:01.121264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.589438+0000","last_change":"2024-05-20T17:05:05.100689+0000","last_active":"2024-05-20T17:06:44.589438+0000","last_peered":"2024-05-20T17:06:44.589438+0000","last_clean":"2024-05-20T17:06:44.589438+0000","last_became_active":"2024-05-20T17:05:05.100321+0000","last_became_peered":"2024-05-20T17:05:05.100321+0000","last_unstale":"2024-05-20T17:06:44.589438+0000","last_undegraded":"2024-05-20T17:06:44.589438+0000","last_fullsized":"2024-05-20T17:06:44.589438+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:10:07.742067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.602701+0000","last_change":"2024-05-20T17:06:44.602189+0000","last_active":"2024-05-20T17:06:44.602701+0000","last_peered":"2024-05-20T17:06:44.602701+0000","last_clean":"2024-05-20T17:06:44.602701+0000","last_became_active":"2024-05-20T17:06:44.595835+0000","last_became_peered":"2024-05-20T17:06:44.595835+0000","last_unstale":"2024-05-20T17:06:44.602701+0000","last_undegraded":"2024-05-20T17:06:44.602701+0000","last_fullsized":"2024-05-20T17:06:44.602701+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:53:24.605243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590134+0000","last_change":"2024-05-20T17:05:09.130715+0000","last_active":"2024-05-20T17:06:44.590134+0000","last_peered":"2024-05-20T17:06:44.590134+0000","last_clean":"2024-05-20T17:06:44.590134+0000","last_became_active":"2024-05-20T17:05:09.130237+0000","last_became_peered":"2024-05-20T17:05:09.130237+0000","last_unstale":"2024-05-20T17:06:44.590134+0000","last_undegraded":"2024-05-20T17:06:44.590134+0000","last_fullsized":"2024-05-20T17:06:44.590134+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:52:15.160631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.591790+0000","last_change":"2024-05-20T17:05:04.103942+0000","last_active":"2024-05-20T17:06:44.591790+0000","last_peered":"2024-05-20T17:06:44.591790+0000","last_clean":"2024-05-20T17:06:44.591790+0000","last_became_active":"2024-05-20T17:05:04.102971+0000","last_became_peered":"2024-05-20T17:05:04.102971+0000","last_unstale":"2024-05-20T17:06:44.591790+0000","last_undegraded":"2024-05-20T17:06:44.591790+0000","last_fullsized":"2024-05-20T17:06:44.591790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:41:37.719913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.589989+0000","last_change":"2024-05-20T17:05:05.087201+0000","last_active":"2024-05-20T17:06:44.589989+0000","last_peered":"2024-05-20T17:06:44.589989+0000","last_clean":"2024-05-20T17:06:44.589989+0000","last_became_active":"2024-05-20T17:05:05.086809+0000","last_became_peered":"2024-05-20T17:05:05.086809+0000","last_unstale":"2024-05-20T17:06:44.589989+0000","last_undegraded":"2024-05-20T17:06:44.589989+0000","last_fullsized":"2024-05-20T17:06:44.589989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:31:45.925200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587115+0000","last_change":"2024-05-20T17:05:09.369881+0000","last_active":"2024-05-20T17:06:44.587115+0000","last_peered":"2024-05-20T17:06:44.587115+0000","last_clean":"2024-05-20T17:06:44.587115+0000","last_became_active":"2024-05-20T17:05:09.369391+0000","last_became_peered":"2024-05-20T17:05:09.369391+0000","last_unstale":"2024-05-20T17:06:44.587115+0000","last_undegraded":"2024-05-20T17:06:44.587115+0000","last_fullsized":"2024-05-20T17:06:44.587115+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:00:00.397289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'13","reported_seq":44,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.719701+0000","last_change":"2024-05-20T17:05:04.098857+0000","last_active":"2024-05-20T17:06:44.719701+0000","last_peered":"2024-05-20T17:06:44.719701+0000","last_clean":"2024-05-20T17:06:44.719701+0000","last_became_active":"2024-05-20T17:05:04.098480+0000","last_became_peered":"2024-05-20T17:05:04.098480+0000","last_unstale":"2024-05-20T17:06:44.719701+0000","last_undegraded":"2024-05-20T17:06:44.719701+0000","last_fullsized":"2024-05-20T17:06:44.719701+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:03:57.164706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587837+0000","last_change":"2024-05-20T17:05:05.121077+0000","last_active":"2024-05-20T17:06:44.587837+0000","last_peered":"2024-05-20T17:06:44.587837+0000","last_clean":"2024-05-20T17:06:44.587837+0000","last_became_active":"2024-05-20T17:05:05.120651+0000","last_became_peered":"2024-05-20T17:05:05.120651+0000","last_unstale":"2024-05-20T17:06:44.587837+0000","last_undegraded":"2024-05-20T17:06:44.587837+0000","last_fullsized":"2024-05-20T17:06:44.587837+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:59:30.061898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.588019+0000","last_change":"2024-05-20T17:05:09.122839+0000","last_active":"2024-05-20T17:06:44.588019+0000","last_peered":"2024-05-20T17:06:44.588019+0000","last_clean":"2024-05-20T17:06:44.588019+0000","last_became_active":"2024-05-20T17:05:09.122390+0000","last_became_peered":"2024-05-20T17:05:09.122390+0000","last_unstale":"2024-05-20T17:06:44.588019+0000","last_undegraded":"2024-05-20T17:06:44.588019+0000","last_fullsized":"2024-05-20T17:06:44.588019+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:50:27.849698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.724171+0000","last_change":"2024-05-20T17:05:04.092416+0000","last_active":"2024-05-20T17:06:44.724171+0000","last_peered":"2024-05-20T17:06:44.724171+0000","last_clean":"2024-05-20T17:06:44.724171+0000","last_became_active":"2024-05-20T17:05:04.091886+0000","last_became_peered":"2024-05-20T17:05:04.091886+0000","last_unstale":"2024-05-20T17:06:44.724171+0000","last_undegraded":"2024-05-20T17:06:44.724171+0000","last_fullsized":"2024-05-20T17:06:44.724171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:00:02.281867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'7","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.773475+0000","last_change":"2024-05-20T17:05:05.115650+0000","last_active":"2024-05-20T17:06:44.773475+0000","last_peered":"2024-05-20T17:06:44.773475+0000","last_clean":"2024-05-20T17:06:44.773475+0000","last_became_active":"2024-05-20T17:05:05.115303+0000","last_became_peered":"2024-05-20T17:05:05.115303+0000","last_unstale":"2024-05-20T17:06:44.773475+0000","last_undegraded":"2024-05-20T17:06:44.773475+0000","last_fullsized":"2024-05-20T17:06:44.773475+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:10:02.144645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.724183+0000","last_change":"2024-05-20T17:05:09.371289+0000","last_active":"2024-05-20T17:06:44.724183+0000","last_peered":"2024-05-20T17:06:44.724183+0000","last_clean":"2024-05-20T17:06:44.724183+0000","last_became_active":"2024-05-20T17:05:09.369823+0000","last_became_peered":"2024-05-20T17:05:09.369823+0000","last_unstale":"2024-05-20T17:06:44.724183+0000","last_undegraded":"2024-05-20T17:06:44.724183+0000","last_fullsized":"2024-05-20T17:06:44.724183+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:34:57.738554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.633114+0000","last_change":"2024-05-20T17:05:04.104909+0000","last_active":"2024-05-20T17:06:44.633114+0000","last_peered":"2024-05-20T17:06:44.633114+0000","last_clean":"2024-05-20T17:06:44.633114+0000","last_became_active":"2024-05-20T17:05:04.104457+0000","last_became_peered":"2024-05-20T17:05:04.104457+0000","last_unstale":"2024-05-20T17:06:44.633114+0000","last_undegraded":"2024-05-20T17:06:44.633114+0000","last_fullsized":"2024-05-20T17:06:44.633114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:53:41.790963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.591404+0000","last_change":"2024-05-20T17:05:05.103188+0000","last_active":"2024-05-20T17:06:44.591404+0000","last_peered":"2024-05-20T17:06:44.591404+0000","last_clean":"2024-05-20T17:06:44.591404+0000","last_became_active":"2024-05-20T17:05:05.102780+0000","last_became_peered":"2024-05-20T17:05:05.102780+0000","last_unstale":"2024-05-20T17:06:44.591404+0000","last_undegraded":"2024-05-20T17:06:44.591404+0000","last_fullsized":"2024-05-20T17:06:44.591404+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:32.907211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.719400+0000","last_change":"2024-05-20T17:05:09.126155+0000","last_active":"2024-05-20T17:06:44.719400+0000","last_peered":"2024-05-20T17:06:44.719400+0000","last_clean":"2024-05-20T17:06:44.719400+0000","last_became_active":"2024-05-20T17:05:09.125464+0000","last_became_peered":"2024-05-20T17:05:09.125464+0000","last_unstale":"2024-05-20T17:06:44.719400+0000","last_undegraded":"2024-05-20T17:06:44.719400+0000","last_fullsized":"2024-05-20T17:06:44.719400+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:28:52.747574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587303+0000","last_change":"2024-05-20T17:05:04.088923+0000","last_active":"2024-05-20T17:06:44.587303+0000","last_peered":"2024-05-20T17:06:44.587303+0000","last_clean":"2024-05-20T17:06:44.587303+0000","last_became_active":"2024-05-20T17:05:04.088335+0000","last_became_peered":"2024-05-20T17:05:04.088335+0000","last_unstale":"2024-05-20T17:06:44.587303+0000","last_undegraded":"2024-05-20T17:06:44.587303+0000","last_fullsized":"2024-05-20T17:06:44.587303+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:43:18.288139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.591736+0000","last_change":"2024-05-20T17:05:05.110964+0000","last_active":"2024-05-20T17:06:44.591736+0000","last_peered":"2024-05-20T17:06:44.591736+0000","last_clean":"2024-05-20T17:06:44.591736+0000","last_became_active":"2024-05-20T17:05:05.110593+0000","last_became_peered":"2024-05-20T17:05:05.110593+0000","last_unstale":"2024-05-20T17:06:44.591736+0000","last_undegraded":"2024-05-20T17:06:44.591736+0000","last_fullsized":"2024-05-20T17:06:44.591736+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:27.921812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":23,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.723756+0000","last_change":"2024-05-20T17:05:09.139541+0000","last_active":"2024-05-20T17:06:44.723756+0000","last_peered":"2024-05-20T17:06:44.723756+0000","last_clean":"2024-05-20T17:06:44.723756+0000","last_became_active":"2024-05-20T17:05:09.139008+0000","last_became_peered":"2024-05-20T17:05:09.139008+0000","last_unstale":"2024-05-20T17:06:44.723756+0000","last_undegraded":"2024-05-20T17:06:44.723756+0000","last_fullsized":"2024-05-20T17:06:44.723756+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:50.125661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'3","reported_seq":17,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.600278+0000","last_change":"2024-05-20T17:06:44.599695+0000","last_active":"2024-05-20T17:06:44.600278+0000","last_peered":"2024-05-20T17:06:44.600278+0000","last_clean":"2024-05-20T17:06:44.600278+0000","last_became_active":"2024-05-20T17:06:44.593479+0000","last_became_peered":"2024-05-20T17:06:44.593479+0000","last_unstale":"2024-05-20T17:06:44.600278+0000","last_undegraded":"2024-05-20T17:06:44.600278+0000","last_fullsized":"2024-05-20T17:06:44.600278+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:47:50.153220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587530+0000","last_change":"2024-05-20T17:05:05.113644+0000","last_active":"2024-05-20T17:06:44.587530+0000","last_peered":"2024-05-20T17:06:44.587530+0000","last_clean":"2024-05-20T17:06:44.587530+0000","last_became_active":"2024-05-20T17:05:05.113186+0000","last_became_peered":"2024-05-20T17:05:05.113186+0000","last_unstale":"2024-05-20T17:06:44.587530+0000","last_undegraded":"2024-05-20T17:06:44.587530+0000","last_fullsized":"2024-05-20T17:06:44.587530+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:54.243939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.723898+0000","last_change":"2024-05-20T17:05:09.370048+0000","last_active":"2024-05-20T17:06:44.723898+0000","last_peered":"2024-05-20T17:06:44.723898+0000","last_clean":"2024-05-20T17:06:44.723898+0000","last_became_active":"2024-05-20T17:05:09.369529+0000","last_became_peered":"2024-05-20T17:05:09.369529+0000","last_unstale":"2024-05-20T17:06:44.723898+0000","last_undegraded":"2024-05-20T17:06:44.723898+0000","last_fullsized":"2024-05-20T17:06:44.723898+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:49:09.332673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":48,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.591094+0000","last_change":"2024-05-20T17:05:43.633934+0000","last_active":"2024-05-20T17:06:44.591094+0000","last_peered":"2024-05-20T17:06:44.591094+0000","last_clean":"2024-05-20T17:06:44.591094+0000","last_became_active":"2024-05-20T17:05:43.628612+0000","last_became_peered":"2024-05-20T17:05:43.628612+0000","last_unstale":"2024-05-20T17:06:44.591094+0000","last_undegraded":"2024-05-20T17:06:44.591094+0000","last_fullsized":"2024-05-20T17:06:44.591094+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:52:27.321272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"92'5","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.593887+0000","last_change":"2024-05-20T17:05:05.115003+0000","last_active":"2024-05-20T17:06:44.593887+0000","last_peered":"2024-05-20T17:06:44.593887+0000","last_clean":"2024-05-20T17:06:44.593887+0000","last_became_active":"2024-05-20T17:05:05.114596+0000","last_became_peered":"2024-05-20T17:05:05.114596+0000","last_unstale":"2024-05-20T17:06:44.593887+0000","last_undegraded":"2024-05-20T17:06:44.593887+0000","last_fullsized":"2024-05-20T17:06:44.593887+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:47:39.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.633598+0000","last_change":"2024-05-20T17:05:09.131310+0000","last_active":"2024-05-20T17:06:44.633598+0000","last_peered":"2024-05-20T17:06:44.633598+0000","last_clean":"2024-05-20T17:06:44.633598+0000","last_became_active":"2024-05-20T17:05:09.130643+0000","last_became_peered":"2024-05-20T17:05:09.130643+0000","last_unstale":"2024-05-20T17:06:44.633598+0000","last_undegraded":"2024-05-20T17:06:44.633598+0000","last_fullsized":"2024-05-20T17:06:44.633598+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:58:21.996929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'5","reported_seq":109,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.706961+0000","last_change":"2024-05-20T17:05:04.100547+0000","last_active":"2024-05-20T17:06:44.706961+0000","last_peered":"2024-05-20T17:06:44.706961+0000","last_clean":"2024-05-20T17:06:44.706961+0000","last_became_active":"2024-05-20T17:05:04.100167+0000","last_became_peered":"2024-05-20T17:05:04.100167+0000","last_unstale":"2024-05-20T17:06:44.706961+0000","last_undegraded":"2024-05-20T17:06:44.706961+0000","last_fullsized":"2024-05-20T17:06:44.706961+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:44.182489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"92'7","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594309+0000","last_change":"2024-05-20T17:05:05.118459+0000","last_active":"2024-05-20T17:06:44.594309+0000","last_peered":"2024-05-20T17:06:44.594309+0000","last_clean":"2024-05-20T17:06:44.594309+0000","last_became_active":"2024-05-20T17:05:05.115445+0000","last_became_peered":"2024-05-20T17:05:05.115445+0000","last_unstale":"2024-05-20T17:06:44.594309+0000","last_undegraded":"2024-05-20T17:06:44.594309+0000","last_fullsized":"2024-05-20T17:06:44.594309+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:06:36.042952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.773147+0000","last_change":"2024-05-20T17:05:09.136508+0000","last_active":"2024-05-20T17:06:44.773147+0000","last_peered":"2024-05-20T17:06:44.773147+0000","last_clean":"2024-05-20T17:06:44.773147+0000","last_became_active":"2024-05-20T17:05:09.135825+0000","last_became_peered":"2024-05-20T17:05:09.135825+0000","last_unstale":"2024-05-20T17:06:44.773147+0000","last_undegraded":"2024-05-20T17:06:44.773147+0000","last_fullsized":"2024-05-20T17:06:44.773147+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:00:48.585071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"90'3","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.595014+0000","last_change":"2024-05-20T17:05:04.096484+0000","last_active":"2024-05-20T17:06:44.595014+0000","last_peered":"2024-05-20T17:06:44.595014+0000","last_clean":"2024-05-20T17:06:44.595014+0000","last_became_active":"2024-05-20T17:05:04.096053+0000","last_became_peered":"2024-05-20T17:05:04.096053+0000","last_unstale":"2024-05-20T17:06:44.595014+0000","last_undegraded":"2024-05-20T17:06:44.595014+0000","last_fullsized":"2024-05-20T17:06:44.595014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:35:19.373932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'6","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.593951+0000","last_change":"2024-05-20T17:05:05.118667+0000","last_active":"2024-05-20T17:06:44.593951+0000","last_peered":"2024-05-20T17:06:44.593951+0000","last_clean":"2024-05-20T17:06:44.593951+0000","last_became_active":"2024-05-20T17:05:05.118173+0000","last_became_peered":"2024-05-20T17:05:05.118173+0000","last_unstale":"2024-05-20T17:06:44.593951+0000","last_undegraded":"2024-05-20T17:06:44.593951+0000","last_fullsized":"2024-05-20T17:06:44.593951+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:14.658446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.593594+0000","last_change":"2024-05-20T17:05:09.127806+0000","last_active":"2024-05-20T17:06:44.593594+0000","last_peered":"2024-05-20T17:06:44.593594+0000","last_clean":"2024-05-20T17:06:44.593594+0000","last_became_active":"2024-05-20T17:05:09.126739+0000","last_became_peered":"2024-05-20T17:05:09.126739+0000","last_unstale":"2024-05-20T17:06:44.593594+0000","last_undegraded":"2024-05-20T17:06:44.593594+0000","last_fullsized":"2024-05-20T17:06:44.593594+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:41:58.391763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.589900+0000","last_change":"2024-05-20T17:05:04.096955+0000","last_active":"2024-05-20T17:06:44.589900+0000","last_peered":"2024-05-20T17:06:44.589900+0000","last_clean":"2024-05-20T17:06:44.589900+0000","last_became_active":"2024-05-20T17:05:04.096467+0000","last_became_peered":"2024-05-20T17:05:04.096467+0000","last_unstale":"2024-05-20T17:06:44.589900+0000","last_undegraded":"2024-05-20T17:06:44.589900+0000","last_fullsized":"2024-05-20T17:06:44.589900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:32:06.511617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594413+0000","last_change":"2024-05-20T17:05:05.106615+0000","last_active":"2024-05-20T17:06:44.594413+0000","last_peered":"2024-05-20T17:06:44.594413+0000","last_clean":"2024-05-20T17:06:44.594413+0000","last_became_active":"2024-05-20T17:05:05.106216+0000","last_became_peered":"2024-05-20T17:05:05.106216+0000","last_unstale":"2024-05-20T17:06:44.594413+0000","last_undegraded":"2024-05-20T17:06:44.594413+0000","last_fullsized":"2024-05-20T17:06:44.594413+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:32:10.920803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.591872+0000","last_change":"2024-05-20T17:05:05.098027+0000","last_active":"2024-05-20T17:06:44.591872+0000","last_peered":"2024-05-20T17:06:44.591872+0000","last_clean":"2024-05-20T17:06:44.591872+0000","last_became_active":"2024-05-20T17:05:05.097639+0000","last_became_peered":"2024-05-20T17:05:05.097639+0000","last_unstale":"2024-05-20T17:06:44.591872+0000","last_undegraded":"2024-05-20T17:06:44.591872+0000","last_fullsized":"2024-05-20T17:06:44.591872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:13:06.432459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":41,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.588446+0000","last_change":"2024-05-20T17:05:05.101197+0000","last_active":"2024-05-20T17:06:44.588446+0000","last_peered":"2024-05-20T17:06:44.588446+0000","last_clean":"2024-05-20T17:06:44.588446+0000","last_became_active":"2024-05-20T17:05:05.100865+0000","last_became_peered":"2024-05-20T17:05:05.100865+0000","last_unstale":"2024-05-20T17:06:44.588446+0000","last_undegraded":"2024-05-20T17:06:44.588446+0000","last_fullsized":"2024-05-20T17:06:44.588446+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:57:28.892291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.588126+0000","last_change":"2024-05-20T17:05:05.109529+0000","last_active":"2024-05-20T17:06:44.588126+0000","last_peered":"2024-05-20T17:06:44.588126+0000","last_clean":"2024-05-20T17:06:44.588126+0000","last_became_active":"2024-05-20T17:05:05.108332+0000","last_became_peered":"2024-05-20T17:05:05.108332+0000","last_unstale":"2024-05-20T17:06:44.588126+0000","last_undegraded":"2024-05-20T17:06:44.588126+0000","last_fullsized":"2024-05-20T17:06:44.588126+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:07.612296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"92'7","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.773766+0000","last_change":"2024-05-20T17:05:05.115602+0000","last_active":"2024-05-20T17:06:44.773766+0000","last_peered":"2024-05-20T17:06:44.773766+0000","last_clean":"2024-05-20T17:06:44.773766+0000","last_became_active":"2024-05-20T17:05:05.115250+0000","last_became_peered":"2024-05-20T17:05:05.115250+0000","last_unstale":"2024-05-20T17:06:44.773766+0000","last_undegraded":"2024-05-20T17:06:44.773766+0000","last_fullsized":"2024-05-20T17:06:44.773766+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:10:50.691956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590058+0000","last_change":"2024-05-20T17:05:05.110528+0000","last_active":"2024-05-20T17:06:44.590058+0000","last_peered":"2024-05-20T17:06:44.590058+0000","last_clean":"2024-05-20T17:06:44.590058+0000","last_became_active":"2024-05-20T17:05:05.110158+0000","last_became_peered":"2024-05-20T17:05:05.110158+0000","last_unstale":"2024-05-20T17:06:44.590058+0000","last_undegraded":"2024-05-20T17:06:44.590058+0000","last_fullsized":"2024-05-20T17:06:44.590058+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:58:15.143026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590706+0000","last_change":"2024-05-20T17:05:05.094890+0000","last_active":"2024-05-20T17:06:44.590706+0000","last_peered":"2024-05-20T17:06:44.590706+0000","last_clean":"2024-05-20T17:06:44.590706+0000","last_became_active":"2024-05-20T17:05:05.094452+0000","last_became_peered":"2024-05-20T17:05:05.094452+0000","last_unstale":"2024-05-20T17:06:44.590706+0000","last_undegraded":"2024-05-20T17:06:44.590706+0000","last_fullsized":"2024-05-20T17:06:44.590706+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:34:00.182526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":44,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.588973+0000","last_change":"2024-05-20T17:05:05.088916+0000","last_active":"2024-05-20T17:06:44.588973+0000","last_peered":"2024-05-20T17:06:44.588973+0000","last_clean":"2024-05-20T17:06:44.588973+0000","last_became_active":"2024-05-20T17:05:05.088257+0000","last_became_peered":"2024-05-20T17:05:05.088257+0000","last_unstale":"2024-05-20T17:06:44.588973+0000","last_undegraded":"2024-05-20T17:06:44.588973+0000","last_fullsized":"2024-05-20T17:06:44.588973+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:43:51.310579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587911+0000","last_change":"2024-05-20T17:05:43.629555+0000","last_active":"2024-05-20T17:06:44.587911+0000","last_peered":"2024-05-20T17:06:44.587911+0000","last_clean":"2024-05-20T17:06:44.587911+0000","last_became_active":"2024-05-20T17:05:43.629211+0000","last_became_peered":"2024-05-20T17:05:43.629211+0000","last_unstale":"2024-05-20T17:06:44.587911+0000","last_undegraded":"2024-05-20T17:06:44.587911+0000","last_fullsized":"2024-05-20T17:06:44.587911+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:27:42.199940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594180+0000","last_change":"2024-05-20T17:05:05.105421+0000","last_active":"2024-05-20T17:06:44.594180+0000","last_peered":"2024-05-20T17:06:44.594180+0000","last_clean":"2024-05-20T17:06:44.594180+0000","last_became_active":"2024-05-20T17:05:05.105086+0000","last_became_peered":"2024-05-20T17:05:05.105086+0000","last_unstale":"2024-05-20T17:06:44.594180+0000","last_undegraded":"2024-05-20T17:06:44.594180+0000","last_fullsized":"2024-05-20T17:06:44.594180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:56:07.257884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587359+0000","last_change":"2024-05-20T17:05:05.108394+0000","last_active":"2024-05-20T17:06:44.587359+0000","last_peered":"2024-05-20T17:06:44.587359+0000","last_clean":"2024-05-20T17:06:44.587359+0000","last_became_active":"2024-05-20T17:05:05.108003+0000","last_became_peered":"2024-05-20T17:05:05.108003+0000","last_unstale":"2024-05-20T17:06:44.587359+0000","last_undegraded":"2024-05-20T17:06:44.587359+0000","last_fullsized":"2024-05-20T17:06:44.587359+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:38.476660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.633897+0000","last_change":"2024-05-20T17:05:05.116825+0000","last_active":"2024-05-20T17:06:44.633897+0000","last_peered":"2024-05-20T17:06:44.633897+0000","last_clean":"2024-05-20T17:06:44.633897+0000","last_became_active":"2024-05-20T17:05:05.116366+0000","last_became_peered":"2024-05-20T17:05:05.116366+0000","last_unstale":"2024-05-20T17:06:44.633897+0000","last_undegraded":"2024-05-20T17:06:44.633897+0000","last_fullsized":"2024-05-20T17:06:44.633897+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:23:19.711036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.589794+0000","last_change":"2024-05-20T17:05:05.106896+0000","last_active":"2024-05-20T17:06:44.589794+0000","last_peered":"2024-05-20T17:06:44.589794+0000","last_clean":"2024-05-20T17:06:44.589794+0000","last_became_active":"2024-05-20T17:05:05.106514+0000","last_became_peered":"2024-05-20T17:05:05.106514+0000","last_unstale":"2024-05-20T17:06:44.589794+0000","last_undegraded":"2024-05-20T17:06:44.589794+0000","last_fullsized":"2024-05-20T17:06:44.589794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:08:22.235321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590988+0000","last_change":"2024-05-20T17:05:43.626576+0000","last_active":"2024-05-20T17:06:44.590988+0000","last_peered":"2024-05-20T17:06:44.590988+0000","last_clean":"2024-05-20T17:06:44.590988+0000","last_became_active":"2024-05-20T17:05:43.626171+0000","last_became_peered":"2024-05-20T17:05:43.626171+0000","last_unstale":"2024-05-20T17:06:44.590988+0000","last_undegraded":"2024-05-20T17:06:44.590988+0000","last_fullsized":"2024-05-20T17:06:44.590988+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:29:29.570441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70559,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":777,"num_read_kb":469,"num_write":248,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":211677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351011,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1073152,"data_stored":523337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612648,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28748,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716404,"statfs":{"total":95995035648,"available":95965597696,"internally_reserved":0,"allocated":1769472,"data_stored":1173758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776173,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":527363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037811,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1093632,"data_stored":523645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1691648,"data_stored":1120283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462973,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":518771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36456,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708696,"statfs":{"total":95995035648,"available":95957704704,"internally_reserved":0,"allocated":1142784,"data_stored":583406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1097728,"data_stored":520227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28156,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716996,"statfs":{"total":95995035648,"available":95966203904,"internally_reserved":0,"allocated":1163264,"data_stored":584158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149774,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1085440,"data_stored":518479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888136,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1081344,"data_stored":522845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724611,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37004,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708148,"statfs":{"total":95995035648,"available":95957143552,"internally_reserved":0,"allocated":1699840,"data_stored":1115865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:06:52.220 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph pg dump --format=json 2024-05-20T17:06:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:06:52.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:52 smithi006 ceph-mon[32486]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:06:53.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:52 smithi062 ceph-mon[35425]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:06:53.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:52 smithi171 ceph-mon[35901]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:06:53.907 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:53 smithi006 ceph-mon[32486]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 600 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:06:54.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:53 smithi062 ceph-mon[35425]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 600 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:06:54.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:53 smithi171 ceph-mon[35901]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 600 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:06:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.271+0000 7faa280ad700 1 -- 172.21.15.6:0/1122735195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa20107d90 msgr2=0x7faa201081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.271+0000 7faa280ad700 1 --2- 172.21.15.6:0/1122735195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa20107d90 0x7faa201081a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7faa140099c0 tx=0x7faa14009cd0 comp rx=0 tx=0).stop 2024-05-20T17:06:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.271+0000 7faa280ad700 1 -- 172.21.15.6:0/1122735195 shutdown_connections 2024-05-20T17:06:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.271+0000 7faa280ad700 1 --2- 172.21.15.6:0/1122735195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa201086e0 0x7faa20110040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:54.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.271+0000 7faa280ad700 1 --2- 172.21.15.6:0/1122735195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa20103460 0x7faa20103870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:54.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.271+0000 7faa280ad700 1 --2- 172.21.15.6:0/1122735195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa20107d90 0x7faa201081a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:54.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.271+0000 7faa280ad700 1 -- 172.21.15.6:0/1122735195 >> 172.21.15.6:0/1122735195 conn(0x7faa200fed50 msgr2=0x7faa201011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:54.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.271+0000 7faa280ad700 1 -- 172.21.15.6:0/1122735195 shutdown_connections 2024-05-20T17:06:54.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.271+0000 7faa280ad700 1 -- 172.21.15.6:0/1122735195 wait complete. 2024-05-20T17:06:54.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.271+0000 7faa280ad700 1 Processor -- start 2024-05-20T17:06:54.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.271+0000 7faa280ad700 1 -- start start 2024-05-20T17:06:54.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.272+0000 7faa280ad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa20103460 0x7faa2019f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:54.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.272+0000 7faa280ad700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa20107d90 0x7faa2019fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:54.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.272+0000 7faa280ad700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa201086e0 0x7faa20199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:54.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.272+0000 7faa280ad700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faa201132f0 con 0x7faa20103460 2024-05-20T17:06:54.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.272+0000 7faa280ad700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7faa20113170 con 0x7faa20107d90 2024-05-20T17:06:54.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.272+0000 7faa280ad700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faa20113470 con 0x7faa201086e0 2024-05-20T17:06:54.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.272+0000 7faa25e49700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa20103460 0x7faa2019f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:54.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.272+0000 7faa25e49700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa20103460 0x7faa2019f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33012/0 (socket says 172.21.15.6:33012) 2024-05-20T17:06:54.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.272+0000 7faa25e49700 1 -- 172.21.15.6:0/1560837904 learned_addr learned my addr 172.21.15.6:0/1560837904 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:54.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.272+0000 7faa2664a700 1 --2- 172.21.15.6:0/1560837904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa201086e0 0x7faa20199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:54.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.272+0000 7faa25648700 1 --2- 172.21.15.6:0/1560837904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa20107d90 0x7faa2019fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:54.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.272+0000 7faa25e49700 1 -- 172.21.15.6:0/1560837904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa201086e0 msgr2=0x7faa20199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:54.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.272+0000 7faa25e49700 1 --2- 172.21.15.6:0/1560837904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa201086e0 0x7faa20199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:54.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.272+0000 7faa25e49700 1 -- 172.21.15.6:0/1560837904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa20107d90 msgr2=0x7faa2019fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:54.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.272+0000 7faa25e49700 1 --2- 172.21.15.6:0/1560837904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa20107d90 0x7faa2019fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:54.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.272+0000 7faa25e49700 1 -- 172.21.15.6:0/1560837904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2019a1d0 con 0x7faa20103460 2024-05-20T17:06:54.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.272+0000 7faa25648700 1 --2- 172.21.15.6:0/1560837904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa20107d90 0x7faa2019fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:06:54.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.272+0000 7faa2664a700 1 --2- 172.21.15.6:0/1560837904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa201086e0 0x7faa20199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:06:54.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.272+0000 7faa25e49700 1 --2- 172.21.15.6:0/1560837904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa20103460 0x7faa2019f8b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00d950 tx=0x7faa1c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:54.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.273+0000 7faa12ffd700 1 -- 172.21.15.6:0/1560837904 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c016070 con 0x7faa20103460 2024-05-20T17:06:54.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.273+0000 7faa280ad700 1 -- 172.21.15.6:0/1560837904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa2019a4c0 con 0x7faa20103460 2024-05-20T17:06:54.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.273+0000 7faa12ffd700 1 -- 172.21.15.6:0/1560837904 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faa1c010460 con 0x7faa20103460 2024-05-20T17:06:54.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.273+0000 7faa12ffd700 1 -- 172.21.15.6:0/1560837904 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c00f620 con 0x7faa20103460 2024-05-20T17:06:54.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.273+0000 7faa280ad700 1 -- 172.21.15.6:0/1560837904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa201a6760 con 0x7faa20103460 2024-05-20T17:06:54.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.274+0000 7faa280ad700 1 -- 172.21.15.6:0/1560837904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa20050170 con 0x7faa20103460 2024-05-20T17:06:54.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.275+0000 7faa12ffd700 1 -- 172.21.15.6:0/1560837904 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7faa1c019070 con 0x7faa20103460 2024-05-20T17:06:54.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.276+0000 7faa12ffd700 1 --2- 172.21.15.6:0/1560837904 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7faa0c0a2c20 0x7faa0c0a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:54.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.276+0000 7faa25648700 1 --2- 172.21.15.6:0/1560837904 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7faa0c0a2c20 0x7faa0c0a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:54.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.276+0000 7faa12ffd700 1 -- 172.21.15.6:0/1560837904 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7faa1c0cf410 con 0x7faa20103460 2024-05-20T17:06:54.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.276+0000 7faa25648700 1 --2- 172.21.15.6:0/1560837904 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7faa0c0a2c20 0x7faa0c0a5130 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faa14006010 tx=0x7faa14005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:54.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.280+0000 7faa12ffd700 1 -- 172.21.15.6:0/1560837904 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7faa1c09bf60 con 0x7faa20103460 2024-05-20T17:06:54.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.480+0000 7faa280ad700 1 -- 172.21.15.6:0/1560837904 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faa2019afe0 con 0x7faa0c0a2c20 2024-05-20T17:06:54.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.489+0000 7faa12ffd700 1 -- 172.21.15.6:0/1560837904 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340517 (secure 0 0 0) 0x7faa2019afe0 con 0x7faa0c0a2c20 2024-05-20T17:06:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:06:54.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.494+0000 7faa280ad700 1 -- 172.21.15.6:0/1560837904 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7faa0c0a2c20 msgr2=0x7faa0c0a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:54.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.494+0000 7faa280ad700 1 --2- 172.21.15.6:0/1560837904 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7faa0c0a2c20 0x7faa0c0a5130 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faa14006010 tx=0x7faa14005e80 comp rx=0 tx=0).stop 2024-05-20T17:06:54.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.494+0000 7faa280ad700 1 -- 172.21.15.6:0/1560837904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa20103460 msgr2=0x7faa2019f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:54.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.494+0000 7faa280ad700 1 --2- 172.21.15.6:0/1560837904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa20103460 0x7faa2019f8b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00d950 tx=0x7faa1c00dd10 comp rx=0 tx=0).stop 2024-05-20T17:06:54.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.494+0000 7faa280ad700 1 -- 172.21.15.6:0/1560837904 shutdown_connections 2024-05-20T17:06:54.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.494+0000 7faa280ad700 1 --2- 172.21.15.6:0/1560837904 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7faa0c0a2c20 0x7faa0c0a5130 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:54.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.494+0000 7faa280ad700 1 --2- 172.21.15.6:0/1560837904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa201086e0 0x7faa20199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:54.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.494+0000 7faa280ad700 1 --2- 172.21.15.6:0/1560837904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa20103460 0x7faa2019f8b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:54.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.494+0000 7faa280ad700 1 --2- 172.21.15.6:0/1560837904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa20107d90 0x7faa2019fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:54.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.494+0000 7faa280ad700 1 -- 172.21.15.6:0/1560837904 >> 172.21.15.6:0/1560837904 conn(0x7faa200fed50 msgr2=0x7faa20109640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:54.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.494+0000 7faa280ad700 1 -- 172.21.15.6:0/1560837904 shutdown_connections 2024-05-20T17:06:54.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:54.495+0000 7faa280ad700 1 -- 172.21.15.6:0/1560837904 wait complete. 2024-05-20T17:06:54.497 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:06:55.313 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2024-05-20T17:06:54.115781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661161,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":953,"num_read_kb":603,"num_write":431,"num_write_kb":3085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":855,"ondisk_log_size":855,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388908,"kb_used_data":14720,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124552916,"statfs":{"total":1151940427776,"available":1151542185984,"internally_reserved":0,"allocated":15073280,"data_stored":8232137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":51,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002915"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.591740+0000","last_change":"2024-05-20T17:05:05.110008+0000","last_active":"2024-05-20T17:06:44.591740+0000","last_peered":"2024-05-20T17:06:44.591740+0000","last_clean":"2024-05-20T17:06:44.591740+0000","last_became_active":"2024-05-20T17:05:05.109556+0000","last_became_peered":"2024-05-20T17:05:05.109556+0000","last_unstale":"2024-05-20T17:06:44.591740+0000","last_undegraded":"2024-05-20T17:06:44.591740+0000","last_fullsized":"2024-05-20T17:06:44.591740+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:05:55.733938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"92'4","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.773527+0000","last_change":"2024-05-20T17:05:05.106305+0000","last_active":"2024-05-20T17:06:44.773527+0000","last_peered":"2024-05-20T17:06:44.773527+0000","last_clean":"2024-05-20T17:06:44.773527+0000","last_became_active":"2024-05-20T17:05:05.105520+0000","last_became_peered":"2024-05-20T17:05:05.105520+0000","last_unstale":"2024-05-20T17:06:44.773527+0000","last_undegraded":"2024-05-20T17:06:44.773527+0000","last_fullsized":"2024-05-20T17:06:44.773527+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:28:55.385934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"92'7","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.773404+0000","last_change":"2024-05-20T17:05:05.103165+0000","last_active":"2024-05-20T17:06:44.773404+0000","last_peered":"2024-05-20T17:06:44.773404+0000","last_clean":"2024-05-20T17:06:44.773404+0000","last_became_active":"2024-05-20T17:05:05.102808+0000","last_became_peered":"2024-05-20T17:05:05.102808+0000","last_unstale":"2024-05-20T17:06:44.773404+0000","last_undegraded":"2024-05-20T17:06:44.773404+0000","last_fullsized":"2024-05-20T17:06:44.773404+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:47:14.217973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.724186+0000","last_change":"2024-05-20T17:05:05.108954+0000","last_active":"2024-05-20T17:06:44.724186+0000","last_peered":"2024-05-20T17:06:44.724186+0000","last_clean":"2024-05-20T17:06:44.724186+0000","last_became_active":"2024-05-20T17:05:05.108563+0000","last_became_peered":"2024-05-20T17:05:05.108563+0000","last_unstale":"2024-05-20T17:06:44.724186+0000","last_undegraded":"2024-05-20T17:06:44.724186+0000","last_fullsized":"2024-05-20T17:06:44.724186+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:07:22.929896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.591223+0000","last_change":"2024-05-20T17:05:05.103357+0000","last_active":"2024-05-20T17:06:44.591223+0000","last_peered":"2024-05-20T17:06:44.591223+0000","last_clean":"2024-05-20T17:06:44.591223+0000","last_became_active":"2024-05-20T17:05:05.102990+0000","last_became_peered":"2024-05-20T17:05:05.102990+0000","last_unstale":"2024-05-20T17:06:44.591223+0000","last_undegraded":"2024-05-20T17:06:44.591223+0000","last_fullsized":"2024-05-20T17:06:44.591223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:01.800910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"92'6","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587063+0000","last_change":"2024-05-20T17:05:05.114822+0000","last_active":"2024-05-20T17:06:44.587063+0000","last_peered":"2024-05-20T17:06:44.587063+0000","last_clean":"2024-05-20T17:06:44.587063+0000","last_became_active":"2024-05-20T17:05:05.114402+0000","last_became_peered":"2024-05-20T17:05:05.114402+0000","last_unstale":"2024-05-20T17:06:44.587063+0000","last_undegraded":"2024-05-20T17:06:44.587063+0000","last_fullsized":"2024-05-20T17:06:44.587063+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:03:19.530670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"92'5","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.593574+0000","last_change":"2024-05-20T17:05:05.111478+0000","last_active":"2024-05-20T17:06:44.593574+0000","last_peered":"2024-05-20T17:06:44.593574+0000","last_clean":"2024-05-20T17:06:44.593574+0000","last_became_active":"2024-05-20T17:05:05.111054+0000","last_became_peered":"2024-05-20T17:05:05.111054+0000","last_unstale":"2024-05-20T17:06:44.593574+0000","last_undegraded":"2024-05-20T17:06:44.593574+0000","last_fullsized":"2024-05-20T17:06:44.593574+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:09:52.783885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587266+0000","last_change":"2024-05-20T17:05:05.109706+0000","last_active":"2024-05-20T17:06:44.587266+0000","last_peered":"2024-05-20T17:06:44.587266+0000","last_clean":"2024-05-20T17:06:44.587266+0000","last_became_active":"2024-05-20T17:05:05.109258+0000","last_became_peered":"2024-05-20T17:05:05.109258+0000","last_unstale":"2024-05-20T17:06:44.587266+0000","last_undegraded":"2024-05-20T17:06:44.587266+0000","last_fullsized":"2024-05-20T17:06:44.587266+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:11:48.568541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.633855+0000","last_change":"2024-05-20T17:05:05.097099+0000","last_active":"2024-05-20T17:06:44.633855+0000","last_peered":"2024-05-20T17:06:44.633855+0000","last_clean":"2024-05-20T17:06:44.633855+0000","last_became_active":"2024-05-20T17:05:05.096514+0000","last_became_peered":"2024-05-20T17:05:05.096514+0000","last_unstale":"2024-05-20T17:06:44.633855+0000","last_undegraded":"2024-05-20T17:06:44.633855+0000","last_fullsized":"2024-05-20T17:06:44.633855+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:30:30.472956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"92'16","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587712+0000","last_change":"2024-05-20T17:05:05.114535+0000","last_active":"2024-05-20T17:06:44.587712+0000","last_peered":"2024-05-20T17:06:44.587712+0000","last_clean":"2024-05-20T17:06:44.587712+0000","last_became_active":"2024-05-20T17:05:05.114126+0000","last_became_peered":"2024-05-20T17:05:05.114126+0000","last_unstale":"2024-05-20T17:06:44.587712+0000","last_undegraded":"2024-05-20T17:06:44.587712+0000","last_fullsized":"2024-05-20T17:06:44.587712+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:36:05.541565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"92'6","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594243+0000","last_change":"2024-05-20T17:05:05.115584+0000","last_active":"2024-05-20T17:06:44.594243+0000","last_peered":"2024-05-20T17:06:44.594243+0000","last_clean":"2024-05-20T17:06:44.594243+0000","last_became_active":"2024-05-20T17:05:05.115178+0000","last_became_peered":"2024-05-20T17:05:05.115178+0000","last_unstale":"2024-05-20T17:06:44.594243+0000","last_undegraded":"2024-05-20T17:06:44.594243+0000","last_fullsized":"2024-05-20T17:06:44.594243+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:11:36.593125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.723949+0000","last_change":"2024-05-20T17:05:05.112302+0000","last_active":"2024-05-20T17:06:44.723949+0000","last_peered":"2024-05-20T17:06:44.723949+0000","last_clean":"2024-05-20T17:06:44.723949+0000","last_became_active":"2024-05-20T17:05:05.109423+0000","last_became_peered":"2024-05-20T17:05:05.109423+0000","last_unstale":"2024-05-20T17:06:44.723949+0000","last_undegraded":"2024-05-20T17:06:44.723949+0000","last_fullsized":"2024-05-20T17:06:44.723949+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:43.149894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.589770+0000","last_change":"2024-05-20T17:05:05.094024+0000","last_active":"2024-05-20T17:06:44.589770+0000","last_peered":"2024-05-20T17:06:44.589770+0000","last_clean":"2024-05-20T17:06:44.589770+0000","last_became_active":"2024-05-20T17:05:05.093681+0000","last_became_peered":"2024-05-20T17:05:05.093681+0000","last_unstale":"2024-05-20T17:06:44.589770+0000","last_undegraded":"2024-05-20T17:06:44.589770+0000","last_fullsized":"2024-05-20T17:06:44.589770+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:05:57.768796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"92'7","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.773128+0000","last_change":"2024-05-20T17:05:05.109210+0000","last_active":"2024-05-20T17:06:44.773128+0000","last_peered":"2024-05-20T17:06:44.773128+0000","last_clean":"2024-05-20T17:06:44.773128+0000","last_became_active":"2024-05-20T17:05:05.108819+0000","last_became_peered":"2024-05-20T17:05:05.108819+0000","last_unstale":"2024-05-20T17:06:44.773128+0000","last_undegraded":"2024-05-20T17:06:44.773128+0000","last_fullsized":"2024-05-20T17:06:44.773128+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:47:10.954313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'7","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.773372+0000","last_change":"2024-05-20T17:05:05.107455+0000","last_active":"2024-05-20T17:06:44.773372+0000","last_peered":"2024-05-20T17:06:44.773372+0000","last_clean":"2024-05-20T17:06:44.773372+0000","last_became_active":"2024-05-20T17:05:05.107010+0000","last_became_peered":"2024-05-20T17:05:05.107010+0000","last_unstale":"2024-05-20T17:06:44.773372+0000","last_undegraded":"2024-05-20T17:06:44.773372+0000","last_fullsized":"2024-05-20T17:06:44.773372+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:31:21.445393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.633069+0000","last_change":"2024-05-20T17:05:05.116417+0000","last_active":"2024-05-20T17:06:44.633069+0000","last_peered":"2024-05-20T17:06:44.633069+0000","last_clean":"2024-05-20T17:06:44.633069+0000","last_became_active":"2024-05-20T17:05:05.116018+0000","last_became_peered":"2024-05-20T17:05:05.116018+0000","last_unstale":"2024-05-20T17:06:44.633069+0000","last_undegraded":"2024-05-20T17:06:44.633069+0000","last_fullsized":"2024-05-20T17:06:44.633069+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:16:52.984984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.591333+0000","last_change":"2024-05-20T17:05:05.109029+0000","last_active":"2024-05-20T17:06:44.591333+0000","last_peered":"2024-05-20T17:06:44.591333+0000","last_clean":"2024-05-20T17:06:44.591333+0000","last_became_active":"2024-05-20T17:05:05.108677+0000","last_became_peered":"2024-05-20T17:05:05.108677+0000","last_unstale":"2024-05-20T17:06:44.591333+0000","last_undegraded":"2024-05-20T17:06:44.591333+0000","last_fullsized":"2024-05-20T17:06:44.591333+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:24:36.698549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.719768+0000","last_change":"2024-05-20T17:05:05.104962+0000","last_active":"2024-05-20T17:06:44.719768+0000","last_peered":"2024-05-20T17:06:44.719768+0000","last_clean":"2024-05-20T17:06:44.719768+0000","last_became_active":"2024-05-20T17:05:05.104503+0000","last_became_peered":"2024-05-20T17:05:05.104503+0000","last_unstale":"2024-05-20T17:06:44.719768+0000","last_undegraded":"2024-05-20T17:06:44.719768+0000","last_fullsized":"2024-05-20T17:06:44.719768+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:51.807731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.588744+0000","last_change":"2024-05-20T17:05:05.094714+0000","last_active":"2024-05-20T17:06:44.588744+0000","last_peered":"2024-05-20T17:06:44.588744+0000","last_clean":"2024-05-20T17:06:44.588744+0000","last_became_active":"2024-05-20T17:05:05.094343+0000","last_became_peered":"2024-05-20T17:05:05.094343+0000","last_unstale":"2024-05-20T17:06:44.588744+0000","last_undegraded":"2024-05-20T17:06:44.588744+0000","last_fullsized":"2024-05-20T17:06:44.588744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:17:50.711969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.588207+0000","last_change":"2024-05-20T17:05:09.130195+0000","last_active":"2024-05-20T17:06:44.588207+0000","last_peered":"2024-05-20T17:06:44.588207+0000","last_clean":"2024-05-20T17:06:44.588207+0000","last_became_active":"2024-05-20T17:05:09.129809+0000","last_became_peered":"2024-05-20T17:05:09.129809+0000","last_unstale":"2024-05-20T17:06:44.588207+0000","last_undegraded":"2024-05-20T17:06:44.588207+0000","last_fullsized":"2024-05-20T17:06:44.588207+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:30:23.666443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'13","reported_seq":122,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:50.727926+0000","last_change":"2024-05-20T17:05:04.093762+0000","last_active":"2024-05-20T17:06:50.727926+0000","last_peered":"2024-05-20T17:06:50.727926+0000","last_clean":"2024-05-20T17:06:50.727926+0000","last_became_active":"2024-05-20T17:05:04.093408+0000","last_became_peered":"2024-05-20T17:05:04.093408+0000","last_unstale":"2024-05-20T17:06:50.727926+0000","last_undegraded":"2024-05-20T17:06:50.727926+0000","last_fullsized":"2024-05-20T17:06:50.727926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:38:12.725701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587468+0000","last_change":"2024-05-20T17:05:05.110848+0000","last_active":"2024-05-20T17:06:44.587468+0000","last_peered":"2024-05-20T17:06:44.587468+0000","last_clean":"2024-05-20T17:06:44.587468+0000","last_became_active":"2024-05-20T17:05:05.110467+0000","last_became_peered":"2024-05-20T17:05:05.110467+0000","last_unstale":"2024-05-20T17:06:44.587468+0000","last_undegraded":"2024-05-20T17:06:44.587468+0000","last_fullsized":"2024-05-20T17:06:44.587468+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:09:11.436295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.723591+0000","last_change":"2024-05-20T17:05:09.138726+0000","last_active":"2024-05-20T17:06:44.723591+0000","last_peered":"2024-05-20T17:06:44.723591+0000","last_clean":"2024-05-20T17:06:44.723591+0000","last_became_active":"2024-05-20T17:05:09.138012+0000","last_became_peered":"2024-05-20T17:05:09.138012+0000","last_unstale":"2024-05-20T17:06:44.723591+0000","last_undegraded":"2024-05-20T17:06:44.723591+0000","last_fullsized":"2024-05-20T17:06:44.723591+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:42:40.892912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587651+0000","last_change":"2024-05-20T17:05:04.101591+0000","last_active":"2024-05-20T17:06:44.587651+0000","last_peered":"2024-05-20T17:06:44.587651+0000","last_clean":"2024-05-20T17:06:44.587651+0000","last_became_active":"2024-05-20T17:05:04.101258+0000","last_became_peered":"2024-05-20T17:05:04.101258+0000","last_unstale":"2024-05-20T17:06:44.587651+0000","last_undegraded":"2024-05-20T17:06:44.587651+0000","last_fullsized":"2024-05-20T17:06:44.587651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:13:35.443657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"92'6","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.773392+0000","last_change":"2024-05-20T17:05:05.114726+0000","last_active":"2024-05-20T17:06:44.773392+0000","last_peered":"2024-05-20T17:06:44.773392+0000","last_clean":"2024-05-20T17:06:44.773392+0000","last_became_active":"2024-05-20T17:05:05.114371+0000","last_became_peered":"2024-05-20T17:05:05.114371+0000","last_unstale":"2024-05-20T17:06:44.773392+0000","last_undegraded":"2024-05-20T17:06:44.773392+0000","last_fullsized":"2024-05-20T17:06:44.773392+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:50:37.982368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.723744+0000","last_change":"2024-05-20T17:05:43.630866+0000","last_active":"2024-05-20T17:06:44.723744+0000","last_peered":"2024-05-20T17:06:44.723744+0000","last_clean":"2024-05-20T17:06:44.723744+0000","last_became_active":"2024-05-20T17:05:43.630335+0000","last_became_peered":"2024-05-20T17:05:43.630335+0000","last_unstale":"2024-05-20T17:06:44.723744+0000","last_undegraded":"2024-05-20T17:06:44.723744+0000","last_fullsized":"2024-05-20T17:06:44.723744+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:59:01.805026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":44,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.592015+0000","last_change":"2024-05-20T17:05:04.094198+0000","last_active":"2024-05-20T17:06:44.592015+0000","last_peered":"2024-05-20T17:06:44.592015+0000","last_clean":"2024-05-20T17:06:44.592015+0000","last_became_active":"2024-05-20T17:05:04.092910+0000","last_became_peered":"2024-05-20T17:05:04.092910+0000","last_unstale":"2024-05-20T17:06:44.592015+0000","last_undegraded":"2024-05-20T17:06:44.592015+0000","last_fullsized":"2024-05-20T17:06:44.592015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:48:59.565790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.633349+0000","last_change":"2024-05-20T17:05:05.094554+0000","last_active":"2024-05-20T17:06:44.633349+0000","last_peered":"2024-05-20T17:06:44.633349+0000","last_clean":"2024-05-20T17:06:44.633349+0000","last_became_active":"2024-05-20T17:05:05.092846+0000","last_became_peered":"2024-05-20T17:05:05.092846+0000","last_unstale":"2024-05-20T17:06:44.633349+0000","last_undegraded":"2024-05-20T17:06:44.633349+0000","last_fullsized":"2024-05-20T17:06:44.633349+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:32:00.607173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.723501+0000","last_change":"2024-05-20T17:05:09.129918+0000","last_active":"2024-05-20T17:06:44.723501+0000","last_peered":"2024-05-20T17:06:44.723501+0000","last_clean":"2024-05-20T17:06:44.723501+0000","last_became_active":"2024-05-20T17:05:09.129497+0000","last_became_peered":"2024-05-20T17:05:09.129497+0000","last_unstale":"2024-05-20T17:06:44.723501+0000","last_undegraded":"2024-05-20T17:06:44.723501+0000","last_fullsized":"2024-05-20T17:06:44.723501+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:45:16.189840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.592249+0000","last_change":"2024-05-20T17:05:04.104740+0000","last_active":"2024-05-20T17:06:44.592249+0000","last_peered":"2024-05-20T17:06:44.592249+0000","last_clean":"2024-05-20T17:06:44.592249+0000","last_became_active":"2024-05-20T17:05:04.103297+0000","last_became_peered":"2024-05-20T17:05:04.103297+0000","last_unstale":"2024-05-20T17:06:44.592249+0000","last_undegraded":"2024-05-20T17:06:44.592249+0000","last_fullsized":"2024-05-20T17:06:44.592249+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:48:08.543394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":44,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594899+0000","last_change":"2024-05-20T17:05:05.108681+0000","last_active":"2024-05-20T17:06:44.594899+0000","last_peered":"2024-05-20T17:06:44.594899+0000","last_clean":"2024-05-20T17:06:44.594899+0000","last_became_active":"2024-05-20T17:05:05.108275+0000","last_became_peered":"2024-05-20T17:05:05.108275+0000","last_unstale":"2024-05-20T17:06:44.594899+0000","last_undegraded":"2024-05-20T17:06:44.594899+0000","last_fullsized":"2024-05-20T17:06:44.594899+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:15:26.540948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.588403+0000","last_change":"2024-05-20T17:05:09.125991+0000","last_active":"2024-05-20T17:06:44.588403+0000","last_peered":"2024-05-20T17:06:44.588403+0000","last_clean":"2024-05-20T17:06:44.588403+0000","last_became_active":"2024-05-20T17:05:09.125493+0000","last_became_peered":"2024-05-20T17:05:09.125493+0000","last_unstale":"2024-05-20T17:06:44.588403+0000","last_undegraded":"2024-05-20T17:06:44.588403+0000","last_fullsized":"2024-05-20T17:06:44.588403+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:09:19.603595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"92'7","reported_seq":121,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:49.688122+0000","last_change":"2024-05-20T17:05:04.100387+0000","last_active":"2024-05-20T17:06:49.688122+0000","last_peered":"2024-05-20T17:06:49.688122+0000","last_clean":"2024-05-20T17:06:49.688122+0000","last_became_active":"2024-05-20T17:05:04.099834+0000","last_became_peered":"2024-05-20T17:05:04.099834+0000","last_unstale":"2024-05-20T17:06:49.688122+0000","last_undegraded":"2024-05-20T17:06:49.688122+0000","last_fullsized":"2024-05-20T17:06:49.688122+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:10:18.696925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":83,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590567+0000","last_change":"2024-05-20T17:05:05.094015+0000","last_active":"2024-05-20T17:06:44.590567+0000","last_peered":"2024-05-20T17:06:44.590567+0000","last_clean":"2024-05-20T17:06:44.590567+0000","last_became_active":"2024-05-20T17:05:05.093650+0000","last_became_peered":"2024-05-20T17:05:05.093650+0000","last_unstale":"2024-05-20T17:06:44.590567+0000","last_undegraded":"2024-05-20T17:06:44.590567+0000","last_fullsized":"2024-05-20T17:06:44.590567+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:39:46.944348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.588560+0000","last_change":"2024-05-20T17:05:09.122824+0000","last_active":"2024-05-20T17:06:44.588560+0000","last_peered":"2024-05-20T17:06:44.588560+0000","last_clean":"2024-05-20T17:06:44.588560+0000","last_became_active":"2024-05-20T17:05:09.122047+0000","last_became_peered":"2024-05-20T17:05:09.122047+0000","last_unstale":"2024-05-20T17:06:44.588560+0000","last_undegraded":"2024-05-20T17:06:44.588560+0000","last_fullsized":"2024-05-20T17:06:44.588560+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:55:49.843543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":52,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.640701+0000","last_change":"2024-05-20T17:06:44.640701+0000","last_active":"2024-05-20T17:06:44.640701+0000","last_peered":"2024-05-20T17:06:44.640701+0000","last_clean":"2024-05-20T17:06:44.640701+0000","last_became_active":"2024-05-20T17:06:44.634542+0000","last_became_peered":"2024-05-20T17:06:44.634542+0000","last_unstale":"2024-05-20T17:06:44.640701+0000","last_undegraded":"2024-05-20T17:06:44.640701+0000","last_fullsized":"2024-05-20T17:06:44.640701+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:39:58.700196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":23,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.719121+0000","last_change":"2024-05-20T17:05:43.627917+0000","last_active":"2024-05-20T17:06:44.719121+0000","last_peered":"2024-05-20T17:06:44.719121+0000","last_clean":"2024-05-20T17:06:44.719121+0000","last_became_active":"2024-05-20T17:05:43.627522+0000","last_became_peered":"2024-05-20T17:05:43.627522+0000","last_unstale":"2024-05-20T17:06:44.719121+0000","last_undegraded":"2024-05-20T17:06:44.719121+0000","last_fullsized":"2024-05-20T17:06:44.719121+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:13.634781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.591239+0000","last_change":"2024-05-20T17:05:43.948544+0000","last_active":"2024-05-20T17:06:44.591239+0000","last_peered":"2024-05-20T17:06:44.591239+0000","last_clean":"2024-05-20T17:06:44.591239+0000","last_became_active":"2024-05-20T17:05:43.948156+0000","last_became_peered":"2024-05-20T17:05:43.948156+0000","last_unstale":"2024-05-20T17:06:44.591239+0000","last_undegraded":"2024-05-20T17:06:44.591239+0000","last_fullsized":"2024-05-20T17:06:44.591239+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:23:03.437012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,10,0],"acting":[11,4,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.589565+0000","last_change":"2024-05-20T17:05:04.088139+0000","last_active":"2024-05-20T17:06:44.589565+0000","last_peered":"2024-05-20T17:06:44.589565+0000","last_clean":"2024-05-20T17:06:44.589565+0000","last_became_active":"2024-05-20T17:05:04.087746+0000","last_became_peered":"2024-05-20T17:05:04.087746+0000","last_unstale":"2024-05-20T17:06:44.589565+0000","last_undegraded":"2024-05-20T17:06:44.589565+0000","last_fullsized":"2024-05-20T17:06:44.589565+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:27:43.440887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587128+0000","last_change":"2024-05-20T17:05:05.099478+0000","last_active":"2024-05-20T17:06:44.587128+0000","last_peered":"2024-05-20T17:06:44.587128+0000","last_clean":"2024-05-20T17:06:44.587128+0000","last_became_active":"2024-05-20T17:05:05.099058+0000","last_became_peered":"2024-05-20T17:05:05.099058+0000","last_unstale":"2024-05-20T17:06:44.587128+0000","last_undegraded":"2024-05-20T17:06:44.587128+0000","last_fullsized":"2024-05-20T17:06:44.587128+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:41:51.133985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.773396+0000","last_change":"2024-05-20T17:05:09.132210+0000","last_active":"2024-05-20T17:06:44.773396+0000","last_peered":"2024-05-20T17:06:44.773396+0000","last_clean":"2024-05-20T17:06:44.773396+0000","last_became_active":"2024-05-20T17:05:09.131782+0000","last_became_peered":"2024-05-20T17:05:09.131782+0000","last_unstale":"2024-05-20T17:06:44.773396+0000","last_undegraded":"2024-05-20T17:06:44.773396+0000","last_fullsized":"2024-05-20T17:06:44.773396+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:39:13.111988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594081+0000","last_change":"2024-05-20T17:05:04.100091+0000","last_active":"2024-05-20T17:06:44.594081+0000","last_peered":"2024-05-20T17:06:44.594081+0000","last_clean":"2024-05-20T17:06:44.594081+0000","last_became_active":"2024-05-20T17:05:04.099741+0000","last_became_peered":"2024-05-20T17:05:04.099741+0000","last_unstale":"2024-05-20T17:06:44.594081+0000","last_undegraded":"2024-05-20T17:06:44.594081+0000","last_fullsized":"2024-05-20T17:06:44.594081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:58:51.078656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.719066+0000","last_change":"2024-05-20T17:05:05.101320+0000","last_active":"2024-05-20T17:06:44.719066+0000","last_peered":"2024-05-20T17:06:44.719066+0000","last_clean":"2024-05-20T17:06:44.719066+0000","last_became_active":"2024-05-20T17:05:05.100957+0000","last_became_peered":"2024-05-20T17:05:05.100957+0000","last_unstale":"2024-05-20T17:06:44.719066+0000","last_undegraded":"2024-05-20T17:06:44.719066+0000","last_fullsized":"2024-05-20T17:06:44.719066+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:19.765284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587203+0000","last_change":"2024-05-20T17:05:09.131013+0000","last_active":"2024-05-20T17:06:44.587203+0000","last_peered":"2024-05-20T17:06:44.587203+0000","last_clean":"2024-05-20T17:06:44.587203+0000","last_became_active":"2024-05-20T17:05:09.130459+0000","last_became_peered":"2024-05-20T17:05:09.130459+0000","last_unstale":"2024-05-20T17:06:44.587203+0000","last_undegraded":"2024-05-20T17:06:44.587203+0000","last_fullsized":"2024-05-20T17:06:44.587203+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:46.158164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"92'5","reported_seq":195,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:52.692237+0000","last_change":"2024-05-20T17:05:04.094572+0000","last_active":"2024-05-20T17:06:52.692237+0000","last_peered":"2024-05-20T17:06:52.692237+0000","last_clean":"2024-05-20T17:06:52.692237+0000","last_became_active":"2024-05-20T17:05:04.094170+0000","last_became_peered":"2024-05-20T17:05:04.094170+0000","last_unstale":"2024-05-20T17:06:52.692237+0000","last_undegraded":"2024-05-20T17:06:52.692237+0000","last_fullsized":"2024-05-20T17:06:52.692237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:31:00.700434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":159,"num_read_kb":159,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.633902+0000","last_change":"2024-05-20T17:05:05.108241+0000","last_active":"2024-05-20T17:06:44.633902+0000","last_peered":"2024-05-20T17:06:44.633902+0000","last_clean":"2024-05-20T17:06:44.633902+0000","last_became_active":"2024-05-20T17:05:05.107515+0000","last_became_peered":"2024-05-20T17:05:05.107515+0000","last_unstale":"2024-05-20T17:06:44.633902+0000","last_undegraded":"2024-05-20T17:06:44.633902+0000","last_fullsized":"2024-05-20T17:06:44.633902+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:41:44.735821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.718991+0000","last_change":"2024-05-20T17:05:09.133897+0000","last_active":"2024-05-20T17:06:44.718991+0000","last_peered":"2024-05-20T17:06:44.718991+0000","last_clean":"2024-05-20T17:06:44.718991+0000","last_became_active":"2024-05-20T17:05:09.128953+0000","last_became_peered":"2024-05-20T17:05:09.128953+0000","last_unstale":"2024-05-20T17:06:44.718991+0000","last_undegraded":"2024-05-20T17:06:44.718991+0000","last_fullsized":"2024-05-20T17:06:44.718991+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:48:01.515930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594230+0000","last_change":"2024-05-20T17:05:04.099314+0000","last_active":"2024-05-20T17:06:44.594230+0000","last_peered":"2024-05-20T17:06:44.594230+0000","last_clean":"2024-05-20T17:06:44.594230+0000","last_became_active":"2024-05-20T17:05:04.098912+0000","last_became_peered":"2024-05-20T17:05:04.098912+0000","last_unstale":"2024-05-20T17:06:44.594230+0000","last_undegraded":"2024-05-20T17:06:44.594230+0000","last_fullsized":"2024-05-20T17:06:44.594230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:42:57.797943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.773516+0000","last_change":"2024-05-20T17:05:05.117909+0000","last_active":"2024-05-20T17:06:44.773516+0000","last_peered":"2024-05-20T17:06:44.773516+0000","last_clean":"2024-05-20T17:06:44.773516+0000","last_became_active":"2024-05-20T17:05:05.117031+0000","last_became_peered":"2024-05-20T17:05:05.117031+0000","last_unstale":"2024-05-20T17:06:44.773516+0000","last_undegraded":"2024-05-20T17:06:44.773516+0000","last_fullsized":"2024-05-20T17:06:44.773516+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:09:29.211373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.724048+0000","last_change":"2024-05-20T17:05:43.850870+0000","last_active":"2024-05-20T17:06:44.724048+0000","last_peered":"2024-05-20T17:06:44.724048+0000","last_clean":"2024-05-20T17:06:44.724048+0000","last_became_active":"2024-05-20T17:05:43.850309+0000","last_became_peered":"2024-05-20T17:05:43.850309+0000","last_unstale":"2024-05-20T17:06:44.724048+0000","last_undegraded":"2024-05-20T17:06:44.724048+0000","last_fullsized":"2024-05-20T17:06:44.724048+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:23:32.213388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594764+0000","last_change":"2024-05-20T17:05:04.101362+0000","last_active":"2024-05-20T17:06:44.594764+0000","last_peered":"2024-05-20T17:06:44.594764+0000","last_clean":"2024-05-20T17:06:44.594764+0000","last_became_active":"2024-05-20T17:05:04.100972+0000","last_became_peered":"2024-05-20T17:05:04.100972+0000","last_unstale":"2024-05-20T17:06:44.594764+0000","last_undegraded":"2024-05-20T17:06:44.594764+0000","last_fullsized":"2024-05-20T17:06:44.594764+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:43:57.245788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.633665+0000","last_change":"2024-05-20T17:05:05.105432+0000","last_active":"2024-05-20T17:06:44.633665+0000","last_peered":"2024-05-20T17:06:44.633665+0000","last_clean":"2024-05-20T17:06:44.633665+0000","last_became_active":"2024-05-20T17:05:05.100514+0000","last_became_peered":"2024-05-20T17:05:05.100514+0000","last_unstale":"2024-05-20T17:06:44.633665+0000","last_undegraded":"2024-05-20T17:06:44.633665+0000","last_fullsized":"2024-05-20T17:06:44.633665+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:39:41.164482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.719085+0000","last_change":"2024-05-20T17:05:09.124544+0000","last_active":"2024-05-20T17:06:44.719085+0000","last_peered":"2024-05-20T17:06:44.719085+0000","last_clean":"2024-05-20T17:06:44.719085+0000","last_became_active":"2024-05-20T17:05:09.123525+0000","last_became_peered":"2024-05-20T17:05:09.123525+0000","last_unstale":"2024-05-20T17:06:44.719085+0000","last_undegraded":"2024-05-20T17:06:44.719085+0000","last_fullsized":"2024-05-20T17:06:44.719085+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:10:26.250112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"92'38","reported_seq":240,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:52.692085+0000","last_change":"2024-05-20T17:05:04.097234+0000","last_active":"2024-05-20T17:06:52.692085+0000","last_peered":"2024-05-20T17:06:52.692085+0000","last_clean":"2024-05-20T17:06:52.692085+0000","last_became_active":"2024-05-20T17:05:04.096532+0000","last_became_peered":"2024-05-20T17:05:04.096532+0000","last_unstale":"2024-05-20T17:06:52.692085+0000","last_undegraded":"2024-05-20T17:06:52.692085+0000","last_fullsized":"2024-05-20T17:06:52.692085+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:07:12.407496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63605,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":171,"num_read_kb":148,"num_write":40,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.591636+0000","last_change":"2024-05-20T17:05:05.113881+0000","last_active":"2024-05-20T17:06:44.591636+0000","last_peered":"2024-05-20T17:06:44.591636+0000","last_clean":"2024-05-20T17:06:44.591636+0000","last_became_active":"2024-05-20T17:05:05.113523+0000","last_became_peered":"2024-05-20T17:05:05.113523+0000","last_unstale":"2024-05-20T17:06:44.591636+0000","last_undegraded":"2024-05-20T17:06:44.591636+0000","last_fullsized":"2024-05-20T17:06:44.591636+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:50:44.206742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.595255+0000","last_change":"2024-05-20T17:05:09.133344+0000","last_active":"2024-05-20T17:06:44.595255+0000","last_peered":"2024-05-20T17:06:44.595255+0000","last_clean":"2024-05-20T17:06:44.595255+0000","last_became_active":"2024-05-20T17:05:09.132914+0000","last_became_peered":"2024-05-20T17:05:09.132914+0000","last_unstale":"2024-05-20T17:06:44.595255+0000","last_undegraded":"2024-05-20T17:06:44.595255+0000","last_fullsized":"2024-05-20T17:06:44.595255+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:56:17.279757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.588343+0000","last_change":"2024-05-20T17:05:04.099029+0000","last_active":"2024-05-20T17:06:44.588343+0000","last_peered":"2024-05-20T17:06:44.588343+0000","last_clean":"2024-05-20T17:06:44.588343+0000","last_became_active":"2024-05-20T17:05:04.098553+0000","last_became_peered":"2024-05-20T17:05:04.098553+0000","last_unstale":"2024-05-20T17:06:44.588343+0000","last_undegraded":"2024-05-20T17:06:44.588343+0000","last_fullsized":"2024-05-20T17:06:44.588343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:12.793008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.589885+0000","last_change":"2024-05-20T17:05:05.107734+0000","last_active":"2024-05-20T17:06:44.589885+0000","last_peered":"2024-05-20T17:06:44.589885+0000","last_clean":"2024-05-20T17:06:44.589885+0000","last_became_active":"2024-05-20T17:05:05.107388+0000","last_became_peered":"2024-05-20T17:05:05.107388+0000","last_unstale":"2024-05-20T17:06:44.589885+0000","last_undegraded":"2024-05-20T17:06:44.589885+0000","last_fullsized":"2024-05-20T17:06:44.589885+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:51.147757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590859+0000","last_change":"2024-05-20T17:05:09.137618+0000","last_active":"2024-05-20T17:06:44.590859+0000","last_peered":"2024-05-20T17:06:44.590859+0000","last_clean":"2024-05-20T17:06:44.590859+0000","last_became_active":"2024-05-20T17:05:09.137172+0000","last_became_peered":"2024-05-20T17:05:09.137172+0000","last_unstale":"2024-05-20T17:06:44.590859+0000","last_undegraded":"2024-05-20T17:06:44.590859+0000","last_fullsized":"2024-05-20T17:06:44.590859+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:17:45.218886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594646+0000","last_change":"2024-05-20T17:05:04.095628+0000","last_active":"2024-05-20T17:06:44.594646+0000","last_peered":"2024-05-20T17:06:44.594646+0000","last_clean":"2024-05-20T17:06:44.594646+0000","last_became_active":"2024-05-20T17:05:04.095187+0000","last_became_peered":"2024-05-20T17:05:04.095187+0000","last_unstale":"2024-05-20T17:06:44.594646+0000","last_undegraded":"2024-05-20T17:06:44.594646+0000","last_fullsized":"2024-05-20T17:06:44.594646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:03:33.601967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"92'15","reported_seq":44,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594068+0000","last_change":"2024-05-20T17:05:05.108321+0000","last_active":"2024-05-20T17:06:44.594068+0000","last_peered":"2024-05-20T17:06:44.594068+0000","last_clean":"2024-05-20T17:06:44.594068+0000","last_became_active":"2024-05-20T17:05:05.107943+0000","last_became_peered":"2024-05-20T17:05:05.107943+0000","last_unstale":"2024-05-20T17:06:44.594068+0000","last_undegraded":"2024-05-20T17:06:44.594068+0000","last_fullsized":"2024-05-20T17:06:44.594068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:12:44.324799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.719362+0000","last_change":"2024-05-20T17:05:09.135210+0000","last_active":"2024-05-20T17:06:44.719362+0000","last_peered":"2024-05-20T17:06:44.719362+0000","last_clean":"2024-05-20T17:06:44.719362+0000","last_became_active":"2024-05-20T17:05:09.134226+0000","last_became_peered":"2024-05-20T17:05:09.134226+0000","last_unstale":"2024-05-20T17:06:44.719362+0000","last_undegraded":"2024-05-20T17:06:44.719362+0000","last_fullsized":"2024-05-20T17:06:44.719362+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:36:22.833036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":114,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:49.733471+0000","last_change":"2024-05-20T17:05:04.089661+0000","last_active":"2024-05-20T17:06:49.733471+0000","last_peered":"2024-05-20T17:06:49.733471+0000","last_clean":"2024-05-20T17:06:49.733471+0000","last_became_active":"2024-05-20T17:05:04.088939+0000","last_became_peered":"2024-05-20T17:05:04.088939+0000","last_unstale":"2024-05-20T17:06:49.733471+0000","last_undegraded":"2024-05-20T17:06:49.733471+0000","last_fullsized":"2024-05-20T17:06:49.733471+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:48:15.962887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"92'6","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.593766+0000","last_change":"2024-05-20T17:05:05.113827+0000","last_active":"2024-05-20T17:06:44.593766+0000","last_peered":"2024-05-20T17:06:44.593766+0000","last_clean":"2024-05-20T17:06:44.593766+0000","last_became_active":"2024-05-20T17:05:05.111547+0000","last_became_peered":"2024-05-20T17:05:05.111547+0000","last_unstale":"2024-05-20T17:06:44.593766+0000","last_undegraded":"2024-05-20T17:06:44.593766+0000","last_fullsized":"2024-05-20T17:06:44.593766+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:29:13.826983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590048+0000","last_change":"2024-05-20T17:05:09.138814+0000","last_active":"2024-05-20T17:06:44.590048+0000","last_peered":"2024-05-20T17:06:44.590048+0000","last_clean":"2024-05-20T17:06:44.590048+0000","last_became_active":"2024-05-20T17:05:09.138119+0000","last_became_peered":"2024-05-20T17:05:09.138119+0000","last_unstale":"2024-05-20T17:06:44.590048+0000","last_undegraded":"2024-05-20T17:06:44.590048+0000","last_fullsized":"2024-05-20T17:06:44.590048+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:23.323841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":49,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.589886+0000","last_change":"2024-05-20T17:05:04.102468+0000","last_active":"2024-05-20T17:06:44.589886+0000","last_peered":"2024-05-20T17:06:44.589886+0000","last_clean":"2024-05-20T17:06:44.589886+0000","last_became_active":"2024-05-20T17:05:04.102073+0000","last_became_peered":"2024-05-20T17:05:04.102073+0000","last_unstale":"2024-05-20T17:06:44.589886+0000","last_undegraded":"2024-05-20T17:06:44.589886+0000","last_fullsized":"2024-05-20T17:06:44.589886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:42:46.929625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":41,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.593911+0000","last_change":"2024-05-20T17:05:43.850307+0000","last_active":"2024-05-20T17:06:44.593911+0000","last_peered":"2024-05-20T17:06:44.593911+0000","last_clean":"2024-05-20T17:06:44.593911+0000","last_became_active":"2024-05-20T17:05:43.849854+0000","last_became_peered":"2024-05-20T17:05:43.849854+0000","last_unstale":"2024-05-20T17:06:44.593911+0000","last_undegraded":"2024-05-20T17:06:44.593911+0000","last_fullsized":"2024-05-20T17:06:44.593911+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:55:46.179353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.593921+0000","last_change":"2024-05-20T17:05:09.134534+0000","last_active":"2024-05-20T17:06:44.593921+0000","last_peered":"2024-05-20T17:06:44.593921+0000","last_clean":"2024-05-20T17:06:44.593921+0000","last_became_active":"2024-05-20T17:05:09.134097+0000","last_became_peered":"2024-05-20T17:05:09.134097+0000","last_unstale":"2024-05-20T17:06:44.593921+0000","last_undegraded":"2024-05-20T17:06:44.593921+0000","last_fullsized":"2024-05-20T17:06:44.593921+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:43.782343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590466+0000","last_change":"2024-05-20T17:05:04.104314+0000","last_active":"2024-05-20T17:06:44.590466+0000","last_peered":"2024-05-20T17:06:44.590466+0000","last_clean":"2024-05-20T17:06:44.590466+0000","last_became_active":"2024-05-20T17:05:04.103338+0000","last_became_peered":"2024-05-20T17:05:04.103338+0000","last_unstale":"2024-05-20T17:06:44.590466+0000","last_undegraded":"2024-05-20T17:06:44.590466+0000","last_fullsized":"2024-05-20T17:06:44.590466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:32:06.721674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590990+0000","last_change":"2024-05-20T17:05:05.107566+0000","last_active":"2024-05-20T17:06:44.590990+0000","last_peered":"2024-05-20T17:06:44.590990+0000","last_clean":"2024-05-20T17:06:44.590990+0000","last_became_active":"2024-05-20T17:05:05.107190+0000","last_became_peered":"2024-05-20T17:05:05.107190+0000","last_unstale":"2024-05-20T17:06:44.590990+0000","last_undegraded":"2024-05-20T17:06:44.590990+0000","last_fullsized":"2024-05-20T17:06:44.590990+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:55:15.312700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590416+0000","last_change":"2024-05-20T17:05:09.369886+0000","last_active":"2024-05-20T17:06:44.590416+0000","last_peered":"2024-05-20T17:06:44.590416+0000","last_clean":"2024-05-20T17:06:44.590416+0000","last_became_active":"2024-05-20T17:05:09.369254+0000","last_became_peered":"2024-05-20T17:05:09.369254+0000","last_unstale":"2024-05-20T17:06:44.590416+0000","last_undegraded":"2024-05-20T17:06:44.590416+0000","last_fullsized":"2024-05-20T17:06:44.590416+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:54:54.784952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.719446+0000","last_change":"2024-05-20T17:05:04.100182+0000","last_active":"2024-05-20T17:06:44.719446+0000","last_peered":"2024-05-20T17:06:44.719446+0000","last_clean":"2024-05-20T17:06:44.719446+0000","last_became_active":"2024-05-20T17:05:04.099801+0000","last_became_peered":"2024-05-20T17:05:04.099801+0000","last_unstale":"2024-05-20T17:06:44.719446+0000","last_undegraded":"2024-05-20T17:06:44.719446+0000","last_fullsized":"2024-05-20T17:06:44.719446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:34.666869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'4","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587553+0000","last_change":"2024-05-20T17:05:05.111514+0000","last_active":"2024-05-20T17:06:44.587553+0000","last_peered":"2024-05-20T17:06:44.587553+0000","last_clean":"2024-05-20T17:06:44.587553+0000","last_became_active":"2024-05-20T17:05:05.111137+0000","last_became_peered":"2024-05-20T17:05:05.111137+0000","last_unstale":"2024-05-20T17:06:44.587553+0000","last_undegraded":"2024-05-20T17:06:44.587553+0000","last_fullsized":"2024-05-20T17:06:44.587553+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:19:44.677701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.589744+0000","last_change":"2024-05-20T17:05:09.133601+0000","last_active":"2024-05-20T17:06:44.589744+0000","last_peered":"2024-05-20T17:06:44.589744+0000","last_clean":"2024-05-20T17:06:44.589744+0000","last_became_active":"2024-05-20T17:05:09.132297+0000","last_became_peered":"2024-05-20T17:05:09.132297+0000","last_unstale":"2024-05-20T17:06:44.589744+0000","last_undegraded":"2024-05-20T17:06:44.589744+0000","last_fullsized":"2024-05-20T17:06:44.589744+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:06.896380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'5","reported_seq":116,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:52.731478+0000","last_change":"2024-05-20T17:05:04.099522+0000","last_active":"2024-05-20T17:06:52.731478+0000","last_peered":"2024-05-20T17:06:52.731478+0000","last_clean":"2024-05-20T17:06:52.731478+0000","last_became_active":"2024-05-20T17:05:04.098933+0000","last_became_peered":"2024-05-20T17:05:04.098933+0000","last_unstale":"2024-05-20T17:06:52.731478+0000","last_undegraded":"2024-05-20T17:06:52.731478+0000","last_fullsized":"2024-05-20T17:06:52.731478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:14.996617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"92'7","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587266+0000","last_change":"2024-05-20T17:05:05.116526+0000","last_active":"2024-05-20T17:06:44.587266+0000","last_peered":"2024-05-20T17:06:44.587266+0000","last_clean":"2024-05-20T17:06:44.587266+0000","last_became_active":"2024-05-20T17:05:05.116108+0000","last_became_peered":"2024-05-20T17:05:05.116108+0000","last_unstale":"2024-05-20T17:06:44.587266+0000","last_undegraded":"2024-05-20T17:06:44.587266+0000","last_fullsized":"2024-05-20T17:06:44.587266+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:20:03.481555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590089+0000","last_change":"2024-05-20T17:05:09.369912+0000","last_active":"2024-05-20T17:06:44.590089+0000","last_peered":"2024-05-20T17:06:44.590089+0000","last_clean":"2024-05-20T17:06:44.590089+0000","last_became_active":"2024-05-20T17:05:09.369456+0000","last_became_peered":"2024-05-20T17:05:09.369456+0000","last_unstale":"2024-05-20T17:06:44.590089+0000","last_undegraded":"2024-05-20T17:06:44.590089+0000","last_fullsized":"2024-05-20T17:06:44.590089+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:09:11.675548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594238+0000","last_change":"2024-05-20T17:05:05.093045+0000","last_active":"2024-05-20T17:06:44.594238+0000","last_peered":"2024-05-20T17:06:44.594238+0000","last_clean":"2024-05-20T17:06:44.594238+0000","last_became_active":"2024-05-20T17:05:05.092477+0000","last_became_peered":"2024-05-20T17:05:05.092477+0000","last_unstale":"2024-05-20T17:06:44.594238+0000","last_undegraded":"2024-05-20T17:06:44.594238+0000","last_fullsized":"2024-05-20T17:06:44.594238+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:08:43.038885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":115,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:51.736211+0000","last_change":"2024-05-20T17:05:04.100893+0000","last_active":"2024-05-20T17:06:51.736211+0000","last_peered":"2024-05-20T17:06:51.736211+0000","last_clean":"2024-05-20T17:06:51.736211+0000","last_became_active":"2024-05-20T17:05:04.100519+0000","last_became_peered":"2024-05-20T17:05:04.100519+0000","last_unstale":"2024-05-20T17:06:51.736211+0000","last_undegraded":"2024-05-20T17:06:51.736211+0000","last_fullsized":"2024-05-20T17:06:51.736211+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:10:13.764472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":79,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":23,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594008+0000","last_change":"2024-05-20T17:05:09.123689+0000","last_active":"2024-05-20T17:06:44.594008+0000","last_peered":"2024-05-20T17:06:44.594008+0000","last_clean":"2024-05-20T17:06:44.594008+0000","last_became_active":"2024-05-20T17:05:09.123124+0000","last_became_peered":"2024-05-20T17:05:09.123124+0000","last_unstale":"2024-05-20T17:06:44.594008+0000","last_undegraded":"2024-05-20T17:06:44.594008+0000","last_fullsized":"2024-05-20T17:06:44.594008+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:22:45.865765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":23,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.719235+0000","last_change":"2024-05-20T17:05:43.850832+0000","last_active":"2024-05-20T17:06:44.719235+0000","last_peered":"2024-05-20T17:06:44.719235+0000","last_clean":"2024-05-20T17:06:44.719235+0000","last_became_active":"2024-05-20T17:05:43.850352+0000","last_became_peered":"2024-05-20T17:05:43.850352+0000","last_unstale":"2024-05-20T17:06:44.719235+0000","last_undegraded":"2024-05-20T17:06:44.719235+0000","last_fullsized":"2024-05-20T17:06:44.719235+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:48:03.124871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.723886+0000","last_change":"2024-05-20T17:05:04.089427+0000","last_active":"2024-05-20T17:06:44.723886+0000","last_peered":"2024-05-20T17:06:44.723886+0000","last_clean":"2024-05-20T17:06:44.723886+0000","last_became_active":"2024-05-20T17:05:04.088880+0000","last_became_peered":"2024-05-20T17:05:04.088880+0000","last_unstale":"2024-05-20T17:06:44.723886+0000","last_undegraded":"2024-05-20T17:06:44.723886+0000","last_fullsized":"2024-05-20T17:06:44.723886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:16.068072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":353,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.593642+0000","last_change":"2024-05-20T17:03:47.606627+0000","last_active":"2024-05-20T17:06:44.593642+0000","last_peered":"2024-05-20T17:06:44.593642+0000","last_clean":"2024-05-20T17:06:44.593642+0000","last_became_active":"2024-05-20T17:03:47.606105+0000","last_became_peered":"2024-05-20T17:03:47.606105+0000","last_unstale":"2024-05-20T17:06:44.593642+0000","last_undegraded":"2024-05-20T17:06:44.593642+0000","last_fullsized":"2024-05-20T17:06:44.593642+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:00:12.876377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:00:12.876377+0000","last_clean_scrub_stamp":"2024-05-20T17:00:12.876377+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:26:46.526462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590202+0000","last_change":"2024-05-20T17:05:43.764889+0000","last_active":"2024-05-20T17:06:44.590202+0000","last_peered":"2024-05-20T17:06:44.590202+0000","last_clean":"2024-05-20T17:06:44.590202+0000","last_became_active":"2024-05-20T17:05:43.764351+0000","last_became_peered":"2024-05-20T17:05:43.764351+0000","last_unstale":"2024-05-20T17:06:44.590202+0000","last_undegraded":"2024-05-20T17:06:44.590202+0000","last_fullsized":"2024-05-20T17:06:44.590202+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:40:01.121264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.589438+0000","last_change":"2024-05-20T17:05:05.100689+0000","last_active":"2024-05-20T17:06:44.589438+0000","last_peered":"2024-05-20T17:06:44.589438+0000","last_clean":"2024-05-20T17:06:44.589438+0000","last_became_active":"2024-05-20T17:05:05.100321+0000","last_became_peered":"2024-05-20T17:05:05.100321+0000","last_unstale":"2024-05-20T17:06:44.589438+0000","last_undegraded":"2024-05-20T17:06:44.589438+0000","last_fullsized":"2024-05-20T17:06:44.589438+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:10:07.742067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.602701+0000","last_change":"2024-05-20T17:06:44.602189+0000","last_active":"2024-05-20T17:06:44.602701+0000","last_peered":"2024-05-20T17:06:44.602701+0000","last_clean":"2024-05-20T17:06:44.602701+0000","last_became_active":"2024-05-20T17:06:44.595835+0000","last_became_peered":"2024-05-20T17:06:44.595835+0000","last_unstale":"2024-05-20T17:06:44.602701+0000","last_undegraded":"2024-05-20T17:06:44.602701+0000","last_fullsized":"2024-05-20T17:06:44.602701+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:53:24.605243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590134+0000","last_change":"2024-05-20T17:05:09.130715+0000","last_active":"2024-05-20T17:06:44.590134+0000","last_peered":"2024-05-20T17:06:44.590134+0000","last_clean":"2024-05-20T17:06:44.590134+0000","last_became_active":"2024-05-20T17:05:09.130237+0000","last_became_peered":"2024-05-20T17:05:09.130237+0000","last_unstale":"2024-05-20T17:06:44.590134+0000","last_undegraded":"2024-05-20T17:06:44.590134+0000","last_fullsized":"2024-05-20T17:06:44.590134+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:52:15.160631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.591790+0000","last_change":"2024-05-20T17:05:04.103942+0000","last_active":"2024-05-20T17:06:44.591790+0000","last_peered":"2024-05-20T17:06:44.591790+0000","last_clean":"2024-05-20T17:06:44.591790+0000","last_became_active":"2024-05-20T17:05:04.102971+0000","last_became_peered":"2024-05-20T17:05:04.102971+0000","last_unstale":"2024-05-20T17:06:44.591790+0000","last_undegraded":"2024-05-20T17:06:44.591790+0000","last_fullsized":"2024-05-20T17:06:44.591790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:41:37.719913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.589989+0000","last_change":"2024-05-20T17:05:05.087201+0000","last_active":"2024-05-20T17:06:44.589989+0000","last_peered":"2024-05-20T17:06:44.589989+0000","last_clean":"2024-05-20T17:06:44.589989+0000","last_became_active":"2024-05-20T17:05:05.086809+0000","last_became_peered":"2024-05-20T17:05:05.086809+0000","last_unstale":"2024-05-20T17:06:44.589989+0000","last_undegraded":"2024-05-20T17:06:44.589989+0000","last_fullsized":"2024-05-20T17:06:44.589989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:31:45.925200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587115+0000","last_change":"2024-05-20T17:05:09.369881+0000","last_active":"2024-05-20T17:06:44.587115+0000","last_peered":"2024-05-20T17:06:44.587115+0000","last_clean":"2024-05-20T17:06:44.587115+0000","last_became_active":"2024-05-20T17:05:09.369391+0000","last_became_peered":"2024-05-20T17:05:09.369391+0000","last_unstale":"2024-05-20T17:06:44.587115+0000","last_undegraded":"2024-05-20T17:06:44.587115+0000","last_fullsized":"2024-05-20T17:06:44.587115+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:00:00.397289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'13","reported_seq":44,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.719701+0000","last_change":"2024-05-20T17:05:04.098857+0000","last_active":"2024-05-20T17:06:44.719701+0000","last_peered":"2024-05-20T17:06:44.719701+0000","last_clean":"2024-05-20T17:06:44.719701+0000","last_became_active":"2024-05-20T17:05:04.098480+0000","last_became_peered":"2024-05-20T17:05:04.098480+0000","last_unstale":"2024-05-20T17:06:44.719701+0000","last_undegraded":"2024-05-20T17:06:44.719701+0000","last_fullsized":"2024-05-20T17:06:44.719701+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:03:57.164706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587837+0000","last_change":"2024-05-20T17:05:05.121077+0000","last_active":"2024-05-20T17:06:44.587837+0000","last_peered":"2024-05-20T17:06:44.587837+0000","last_clean":"2024-05-20T17:06:44.587837+0000","last_became_active":"2024-05-20T17:05:05.120651+0000","last_became_peered":"2024-05-20T17:05:05.120651+0000","last_unstale":"2024-05-20T17:06:44.587837+0000","last_undegraded":"2024-05-20T17:06:44.587837+0000","last_fullsized":"2024-05-20T17:06:44.587837+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:59:30.061898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.588019+0000","last_change":"2024-05-20T17:05:09.122839+0000","last_active":"2024-05-20T17:06:44.588019+0000","last_peered":"2024-05-20T17:06:44.588019+0000","last_clean":"2024-05-20T17:06:44.588019+0000","last_became_active":"2024-05-20T17:05:09.122390+0000","last_became_peered":"2024-05-20T17:05:09.122390+0000","last_unstale":"2024-05-20T17:06:44.588019+0000","last_undegraded":"2024-05-20T17:06:44.588019+0000","last_fullsized":"2024-05-20T17:06:44.588019+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:50:27.849698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.724171+0000","last_change":"2024-05-20T17:05:04.092416+0000","last_active":"2024-05-20T17:06:44.724171+0000","last_peered":"2024-05-20T17:06:44.724171+0000","last_clean":"2024-05-20T17:06:44.724171+0000","last_became_active":"2024-05-20T17:05:04.091886+0000","last_became_peered":"2024-05-20T17:05:04.091886+0000","last_unstale":"2024-05-20T17:06:44.724171+0000","last_undegraded":"2024-05-20T17:06:44.724171+0000","last_fullsized":"2024-05-20T17:06:44.724171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:00:02.281867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'7","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.773475+0000","last_change":"2024-05-20T17:05:05.115650+0000","last_active":"2024-05-20T17:06:44.773475+0000","last_peered":"2024-05-20T17:06:44.773475+0000","last_clean":"2024-05-20T17:06:44.773475+0000","last_became_active":"2024-05-20T17:05:05.115303+0000","last_became_peered":"2024-05-20T17:05:05.115303+0000","last_unstale":"2024-05-20T17:06:44.773475+0000","last_undegraded":"2024-05-20T17:06:44.773475+0000","last_fullsized":"2024-05-20T17:06:44.773475+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:10:02.144645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.724183+0000","last_change":"2024-05-20T17:05:09.371289+0000","last_active":"2024-05-20T17:06:44.724183+0000","last_peered":"2024-05-20T17:06:44.724183+0000","last_clean":"2024-05-20T17:06:44.724183+0000","last_became_active":"2024-05-20T17:05:09.369823+0000","last_became_peered":"2024-05-20T17:05:09.369823+0000","last_unstale":"2024-05-20T17:06:44.724183+0000","last_undegraded":"2024-05-20T17:06:44.724183+0000","last_fullsized":"2024-05-20T17:06:44.724183+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:34:57.738554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.633114+0000","last_change":"2024-05-20T17:05:04.104909+0000","last_active":"2024-05-20T17:06:44.633114+0000","last_peered":"2024-05-20T17:06:44.633114+0000","last_clean":"2024-05-20T17:06:44.633114+0000","last_became_active":"2024-05-20T17:05:04.104457+0000","last_became_peered":"2024-05-20T17:05:04.104457+0000","last_unstale":"2024-05-20T17:06:44.633114+0000","last_undegraded":"2024-05-20T17:06:44.633114+0000","last_fullsized":"2024-05-20T17:06:44.633114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:53:41.790963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.591404+0000","last_change":"2024-05-20T17:05:05.103188+0000","last_active":"2024-05-20T17:06:44.591404+0000","last_peered":"2024-05-20T17:06:44.591404+0000","last_clean":"2024-05-20T17:06:44.591404+0000","last_became_active":"2024-05-20T17:05:05.102780+0000","last_became_peered":"2024-05-20T17:05:05.102780+0000","last_unstale":"2024-05-20T17:06:44.591404+0000","last_undegraded":"2024-05-20T17:06:44.591404+0000","last_fullsized":"2024-05-20T17:06:44.591404+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:32.907211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.719400+0000","last_change":"2024-05-20T17:05:09.126155+0000","last_active":"2024-05-20T17:06:44.719400+0000","last_peered":"2024-05-20T17:06:44.719400+0000","last_clean":"2024-05-20T17:06:44.719400+0000","last_became_active":"2024-05-20T17:05:09.125464+0000","last_became_peered":"2024-05-20T17:05:09.125464+0000","last_unstale":"2024-05-20T17:06:44.719400+0000","last_undegraded":"2024-05-20T17:06:44.719400+0000","last_fullsized":"2024-05-20T17:06:44.719400+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:28:52.747574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587303+0000","last_change":"2024-05-20T17:05:04.088923+0000","last_active":"2024-05-20T17:06:44.587303+0000","last_peered":"2024-05-20T17:06:44.587303+0000","last_clean":"2024-05-20T17:06:44.587303+0000","last_became_active":"2024-05-20T17:05:04.088335+0000","last_became_peered":"2024-05-20T17:05:04.088335+0000","last_unstale":"2024-05-20T17:06:44.587303+0000","last_undegraded":"2024-05-20T17:06:44.587303+0000","last_fullsized":"2024-05-20T17:06:44.587303+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:43:18.288139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.591736+0000","last_change":"2024-05-20T17:05:05.110964+0000","last_active":"2024-05-20T17:06:44.591736+0000","last_peered":"2024-05-20T17:06:44.591736+0000","last_clean":"2024-05-20T17:06:44.591736+0000","last_became_active":"2024-05-20T17:05:05.110593+0000","last_became_peered":"2024-05-20T17:05:05.110593+0000","last_unstale":"2024-05-20T17:06:44.591736+0000","last_undegraded":"2024-05-20T17:06:44.591736+0000","last_fullsized":"2024-05-20T17:06:44.591736+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:27.921812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":23,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.723756+0000","last_change":"2024-05-20T17:05:09.139541+0000","last_active":"2024-05-20T17:06:44.723756+0000","last_peered":"2024-05-20T17:06:44.723756+0000","last_clean":"2024-05-20T17:06:44.723756+0000","last_became_active":"2024-05-20T17:05:09.139008+0000","last_became_peered":"2024-05-20T17:05:09.139008+0000","last_unstale":"2024-05-20T17:06:44.723756+0000","last_undegraded":"2024-05-20T17:06:44.723756+0000","last_fullsized":"2024-05-20T17:06:44.723756+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:50.125661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'3","reported_seq":17,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.600278+0000","last_change":"2024-05-20T17:06:44.599695+0000","last_active":"2024-05-20T17:06:44.600278+0000","last_peered":"2024-05-20T17:06:44.600278+0000","last_clean":"2024-05-20T17:06:44.600278+0000","last_became_active":"2024-05-20T17:06:44.593479+0000","last_became_peered":"2024-05-20T17:06:44.593479+0000","last_unstale":"2024-05-20T17:06:44.600278+0000","last_undegraded":"2024-05-20T17:06:44.600278+0000","last_fullsized":"2024-05-20T17:06:44.600278+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:47:50.153220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587530+0000","last_change":"2024-05-20T17:05:05.113644+0000","last_active":"2024-05-20T17:06:44.587530+0000","last_peered":"2024-05-20T17:06:44.587530+0000","last_clean":"2024-05-20T17:06:44.587530+0000","last_became_active":"2024-05-20T17:05:05.113186+0000","last_became_peered":"2024-05-20T17:05:05.113186+0000","last_unstale":"2024-05-20T17:06:44.587530+0000","last_undegraded":"2024-05-20T17:06:44.587530+0000","last_fullsized":"2024-05-20T17:06:44.587530+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:54.243939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.723898+0000","last_change":"2024-05-20T17:05:09.370048+0000","last_active":"2024-05-20T17:06:44.723898+0000","last_peered":"2024-05-20T17:06:44.723898+0000","last_clean":"2024-05-20T17:06:44.723898+0000","last_became_active":"2024-05-20T17:05:09.369529+0000","last_became_peered":"2024-05-20T17:05:09.369529+0000","last_unstale":"2024-05-20T17:06:44.723898+0000","last_undegraded":"2024-05-20T17:06:44.723898+0000","last_fullsized":"2024-05-20T17:06:44.723898+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:49:09.332673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":48,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.591094+0000","last_change":"2024-05-20T17:05:43.633934+0000","last_active":"2024-05-20T17:06:44.591094+0000","last_peered":"2024-05-20T17:06:44.591094+0000","last_clean":"2024-05-20T17:06:44.591094+0000","last_became_active":"2024-05-20T17:05:43.628612+0000","last_became_peered":"2024-05-20T17:05:43.628612+0000","last_unstale":"2024-05-20T17:06:44.591094+0000","last_undegraded":"2024-05-20T17:06:44.591094+0000","last_fullsized":"2024-05-20T17:06:44.591094+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:52:27.321272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"92'5","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.593887+0000","last_change":"2024-05-20T17:05:05.115003+0000","last_active":"2024-05-20T17:06:44.593887+0000","last_peered":"2024-05-20T17:06:44.593887+0000","last_clean":"2024-05-20T17:06:44.593887+0000","last_became_active":"2024-05-20T17:05:05.114596+0000","last_became_peered":"2024-05-20T17:05:05.114596+0000","last_unstale":"2024-05-20T17:06:44.593887+0000","last_undegraded":"2024-05-20T17:06:44.593887+0000","last_fullsized":"2024-05-20T17:06:44.593887+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:47:39.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.633598+0000","last_change":"2024-05-20T17:05:09.131310+0000","last_active":"2024-05-20T17:06:44.633598+0000","last_peered":"2024-05-20T17:06:44.633598+0000","last_clean":"2024-05-20T17:06:44.633598+0000","last_became_active":"2024-05-20T17:05:09.130643+0000","last_became_peered":"2024-05-20T17:05:09.130643+0000","last_unstale":"2024-05-20T17:06:44.633598+0000","last_undegraded":"2024-05-20T17:06:44.633598+0000","last_fullsized":"2024-05-20T17:06:44.633598+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:58:21.996929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'5","reported_seq":114,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:49.715464+0000","last_change":"2024-05-20T17:05:04.100547+0000","last_active":"2024-05-20T17:06:49.715464+0000","last_peered":"2024-05-20T17:06:49.715464+0000","last_clean":"2024-05-20T17:06:49.715464+0000","last_became_active":"2024-05-20T17:05:04.100167+0000","last_became_peered":"2024-05-20T17:05:04.100167+0000","last_unstale":"2024-05-20T17:06:49.715464+0000","last_undegraded":"2024-05-20T17:06:49.715464+0000","last_fullsized":"2024-05-20T17:06:49.715464+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:44.182489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"92'7","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594309+0000","last_change":"2024-05-20T17:05:05.118459+0000","last_active":"2024-05-20T17:06:44.594309+0000","last_peered":"2024-05-20T17:06:44.594309+0000","last_clean":"2024-05-20T17:06:44.594309+0000","last_became_active":"2024-05-20T17:05:05.115445+0000","last_became_peered":"2024-05-20T17:05:05.115445+0000","last_unstale":"2024-05-20T17:06:44.594309+0000","last_undegraded":"2024-05-20T17:06:44.594309+0000","last_fullsized":"2024-05-20T17:06:44.594309+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:06:36.042952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.773147+0000","last_change":"2024-05-20T17:05:09.136508+0000","last_active":"2024-05-20T17:06:44.773147+0000","last_peered":"2024-05-20T17:06:44.773147+0000","last_clean":"2024-05-20T17:06:44.773147+0000","last_became_active":"2024-05-20T17:05:09.135825+0000","last_became_peered":"2024-05-20T17:05:09.135825+0000","last_unstale":"2024-05-20T17:06:44.773147+0000","last_undegraded":"2024-05-20T17:06:44.773147+0000","last_fullsized":"2024-05-20T17:06:44.773147+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:00:48.585071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"90'3","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.595014+0000","last_change":"2024-05-20T17:05:04.096484+0000","last_active":"2024-05-20T17:06:44.595014+0000","last_peered":"2024-05-20T17:06:44.595014+0000","last_clean":"2024-05-20T17:06:44.595014+0000","last_became_active":"2024-05-20T17:05:04.096053+0000","last_became_peered":"2024-05-20T17:05:04.096053+0000","last_unstale":"2024-05-20T17:06:44.595014+0000","last_undegraded":"2024-05-20T17:06:44.595014+0000","last_fullsized":"2024-05-20T17:06:44.595014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:35:19.373932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'6","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.593951+0000","last_change":"2024-05-20T17:05:05.118667+0000","last_active":"2024-05-20T17:06:44.593951+0000","last_peered":"2024-05-20T17:06:44.593951+0000","last_clean":"2024-05-20T17:06:44.593951+0000","last_became_active":"2024-05-20T17:05:05.118173+0000","last_became_peered":"2024-05-20T17:05:05.118173+0000","last_unstale":"2024-05-20T17:06:44.593951+0000","last_undegraded":"2024-05-20T17:06:44.593951+0000","last_fullsized":"2024-05-20T17:06:44.593951+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:14.658446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.593594+0000","last_change":"2024-05-20T17:05:09.127806+0000","last_active":"2024-05-20T17:06:44.593594+0000","last_peered":"2024-05-20T17:06:44.593594+0000","last_clean":"2024-05-20T17:06:44.593594+0000","last_became_active":"2024-05-20T17:05:09.126739+0000","last_became_peered":"2024-05-20T17:05:09.126739+0000","last_unstale":"2024-05-20T17:06:44.593594+0000","last_undegraded":"2024-05-20T17:06:44.593594+0000","last_fullsized":"2024-05-20T17:06:44.593594+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:08.104201+0000","last_clean_scrub_stamp":"2024-05-20T17:05:08.104201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:41:58.391763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.589900+0000","last_change":"2024-05-20T17:05:04.096955+0000","last_active":"2024-05-20T17:06:44.589900+0000","last_peered":"2024-05-20T17:06:44.589900+0000","last_clean":"2024-05-20T17:06:44.589900+0000","last_became_active":"2024-05-20T17:05:04.096467+0000","last_became_peered":"2024-05-20T17:05:04.096467+0000","last_unstale":"2024-05-20T17:06:44.589900+0000","last_undegraded":"2024-05-20T17:06:44.589900+0000","last_fullsized":"2024-05-20T17:06:44.589900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:03.063909+0000","last_clean_scrub_stamp":"2024-05-20T17:05:03.063909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:32:06.511617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594413+0000","last_change":"2024-05-20T17:05:05.106615+0000","last_active":"2024-05-20T17:06:44.594413+0000","last_peered":"2024-05-20T17:06:44.594413+0000","last_clean":"2024-05-20T17:06:44.594413+0000","last_became_active":"2024-05-20T17:05:05.106216+0000","last_became_peered":"2024-05-20T17:05:05.106216+0000","last_unstale":"2024-05-20T17:06:44.594413+0000","last_undegraded":"2024-05-20T17:06:44.594413+0000","last_fullsized":"2024-05-20T17:06:44.594413+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:32:10.920803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.591872+0000","last_change":"2024-05-20T17:05:05.098027+0000","last_active":"2024-05-20T17:06:44.591872+0000","last_peered":"2024-05-20T17:06:44.591872+0000","last_clean":"2024-05-20T17:06:44.591872+0000","last_became_active":"2024-05-20T17:05:05.097639+0000","last_became_peered":"2024-05-20T17:05:05.097639+0000","last_unstale":"2024-05-20T17:06:44.591872+0000","last_undegraded":"2024-05-20T17:06:44.591872+0000","last_fullsized":"2024-05-20T17:06:44.591872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:13:06.432459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":41,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.588446+0000","last_change":"2024-05-20T17:05:05.101197+0000","last_active":"2024-05-20T17:06:44.588446+0000","last_peered":"2024-05-20T17:06:44.588446+0000","last_clean":"2024-05-20T17:06:44.588446+0000","last_became_active":"2024-05-20T17:05:05.100865+0000","last_became_peered":"2024-05-20T17:05:05.100865+0000","last_unstale":"2024-05-20T17:06:44.588446+0000","last_undegraded":"2024-05-20T17:06:44.588446+0000","last_fullsized":"2024-05-20T17:06:44.588446+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:57:28.892291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.588126+0000","last_change":"2024-05-20T17:05:05.109529+0000","last_active":"2024-05-20T17:06:44.588126+0000","last_peered":"2024-05-20T17:06:44.588126+0000","last_clean":"2024-05-20T17:06:44.588126+0000","last_became_active":"2024-05-20T17:05:05.108332+0000","last_became_peered":"2024-05-20T17:05:05.108332+0000","last_unstale":"2024-05-20T17:06:44.588126+0000","last_undegraded":"2024-05-20T17:06:44.588126+0000","last_fullsized":"2024-05-20T17:06:44.588126+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:07.612296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"92'7","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.773766+0000","last_change":"2024-05-20T17:05:05.115602+0000","last_active":"2024-05-20T17:06:44.773766+0000","last_peered":"2024-05-20T17:06:44.773766+0000","last_clean":"2024-05-20T17:06:44.773766+0000","last_became_active":"2024-05-20T17:05:05.115250+0000","last_became_peered":"2024-05-20T17:05:05.115250+0000","last_unstale":"2024-05-20T17:06:44.773766+0000","last_undegraded":"2024-05-20T17:06:44.773766+0000","last_fullsized":"2024-05-20T17:06:44.773766+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:10:50.691956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590058+0000","last_change":"2024-05-20T17:05:05.110528+0000","last_active":"2024-05-20T17:06:44.590058+0000","last_peered":"2024-05-20T17:06:44.590058+0000","last_clean":"2024-05-20T17:06:44.590058+0000","last_became_active":"2024-05-20T17:05:05.110158+0000","last_became_peered":"2024-05-20T17:05:05.110158+0000","last_unstale":"2024-05-20T17:06:44.590058+0000","last_undegraded":"2024-05-20T17:06:44.590058+0000","last_fullsized":"2024-05-20T17:06:44.590058+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:58:15.143026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590706+0000","last_change":"2024-05-20T17:05:05.094890+0000","last_active":"2024-05-20T17:06:44.590706+0000","last_peered":"2024-05-20T17:06:44.590706+0000","last_clean":"2024-05-20T17:06:44.590706+0000","last_became_active":"2024-05-20T17:05:05.094452+0000","last_became_peered":"2024-05-20T17:05:05.094452+0000","last_unstale":"2024-05-20T17:06:44.590706+0000","last_undegraded":"2024-05-20T17:06:44.590706+0000","last_fullsized":"2024-05-20T17:06:44.590706+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:34:00.182526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":44,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.588973+0000","last_change":"2024-05-20T17:05:05.088916+0000","last_active":"2024-05-20T17:06:44.588973+0000","last_peered":"2024-05-20T17:06:44.588973+0000","last_clean":"2024-05-20T17:06:44.588973+0000","last_became_active":"2024-05-20T17:05:05.088257+0000","last_became_peered":"2024-05-20T17:05:05.088257+0000","last_unstale":"2024-05-20T17:06:44.588973+0000","last_undegraded":"2024-05-20T17:06:44.588973+0000","last_fullsized":"2024-05-20T17:06:44.588973+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:43:51.310579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587911+0000","last_change":"2024-05-20T17:05:43.629555+0000","last_active":"2024-05-20T17:06:44.587911+0000","last_peered":"2024-05-20T17:06:44.587911+0000","last_clean":"2024-05-20T17:06:44.587911+0000","last_became_active":"2024-05-20T17:05:43.629211+0000","last_became_peered":"2024-05-20T17:05:43.629211+0000","last_unstale":"2024-05-20T17:06:44.587911+0000","last_undegraded":"2024-05-20T17:06:44.587911+0000","last_fullsized":"2024-05-20T17:06:44.587911+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:27:42.199940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.594180+0000","last_change":"2024-05-20T17:05:05.105421+0000","last_active":"2024-05-20T17:06:44.594180+0000","last_peered":"2024-05-20T17:06:44.594180+0000","last_clean":"2024-05-20T17:06:44.594180+0000","last_became_active":"2024-05-20T17:05:05.105086+0000","last_became_peered":"2024-05-20T17:05:05.105086+0000","last_unstale":"2024-05-20T17:06:44.594180+0000","last_undegraded":"2024-05-20T17:06:44.594180+0000","last_fullsized":"2024-05-20T17:06:44.594180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:56:07.257884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.587359+0000","last_change":"2024-05-20T17:05:05.108394+0000","last_active":"2024-05-20T17:06:44.587359+0000","last_peered":"2024-05-20T17:06:44.587359+0000","last_clean":"2024-05-20T17:06:44.587359+0000","last_became_active":"2024-05-20T17:05:05.108003+0000","last_became_peered":"2024-05-20T17:05:05.108003+0000","last_unstale":"2024-05-20T17:06:44.587359+0000","last_undegraded":"2024-05-20T17:06:44.587359+0000","last_fullsized":"2024-05-20T17:06:44.587359+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:38.476660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.633897+0000","last_change":"2024-05-20T17:05:05.116825+0000","last_active":"2024-05-20T17:06:44.633897+0000","last_peered":"2024-05-20T17:06:44.633897+0000","last_clean":"2024-05-20T17:06:44.633897+0000","last_became_active":"2024-05-20T17:05:05.116366+0000","last_became_peered":"2024-05-20T17:05:05.116366+0000","last_unstale":"2024-05-20T17:06:44.633897+0000","last_undegraded":"2024-05-20T17:06:44.633897+0000","last_fullsized":"2024-05-20T17:06:44.633897+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:23:19.711036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.589794+0000","last_change":"2024-05-20T17:05:05.106896+0000","last_active":"2024-05-20T17:06:44.589794+0000","last_peered":"2024-05-20T17:06:44.589794+0000","last_clean":"2024-05-20T17:06:44.589794+0000","last_became_active":"2024-05-20T17:05:05.106514+0000","last_became_peered":"2024-05-20T17:05:05.106514+0000","last_unstale":"2024-05-20T17:06:44.589794+0000","last_undegraded":"2024-05-20T17:06:44.589794+0000","last_fullsized":"2024-05-20T17:06:44.589794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:08:22.235321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-20T17:06:44.590988+0000","last_change":"2024-05-20T17:05:43.626576+0000","last_active":"2024-05-20T17:06:44.590988+0000","last_peered":"2024-05-20T17:06:44.590988+0000","last_clean":"2024-05-20T17:06:44.590988+0000","last_became_active":"2024-05-20T17:05:43.626171+0000","last_became_peered":"2024-05-20T17:05:43.626171+0000","last_unstale":"2024-05-20T17:06:44.590988+0000","last_undegraded":"2024-05-20T17:06:44.590988+0000","last_fullsized":"2024-05-20T17:06:44.590988+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:05:04.072085+0000","last_clean_scrub_stamp":"2024-05-20T17:05:04.072085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:29:29.570441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70559,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":827,"num_read_kb":494,"num_write":248,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":211677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351012,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1073152,"data_stored":523337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612649,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28748,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716404,"statfs":{"total":95995035648,"available":95965597696,"internally_reserved":0,"allocated":1769472,"data_stored":1173758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776174,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":527363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037812,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1093632,"data_stored":523645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299449,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1691648,"data_stored":1120283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462974,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":518771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36456,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708696,"statfs":{"total":95995035648,"available":95957704704,"internally_reserved":0,"allocated":1142784,"data_stored":583406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1097728,"data_stored":520227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28156,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716996,"statfs":{"total":95995035648,"available":95966203904,"internally_reserved":0,"allocated":1163264,"data_stored":584158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149774,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1085440,"data_stored":518479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888137,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1081344,"data_stored":522845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724612,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37004,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708148,"statfs":{"total":95995035648,"available":95957143552,"internally_reserved":0,"allocated":1699840,"data_stored":1115865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:06:55.322 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-20T17:06:55.323 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-20T17:06:55.323 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-20T17:06:55.323 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph health --format=json 2024-05-20T17:06:55.588 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:06:55.964 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:55 smithi006 ceph-mon[32486]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:06:55.964 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:55 smithi006 ceph-mon[32486]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:06:56.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:55 smithi062 ceph-mon[35425]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:06:56.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:55 smithi062 ceph-mon[35425]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:06:56.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:55 smithi171 ceph-mon[35901]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:06:56.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:55 smithi171 ceph-mon[35901]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-20T17:06:57.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.436+0000 7f4e788b3700 1 -- 172.21.15.6:0/3454442267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e741075c0 msgr2=0x7f4e7410ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:57.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.436+0000 7f4e788b3700 1 --2- 172.21.15.6:0/3454442267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e741075c0 0x7f4e7410ef20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00b0d0 tx=0x7f4e6c00b3e0 comp rx=0 tx=0).stop 2024-05-20T17:06:57.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.436+0000 7f4e788b3700 1 -- 172.21.15.6:0/3454442267 shutdown_connections 2024-05-20T17:06:57.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.436+0000 7f4e788b3700 1 --2- 172.21.15.6:0/3454442267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e741075c0 0x7f4e7410ef20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:57.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.436+0000 7f4e788b3700 1 --2- 172.21.15.6:0/3454442267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e74102340 0x7f4e74102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:57.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.436+0000 7f4e788b3700 1 --2- 172.21.15.6:0/3454442267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e74106c70 0x7f4e74107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:57.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.436+0000 7f4e788b3700 1 -- 172.21.15.6:0/3454442267 >> 172.21.15.6:0/3454442267 conn(0x7f4e740fdc40 msgr2=0x7f4e74100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:57.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.436+0000 7f4e788b3700 1 -- 172.21.15.6:0/3454442267 shutdown_connections 2024-05-20T17:06:57.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.436+0000 7f4e788b3700 1 -- 172.21.15.6:0/3454442267 wait complete. 2024-05-20T17:06:57.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.437+0000 7f4e788b3700 1 Processor -- start 2024-05-20T17:06:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.437+0000 7f4e788b3700 1 -- start start 2024-05-20T17:06:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.438+0000 7f4e788b3700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e74102340 0x7f4e7419e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.438+0000 7f4e788b3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e74106c70 0x7f4e7419ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.438+0000 7f4e788b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e741075c0 0x7f4e74198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.438+0000 7f4e788b3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4e74112270 con 0x7f4e741075c0 2024-05-20T17:06:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.438+0000 7f4e788b3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4e741120f0 con 0x7f4e74106c70 2024-05-20T17:06:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.438+0000 7f4e788b3700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4e741123f0 con 0x7f4e74102340 2024-05-20T17:06:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.438+0000 7f4e72d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e741075c0 0x7f4e74198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.438+0000 7f4e72d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e741075c0 0x7f4e74198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33030/0 (socket says 172.21.15.6:33030) 2024-05-20T17:06:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.438+0000 7f4e72d9d700 1 -- 172.21.15.6:0/1775101753 learned_addr learned my addr 172.21.15.6:0/1775101753 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.438+0000 7f4e71d9b700 1 --2- 172.21.15.6:0/1775101753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e74106c70 0x7f4e7419ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.438+0000 7f4e7259c700 1 --2- 172.21.15.6:0/1775101753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e74102340 0x7f4e7419e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.438+0000 7f4e72d9d700 1 -- 172.21.15.6:0/1775101753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e74102340 msgr2=0x7f4e7419e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.438+0000 7f4e72d9d700 1 --2- 172.21.15.6:0/1775101753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e74102340 0x7f4e7419e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.438+0000 7f4e72d9d700 1 -- 172.21.15.6:0/1775101753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e74106c70 msgr2=0x7f4e7419ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.438+0000 7f4e72d9d700 1 --2- 172.21.15.6:0/1775101753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e74106c70 0x7f4e7419ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.438+0000 7f4e72d9d700 1 -- 172.21.15.6:0/1775101753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e741990c0 con 0x7f4e741075c0 2024-05-20T17:06:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.438+0000 7f4e72d9d700 1 --2- 172.21.15.6:0/1775101753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e741075c0 0x7f4e74198a10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009850 tx=0x7f4e6c007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.439+0000 7f4e637fe700 1 -- 172.21.15.6:0/1775101753 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c01f070 con 0x7f4e741075c0 2024-05-20T17:06:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.439+0000 7f4e637fe700 1 -- 172.21.15.6:0/1775101753 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e6c004c50 con 0x7f4e741075c0 2024-05-20T17:06:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.439+0000 7f4e788b3700 1 -- 172.21.15.6:0/1775101753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e74199350 con 0x7f4e741075c0 2024-05-20T17:06:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.439+0000 7f4e637fe700 1 -- 172.21.15.6:0/1775101753 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c01b670 con 0x7f4e741075c0 2024-05-20T17:06:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.439+0000 7f4e788b3700 1 -- 172.21.15.6:0/1775101753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e741997e0 con 0x7f4e741075c0 2024-05-20T17:06:57.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.440+0000 7f4e788b3700 1 -- 172.21.15.6:0/1775101753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e74050170 con 0x7f4e741075c0 2024-05-20T17:06:57.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.442+0000 7f4e637fe700 1 -- 172.21.15.6:0/1775101753 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f4e6c022070 con 0x7f4e741075c0 2024-05-20T17:06:57.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.443+0000 7f4e637fe700 1 --2- 172.21.15.6:0/1775101753 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4e5c0a2c20 0x7f4e5c0a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:57.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.443+0000 7f4e637fe700 1 -- 172.21.15.6:0/1775101753 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f4e6c0d0320 con 0x7f4e741075c0 2024-05-20T17:06:57.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.443+0000 7f4e7259c700 1 --2- 172.21.15.6:0/1775101753 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4e5c0a2c20 0x7f4e5c0a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:57.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.443+0000 7f4e7259c700 1 --2- 172.21.15.6:0/1775101753 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4e5c0a2c20 0x7f4e5c0a5130 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4e74199b50 tx=0x7f4e64009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:57.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.448+0000 7f4e637fe700 1 -- 172.21.15.6:0/1775101753 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4e6c09cf60 con 0x7f4e741075c0 2024-05-20T17:06:57.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.707+0000 7f4e788b3700 1 -- 172.21.15.6:0/1775101753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4e7410a050 con 0x7f4e741075c0 2024-05-20T17:06:57.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.707+0000 7f4e637fe700 1 -- 172.21.15.6:0/1775101753 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f4e6c09c860 con 0x7f4e741075c0 2024-05-20T17:06:57.707 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:06:57.707 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-20T17:06:57.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.709+0000 7f4e788b3700 1 -- 172.21.15.6:0/1775101753 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4e5c0a2c20 msgr2=0x7f4e5c0a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:57.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.709+0000 7f4e788b3700 1 --2- 172.21.15.6:0/1775101753 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4e5c0a2c20 0x7f4e5c0a5130 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4e74199b50 tx=0x7f4e64009190 comp rx=0 tx=0).stop 2024-05-20T17:06:57.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.709+0000 7f4e788b3700 1 -- 172.21.15.6:0/1775101753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e741075c0 msgr2=0x7f4e74198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:57.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.709+0000 7f4e788b3700 1 --2- 172.21.15.6:0/1775101753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e741075c0 0x7f4e74198a10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009850 tx=0x7f4e6c007a20 comp rx=0 tx=0).stop 2024-05-20T17:06:57.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.710+0000 7f4e788b3700 1 -- 172.21.15.6:0/1775101753 shutdown_connections 2024-05-20T17:06:57.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.710+0000 7f4e788b3700 1 --2- 172.21.15.6:0/1775101753 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4e5c0a2c20 0x7f4e5c0a5130 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:57.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.710+0000 7f4e788b3700 1 --2- 172.21.15.6:0/1775101753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e741075c0 0x7f4e74198a10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:57.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.710+0000 7f4e788b3700 1 --2- 172.21.15.6:0/1775101753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e74102340 0x7f4e7419e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:57.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.710+0000 7f4e788b3700 1 --2- 172.21.15.6:0/1775101753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e74106c70 0x7f4e7419ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:57.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.710+0000 7f4e788b3700 1 -- 172.21.15.6:0/1775101753 >> 172.21.15.6:0/1775101753 conn(0x7f4e740fdc40 msgr2=0x7f4e74106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:57.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.710+0000 7f4e788b3700 1 -- 172.21.15.6:0/1775101753 shutdown_connections 2024-05-20T17:06:57.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:57.710+0000 7f4e788b3700 1 -- 172.21.15.6:0/1775101753 wait complete. 2024-05-20T17:06:58.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:57 smithi062 ceph-mon[35425]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 88 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:06:58.091 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:57 smithi006 ceph-mon[32486]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 88 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:06:58.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:57 smithi171 ceph-mon[35901]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 88 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:06:58.561 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-20T17:06:58.562 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:06:58.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.681+0000 7fafad440640 1 -- 172.21.15.6:0/3702750300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa8101f20 msgr2=0x7fafa8102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:58.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.681+0000 7fafad440640 1 --2- 172.21.15.6:0/3702750300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa8101f20 0x7fafa8102330 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7faf98009900 tx=0x7faf9802a410 comp rx=0 tx=0).stop 2024-05-20T17:06:58.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.681+0000 7fafad440640 1 -- 172.21.15.6:0/3702750300 shutdown_connections 2024-05-20T17:06:58.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.681+0000 7fafad440640 1 --2- 172.21.15.6:0/3702750300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafa8103420 0x7fafa8109b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:58.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.681+0000 7fafad440640 1 --2- 172.21.15.6:0/3702750300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafa8102900 0x7fafa8102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:58.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.681+0000 7fafad440640 1 --2- 172.21.15.6:0/3702750300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa8101f20 0x7fafa8102330 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:58.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.681+0000 7fafad440640 1 -- 172.21.15.6:0/3702750300 >> 172.21.15.6:0/3702750300 conn(0x7fafa80fc340 msgr2=0x7fafa80fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:58.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.681+0000 7fafad440640 1 -- 172.21.15.6:0/3702750300 shutdown_connections 2024-05-20T17:06:58.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.681+0000 7fafad440640 1 -- 172.21.15.6:0/3702750300 wait complete. 2024-05-20T17:06:58.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.682+0000 7fafad440640 1 Processor -- start 2024-05-20T17:06:58.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.682+0000 7fafad440640 1 -- start start 2024-05-20T17:06:58.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.682+0000 7fafad440640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafa8101f20 0x7fafa8199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:58.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.682+0000 7fafad440640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa8102900 0x7fafa8199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:58.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.682+0000 7fafad440640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafa8103420 0x7fafa81a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:58.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.682+0000 7fafad440640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fafa81010f0 con 0x7fafa8102900 2024-05-20T17:06:58.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.682+0000 7fafad440640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fafa8100f70 con 0x7fafa8101f20 2024-05-20T17:06:58.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.682+0000 7fafad440640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fafa8101270 con 0x7fafa8103420 2024-05-20T17:06:58.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.682+0000 7fafa67fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa8102900 0x7fafa8199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:58.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.682+0000 7fafa67fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa8102900 0x7fafa8199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33062/0 (socket says 172.21.15.6:33062) 2024-05-20T17:06:58.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.682+0000 7fafa67fc640 1 -- 172.21.15.6:0/3042629247 learned_addr learned my addr 172.21.15.6:0/3042629247 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:58.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.683+0000 7fafa6ffd640 1 --2- 172.21.15.6:0/3042629247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafa8101f20 0x7fafa8199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:58.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.683+0000 7fafa77fe640 1 --2- 172.21.15.6:0/3042629247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafa8103420 0x7fafa81a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:58.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.683+0000 7fafa67fc640 1 -- 172.21.15.6:0/3042629247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafa8103420 msgr2=0x7fafa81a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:58.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.683+0000 7fafa67fc640 1 --2- 172.21.15.6:0/3042629247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafa8103420 0x7fafa81a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.683+0000 7fafa67fc640 1 -- 172.21.15.6:0/3042629247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafa8101f20 msgr2=0x7fafa8199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.683+0000 7fafa67fc640 1 --2- 172.21.15.6:0/3042629247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafa8101f20 0x7fafa8199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.683+0000 7fafa67fc640 1 -- 172.21.15.6:0/3042629247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa81a0c40 con 0x7fafa8102900 2024-05-20T17:06:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.683+0000 7fafa6ffd640 1 --2- 172.21.15.6:0/3042629247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafa8101f20 0x7fafa8199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:06:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.683+0000 7fafa77fe640 1 --2- 172.21.15.6:0/3042629247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafa8103420 0x7fafa81a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:06:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.683+0000 7fafa67fc640 1 --2- 172.21.15.6:0/3042629247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa8102900 0x7fafa8199640 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faf9000d770 tx=0x7faf9000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.683+0000 7faf9ffff640 1 -- 172.21.15.6:0/3042629247 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf90017070 con 0x7fafa8102900 2024-05-20T17:06:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.683+0000 7fafad440640 1 -- 172.21.15.6:0/3042629247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafa81a0f30 con 0x7fafa8102900 2024-05-20T17:06:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.683+0000 7faf9ffff640 1 -- 172.21.15.6:0/3042629247 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faf900054d0 con 0x7fafa8102900 2024-05-20T17:06:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.683+0000 7faf9ffff640 1 -- 172.21.15.6:0/3042629247 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf90004cf0 con 0x7fafa8102900 2024-05-20T17:06:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.683+0000 7fafad440640 1 -- 172.21.15.6:0/3042629247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafa81a13a0 con 0x7fafa8102900 2024-05-20T17:06:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.684+0000 7fafad440640 1 -- 172.21.15.6:0/3042629247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafa81068c0 con 0x7fafa8102900 2024-05-20T17:06:58.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.685+0000 7faf9ffff640 1 -- 172.21.15.6:0/3042629247 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7faf90004e90 con 0x7fafa8102900 2024-05-20T17:06:58.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.686+0000 7faf9ffff640 1 --2- 172.21.15.6:0/3042629247 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7faf940a2c30 0x7faf940a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:58.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.686+0000 7fafa6ffd640 1 --2- 172.21.15.6:0/3042629247 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7faf940a2c30 0x7faf940a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:58.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.686+0000 7faf9ffff640 1 -- 172.21.15.6:0/3042629247 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7faf900cf3c0 con 0x7fafa8102900 2024-05-20T17:06:58.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.687+0000 7fafa6ffd640 1 --2- 172.21.15.6:0/3042629247 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7faf940a2c30 0x7faf940a5140 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faf98006010 tx=0x7faf98000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:58.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.690+0000 7faf9ffff640 1 -- 172.21.15.6:0/3042629247 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7faf9009bf10 con 0x7fafa8102900 2024-05-20T17:06:58.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:58 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1775101753' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-20T17:06:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.882+0000 7fafad440640 1 -- 172.21.15.6:0/3042629247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fafa802d4f0 con 0x7fafa8102900 2024-05-20T17:06:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.884+0000 7faf9ffff640 1 -- 172.21.15.6:0/3042629247 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+24584 (secure 0 0 0) 0x7faf9009b810 con 0x7fafa8102900 2024-05-20T17:06:58.884 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:06:58.884 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":94,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:06:44.581646+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:05:02.947896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:05:03.842231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:05:07.551471+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:06:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.886+0000 7fafad440640 1 -- 172.21.15.6:0/3042629247 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7faf940a2c30 msgr2=0x7faf940a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.886+0000 7fafad440640 1 --2- 172.21.15.6:0/3042629247 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7faf940a2c30 0x7faf940a5140 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faf98006010 tx=0x7faf98000bc0 comp rx=0 tx=0).stop 2024-05-20T17:06:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.886+0000 7fafad440640 1 -- 172.21.15.6:0/3042629247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa8102900 msgr2=0x7fafa8199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.886+0000 7fafad440640 1 --2- 172.21.15.6:0/3042629247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa8102900 0x7fafa8199640 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faf9000d770 tx=0x7faf9000dc30 comp rx=0 tx=0).stop 2024-05-20T17:06:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.886+0000 7fafad440640 1 -- 172.21.15.6:0/3042629247 shutdown_connections 2024-05-20T17:06:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.886+0000 7fafad440640 1 --2- 172.21.15.6:0/3042629247 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7faf940a2c30 0x7faf940a5140 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.886+0000 7fafad440640 1 --2- 172.21.15.6:0/3042629247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafa8103420 0x7fafa81a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.886+0000 7fafad440640 1 --2- 172.21.15.6:0/3042629247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa8102900 0x7fafa8199640 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.886+0000 7fafad440640 1 --2- 172.21.15.6:0/3042629247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafa8101f20 0x7fafa8199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.886+0000 7fafad440640 1 -- 172.21.15.6:0/3042629247 >> 172.21.15.6:0/3042629247 conn(0x7fafa80fc340 msgr2=0x7fafa8103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.886+0000 7fafad440640 1 -- 172.21.15.6:0/3042629247 shutdown_connections 2024-05-20T17:06:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:58.886+0000 7fafad440640 1 -- 172.21.15.6:0/3042629247 wait complete. 2024-05-20T17:06:58.898 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:00:12.516679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:05:02.947896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:05:03.842231+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:05:07.551471+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:06:58.899 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:06:59.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.017+0000 7f82f399c640 1 -- 172.21.15.6:0/3099497752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec108730 msgr2=0x7f82ec10ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:59.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.017+0000 7f82f399c640 1 --2- 172.21.15.6:0/3099497752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec108730 0x7f82ec10ac40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f82e4009ca0 tx=0x7f82e402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.017+0000 7f82f399c640 1 -- 172.21.15.6:0/3099497752 shutdown_connections 2024-05-20T17:06:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.017+0000 7f82f399c640 1 --2- 172.21.15.6:0/3099497752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec108730 0x7f82ec10ac40 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.017+0000 7f82f399c640 1 --2- 172.21.15.6:0/3099497752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82ec105bc0 0x7f82ec1080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.017+0000 7f82f399c640 1 --2- 172.21.15.6:0/3099497752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82ec100de0 0x7f82ec1011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.017+0000 7f82f399c640 1 -- 172.21.15.6:0/3099497752 >> 172.21.15.6:0/3099497752 conn(0x7f82ec0fc330 msgr2=0x7f82ec0fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.018+0000 7f82f399c640 1 -- 172.21.15.6:0/3099497752 shutdown_connections 2024-05-20T17:06:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.018+0000 7f82f399c640 1 -- 172.21.15.6:0/3099497752 wait complete. 2024-05-20T17:06:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.018+0000 7f82f399c640 1 Processor -- start 2024-05-20T17:06:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.018+0000 7f82f399c640 1 -- start start 2024-05-20T17:06:59.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.018+0000 7f82f399c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82ec100de0 0x7f82ec199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:59.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.018+0000 7f82f399c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec105bc0 0x7f82ec199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:59.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.018+0000 7f82f399c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82ec108730 0x7f82ec1a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:59.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.018+0000 7f82f399c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f82ec10e5c0 con 0x7f82ec105bc0 2024-05-20T17:06:59.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.018+0000 7f82f399c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f82ec10e440 con 0x7f82ec108730 2024-05-20T17:06:59.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.018+0000 7f82f399c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f82ec10e740 con 0x7f82ec100de0 2024-05-20T17:06:59.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.019+0000 7f82f0f37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec105bc0 0x7f82ec199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:59.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.019+0000 7f82f0f37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec105bc0 0x7f82ec199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33086/0 (socket says 172.21.15.6:33086) 2024-05-20T17:06:59.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.019+0000 7f82f0f37640 1 -- 172.21.15.6:0/592544913 learned_addr learned my addr 172.21.15.6:0/592544913 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:59.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.019+0000 7f82f1f39640 1 --2- 172.21.15.6:0/592544913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82ec108730 0x7f82ec1a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:59.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.019+0000 7f82f1738640 1 --2- 172.21.15.6:0/592544913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82ec100de0 0x7f82ec199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:59.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.019+0000 7f82f0f37640 1 -- 172.21.15.6:0/592544913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82ec100de0 msgr2=0x7f82ec199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:59.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.019+0000 7f82f0f37640 1 --2- 172.21.15.6:0/592544913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82ec100de0 0x7f82ec199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.019+0000 7f82f0f37640 1 -- 172.21.15.6:0/592544913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82ec108730 msgr2=0x7f82ec1a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:59.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.019+0000 7f82f0f37640 1 --2- 172.21.15.6:0/592544913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82ec108730 0x7f82ec1a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.019+0000 7f82f0f37640 1 -- 172.21.15.6:0/592544913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ec1a0b90 con 0x7f82ec105bc0 2024-05-20T17:06:59.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.019+0000 7f82f1738640 1 --2- 172.21.15.6:0/592544913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82ec100de0 0x7f82ec199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:06:59.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.019+0000 7f82f0f37640 1 --2- 172.21.15.6:0/592544913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec105bc0 0x7f82ec199640 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00c920 tx=0x7f82dc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:59.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.019+0000 7f82e27fc640 1 -- 172.21.15.6:0/592544913 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc007c70 con 0x7f82ec105bc0 2024-05-20T17:06:59.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.019+0000 7f82e27fc640 1 -- 172.21.15.6:0/592544913 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82dc007e10 con 0x7f82ec105bc0 2024-05-20T17:06:59.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.019+0000 7f82f399c640 1 -- 172.21.15.6:0/592544913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82ec1a0e80 con 0x7f82ec105bc0 2024-05-20T17:06:59.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.019+0000 7f82e27fc640 1 -- 172.21.15.6:0/592544913 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc018820 con 0x7f82ec105bc0 2024-05-20T17:06:59.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.019+0000 7f82f399c640 1 -- 172.21.15.6:0/592544913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82ec1a1340 con 0x7f82ec105bc0 2024-05-20T17:06:59.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.020+0000 7f82f399c640 1 -- 172.21.15.6:0/592544913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82ec0fde50 con 0x7f82ec105bc0 2024-05-20T17:06:59.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:58 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1775101753' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-20T17:06:59.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.022+0000 7f82e27fc640 1 -- 172.21.15.6:0/592544913 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f82dc0189c0 con 0x7f82ec105bc0 2024-05-20T17:06:59.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.023+0000 7f82e27fc640 1 --2- 172.21.15.6:0/592544913 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f82d80a2c10 0x7f82d80a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:59.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.023+0000 7f82f1738640 1 --2- 172.21.15.6:0/592544913 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f82d80a2c10 0x7f82d80a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:59.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.023+0000 7f82e27fc640 1 -- 172.21.15.6:0/592544913 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f82dc0cf7b0 con 0x7f82ec105bc0 2024-05-20T17:06:59.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.023+0000 7f82f1738640 1 --2- 172.21.15.6:0/592544913 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f82d80a2c10 0x7f82d80a5120 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f82ec103ab0 tx=0x7f82e8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:59.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.027+0000 7f82e27fc640 1 -- 172.21.15.6:0/592544913 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f82dc014030 con 0x7f82ec105bc0 2024-05-20T17:06:59.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:58 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1775101753' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-20T17:06:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.210+0000 7f82f399c640 1 -- 172.21.15.6:0/592544913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f82ec02d4f0 con 0x7f82ec105bc0 2024-05-20T17:06:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.210+0000 7f82e27fc640 1 -- 172.21.15.6:0/592544913 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) ==== 93+0+10 (secure 0 0 0) 0x7f82dc09c410 con 0x7f82ec105bc0 2024-05-20T17:06:59.210 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:06:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.213+0000 7f82f399c640 1 -- 172.21.15.6:0/592544913 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f82d80a2c10 msgr2=0x7f82d80a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.213+0000 7f82f399c640 1 --2- 172.21.15.6:0/592544913 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f82d80a2c10 0x7f82d80a5120 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f82ec103ab0 tx=0x7f82e8005f90 comp rx=0 tx=0).stop 2024-05-20T17:06:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.213+0000 7f82f399c640 1 -- 172.21.15.6:0/592544913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec105bc0 msgr2=0x7f82ec199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.213+0000 7f82f399c640 1 --2- 172.21.15.6:0/592544913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec105bc0 0x7f82ec199640 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00c920 tx=0x7f82dc00cde0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.213+0000 7f82f399c640 1 -- 172.21.15.6:0/592544913 shutdown_connections 2024-05-20T17:06:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.213+0000 7f82f399c640 1 --2- 172.21.15.6:0/592544913 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f82d80a2c10 0x7f82d80a5120 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.213+0000 7f82f399c640 1 --2- 172.21.15.6:0/592544913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82ec108730 0x7f82ec1a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.213+0000 7f82f399c640 1 --2- 172.21.15.6:0/592544913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec105bc0 0x7f82ec199640 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.213+0000 7f82f399c640 1 --2- 172.21.15.6:0/592544913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82ec100de0 0x7f82ec199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.213+0000 7f82f399c640 1 -- 172.21.15.6:0/592544913 >> 172.21.15.6:0/592544913 conn(0x7f82ec0fc330 msgr2=0x7f82ec106b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.213+0000 7f82f399c640 1 -- 172.21.15.6:0/592544913 shutdown_connections 2024-05-20T17:06:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.213+0000 7f82f399c640 1 -- 172.21.15.6:0/592544913 wait complete. 2024-05-20T17:06:59.224 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:06:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.347+0000 7fdde681b640 1 -- 172.21.15.6:0/186109994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdde0103570 msgr2=0x7fdde0105990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.347+0000 7fdde681b640 1 --2- 172.21.15.6:0/186109994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdde0103570 0x7fdde0105990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009900 tx=0x7fddd002a410 comp rx=0 tx=0).stop 2024-05-20T17:06:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.347+0000 7fdde681b640 1 -- 172.21.15.6:0/186109994 shutdown_connections 2024-05-20T17:06:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.347+0000 7fdde681b640 1 --2- 172.21.15.6:0/186109994 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdde0108830 0x7fdde010ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.347+0000 7fdde681b640 1 --2- 172.21.15.6:0/186109994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdde0105ed0 0x7fdde01082f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.347+0000 7fdde681b640 1 --2- 172.21.15.6:0/186109994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdde0103570 0x7fdde0105990 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.347+0000 7fdde681b640 1 -- 172.21.15.6:0/186109994 >> 172.21.15.6:0/186109994 conn(0x7fdde00fcb70 msgr2=0x7fdde00ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.347+0000 7fdde681b640 1 -- 172.21.15.6:0/186109994 shutdown_connections 2024-05-20T17:06:59.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.347+0000 7fdde681b640 1 -- 172.21.15.6:0/186109994 wait complete. 2024-05-20T17:06:59.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.348+0000 7fdde681b640 1 Processor -- start 2024-05-20T17:06:59.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.348+0000 7fdde681b640 1 -- start start 2024-05-20T17:06:59.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.348+0000 7fdde681b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdde0103570 0x7fdde01991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:59.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.348+0000 7fdde681b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdde0105ed0 0x7fdde01996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:59.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.348+0000 7fdde681b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdde0108830 0x7fdde01a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:59.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.348+0000 7fdde681b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdde010e580 con 0x7fdde0105ed0 2024-05-20T17:06:59.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.348+0000 7fdde681b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdde010e400 con 0x7fdde0103570 2024-05-20T17:06:59.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.348+0000 7fdde681b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdde010e700 con 0x7fdde0108830 2024-05-20T17:06:59.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.348+0000 7fdddf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdde0105ed0 0x7fdde01996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:59.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.348+0000 7fdddf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdde0105ed0 0x7fdde01996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33108/0 (socket says 172.21.15.6:33108) 2024-05-20T17:06:59.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.348+0000 7fdddf7fe640 1 -- 172.21.15.6:0/3009937113 learned_addr learned my addr 172.21.15.6:0/3009937113 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:59.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.348+0000 7fdddffff640 1 --2- 172.21.15.6:0/3009937113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdde0103570 0x7fdde01991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:59.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.348+0000 7fdde4db8640 1 --2- 172.21.15.6:0/3009937113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdde0108830 0x7fdde01a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:59.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.348+0000 7fdddf7fe640 1 -- 172.21.15.6:0/3009937113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdde0108830 msgr2=0x7fdde01a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:59.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.348+0000 7fdddf7fe640 1 --2- 172.21.15.6:0/3009937113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdde0108830 0x7fdde01a0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.348+0000 7fdddf7fe640 1 -- 172.21.15.6:0/3009937113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdde0103570 msgr2=0x7fdde01991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.348+0000 7fdddf7fe640 1 --2- 172.21.15.6:0/3009937113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdde0103570 0x7fdde01991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.348+0000 7fdddf7fe640 1 -- 172.21.15.6:0/3009937113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde01a0c40 con 0x7fdde0105ed0 2024-05-20T17:06:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.349+0000 7fdddffff640 1 --2- 172.21.15.6:0/3009937113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdde0103570 0x7fdde01991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:06:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.349+0000 7fdddf7fe640 1 --2- 172.21.15.6:0/3009937113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdde0105ed0 0x7fdde01996f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fddd400c920 tx=0x7fddd400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.349+0000 7fdddd7fa640 1 -- 172.21.15.6:0/3009937113 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd4007c70 con 0x7fdde0105ed0 2024-05-20T17:06:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.349+0000 7fdddd7fa640 1 -- 172.21.15.6:0/3009937113 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fddd4007e10 con 0x7fdde0105ed0 2024-05-20T17:06:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.349+0000 7fdde681b640 1 -- 172.21.15.6:0/3009937113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde01a0f30 con 0x7fdde0105ed0 2024-05-20T17:06:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.349+0000 7fdddd7fa640 1 -- 172.21.15.6:0/3009937113 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd4018820 con 0x7fdde0105ed0 2024-05-20T17:06:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.349+0000 7fdde681b640 1 -- 172.21.15.6:0/3009937113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde01a13a0 con 0x7fdde0105ed0 2024-05-20T17:06:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.350+0000 7fdde681b640 1 -- 172.21.15.6:0/3009937113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde00fe690 con 0x7fdde0105ed0 2024-05-20T17:06:59.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.352+0000 7fdddd7fa640 1 -- 172.21.15.6:0/3009937113 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fddd40189c0 con 0x7fdde0105ed0 2024-05-20T17:06:59.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.353+0000 7fdddd7fa640 1 --2- 172.21.15.6:0/3009937113 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fddc80a2b90 0x7fddc80a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:59.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.353+0000 7fdddffff640 1 --2- 172.21.15.6:0/3009937113 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fddc80a2b90 0x7fddc80a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:59.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.353+0000 7fdddd7fa640 1 -- 172.21.15.6:0/3009937113 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fddd40cf900 con 0x7fdde0105ed0 2024-05-20T17:06:59.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.354+0000 7fdddffff640 1 --2- 172.21.15.6:0/3009937113 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fddc80a2b90 0x7fddc80a50a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fddd0000c00 tx=0x7fddd0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:59.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.357+0000 7fdddd7fa640 1 -- 172.21.15.6:0/3009937113 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fddd4014030 con 0x7fdde0105ed0 2024-05-20T17:06:59.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.543+0000 7fdde681b640 1 -- 172.21.15.6:0/3009937113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdde002d430 con 0x7fdde0105ed0 2024-05-20T17:06:59.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.544+0000 7fdddd7fa640 1 -- 172.21.15.6:0/3009937113 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) ==== 104+0+11 (secure 0 0 0) 0x7fddd409c4e0 con 0x7fdde0105ed0 2024-05-20T17:06:59.543 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:06:59.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.546+0000 7fdde681b640 1 -- 172.21.15.6:0/3009937113 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fddc80a2b90 msgr2=0x7fddc80a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:59.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.546+0000 7fdde681b640 1 --2- 172.21.15.6:0/3009937113 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fddc80a2b90 0x7fddc80a50a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fddd0000c00 tx=0x7fddd0031400 comp rx=0 tx=0).stop 2024-05-20T17:06:59.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.546+0000 7fdde681b640 1 -- 172.21.15.6:0/3009937113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdde0105ed0 msgr2=0x7fdde01996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:59.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.546+0000 7fdde681b640 1 --2- 172.21.15.6:0/3009937113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdde0105ed0 0x7fdde01996f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fddd400c920 tx=0x7fddd400cde0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.546+0000 7fdde681b640 1 -- 172.21.15.6:0/3009937113 shutdown_connections 2024-05-20T17:06:59.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.546+0000 7fdde681b640 1 --2- 172.21.15.6:0/3009937113 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fddc80a2b90 0x7fddc80a50a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.546+0000 7fdde681b640 1 --2- 172.21.15.6:0/3009937113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdde0108830 0x7fdde01a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.546+0000 7fdde681b640 1 --2- 172.21.15.6:0/3009937113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdde0105ed0 0x7fdde01996f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.546+0000 7fdde681b640 1 --2- 172.21.15.6:0/3009937113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdde0103570 0x7fdde01991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.546+0000 7fdde681b640 1 -- 172.21.15.6:0/3009937113 >> 172.21.15.6:0/3009937113 conn(0x7fdde00fcb70 msgr2=0x7fdde0104160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:59.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.546+0000 7fdde681b640 1 -- 172.21.15.6:0/3009937113 shutdown_connections 2024-05-20T17:06:59.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.546+0000 7fdde681b640 1 -- 172.21.15.6:0/3009937113 wait complete. 2024-05-20T17:06:59.557 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:06:59.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.680+0000 7f70506f0640 1 -- 172.21.15.6:0/1091505966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70481078c0 msgr2=0x7f7048109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.680+0000 7f70506f0640 1 --2- 172.21.15.6:0/1091505966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70481078c0 0x7f7048109ce0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7040009ca0 tx=0x7f704002a8c0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.680+0000 7f70506f0640 1 -- 172.21.15.6:0/1091505966 shutdown_connections 2024-05-20T17:06:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.680+0000 7f70506f0640 1 --2- 172.21.15.6:0/1091505966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70481078c0 0x7f7048109ce0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.680+0000 7f70506f0640 1 --2- 172.21.15.6:0/1091505966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7048102bc0 0x7f7048102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.680+0000 7f70506f0640 1 --2- 172.21.15.6:0/1091505966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7048101980 0x7f7048102680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.680+0000 7f70506f0640 1 -- 172.21.15.6:0/1091505966 >> 172.21.15.6:0/1091505966 conn(0x7f70480fcb70 msgr2=0x7f70480ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.680+0000 7f70506f0640 1 -- 172.21.15.6:0/1091505966 shutdown_connections 2024-05-20T17:06:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.680+0000 7f70506f0640 1 -- 172.21.15.6:0/1091505966 wait complete. 2024-05-20T17:06:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.680+0000 7f70506f0640 1 Processor -- start 2024-05-20T17:06:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.681+0000 7f70506f0640 1 -- start start 2024-05-20T17:06:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.681+0000 7f70506f0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7048101980 0x7f7048199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:59.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.681+0000 7f70506f0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7048102bc0 0x7f70481996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:59.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.681+0000 7f70506f0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70481078c0 0x7f70481a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:59.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.681+0000 7f70506f0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f704810e610 con 0x7f7048102bc0 2024-05-20T17:06:59.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.681+0000 7f70506f0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f704810e490 con 0x7f70481078c0 2024-05-20T17:06:59.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.681+0000 7f70506f0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f704810e790 con 0x7f7048101980 2024-05-20T17:06:59.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.681+0000 7f704dc8b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7048102bc0 0x7f70481996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:59.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.681+0000 7f704dc8b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7048102bc0 0x7f70481996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33132/0 (socket says 172.21.15.6:33132) 2024-05-20T17:06:59.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.681+0000 7f704dc8b640 1 -- 172.21.15.6:0/3448902429 learned_addr learned my addr 172.21.15.6:0/3448902429 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:06:59.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.681+0000 7f704ec8d640 1 --2- 172.21.15.6:0/3448902429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70481078c0 0x7f70481a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:59.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.681+0000 7f704e48c640 1 --2- 172.21.15.6:0/3448902429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7048101980 0x7f7048199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:59.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.681+0000 7f704dc8b640 1 -- 172.21.15.6:0/3448902429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7048101980 msgr2=0x7f7048199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:59.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.681+0000 7f704dc8b640 1 --2- 172.21.15.6:0/3448902429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7048101980 0x7f7048199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.681+0000 7f704dc8b640 1 -- 172.21.15.6:0/3448902429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70481078c0 msgr2=0x7f70481a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.681+0000 7f704dc8b640 1 --2- 172.21.15.6:0/3448902429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70481078c0 0x7f70481a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.681+0000 7f704dc8b640 1 -- 172.21.15.6:0/3448902429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70481a0cc0 con 0x7f7048102bc0 2024-05-20T17:06:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.681+0000 7f704dc8b640 1 --2- 172.21.15.6:0/3448902429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7048102bc0 0x7f70481996c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f703800e9f0 tx=0x7f703800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.681+0000 7f703f7fe640 1 -- 172.21.15.6:0/3448902429 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703800cd80 con 0x7f7048102bc0 2024-05-20T17:06:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.682+0000 7f703f7fe640 1 -- 172.21.15.6:0/3448902429 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f70380108e0 con 0x7f7048102bc0 2024-05-20T17:06:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.682+0000 7f70506f0640 1 -- 172.21.15.6:0/3448902429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70481a0fb0 con 0x7f7048102bc0 2024-05-20T17:06:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.682+0000 7f703f7fe640 1 -- 172.21.15.6:0/3448902429 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7038018920 con 0x7f7048102bc0 2024-05-20T17:06:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.682+0000 7f70506f0640 1 -- 172.21.15.6:0/3448902429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70481a1420 con 0x7f7048102bc0 2024-05-20T17:06:59.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.683+0000 7f70506f0640 1 -- 172.21.15.6:0/3448902429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70481066d0 con 0x7f7048102bc0 2024-05-20T17:06:59.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.684+0000 7f703f7fe640 1 -- 172.21.15.6:0/3448902429 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f7038010a90 con 0x7f7048102bc0 2024-05-20T17:06:59.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.685+0000 7f703f7fe640 1 --2- 172.21.15.6:0/3448902429 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f70340a2b90 0x7f70340a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:06:59.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.685+0000 7f704e48c640 1 --2- 172.21.15.6:0/3448902429 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f70340a2b90 0x7f70340a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:06:59.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.685+0000 7f703f7fe640 1 -- 172.21.15.6:0/3448902429 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f70380cfc90 con 0x7f7048102bc0 2024-05-20T17:06:59.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.686+0000 7f704e48c640 1 --2- 172.21.15.6:0/3448902429 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f70340a2b90 0x7f70340a50a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7048102580 tx=0x7f7044005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:06:59.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.689+0000 7f703f7fe640 1 -- 172.21.15.6:0/3448902429 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f703809c840 con 0x7f7048102bc0 2024-05-20T17:06:59.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.874+0000 7f70506f0640 1 -- 172.21.15.6:0/3448902429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f704802d430 con 0x7f7048102bc0 2024-05-20T17:06:59.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.875+0000 7f703f7fe640 1 -- 172.21.15.6:0/3448902429 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) ==== 100+0+11 (secure 0 0 0) 0x7f703809c140 con 0x7f7048102bc0 2024-05-20T17:06:59.874 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:06:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.877+0000 7f70506f0640 1 -- 172.21.15.6:0/3448902429 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f70340a2b90 msgr2=0x7f70340a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.877+0000 7f70506f0640 1 --2- 172.21.15.6:0/3448902429 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f70340a2b90 0x7f70340a50a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7048102580 tx=0x7f7044005f90 comp rx=0 tx=0).stop 2024-05-20T17:06:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.877+0000 7f70506f0640 1 -- 172.21.15.6:0/3448902429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7048102bc0 msgr2=0x7f70481996c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:06:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.877+0000 7f70506f0640 1 --2- 172.21.15.6:0/3448902429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7048102bc0 0x7f70481996c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f703800e9f0 tx=0x7f703800eeb0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.877+0000 7f70506f0640 1 -- 172.21.15.6:0/3448902429 shutdown_connections 2024-05-20T17:06:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.877+0000 7f70506f0640 1 --2- 172.21.15.6:0/3448902429 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f70340a2b90 0x7f70340a50a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.877+0000 7f70506f0640 1 --2- 172.21.15.6:0/3448902429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f70481078c0 0x7f70481a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.877+0000 7f70506f0640 1 --2- 172.21.15.6:0/3448902429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7048102bc0 0x7f70481996c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.877+0000 7f70506f0640 1 --2- 172.21.15.6:0/3448902429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7048101980 0x7f7048199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:06:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.877+0000 7f70506f0640 1 -- 172.21.15.6:0/3448902429 >> 172.21.15.6:0/3448902429 conn(0x7f70480fcb70 msgr2=0x7f70481038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:06:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.877+0000 7f70506f0640 1 -- 172.21.15.6:0/3448902429 shutdown_connections 2024-05-20T17:06:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:06:59.877+0000 7f70506f0640 1 -- 172.21.15.6:0/3448902429 wait complete. 2024-05-20T17:06:59.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:59 smithi006 ceph-mon[32486]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:06:59.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:59 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3042629247' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:06:59.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:59 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/592544913' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:06:59.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:06:59 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3009937113' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:06:59.888 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:07:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.006+0000 7fdfc006c640 1 -- 172.21.15.6:0/852197975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb8102bd0 msgr2=0x7fdfb8102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.006+0000 7fdfc006c640 1 --2- 172.21.15.6:0/852197975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb8102bd0 0x7fdfb8102fe0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009900 tx=0x7fdfac02a410 comp rx=0 tx=0).stop 2024-05-20T17:07:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.006+0000 7fdfc006c640 1 -- 172.21.15.6:0/852197975 shutdown_connections 2024-05-20T17:07:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.006+0000 7fdfc006c640 1 --2- 172.21.15.6:0/852197975 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfb81078d0 0x7fdfb8109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.006+0000 7fdfc006c640 1 --2- 172.21.15.6:0/852197975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb8102bd0 0x7fdfb8102fe0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.006+0000 7fdfc006c640 1 --2- 172.21.15.6:0/852197975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfb8101990 0x7fdfb8102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.006+0000 7fdfc006c640 1 -- 172.21.15.6:0/852197975 >> 172.21.15.6:0/852197975 conn(0x7fdfb80fcb80 msgr2=0x7fdfb80ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.006+0000 7fdfc006c640 1 -- 172.21.15.6:0/852197975 shutdown_connections 2024-05-20T17:07:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.006+0000 7fdfc006c640 1 -- 172.21.15.6:0/852197975 wait complete. 2024-05-20T17:07:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.007+0000 7fdfc006c640 1 Processor -- start 2024-05-20T17:07:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.007+0000 7fdfc006c640 1 -- start start 2024-05-20T17:07:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.007+0000 7fdfc006c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfb8101990 0x7fdfb8074810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.007+0000 7fdfc006c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb8102bd0 0x7fdfb819df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.007+0000 7fdfc006c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfb81078d0 0x7fdfb81a0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.007+0000 7fdfc006c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb810d490 con 0x7fdfb8102bd0 2024-05-20T17:07:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.007+0000 7fdfc006c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb810d310 con 0x7fdfb8101990 2024-05-20T17:07:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.007+0000 7fdfc006c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb810d610 con 0x7fdfb81078d0 2024-05-20T17:07:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.007+0000 7fdfbd607640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb8102bd0 0x7fdfb819df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.007+0000 7fdfbd607640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb8102bd0 0x7fdfb819df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33160/0 (socket says 172.21.15.6:33160) 2024-05-20T17:07:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.007+0000 7fdfbd607640 1 -- 172.21.15.6:0/2543893274 learned_addr learned my addr 172.21.15.6:0/2543893274 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.008+0000 7fdfbde08640 1 --2- 172.21.15.6:0/2543893274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfb8101990 0x7fdfb8074810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.008+0000 7fdfbe609640 1 --2- 172.21.15.6:0/2543893274 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfb81078d0 0x7fdfb81a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.008+0000 7fdfbd607640 1 -- 172.21.15.6:0/2543893274 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfb81078d0 msgr2=0x7fdfb81a0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.008+0000 7fdfbd607640 1 --2- 172.21.15.6:0/2543893274 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfb81078d0 0x7fdfb81a0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.008+0000 7fdfbd607640 1 -- 172.21.15.6:0/2543893274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfb8101990 msgr2=0x7fdfb8074810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.008+0000 7fdfbd607640 1 --2- 172.21.15.6:0/2543893274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfb8101990 0x7fdfb8074810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.008+0000 7fdfbd607640 1 -- 172.21.15.6:0/2543893274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb81a0c90 con 0x7fdfb8102bd0 2024-05-20T17:07:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.008+0000 7fdfbe609640 1 --2- 172.21.15.6:0/2543893274 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfb81078d0 0x7fdfb81a0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.008+0000 7fdfbd607640 1 --2- 172.21.15.6:0/2543893274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb8102bd0 0x7fdfb819df00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdfac004770 tx=0x7fdfac004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.008+0000 7fdfb6ffd640 1 -- 172.21.15.6:0/2543893274 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac03f030 con 0x7fdfb8102bd0 2024-05-20T17:07:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.008+0000 7fdfb6ffd640 1 -- 172.21.15.6:0/2543893274 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdfac003aa0 con 0x7fdfb8102bd0 2024-05-20T17:07:00.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.008+0000 7fdfc006c640 1 -- 172.21.15.6:0/2543893274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb81a0f20 con 0x7fdfb8102bd0 2024-05-20T17:07:00.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.008+0000 7fdfb6ffd640 1 -- 172.21.15.6:0/2543893274 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac035070 con 0x7fdfb8102bd0 2024-05-20T17:07:00.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.008+0000 7fdfc006c640 1 -- 172.21.15.6:0/2543893274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb81a1380 con 0x7fdfb8102bd0 2024-05-20T17:07:00.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.009+0000 7fdfc006c640 1 -- 172.21.15.6:0/2543893274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb81066e0 con 0x7fdfb8102bd0 2024-05-20T17:07:00.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.011+0000 7fdfb6ffd640 1 -- 172.21.15.6:0/2543893274 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fdfac042030 con 0x7fdfb8102bd0 2024-05-20T17:07:00.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.012+0000 7fdfb6ffd640 1 --2- 172.21.15.6:0/2543893274 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdfa00a2b90 0x7fdfa00a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:00.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.012+0000 7fdfbde08640 1 --2- 172.21.15.6:0/2543893274 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdfa00a2b90 0x7fdfa00a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:00.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.012+0000 7fdfb6ffd640 1 -- 172.21.15.6:0/2543893274 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fdfac0f02f0 con 0x7fdfb8102bd0 2024-05-20T17:07:00.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.013+0000 7fdfbde08640 1 --2- 172.21.15.6:0/2543893274 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdfa00a2b90 0x7fdfa00a50a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8102590 tx=0x7fdfa8009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:00.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.016+0000 7fdfb6ffd640 1 -- 172.21.15.6:0/2543893274 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fdfac0bce40 con 0x7fdfb8102bd0 2024-05-20T17:07:00.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:59 smithi062 ceph-mon[35425]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:07:00.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:59 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3042629247' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:07:00.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:59 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/592544913' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:07:00.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:06:59 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3009937113' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:07:00.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:59 smithi171 ceph-mon[35901]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:07:00.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:59 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3042629247' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:07:00.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:59 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/592544913' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:07:00.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:06:59 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3009937113' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:07:00.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.200+0000 7fdfc006c640 1 -- 172.21.15.6:0/2543893274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fdfb802d430 con 0x7fdfb8102bd0 2024-05-20T17:07:00.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.201+0000 7fdfb6ffd640 1 -- 172.21.15.6:0/2543893274 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) ==== 103+0+11 (secure 0 0 0) 0x7fdfac0bc740 con 0x7fdfb8102bd0 2024-05-20T17:07:00.200 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:07:00.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.203+0000 7fdfc006c640 1 -- 172.21.15.6:0/2543893274 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdfa00a2b90 msgr2=0x7fdfa00a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:00.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.203+0000 7fdfc006c640 1 --2- 172.21.15.6:0/2543893274 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdfa00a2b90 0x7fdfa00a50a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8102590 tx=0x7fdfa8009500 comp rx=0 tx=0).stop 2024-05-20T17:07:00.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.203+0000 7fdfc006c640 1 -- 172.21.15.6:0/2543893274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb8102bd0 msgr2=0x7fdfb819df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.203+0000 7fdfc006c640 1 --2- 172.21.15.6:0/2543893274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb8102bd0 0x7fdfb819df00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdfac004770 tx=0x7fdfac004270 comp rx=0 tx=0).stop 2024-05-20T17:07:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.203+0000 7fdfc006c640 1 -- 172.21.15.6:0/2543893274 shutdown_connections 2024-05-20T17:07:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.203+0000 7fdfc006c640 1 --2- 172.21.15.6:0/2543893274 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdfa00a2b90 0x7fdfa00a50a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.203+0000 7fdfc006c640 1 --2- 172.21.15.6:0/2543893274 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfb81078d0 0x7fdfb81a0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.203+0000 7fdfc006c640 1 --2- 172.21.15.6:0/2543893274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb8102bd0 0x7fdfb819df00 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.203+0000 7fdfc006c640 1 --2- 172.21.15.6:0/2543893274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfb8101990 0x7fdfb8074810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.203+0000 7fdfc006c640 1 -- 172.21.15.6:0/2543893274 >> 172.21.15.6:0/2543893274 conn(0x7fdfb80fcb80 msgr2=0x7fdfb81038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.203+0000 7fdfc006c640 1 -- 172.21.15.6:0/2543893274 shutdown_connections 2024-05-20T17:07:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.203+0000 7fdfc006c640 1 -- 172.21.15.6:0/2543893274 wait complete. 2024-05-20T17:07:00.214 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:07:00.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.330+0000 7fb271db5640 1 -- 172.21.15.6:0/2222810277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c1078f0 msgr2=0x7fb26c109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:00.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.330+0000 7fb271db5640 1 --2- 172.21.15.6:0/2222810277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c1078f0 0x7fb26c109d10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb264009ca0 tx=0x7fb26402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.330+0000 7fb271db5640 1 -- 172.21.15.6:0/2222810277 shutdown_connections 2024-05-20T17:07:00.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.330+0000 7fb271db5640 1 --2- 172.21.15.6:0/2222810277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c1078f0 0x7fb26c109d10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.330+0000 7fb271db5640 1 --2- 172.21.15.6:0/2222810277 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb26c102bf0 0x7fb26c103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.330+0000 7fb271db5640 1 --2- 172.21.15.6:0/2222810277 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb26c1019b0 0x7fb26c1026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.330+0000 7fb271db5640 1 -- 172.21.15.6:0/2222810277 >> 172.21.15.6:0/2222810277 conn(0x7fb26c0fcba0 msgr2=0x7fb26c0ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:00.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.330+0000 7fb271db5640 1 -- 172.21.15.6:0/2222810277 shutdown_connections 2024-05-20T17:07:00.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.330+0000 7fb271db5640 1 -- 172.21.15.6:0/2222810277 wait complete. 2024-05-20T17:07:00.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.331+0000 7fb271db5640 1 Processor -- start 2024-05-20T17:07:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.331+0000 7fb271db5640 1 -- start start 2024-05-20T17:07:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.331+0000 7fb271db5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb26c1019b0 0x7fb26c197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.331+0000 7fb271db5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb26c102bf0 0x7fb26c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.331+0000 7fb271db5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c1078f0 0x7fb26c19f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.331+0000 7fb271db5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c10d530 con 0x7fb26c1078f0 2024-05-20T17:07:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.331+0000 7fb271db5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c10d3b0 con 0x7fb26c102bf0 2024-05-20T17:07:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.331+0000 7fb271db5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c10d6b0 con 0x7fb26c1019b0 2024-05-20T17:07:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.331+0000 7fb26bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c1078f0 0x7fb26c19f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.331+0000 7fb26bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c1078f0 0x7fb26c19f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33182/0 (socket says 172.21.15.6:33182) 2024-05-20T17:07:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.331+0000 7fb26bfff640 1 -- 172.21.15.6:0/567365372 learned_addr learned my addr 172.21.15.6:0/567365372 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.331+0000 7fb26b7fe640 1 --2- 172.21.15.6:0/567365372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb26c1019b0 0x7fb26c197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:00.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.331+0000 7fb26affd640 1 --2- 172.21.15.6:0/567365372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb26c102bf0 0x7fb26c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:00.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.332+0000 7fb26bfff640 1 -- 172.21.15.6:0/567365372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb26c1019b0 msgr2=0x7fb26c197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:00.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.332+0000 7fb26bfff640 1 --2- 172.21.15.6:0/567365372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb26c1019b0 0x7fb26c197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.332+0000 7fb26bfff640 1 -- 172.21.15.6:0/567365372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb26c102bf0 msgr2=0x7fb26c1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:00.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.332+0000 7fb26bfff640 1 --2- 172.21.15.6:0/567365372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb26c102bf0 0x7fb26c1984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.332+0000 7fb26bfff640 1 -- 172.21.15.6:0/567365372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26c19faf0 con 0x7fb26c1078f0 2024-05-20T17:07:00.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.332+0000 7fb26affd640 1 --2- 172.21.15.6:0/567365372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb26c102bf0 0x7fb26c1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:07:00.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.332+0000 7fb26bfff640 1 --2- 172.21.15.6:0/567365372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c1078f0 0x7fb26c19f480 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb264031040 tx=0x7fb264003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:00.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.332+0000 7fb268ff9640 1 -- 172.21.15.6:0/567365372 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb264032ec0 con 0x7fb26c1078f0 2024-05-20T17:07:00.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.332+0000 7fb268ff9640 1 -- 172.21.15.6:0/567365372 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb2640044f0 con 0x7fb26c1078f0 2024-05-20T17:07:00.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.332+0000 7fb271db5640 1 -- 172.21.15.6:0/567365372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb26c19fd80 con 0x7fb26c1078f0 2024-05-20T17:07:00.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.332+0000 7fb268ff9640 1 -- 172.21.15.6:0/567365372 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb264030cb0 con 0x7fb26c1078f0 2024-05-20T17:07:00.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.332+0000 7fb271db5640 1 -- 172.21.15.6:0/567365372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb26c1a0210 con 0x7fb26c1078f0 2024-05-20T17:07:00.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.333+0000 7fb271db5640 1 -- 172.21.15.6:0/567365372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb26c105ff0 con 0x7fb26c1078f0 2024-05-20T17:07:00.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.334+0000 7fb268ff9640 1 -- 172.21.15.6:0/567365372 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fb264004040 con 0x7fb26c1078f0 2024-05-20T17:07:00.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.335+0000 7fb268ff9640 1 --2- 172.21.15.6:0/567365372 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb2540a2dd0 0x7fb2540a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:00.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.335+0000 7fb26b7fe640 1 --2- 172.21.15.6:0/567365372 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb2540a2dd0 0x7fb2540a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:00.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.335+0000 7fb268ff9640 1 -- 172.21.15.6:0/567365372 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fb2640f09f0 con 0x7fb26c1078f0 2024-05-20T17:07:00.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.336+0000 7fb26b7fe640 1 --2- 172.21.15.6:0/567365372 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb2540a2dd0 0x7fb2540a52e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb26c1025b0 tx=0x7fb25c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:00.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.340+0000 7fb268ff9640 1 -- 172.21.15.6:0/567365372 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb2640bd5a0 con 0x7fb26c1078f0 2024-05-20T17:07:00.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.564+0000 7fb271db5640 1 -- 172.21.15.6:0/567365372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb26c02d2a0 con 0x7fb26c1078f0 2024-05-20T17:07:00.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.565+0000 7fb268ff9640 1 -- 172.21.15.6:0/567365372 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11914 (secure 0 0 0) 0x7fb2640bcea0 con 0x7fb26c1078f0 2024-05-20T17:07:00.564 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:07:00.564 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:05:04.455743+0000","modified":"2024-05-20T17:05:35.584679+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24548,"mds_1":24526,"mds_2":24484,"mds_3":24470,"mds_4":24440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/3061403904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":3061403904},{"type":"v1","addr":"172.21.15.6:6839","nonce":3061403904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/223306009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":223306009},{"type":"v1","addr":"172.21.15.6:6841","nonce":223306009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.62:6835/78063155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":78063155},{"type":"v1","addr":"172.21.15.62:6835","nonce":78063155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.171:6835/1542537621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1542537621},{"type":"v1","addr":"172.21.15.171:6835","nonce":1542537621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/732693575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":732693575},{"type":"v1","addr":"172.21.15.171:6837","nonce":732693575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6837/1745943929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1745943929},{"type":"v1","addr":"172.21.15.62:6837","nonce":1745943929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.171:6839/3246292303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3246292303},{"type":"v1","addr":"172.21.15.171:6839","nonce":3246292303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6839/3023093487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3023093487},{"type":"v1","addr":"172.21.15.62:6839","nonce":3023093487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24548,"qdb_cluster":[24440,24548,24526,24470,24484]},"id":1}]} 2024-05-20T17:07:00.565 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 28 2024-05-20T17:07:00.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.567+0000 7fb271db5640 1 -- 172.21.15.6:0/567365372 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb2540a2dd0 msgr2=0x7fb2540a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:00.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.567+0000 7fb271db5640 1 --2- 172.21.15.6:0/567365372 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb2540a2dd0 0x7fb2540a52e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb26c1025b0 tx=0x7fb25c005f90 comp rx=0 tx=0).stop 2024-05-20T17:07:00.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.567+0000 7fb271db5640 1 -- 172.21.15.6:0/567365372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c1078f0 msgr2=0x7fb26c19f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:00.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.567+0000 7fb271db5640 1 --2- 172.21.15.6:0/567365372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c1078f0 0x7fb26c19f480 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb264031040 tx=0x7fb264003ba0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.567+0000 7fb271db5640 1 -- 172.21.15.6:0/567365372 shutdown_connections 2024-05-20T17:07:00.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.567+0000 7fb271db5640 1 --2- 172.21.15.6:0/567365372 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb2540a2dd0 0x7fb2540a52e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.567+0000 7fb271db5640 1 --2- 172.21.15.6:0/567365372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c1078f0 0x7fb26c19f480 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.567+0000 7fb271db5640 1 --2- 172.21.15.6:0/567365372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb26c102bf0 0x7fb26c1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.567+0000 7fb271db5640 1 --2- 172.21.15.6:0/567365372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb26c1019b0 0x7fb26c197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.567+0000 7fb271db5640 1 -- 172.21.15.6:0/567365372 >> 172.21.15.6:0/567365372 conn(0x7fb26c0fcba0 msgr2=0x7fb26c0ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:00.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.567+0000 7fb271db5640 1 -- 172.21.15.6:0/567365372 shutdown_connections 2024-05-20T17:07:00.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.567+0000 7fb271db5640 1 -- 172.21.15.6:0/567365372 wait complete. 2024-05-20T17:07:00.578 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:07:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.695+0000 7fbd9cfb5640 1 -- 172.21.15.6:0/2665912149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd98104120 msgr2=0x7fbd981022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.695+0000 7fbd9cfb5640 1 --2- 172.21.15.6:0/2665912149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd98104120 0x7fbd981022a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbd88009900 tx=0x7fbd8802a410 comp rx=0 tx=0).stop 2024-05-20T17:07:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.696+0000 7fbd9cfb5640 1 -- 172.21.15.6:0/2665912149 shutdown_connections 2024-05-20T17:07:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.696+0000 7fbd9cfb5640 1 --2- 172.21.15.6:0/2665912149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd98108a20 0x7fbd9810ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.696+0000 7fbd9cfb5640 1 --2- 172.21.15.6:0/2665912149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd981027e0 0x7fbd98102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.696+0000 7fbd9cfb5640 1 --2- 172.21.15.6:0/2665912149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd98104120 0x7fbd981022a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.696+0000 7fbd9cfb5640 1 -- 172.21.15.6:0/2665912149 >> 172.21.15.6:0/2665912149 conn(0x7fbd980fdcf0 msgr2=0x7fbd98100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.696+0000 7fbd9cfb5640 1 -- 172.21.15.6:0/2665912149 shutdown_connections 2024-05-20T17:07:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.696+0000 7fbd9cfb5640 1 -- 172.21.15.6:0/2665912149 wait complete. 2024-05-20T17:07:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.696+0000 7fbd9cfb5640 1 Processor -- start 2024-05-20T17:07:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.696+0000 7fbd9cfb5640 1 -- start start 2024-05-20T17:07:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd9cfb5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd981027e0 0x7fbd98199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd9cfb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd98104120 0x7fbd981997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd9cfb5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd98108a20 0x7fbd981a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd9cfb5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9810e720 con 0x7fbd981027e0 2024-05-20T17:07:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd9cfb5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9810e5a0 con 0x7fbd98104120 2024-05-20T17:07:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd9cfb5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9810e8a0 con 0x7fbd98108a20 2024-05-20T17:07:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd9659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd981027e0 0x7fbd98199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd9659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd981027e0 0x7fbd98199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58232/0 (socket says 172.21.15.6:58232) 2024-05-20T17:07:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd9659c640 1 -- 172.21.15.6:0/4245875579 learned_addr learned my addr 172.21.15.6:0/4245875579 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd95d9b640 1 --2- 172.21.15.6:0/4245875579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd98104120 0x7fbd981997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd96d9d640 1 --2- 172.21.15.6:0/4245875579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd98108a20 0x7fbd981a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd9659c640 1 -- 172.21.15.6:0/4245875579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd98108a20 msgr2=0x7fbd981a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd9659c640 1 --2- 172.21.15.6:0/4245875579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd98108a20 0x7fbd981a0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd9659c640 1 -- 172.21.15.6:0/4245875579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd98104120 msgr2=0x7fbd981997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd9659c640 1 --2- 172.21.15.6:0/4245875579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd98104120 0x7fbd981997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd9659c640 1 -- 172.21.15.6:0/4245875579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd981a0d80 con 0x7fbd981027e0 2024-05-20T17:07:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd95d9b640 1 --2- 172.21.15.6:0/4245875579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd98104120 0x7fbd981997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd9659c640 1 --2- 172.21.15.6:0/4245875579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd981027e0 0x7fbd98199290 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbd880314e0 tx=0x7fbd88003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd877fe640 1 -- 172.21.15.6:0/4245875579 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8803f070 con 0x7fbd981027e0 2024-05-20T17:07:00.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd877fe640 1 -- 172.21.15.6:0/4245875579 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd88031e40 con 0x7fbd981027e0 2024-05-20T17:07:00.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.697+0000 7fbd877fe640 1 -- 172.21.15.6:0/4245875579 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88035030 con 0x7fbd981027e0 2024-05-20T17:07:00.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.698+0000 7fbd9cfb5640 1 -- 172.21.15.6:0/4245875579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd981a1010 con 0x7fbd981027e0 2024-05-20T17:07:00.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.698+0000 7fbd9cfb5640 1 -- 172.21.15.6:0/4245875579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd981a1500 con 0x7fbd981027e0 2024-05-20T17:07:00.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.699+0000 7fbd9cfb5640 1 -- 172.21.15.6:0/4245875579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd980691c0 con 0x7fbd981027e0 2024-05-20T17:07:00.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.700+0000 7fbd877fe640 1 -- 172.21.15.6:0/4245875579 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fbd88042070 con 0x7fbd981027e0 2024-05-20T17:07:00.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.700+0000 7fbd877fe640 1 --2- 172.21.15.6:0/4245875579 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbd800a2c30 0x7fbd800a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:00.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.701+0000 7fbd95d9b640 1 --2- 172.21.15.6:0/4245875579 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbd800a2c30 0x7fbd800a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:00.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.701+0000 7fbd877fe640 1 -- 172.21.15.6:0/4245875579 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fbd880efdd0 con 0x7fbd981027e0 2024-05-20T17:07:00.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.701+0000 7fbd95d9b640 1 --2- 172.21.15.6:0/4245875579 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbd800a2c30 0x7fbd800a5140 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c005fd0 tx=0x7fbd8c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:00.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.705+0000 7fbd877fe640 1 -- 172.21.15.6:0/4245875579 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbd880bc980 con 0x7fbd981027e0 2024-05-20T17:07:00.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:00 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3448902429' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:07:00.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:00 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2543893274' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:07:00.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:00 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/567365372' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:07:00.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.891+0000 7fbd9cfb5640 1 -- 172.21.15.6:0/4245875579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd98062750 con 0x7fbd981027e0 2024-05-20T17:07:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.892+0000 7fbd877fe640 1 -- 172.21.15.6:0/4245875579 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+24584 (secure 0 0 0) 0x7fbd880bc280 con 0x7fbd981027e0 2024-05-20T17:07:00.892 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:07:00.892 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":94,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:06:44.581646+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:05:02.947896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:05:03.842231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:05:07.551471+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:07:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.894+0000 7fbd9cfb5640 1 -- 172.21.15.6:0/4245875579 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbd800a2c30 msgr2=0x7fbd800a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.894+0000 7fbd9cfb5640 1 --2- 172.21.15.6:0/4245875579 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbd800a2c30 0x7fbd800a5140 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c005fd0 tx=0x7fbd8c005850 comp rx=0 tx=0).stop 2024-05-20T17:07:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.894+0000 7fbd9cfb5640 1 -- 172.21.15.6:0/4245875579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd981027e0 msgr2=0x7fbd98199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.894+0000 7fbd9cfb5640 1 --2- 172.21.15.6:0/4245875579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd981027e0 0x7fbd98199290 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbd880314e0 tx=0x7fbd88003d50 comp rx=0 tx=0).stop 2024-05-20T17:07:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.895+0000 7fbd9cfb5640 1 -- 172.21.15.6:0/4245875579 shutdown_connections 2024-05-20T17:07:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.895+0000 7fbd9cfb5640 1 --2- 172.21.15.6:0/4245875579 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbd800a2c30 0x7fbd800a5140 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.895+0000 7fbd9cfb5640 1 --2- 172.21.15.6:0/4245875579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd98108a20 0x7fbd981a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.895+0000 7fbd9cfb5640 1 --2- 172.21.15.6:0/4245875579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd98104120 0x7fbd981997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.895+0000 7fbd9cfb5640 1 --2- 172.21.15.6:0/4245875579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd981027e0 0x7fbd98199290 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:00.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.895+0000 7fbd9cfb5640 1 -- 172.21.15.6:0/4245875579 >> 172.21.15.6:0/4245875579 conn(0x7fbd980fdcf0 msgr2=0x7fbd98104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:00.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.895+0000 7fbd9cfb5640 1 -- 172.21.15.6:0/4245875579 shutdown_connections 2024-05-20T17:07:00.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:00.895+0000 7fbd9cfb5640 1 -- 172.21.15.6:0/4245875579 wait complete. 2024-05-20T17:07:00.906 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:00:12.516679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:05:02.947896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:05:03.842231+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:05:07.551471+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:07:00.906 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:07:01.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:00 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3448902429' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:07:01.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:00 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2543893274' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:07:01.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:00 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/567365372' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:07:01.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.025+0000 7fa01f20d640 1 -- 172.21.15.6:0/789538554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0181031b0 msgr2=0x7fa0181055d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:01.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.025+0000 7fa01f20d640 1 --2- 172.21.15.6:0/789538554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0181031b0 0x7fa0181055d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa008009900 tx=0x7fa00802a410 comp rx=0 tx=0).stop 2024-05-20T17:07:01.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.025+0000 7fa01f20d640 1 -- 172.21.15.6:0/789538554 shutdown_connections 2024-05-20T17:07:01.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.025+0000 7fa01f20d640 1 --2- 172.21.15.6:0/789538554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa018108710 0x7fa01810ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.025+0000 7fa01f20d640 1 --2- 172.21.15.6:0/789538554 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa018105ba0 0x7fa018108080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.025+0000 7fa01f20d640 1 --2- 172.21.15.6:0/789538554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0181031b0 0x7fa0181055d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.025+0000 7fa01f20d640 1 -- 172.21.15.6:0/789538554 >> 172.21.15.6:0/789538554 conn(0x7fa0180fcb70 msgr2=0x7fa0180ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:01.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.025+0000 7fa01f20d640 1 -- 172.21.15.6:0/789538554 shutdown_connections 2024-05-20T17:07:01.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.025+0000 7fa01f20d640 1 -- 172.21.15.6:0/789538554 wait complete. 2024-05-20T17:07:01.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.025+0000 7fa01f20d640 1 Processor -- start 2024-05-20T17:07:01.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.025+0000 7fa01f20d640 1 -- start start 2024-05-20T17:07:01.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa01f20d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0181031b0 0x7fa0181991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:01.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa01f20d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa018105ba0 0x7fa0181996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:01.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa01f20d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa018108710 0x7fa0181a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:01.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa01f20d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa01810e570 con 0x7fa018108710 2024-05-20T17:07:01.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa01f20d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa01810e3f0 con 0x7fa018105ba0 2024-05-20T17:07:01.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa01f20d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa01810e6f0 con 0x7fa0181031b0 2024-05-20T17:07:01.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa01d7aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa018108710 0x7fa0181a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:01.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa01d7aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa018108710 0x7fa0181a0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58258/0 (socket says 172.21.15.6:58258) 2024-05-20T17:07:01.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa01d7aa640 1 -- 172.21.15.6:0/4084720343 learned_addr learned my addr 172.21.15.6:0/4084720343 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:01.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa01cfa9640 1 --2- 172.21.15.6:0/4084720343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0181031b0 0x7fa0181991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:01.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa01d7aa640 1 -- 172.21.15.6:0/4084720343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0181031b0 msgr2=0x7fa0181991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:01.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa01d7aa640 1 --2- 172.21.15.6:0/4084720343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0181031b0 0x7fa0181991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa017fff640 1 --2- 172.21.15.6:0/4084720343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa018105ba0 0x7fa0181996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:01.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa01d7aa640 1 -- 172.21.15.6:0/4084720343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa018105ba0 msgr2=0x7fa0181996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:01.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa01d7aa640 1 --2- 172.21.15.6:0/4084720343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa018105ba0 0x7fa0181996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa01d7aa640 1 -- 172.21.15.6:0/4084720343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0181a0cf0 con 0x7fa018108710 2024-05-20T17:07:01.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa01d7aa640 1 --2- 172.21.15.6:0/4084720343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa018108710 0x7fa0181a0680 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa01000eaa0 tx=0x7fa01000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:01.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa015ffb640 1 -- 172.21.15.6:0/4084720343 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01000cdb0 con 0x7fa018108710 2024-05-20T17:07:01.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa015ffb640 1 -- 172.21.15.6:0/4084720343 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa010005020 con 0x7fa018108710 2024-05-20T17:07:01.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa01f20d640 1 -- 172.21.15.6:0/4084720343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0181a0fe0 con 0x7fa018108710 2024-05-20T17:07:01.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.026+0000 7fa015ffb640 1 -- 172.21.15.6:0/4084720343 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0100116d0 con 0x7fa018108710 2024-05-20T17:07:01.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.027+0000 7fa01f20d640 1 -- 172.21.15.6:0/4084720343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0181a13f0 con 0x7fa018108710 2024-05-20T17:07:01.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.028+0000 7fa01f20d640 1 -- 172.21.15.6:0/4084720343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa018068d70 con 0x7fa018108710 2024-05-20T17:07:01.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.029+0000 7fa015ffb640 1 -- 172.21.15.6:0/4084720343 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fa0100051d0 con 0x7fa018108710 2024-05-20T17:07:01.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.029+0000 7fa015ffb640 1 --2- 172.21.15.6:0/4084720343 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa0000a2b90 0x7fa0000a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:01.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.030+0000 7fa01cfa9640 1 --2- 172.21.15.6:0/4084720343 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa0000a2b90 0x7fa0000a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:01.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.030+0000 7fa015ffb640 1 -- 172.21.15.6:0/4084720343 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fa0100cf710 con 0x7fa018108710 2024-05-20T17:07:01.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.030+0000 7fa01cfa9640 1 --2- 172.21.15.6:0/4084720343 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa0000a2b90 0x7fa0000a50a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa008000c00 tx=0x7fa008031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:01.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.035+0000 7fa015ffb640 1 -- 172.21.15.6:0/4084720343 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa010016030 con 0x7fa018108710 2024-05-20T17:07:01.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:00 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3448902429' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:07:01.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:00 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2543893274' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:07:01.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:00 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/567365372' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:07:01.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.221+0000 7fa01f20d640 1 -- 172.21.15.6:0/4084720343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa018062810 con 0x7fa018108710 2024-05-20T17:07:01.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.222+0000 7fa015ffb640 1 -- 172.21.15.6:0/4084720343 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) ==== 93+0+10 (secure 0 0 0) 0x7fa01009c260 con 0x7fa018108710 2024-05-20T17:07:01.221 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:07:01.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.224+0000 7fa01f20d640 1 -- 172.21.15.6:0/4084720343 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa0000a2b90 msgr2=0x7fa0000a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:01.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.224+0000 7fa01f20d640 1 --2- 172.21.15.6:0/4084720343 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa0000a2b90 0x7fa0000a50a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa008000c00 tx=0x7fa008031400 comp rx=0 tx=0).stop 2024-05-20T17:07:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.224+0000 7fa01f20d640 1 -- 172.21.15.6:0/4084720343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa018108710 msgr2=0x7fa0181a0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.224+0000 7fa01f20d640 1 --2- 172.21.15.6:0/4084720343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa018108710 0x7fa0181a0680 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa01000eaa0 tx=0x7fa01000ef60 comp rx=0 tx=0).stop 2024-05-20T17:07:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.224+0000 7fa01f20d640 1 -- 172.21.15.6:0/4084720343 shutdown_connections 2024-05-20T17:07:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.224+0000 7fa01f20d640 1 --2- 172.21.15.6:0/4084720343 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa0000a2b90 0x7fa0000a50a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.224+0000 7fa01f20d640 1 --2- 172.21.15.6:0/4084720343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa018108710 0x7fa0181a0680 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.224+0000 7fa01f20d640 1 --2- 172.21.15.6:0/4084720343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa018105ba0 0x7fa0181996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.224+0000 7fa01f20d640 1 --2- 172.21.15.6:0/4084720343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0181031b0 0x7fa0181991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.224+0000 7fa01f20d640 1 -- 172.21.15.6:0/4084720343 >> 172.21.15.6:0/4084720343 conn(0x7fa0180fcb70 msgr2=0x7fa0181051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.224+0000 7fa01f20d640 1 -- 172.21.15.6:0/4084720343 shutdown_connections 2024-05-20T17:07:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.224+0000 7fa01f20d640 1 -- 172.21.15.6:0/4084720343 wait complete. 2024-05-20T17:07:01.235 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:07:01.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.353+0000 7f163fd96640 1 -- 172.21.15.6:0/743124676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1638101990 msgr2=0x7f1638102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:01.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.353+0000 7f163fd96640 1 --2- 172.21.15.6:0/743124676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1638101990 0x7f1638102690 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1634009900 tx=0x7f163402a410 comp rx=0 tx=0).stop 2024-05-20T17:07:01.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.353+0000 7f163fd96640 1 -- 172.21.15.6:0/743124676 shutdown_connections 2024-05-20T17:07:01.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.353+0000 7f163fd96640 1 --2- 172.21.15.6:0/743124676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16381078d0 0x7f1638109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.353+0000 7f163fd96640 1 --2- 172.21.15.6:0/743124676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1638102bd0 0x7f1638102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.353+0000 7f163fd96640 1 --2- 172.21.15.6:0/743124676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1638101990 0x7f1638102690 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.353+0000 7f163fd96640 1 -- 172.21.15.6:0/743124676 >> 172.21.15.6:0/743124676 conn(0x7f16380fcb80 msgr2=0x7f16380ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:01.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.353+0000 7f163fd96640 1 -- 172.21.15.6:0/743124676 shutdown_connections 2024-05-20T17:07:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.353+0000 7f163fd96640 1 -- 172.21.15.6:0/743124676 wait complete. 2024-05-20T17:07:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.354+0000 7f163fd96640 1 Processor -- start 2024-05-20T17:07:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.354+0000 7f163fd96640 1 -- start start 2024-05-20T17:07:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.354+0000 7f163fd96640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1638101990 0x7f16381991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.354+0000 7f163fd96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1638102bd0 0x7f1638199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.354+0000 7f163fd96640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16381078d0 0x7f16381a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.354+0000 7f163fd96640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f163810e620 con 0x7f1638102bd0 2024-05-20T17:07:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.354+0000 7f163fd96640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f163810e4a0 con 0x7f16381078d0 2024-05-20T17:07:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.354+0000 7f163fd96640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f163810e7a0 con 0x7f1638101990 2024-05-20T17:07:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.354+0000 7f163d331640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1638102bd0 0x7f1638199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.354+0000 7f163d331640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1638102bd0 0x7f1638199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58288/0 (socket says 172.21.15.6:58288) 2024-05-20T17:07:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.354+0000 7f163d331640 1 -- 172.21.15.6:0/2475116839 learned_addr learned my addr 172.21.15.6:0/2475116839 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.354+0000 7f163db32640 1 --2- 172.21.15.6:0/2475116839 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1638101990 0x7f16381991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.355+0000 7f163e333640 1 --2- 172.21.15.6:0/2475116839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16381078d0 0x7f16381a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.355+0000 7f163d331640 1 -- 172.21.15.6:0/2475116839 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1638101990 msgr2=0x7f16381991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.355+0000 7f163d331640 1 --2- 172.21.15.6:0/2475116839 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1638101990 0x7f16381991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.355+0000 7f163d331640 1 -- 172.21.15.6:0/2475116839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16381078d0 msgr2=0x7f16381a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.355+0000 7f163d331640 1 --2- 172.21.15.6:0/2475116839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16381078d0 0x7f16381a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.355+0000 7f163d331640 1 -- 172.21.15.6:0/2475116839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16381a0c70 con 0x7f1638102bd0 2024-05-20T17:07:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.355+0000 7f163d331640 1 --2- 172.21.15.6:0/2475116839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1638102bd0 0x7f1638199720 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f162800e9f0 tx=0x7f162800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.355+0000 7f162effd640 1 -- 172.21.15.6:0/2475116839 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162800cd80 con 0x7f1638102bd0 2024-05-20T17:07:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.355+0000 7f162effd640 1 -- 172.21.15.6:0/2475116839 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16280108e0 con 0x7f1638102bd0 2024-05-20T17:07:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.355+0000 7f163fd96640 1 -- 172.21.15.6:0/2475116839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16381a0f60 con 0x7f1638102bd0 2024-05-20T17:07:01.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.355+0000 7f162effd640 1 -- 172.21.15.6:0/2475116839 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1628018920 con 0x7f1638102bd0 2024-05-20T17:07:01.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.355+0000 7f163fd96640 1 -- 172.21.15.6:0/2475116839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16381a1420 con 0x7f1638102bd0 2024-05-20T17:07:01.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.356+0000 7f163fd96640 1 -- 172.21.15.6:0/2475116839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16381066e0 con 0x7f1638102bd0 2024-05-20T17:07:01.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.357+0000 7f162effd640 1 -- 172.21.15.6:0/2475116839 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f1628010a90 con 0x7f1638102bd0 2024-05-20T17:07:01.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.358+0000 7f162effd640 1 --2- 172.21.15.6:0/2475116839 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f16240a2c10 0x7f16240a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:01.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.358+0000 7f162effd640 1 -- 172.21.15.6:0/2475116839 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f16280cf730 con 0x7f1638102bd0 2024-05-20T17:07:01.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.358+0000 7f163db32640 1 --2- 172.21.15.6:0/2475116839 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f16240a2c10 0x7f16240a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:01.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.359+0000 7f163db32640 1 --2- 172.21.15.6:0/2475116839 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f16240a2c10 0x7f16240a5120 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f163402a930 tx=0x7f1634031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.363+0000 7f162effd640 1 -- 172.21.15.6:0/2475116839 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f162809c280 con 0x7f1638102bd0 2024-05-20T17:07:01.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.547+0000 7f163fd96640 1 -- 172.21.15.6:0/2475116839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f163802d4c0 con 0x7f1638102bd0 2024-05-20T17:07:01.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.547+0000 7f162effd640 1 -- 172.21.15.6:0/2475116839 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) ==== 104+0+11 (secure 0 0 0) 0x7f162809bb80 con 0x7f1638102bd0 2024-05-20T17:07:01.547 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:07:01.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.549+0000 7f163fd96640 1 -- 172.21.15.6:0/2475116839 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f16240a2c10 msgr2=0x7f16240a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:01.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.549+0000 7f163fd96640 1 --2- 172.21.15.6:0/2475116839 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f16240a2c10 0x7f16240a5120 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f163402a930 tx=0x7f1634031400 comp rx=0 tx=0).stop 2024-05-20T17:07:01.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.549+0000 7f163fd96640 1 -- 172.21.15.6:0/2475116839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1638102bd0 msgr2=0x7f1638199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:01.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.549+0000 7f163fd96640 1 --2- 172.21.15.6:0/2475116839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1638102bd0 0x7f1638199720 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f162800e9f0 tx=0x7f162800eeb0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.550+0000 7f163fd96640 1 -- 172.21.15.6:0/2475116839 shutdown_connections 2024-05-20T17:07:01.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.550+0000 7f163fd96640 1 --2- 172.21.15.6:0/2475116839 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f16240a2c10 0x7f16240a5120 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.550+0000 7f163fd96640 1 --2- 172.21.15.6:0/2475116839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16381078d0 0x7f16381a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.550+0000 7f163fd96640 1 --2- 172.21.15.6:0/2475116839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1638102bd0 0x7f1638199720 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.550+0000 7f163fd96640 1 --2- 172.21.15.6:0/2475116839 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1638101990 0x7f16381991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.550+0000 7f163fd96640 1 -- 172.21.15.6:0/2475116839 >> 172.21.15.6:0/2475116839 conn(0x7f16380fcb80 msgr2=0x7f16381038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:01.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.550+0000 7f163fd96640 1 -- 172.21.15.6:0/2475116839 shutdown_connections 2024-05-20T17:07:01.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.550+0000 7f163fd96640 1 -- 172.21.15.6:0/2475116839 wait complete. 2024-05-20T17:07:01.561 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:07:01.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.679+0000 7f20a0fc7640 1 -- 172.21.15.6:0/679343767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f209c108830 msgr2=0x7f209c10ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:01.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.679+0000 7f20a0fc7640 1 --2- 172.21.15.6:0/679343767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f209c108830 0x7f209c10ac50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2094009900 tx=0x7f209402a410 comp rx=0 tx=0).stop 2024-05-20T17:07:01.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.679+0000 7f20a0fc7640 1 -- 172.21.15.6:0/679343767 shutdown_connections 2024-05-20T17:07:01.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.679+0000 7f20a0fc7640 1 --2- 172.21.15.6:0/679343767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f209c108830 0x7f209c10ac50 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.679+0000 7f20a0fc7640 1 --2- 172.21.15.6:0/679343767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f209c105ed0 0x7f209c1082f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.679+0000 7f20a0fc7640 1 --2- 172.21.15.6:0/679343767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f209c103570 0x7f209c105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.679+0000 7f20a0fc7640 1 -- 172.21.15.6:0/679343767 >> 172.21.15.6:0/679343767 conn(0x7f209c0fcb70 msgr2=0x7f209c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:01.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.679+0000 7f20a0fc7640 1 -- 172.21.15.6:0/679343767 shutdown_connections 2024-05-20T17:07:01.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.679+0000 7f20a0fc7640 1 -- 172.21.15.6:0/679343767 wait complete. 2024-05-20T17:07:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.680+0000 7f20a0fc7640 1 Processor -- start 2024-05-20T17:07:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.680+0000 7f20a0fc7640 1 -- start start 2024-05-20T17:07:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.680+0000 7f20a0fc7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f209c103570 0x7f209c1029c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.680+0000 7f20a0fc7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f209c105ed0 0x7f209c101060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.680+0000 7f20a0fc7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f209c108830 0x7f209c1015a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.680+0000 7f20a0fc7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f209c10e590 con 0x7f209c103570 2024-05-20T17:07:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.680+0000 7f20a0fc7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f209c10e410 con 0x7f209c108830 2024-05-20T17:07:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.680+0000 7f20a0fc7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f209c10e710 con 0x7f209c105ed0 2024-05-20T17:07:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.680+0000 7f209a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f209c103570 0x7f209c1029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.680+0000 7f209a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f209c103570 0x7f209c1029c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58294/0 (socket says 172.21.15.6:58294) 2024-05-20T17:07:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.680+0000 7f209a59c640 1 -- 172.21.15.6:0/310901275 learned_addr learned my addr 172.21.15.6:0/310901275 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.681+0000 7f2099d9b640 1 --2- 172.21.15.6:0/310901275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f209c105ed0 0x7f209c101060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.681+0000 7f209ad9d640 1 --2- 172.21.15.6:0/310901275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f209c108830 0x7f209c1015a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.681+0000 7f209a59c640 1 -- 172.21.15.6:0/310901275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f209c105ed0 msgr2=0x7f209c101060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.681+0000 7f209a59c640 1 --2- 172.21.15.6:0/310901275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f209c105ed0 0x7f209c101060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.681+0000 7f209a59c640 1 -- 172.21.15.6:0/310901275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f209c108830 msgr2=0x7f209c1015a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.681+0000 7f209a59c640 1 --2- 172.21.15.6:0/310901275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f209c108830 0x7f209c1015a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.681+0000 7f209a59c640 1 -- 172.21.15.6:0/310901275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c101cd0 con 0x7f209c103570 2024-05-20T17:07:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.681+0000 7f209a59c640 1 --2- 172.21.15.6:0/310901275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f209c103570 0x7f209c1029c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f208c00e9c0 tx=0x7f208c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.684+0000 7f208b7fe640 1 -- 172.21.15.6:0/310901275 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c00cd80 con 0x7f209c103570 2024-05-20T17:07:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.684+0000 7f208b7fe640 1 -- 172.21.15.6:0/310901275 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f208c0054d0 con 0x7f209c103570 2024-05-20T17:07:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.684+0000 7f20a0fc7640 1 -- 172.21.15.6:0/310901275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209c1a3200 con 0x7f209c103570 2024-05-20T17:07:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.684+0000 7f208b7fe640 1 -- 172.21.15.6:0/310901275 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c010430 con 0x7f209c103570 2024-05-20T17:07:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.684+0000 7f20a0fc7640 1 -- 172.21.15.6:0/310901275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f209c1a36f0 con 0x7f209c103570 2024-05-20T17:07:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.685+0000 7f20a0fc7640 1 -- 172.21.15.6:0/310901275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f209c0fe690 con 0x7f209c103570 2024-05-20T17:07:01.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.686+0000 7f208b7fe640 1 -- 172.21.15.6:0/310901275 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f208c004fb0 con 0x7f209c103570 2024-05-20T17:07:01.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.687+0000 7f208b7fe640 1 --2- 172.21.15.6:0/310901275 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f20840a2c10 0x7f20840a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:01.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.687+0000 7f2099d9b640 1 --2- 172.21.15.6:0/310901275 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f20840a2c10 0x7f20840a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:01.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.687+0000 7f208b7fe640 1 -- 172.21.15.6:0/310901275 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f208c0cf8a0 con 0x7f209c103570 2024-05-20T17:07:01.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.687+0000 7f2099d9b640 1 --2- 172.21.15.6:0/310901275 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f20840a2c10 0x7f20840a5120 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f209c102360 tx=0x7f2090009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:01.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.692+0000 7f208b7fe640 1 -- 172.21.15.6:0/310901275 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f208c09c3f0 con 0x7f209c103570 2024-05-20T17:07:01.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.875+0000 7f20a0fc7640 1 -- 172.21.15.6:0/310901275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f209c062750 con 0x7f209c103570 2024-05-20T17:07:01.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.875+0000 7f208b7fe640 1 -- 172.21.15.6:0/310901275 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) ==== 100+0+11 (secure 0 0 0) 0x7f208c09bcf0 con 0x7f209c103570 2024-05-20T17:07:01.875 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:07:01.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.877+0000 7f20a0fc7640 1 -- 172.21.15.6:0/310901275 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f20840a2c10 msgr2=0x7f20840a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:01.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.877+0000 7f20a0fc7640 1 --2- 172.21.15.6:0/310901275 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f20840a2c10 0x7f20840a5120 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f209c102360 tx=0x7f2090009680 comp rx=0 tx=0).stop 2024-05-20T17:07:01.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.877+0000 7f20a0fc7640 1 -- 172.21.15.6:0/310901275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f209c103570 msgr2=0x7f209c1029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:01.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.877+0000 7f20a0fc7640 1 --2- 172.21.15.6:0/310901275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f209c103570 0x7f209c1029c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f208c00e9c0 tx=0x7f208c00ee80 comp rx=0 tx=0).stop 2024-05-20T17:07:01.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.877+0000 7f20a0fc7640 1 -- 172.21.15.6:0/310901275 shutdown_connections 2024-05-20T17:07:01.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.877+0000 7f20a0fc7640 1 --2- 172.21.15.6:0/310901275 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f20840a2c10 0x7f20840a5120 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.877+0000 7f20a0fc7640 1 --2- 172.21.15.6:0/310901275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f209c108830 0x7f209c1015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.877+0000 7f20a0fc7640 1 --2- 172.21.15.6:0/310901275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f209c105ed0 0x7f209c101060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.877+0000 7f20a0fc7640 1 --2- 172.21.15.6:0/310901275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f209c103570 0x7f209c1029c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:01.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.877+0000 7f20a0fc7640 1 -- 172.21.15.6:0/310901275 >> 172.21.15.6:0/310901275 conn(0x7f209c0fcb70 msgr2=0x7f209c104140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:01.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.878+0000 7f20a0fc7640 1 -- 172.21.15.6:0/310901275 shutdown_connections 2024-05-20T17:07:01.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:01.878+0000 7f20a0fc7640 1 -- 172.21.15.6:0/310901275 wait complete. 2024-05-20T17:07:01.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:01 smithi006 ceph-mon[32486]: pgmap v363: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:07:01.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:01 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/4245875579' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:07:01.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:01 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/4084720343' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:07:01.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:01 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2475116839' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:07:01.889 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:07:02.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.009+0000 7ffbc75d5640 1 -- 172.21.15.6:0/119583628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc0108830 msgr2=0x7ffbc010ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:02.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.009+0000 7ffbc75d5640 1 --2- 172.21.15.6:0/119583628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc0108830 0x7ffbc010ac50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009ca0 tx=0x7ffbb802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.009+0000 7ffbc75d5640 1 -- 172.21.15.6:0/119583628 shutdown_connections 2024-05-20T17:07:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.009+0000 7ffbc75d5640 1 --2- 172.21.15.6:0/119583628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc0108830 0x7ffbc010ac50 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.009+0000 7ffbc75d5640 1 --2- 172.21.15.6:0/119583628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbc0105ed0 0x7ffbc01082f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.009+0000 7ffbc75d5640 1 --2- 172.21.15.6:0/119583628 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbc0103570 0x7ffbc0105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.009+0000 7ffbc75d5640 1 -- 172.21.15.6:0/119583628 >> 172.21.15.6:0/119583628 conn(0x7ffbc00fcb70 msgr2=0x7ffbc00ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.009+0000 7ffbc75d5640 1 -- 172.21.15.6:0/119583628 shutdown_connections 2024-05-20T17:07:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.009+0000 7ffbc75d5640 1 -- 172.21.15.6:0/119583628 wait complete. 2024-05-20T17:07:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.009+0000 7ffbc75d5640 1 Processor -- start 2024-05-20T17:07:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.010+0000 7ffbc75d5640 1 -- start start 2024-05-20T17:07:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.010+0000 7ffbc75d5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbc0103570 0x7ffbc0199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.010+0000 7ffbc75d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc0105ed0 0x7ffbc01996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.010+0000 7ffbc75d5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbc0108830 0x7ffbc01a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.010+0000 7ffbc75d5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc010e5b0 con 0x7ffbc0105ed0 2024-05-20T17:07:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.010+0000 7ffbc75d5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc010e430 con 0x7ffbc0108830 2024-05-20T17:07:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.010+0000 7ffbc75d5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc010e730 con 0x7ffbc0103570 2024-05-20T17:07:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.010+0000 7ffbc4b70640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc0105ed0 0x7ffbc01996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.010+0000 7ffbc4b70640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc0105ed0 0x7ffbc01996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58308/0 (socket says 172.21.15.6:58308) 2024-05-20T17:07:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.010+0000 7ffbc4b70640 1 -- 172.21.15.6:0/446972469 learned_addr learned my addr 172.21.15.6:0/446972469 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.010+0000 7ffbc5371640 1 --2- 172.21.15.6:0/446972469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbc0103570 0x7ffbc0199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.010+0000 7ffbc5b72640 1 --2- 172.21.15.6:0/446972469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbc0108830 0x7ffbc01a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.010+0000 7ffbc4b70640 1 -- 172.21.15.6:0/446972469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbc0103570 msgr2=0x7ffbc0199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.010+0000 7ffbc4b70640 1 --2- 172.21.15.6:0/446972469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbc0103570 0x7ffbc0199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.010+0000 7ffbc4b70640 1 -- 172.21.15.6:0/446972469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbc0108830 msgr2=0x7ffbc01a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.010+0000 7ffbc4b70640 1 --2- 172.21.15.6:0/446972469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbc0108830 0x7ffbc01a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.010+0000 7ffbc4b70640 1 -- 172.21.15.6:0/446972469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc01a0ca0 con 0x7ffbc0105ed0 2024-05-20T17:07:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.011+0000 7ffbc4b70640 1 --2- 172.21.15.6:0/446972469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc0105ed0 0x7ffbc01996a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000c890 tx=0x7ffbb000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.011+0000 7ffbb67fc640 1 -- 172.21.15.6:0/446972469 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0004220 con 0x7ffbc0105ed0 2024-05-20T17:07:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.011+0000 7ffbb67fc640 1 -- 172.21.15.6:0/446972469 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffbb00043c0 con 0x7ffbc0105ed0 2024-05-20T17:07:02.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.011+0000 7ffbc75d5640 1 -- 172.21.15.6:0/446972469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc01a0f90 con 0x7ffbc0105ed0 2024-05-20T17:07:02.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.011+0000 7ffbb67fc640 1 -- 172.21.15.6:0/446972469 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0004a00 con 0x7ffbc0105ed0 2024-05-20T17:07:02.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.011+0000 7ffbc75d5640 1 -- 172.21.15.6:0/446972469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc01a1400 con 0x7ffbc0105ed0 2024-05-20T17:07:02.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.012+0000 7ffbc75d5640 1 -- 172.21.15.6:0/446972469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc00fe690 con 0x7ffbc0105ed0 2024-05-20T17:07:02.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.013+0000 7ffbb67fc640 1 -- 172.21.15.6:0/446972469 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7ffbb0004ba0 con 0x7ffbc0105ed0 2024-05-20T17:07:02.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.014+0000 7ffbb67fc640 1 --2- 172.21.15.6:0/446972469 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ffbac0a2b90 0x7ffbac0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:02.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.014+0000 7ffbb67fc640 1 -- 172.21.15.6:0/446972469 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7ffbb00cf490 con 0x7ffbc0105ed0 2024-05-20T17:07:02.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.014+0000 7ffbc5371640 1 --2- 172.21.15.6:0/446972469 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ffbac0a2b90 0x7ffbac0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:02.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.015+0000 7ffbc5371640 1 --2- 172.21.15.6:0/446972469 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ffbac0a2b90 0x7ffbac0a50a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc005fd0 tx=0x7ffbbc00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:02.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.018+0000 7ffbb67fc640 1 -- 172.21.15.6:0/446972469 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ffbb0014030 con 0x7ffbc0105ed0 2024-05-20T17:07:02.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:01 smithi062 ceph-mon[35425]: pgmap v363: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:07:02.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:01 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/4245875579' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:07:02.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:01 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/4084720343' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:07:02.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:01 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2475116839' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:07:02.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:01 smithi171 ceph-mon[35901]: pgmap v363: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-20T17:07:02.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:01 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/4245875579' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:07:02.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:01 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/4084720343' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:07:02.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:01 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2475116839' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:07:02.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.203+0000 7ffbc75d5640 1 -- 172.21.15.6:0/446972469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ffbc002d4f0 con 0x7ffbc0105ed0 2024-05-20T17:07:02.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.204+0000 7ffbb67fc640 1 -- 172.21.15.6:0/446972469 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) ==== 103+0+11 (secure 0 0 0) 0x7ffbb009c040 con 0x7ffbc0105ed0 2024-05-20T17:07:02.203 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:07:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.205+0000 7ffbc75d5640 1 -- 172.21.15.6:0/446972469 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ffbac0a2b90 msgr2=0x7ffbac0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.205+0000 7ffbc75d5640 1 --2- 172.21.15.6:0/446972469 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ffbac0a2b90 0x7ffbac0a50a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc005fd0 tx=0x7ffbbc00b390 comp rx=0 tx=0).stop 2024-05-20T17:07:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.205+0000 7ffbc75d5640 1 -- 172.21.15.6:0/446972469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc0105ed0 msgr2=0x7ffbc01996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.205+0000 7ffbc75d5640 1 --2- 172.21.15.6:0/446972469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc0105ed0 0x7ffbc01996a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000c890 tx=0x7ffbb000cd50 comp rx=0 tx=0).stop 2024-05-20T17:07:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.205+0000 7ffbc75d5640 1 -- 172.21.15.6:0/446972469 shutdown_connections 2024-05-20T17:07:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.205+0000 7ffbc75d5640 1 --2- 172.21.15.6:0/446972469 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ffbac0a2b90 0x7ffbac0a50a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.205+0000 7ffbc75d5640 1 --2- 172.21.15.6:0/446972469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbc0108830 0x7ffbc01a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.205+0000 7ffbc75d5640 1 --2- 172.21.15.6:0/446972469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbc0105ed0 0x7ffbc01996a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.205+0000 7ffbc75d5640 1 --2- 172.21.15.6:0/446972469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbc0103570 0x7ffbc0199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.205+0000 7ffbc75d5640 1 -- 172.21.15.6:0/446972469 >> 172.21.15.6:0/446972469 conn(0x7ffbc00fcb70 msgr2=0x7ffbc0104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:02.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.206+0000 7ffbc75d5640 1 -- 172.21.15.6:0/446972469 shutdown_connections 2024-05-20T17:07:02.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.206+0000 7ffbc75d5640 1 -- 172.21.15.6:0/446972469 wait complete. 2024-05-20T17:07:02.217 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:07:02.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.332+0000 7f4249565640 1 -- 172.21.15.6:0/934778405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42441078f0 msgr2=0x7f4244109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:02.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.332+0000 7f4249565640 1 --2- 172.21.15.6:0/934778405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42441078f0 0x7f4244109d10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f423c009ca0 tx=0x7f423c02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.332+0000 7f4249565640 1 -- 172.21.15.6:0/934778405 shutdown_connections 2024-05-20T17:07:02.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.332+0000 7f4249565640 1 --2- 172.21.15.6:0/934778405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42441078f0 0x7f4244109d10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.333+0000 7f4249565640 1 --2- 172.21.15.6:0/934778405 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4244102bf0 0x7f4244103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.333+0000 7f4249565640 1 --2- 172.21.15.6:0/934778405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42441019b0 0x7f42441026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.333+0000 7f4249565640 1 -- 172.21.15.6:0/934778405 >> 172.21.15.6:0/934778405 conn(0x7f42440fcba0 msgr2=0x7f42440ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:02.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.333+0000 7f4249565640 1 -- 172.21.15.6:0/934778405 shutdown_connections 2024-05-20T17:07:02.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.333+0000 7f4249565640 1 -- 172.21.15.6:0/934778405 wait complete. 2024-05-20T17:07:02.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.333+0000 7f4249565640 1 Processor -- start 2024-05-20T17:07:02.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.333+0000 7f4249565640 1 -- start start 2024-05-20T17:07:02.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.333+0000 7f4249565640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42441019b0 0x7f4244199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:02.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.333+0000 7f4249565640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4244102bf0 0x7f4244199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:02.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.333+0000 7f4249565640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42441078f0 0x7f42441a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:02.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.333+0000 7f4249565640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f424410d4e0 con 0x7f4244102bf0 2024-05-20T17:07:02.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.333+0000 7f4249565640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f424410d360 con 0x7f42441078f0 2024-05-20T17:07:02.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.333+0000 7f4249565640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f424410d660 con 0x7f42441019b0 2024-05-20T17:07:02.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.334+0000 7f423bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4244102bf0 0x7f4244199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:02.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.334+0000 7f423bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4244102bf0 0x7f4244199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58334/0 (socket says 172.21.15.6:58334) 2024-05-20T17:07:02.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.334+0000 7f423bfff640 1 -- 172.21.15.6:0/2949996130 learned_addr learned my addr 172.21.15.6:0/2949996130 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:02.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.334+0000 7f4242ffd640 1 --2- 172.21.15.6:0/2949996130 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42441019b0 0x7f4244199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:02.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.334+0000 7f42437fe640 1 --2- 172.21.15.6:0/2949996130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42441078f0 0x7f42441a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:02.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.334+0000 7f423bfff640 1 -- 172.21.15.6:0/2949996130 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42441019b0 msgr2=0x7f4244199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:02.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.334+0000 7f423bfff640 1 --2- 172.21.15.6:0/2949996130 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42441019b0 0x7f4244199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.334+0000 7f423bfff640 1 -- 172.21.15.6:0/2949996130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42441078f0 msgr2=0x7f42441a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:02.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.334+0000 7f423bfff640 1 --2- 172.21.15.6:0/2949996130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42441078f0 0x7f42441a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.334+0000 7f423bfff640 1 -- 172.21.15.6:0/2949996130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42441a0bf0 con 0x7f4244102bf0 2024-05-20T17:07:02.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.334+0000 7f42437fe640 1 --2- 172.21.15.6:0/2949996130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42441078f0 0x7f42441a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:07:02.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.334+0000 7f4242ffd640 1 --2- 172.21.15.6:0/2949996130 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42441019b0 0x7f4244199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:07:02.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.334+0000 7f423bfff640 1 --2- 172.21.15.6:0/2949996130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4244102bf0 0x7f4244199660 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f422c00e9f0 tx=0x7f422c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:02.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.334+0000 7f4240ff9640 1 -- 172.21.15.6:0/2949996130 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c00cd80 con 0x7f4244102bf0 2024-05-20T17:07:02.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.334+0000 7f4240ff9640 1 -- 172.21.15.6:0/2949996130 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f422c0054d0 con 0x7f4244102bf0 2024-05-20T17:07:02.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.334+0000 7f4249565640 1 -- 172.21.15.6:0/2949996130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42441a0ee0 con 0x7f4244102bf0 2024-05-20T17:07:02.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.334+0000 7f4240ff9640 1 -- 172.21.15.6:0/2949996130 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c010490 con 0x7f4244102bf0 2024-05-20T17:07:02.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.334+0000 7f4249565640 1 -- 172.21.15.6:0/2949996130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42441a1350 con 0x7f4244102bf0 2024-05-20T17:07:02.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.335+0000 7f4249565640 1 -- 172.21.15.6:0/2949996130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42441a1610 con 0x7f4244102bf0 2024-05-20T17:07:02.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.338+0000 7f4240ff9640 1 -- 172.21.15.6:0/2949996130 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f422c005000 con 0x7f4244102bf0 2024-05-20T17:07:02.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.338+0000 7f4240ff9640 1 --2- 172.21.15.6:0/2949996130 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f42300a2cb0 0x7f42300a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:02.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.339+0000 7f4242ffd640 1 --2- 172.21.15.6:0/2949996130 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f42300a2cb0 0x7f42300a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:02.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.339+0000 7f4240ff9640 1 -- 172.21.15.6:0/2949996130 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f422c0cfa60 con 0x7f4244102bf0 2024-05-20T17:07:02.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.339+0000 7f4242ffd640 1 --2- 172.21.15.6:0/2949996130 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f42300a2cb0 0x7f42300a51c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4234005d00 tx=0x7f4234005ef0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:02.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.342+0000 7f4240ff9640 1 -- 172.21.15.6:0/2949996130 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f422c053850 con 0x7f4244102bf0 2024-05-20T17:07:02.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.565+0000 7f4249565640 1 -- 172.21.15.6:0/2949996130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4244106ff0 con 0x7f4244102bf0 2024-05-20T17:07:02.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.566+0000 7f4240ff9640 1 -- 172.21.15.6:0/2949996130 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11914 (secure 0 0 0) 0x7f422c0052f0 con 0x7f4244102bf0 2024-05-20T17:07:02.566 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:07:02.566 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:05:04.455743+0000","modified":"2024-05-20T17:05:35.584679+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24548,"mds_1":24526,"mds_2":24484,"mds_3":24470,"mds_4":24440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/3061403904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":3061403904},{"type":"v1","addr":"172.21.15.6:6839","nonce":3061403904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/223306009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":223306009},{"type":"v1","addr":"172.21.15.6:6841","nonce":223306009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.62:6835/78063155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":78063155},{"type":"v1","addr":"172.21.15.62:6835","nonce":78063155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.171:6835/1542537621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1542537621},{"type":"v1","addr":"172.21.15.171:6835","nonce":1542537621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/732693575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":732693575},{"type":"v1","addr":"172.21.15.171:6837","nonce":732693575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6837/1745943929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1745943929},{"type":"v1","addr":"172.21.15.62:6837","nonce":1745943929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.171:6839/3246292303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3246292303},{"type":"v1","addr":"172.21.15.171:6839","nonce":3246292303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6839/3023093487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3023093487},{"type":"v1","addr":"172.21.15.62:6839","nonce":3023093487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24548,"qdb_cluster":[24440,24548,24526,24470,24484]},"id":1}]} 2024-05-20T17:07:02.566 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 28 2024-05-20T17:07:02.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.568+0000 7f4249565640 1 -- 172.21.15.6:0/2949996130 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f42300a2cb0 msgr2=0x7f42300a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:02.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.568+0000 7f4249565640 1 --2- 172.21.15.6:0/2949996130 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f42300a2cb0 0x7f42300a51c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4234005d00 tx=0x7f4234005ef0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.568+0000 7f4249565640 1 -- 172.21.15.6:0/2949996130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4244102bf0 msgr2=0x7f4244199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:02.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.568+0000 7f4249565640 1 --2- 172.21.15.6:0/2949996130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4244102bf0 0x7f4244199660 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f422c00e9f0 tx=0x7f422c00edf0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.568+0000 7f4249565640 1 -- 172.21.15.6:0/2949996130 shutdown_connections 2024-05-20T17:07:02.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.568+0000 7f4249565640 1 --2- 172.21.15.6:0/2949996130 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f42300a2cb0 0x7f42300a51c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.568+0000 7f4249565640 1 --2- 172.21.15.6:0/2949996130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42441078f0 0x7f42441a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.568+0000 7f4249565640 1 --2- 172.21.15.6:0/2949996130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4244102bf0 0x7f4244199660 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.568+0000 7f4249565640 1 --2- 172.21.15.6:0/2949996130 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42441019b0 0x7f4244199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.568+0000 7f4249565640 1 -- 172.21.15.6:0/2949996130 >> 172.21.15.6:0/2949996130 conn(0x7f42440fcba0 msgr2=0x7f4244100050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:02.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.568+0000 7f4249565640 1 -- 172.21.15.6:0/2949996130 shutdown_connections 2024-05-20T17:07:02.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.568+0000 7f4249565640 1 -- 172.21.15.6:0/2949996130 wait complete. 2024-05-20T17:07:02.580 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:07:02.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.696+0000 7fe56a172640 1 -- 172.21.15.6:0/3246372779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe564103cf0 msgr2=0x7fe564104100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:02.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.696+0000 7fe56a172640 1 --2- 172.21.15.6:0/3246372779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe564103cf0 0x7fe564104100 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009900 tx=0x7fe54c02a410 comp rx=0 tx=0).stop 2024-05-20T17:07:02.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.696+0000 7fe56a172640 1 -- 172.21.15.6:0/3246372779 shutdown_connections 2024-05-20T17:07:02.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.696+0000 7fe56a172640 1 --2- 172.21.15.6:0/3246372779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5641089f0 0x7fe56410ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.696+0000 7fe56a172640 1 --2- 172.21.15.6:0/3246372779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe564103cf0 0x7fe564104100 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.696+0000 7fe56a172640 1 --2- 172.21.15.6:0/3246372779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe564102ab0 0x7fe5641037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.696+0000 7fe56a172640 1 -- 172.21.15.6:0/3246372779 >> 172.21.15.6:0/3246372779 conn(0x7fe5640fdca0 msgr2=0x7fe564100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:02.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.696+0000 7fe56a172640 1 -- 172.21.15.6:0/3246372779 shutdown_connections 2024-05-20T17:07:02.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.696+0000 7fe56a172640 1 -- 172.21.15.6:0/3246372779 wait complete. 2024-05-20T17:07:02.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.697+0000 7fe56a172640 1 Processor -- start 2024-05-20T17:07:02.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.697+0000 7fe56a172640 1 -- start start 2024-05-20T17:07:02.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.697+0000 7fe56a172640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe564102ab0 0x7fe564199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:02.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.697+0000 7fe56a172640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe564103cf0 0x7fe564199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:02.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.697+0000 7fe56a172640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5641089f0 0x7fe5641a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:02.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.697+0000 7fe56a172640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe56410e620 con 0x7fe5641089f0 2024-05-20T17:07:02.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.697+0000 7fe56a172640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe56410e4a0 con 0x7fe564103cf0 2024-05-20T17:07:02.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.697+0000 7fe56a172640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe56410e7a0 con 0x7fe564102ab0 2024-05-20T17:07:02.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.697+0000 7fe563fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5641089f0 0x7fe5641a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:02.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.697+0000 7fe563fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5641089f0 0x7fe5641a05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58352/0 (socket says 172.21.15.6:58352) 2024-05-20T17:07:02.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.697+0000 7fe563fff640 1 -- 172.21.15.6:0/2807621347 learned_addr learned my addr 172.21.15.6:0/2807621347 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:02.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.697+0000 7fe5637fe640 1 --2- 172.21.15.6:0/2807621347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe564102ab0 0x7fe564199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:02.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.697+0000 7fe55affd640 1 --2- 172.21.15.6:0/2807621347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe564103cf0 0x7fe564199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:02.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.698+0000 7fe563fff640 1 -- 172.21.15.6:0/2807621347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe564102ab0 msgr2=0x7fe564199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:02.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.698+0000 7fe563fff640 1 --2- 172.21.15.6:0/2807621347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe564102ab0 0x7fe564199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.698+0000 7fe563fff640 1 -- 172.21.15.6:0/2807621347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe564103cf0 msgr2=0x7fe564199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:02.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.698+0000 7fe563fff640 1 --2- 172.21.15.6:0/2807621347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe564103cf0 0x7fe564199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.698+0000 7fe563fff640 1 -- 172.21.15.6:0/2807621347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5641a0c40 con 0x7fe5641089f0 2024-05-20T17:07:02.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.698+0000 7fe563fff640 1 --2- 172.21.15.6:0/2807621347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5641089f0 0x7fe5641a05d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00cad0 tx=0x7fe55c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:02.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.698+0000 7fe5617fa640 1 -- 172.21.15.6:0/2807621347 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c00ae20 con 0x7fe5641089f0 2024-05-20T17:07:02.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.698+0000 7fe5617fa640 1 -- 172.21.15.6:0/2807621347 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe55c005020 con 0x7fe5641089f0 2024-05-20T17:07:02.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.698+0000 7fe56a172640 1 -- 172.21.15.6:0/2807621347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5641a0f30 con 0x7fe5641089f0 2024-05-20T17:07:02.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.698+0000 7fe5617fa640 1 -- 172.21.15.6:0/2807621347 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c00f6b0 con 0x7fe5641089f0 2024-05-20T17:07:02.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.698+0000 7fe56a172640 1 -- 172.21.15.6:0/2807621347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5641a1390 con 0x7fe5641089f0 2024-05-20T17:07:02.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.699+0000 7fe56a172640 1 -- 172.21.15.6:0/2807621347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe564068da0 con 0x7fe5641089f0 2024-05-20T17:07:02.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.700+0000 7fe5617fa640 1 -- 172.21.15.6:0/2807621347 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fe55c0051d0 con 0x7fe5641089f0 2024-05-20T17:07:02.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.701+0000 7fe5617fa640 1 --2- 172.21.15.6:0/2807621347 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe5500a2cb0 0x7fe5500a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:02.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.701+0000 7fe5617fa640 1 -- 172.21.15.6:0/2807621347 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fe55c0cf350 con 0x7fe5641089f0 2024-05-20T17:07:02.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.701+0000 7fe5637fe640 1 --2- 172.21.15.6:0/2807621347 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe5500a2cb0 0x7fe5500a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:02.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.702+0000 7fe5637fe640 1 --2- 172.21.15.6:0/2807621347 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe5500a2cb0 0x7fe5500a51c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe554005fd0 tx=0x7fe55400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:02.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.706+0000 7fe5617fa640 1 -- 172.21.15.6:0/2807621347 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe564068da0 con 0x7fe5641089f0 2024-05-20T17:07:02.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:02 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/310901275' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:07:02.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:02 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/446972469' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:07:02.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:02 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2949996130' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:07:02.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.896+0000 7fe56a172640 1 -- 172.21.15.6:0/2807621347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe56402d320 con 0x7fe5641089f0 2024-05-20T17:07:02.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.897+0000 7fe5617fa640 1 -- 172.21.15.6:0/2807621347 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+24584 (secure 0 0 0) 0x7fe55c014030 con 0x7fe5641089f0 2024-05-20T17:07:02.897 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:07:02.897 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":94,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:06:44.581646+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:05:02.947896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:05:03.842231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:05:07.551471+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:07:02.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.899+0000 7fe56a172640 1 -- 172.21.15.6:0/2807621347 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe5500a2cb0 msgr2=0x7fe5500a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:02.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.899+0000 7fe56a172640 1 --2- 172.21.15.6:0/2807621347 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe5500a2cb0 0x7fe5500a51c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe554005fd0 tx=0x7fe55400b390 comp rx=0 tx=0).stop 2024-05-20T17:07:02.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.899+0000 7fe56a172640 1 -- 172.21.15.6:0/2807621347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5641089f0 msgr2=0x7fe5641a05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:02.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.899+0000 7fe56a172640 1 --2- 172.21.15.6:0/2807621347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5641089f0 0x7fe5641a05d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00cad0 tx=0x7fe55c00cf90 comp rx=0 tx=0).stop 2024-05-20T17:07:02.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.900+0000 7fe56a172640 1 -- 172.21.15.6:0/2807621347 shutdown_connections 2024-05-20T17:07:02.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.900+0000 7fe56a172640 1 --2- 172.21.15.6:0/2807621347 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe5500a2cb0 0x7fe5500a51c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.900+0000 7fe56a172640 1 --2- 172.21.15.6:0/2807621347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5641089f0 0x7fe5641a05d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.900+0000 7fe56a172640 1 --2- 172.21.15.6:0/2807621347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe564103cf0 0x7fe564199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.900+0000 7fe56a172640 1 --2- 172.21.15.6:0/2807621347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe564102ab0 0x7fe564199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:02.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.900+0000 7fe56a172640 1 -- 172.21.15.6:0/2807621347 >> 172.21.15.6:0/2807621347 conn(0x7fe5640fdca0 msgr2=0x7fe5641049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:02.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.900+0000 7fe56a172640 1 -- 172.21.15.6:0/2807621347 shutdown_connections 2024-05-20T17:07:02.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:02.900+0000 7fe56a172640 1 -- 172.21.15.6:0/2807621347 wait complete. 2024-05-20T17:07:02.911 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:07:03.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:02 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/310901275' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:07:03.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:02 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/446972469' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:07:03.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:02 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2949996130' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:07:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.028+0000 7fe802056640 1 -- 172.21.15.6:0/1366587366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7fc108a20 msgr2=0x7fe7fc10ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.028+0000 7fe802056640 1 --2- 172.21.15.6:0/1366587366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7fc108a20 0x7fe7fc10ae40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4009900 tx=0x7fe7f402a410 comp rx=0 tx=0).stop 2024-05-20T17:07:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.028+0000 7fe802056640 1 -- 172.21.15.6:0/1366587366 shutdown_connections 2024-05-20T17:07:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.028+0000 7fe802056640 1 --2- 172.21.15.6:0/1366587366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7fc108a20 0x7fe7fc10ae40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.028+0000 7fe802056640 1 --2- 172.21.15.6:0/1366587366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7fc1027e0 0x7fe7fc102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.028+0000 7fe802056640 1 --2- 172.21.15.6:0/1366587366 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7fc104120 0x7fe7fc1022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.028+0000 7fe802056640 1 -- 172.21.15.6:0/1366587366 >> 172.21.15.6:0/1366587366 conn(0x7fe7fc0fdcf0 msgr2=0x7fe7fc100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.028+0000 7fe802056640 1 -- 172.21.15.6:0/1366587366 shutdown_connections 2024-05-20T17:07:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.028+0000 7fe802056640 1 -- 172.21.15.6:0/1366587366 wait complete. 2024-05-20T17:07:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.029+0000 7fe802056640 1 Processor -- start 2024-05-20T17:07:03.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.029+0000 7fe802056640 1 -- start start 2024-05-20T17:07:03.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.029+0000 7fe802056640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7fc1027e0 0x7fe7fc199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.029+0000 7fe802056640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7fc104120 0x7fe7fc199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.029+0000 7fe802056640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7fc108a20 0x7fe7fc1a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.029+0000 7fe802056640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe7fc10e720 con 0x7fe7fc104120 2024-05-20T17:07:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.029+0000 7fe802056640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe7fc10e5a0 con 0x7fe7fc1027e0 2024-05-20T17:07:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.029+0000 7fe802056640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe7fc10e8a0 con 0x7fe7fc108a20 2024-05-20T17:07:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.029+0000 7fe7faffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7fc104120 0x7fe7fc199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.029+0000 7fe7faffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7fc104120 0x7fe7fc199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58364/0 (socket says 172.21.15.6:58364) 2024-05-20T17:07:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.029+0000 7fe7faffd640 1 -- 172.21.15.6:0/3184463034 learned_addr learned my addr 172.21.15.6:0/3184463034 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.030+0000 7fe7fbfff640 1 --2- 172.21.15.6:0/3184463034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7fc108a20 0x7fe7fc1a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.030+0000 7fe7fb7fe640 1 --2- 172.21.15.6:0/3184463034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7fc1027e0 0x7fe7fc199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.030+0000 7fe7faffd640 1 -- 172.21.15.6:0/3184463034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7fc108a20 msgr2=0x7fe7fc1a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.030+0000 7fe7faffd640 1 --2- 172.21.15.6:0/3184463034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7fc108a20 0x7fe7fc1a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.030+0000 7fe7faffd640 1 -- 172.21.15.6:0/3184463034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7fc1027e0 msgr2=0x7fe7fc199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.030+0000 7fe7faffd640 1 --2- 172.21.15.6:0/3184463034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7fc1027e0 0x7fe7fc199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.030+0000 7fe7faffd640 1 -- 172.21.15.6:0/3184463034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7fc1a0d40 con 0x7fe7fc104120 2024-05-20T17:07:03.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.030+0000 7fe7fb7fe640 1 --2- 172.21.15.6:0/3184463034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7fc1027e0 0x7fe7fc199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:03.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.030+0000 7fe7faffd640 1 --2- 172.21.15.6:0/3184463034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7fc104120 0x7fe7fc199740 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400e9f0 tx=0x7fe7e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.030+0000 7fe7f8ff9640 1 -- 172.21.15.6:0/3184463034 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e400cd80 con 0x7fe7fc104120 2024-05-20T17:07:03.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.030+0000 7fe7f8ff9640 1 -- 172.21.15.6:0/3184463034 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe7e40108e0 con 0x7fe7fc104120 2024-05-20T17:07:03.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.030+0000 7fe802056640 1 -- 172.21.15.6:0/3184463034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7fc1a0fd0 con 0x7fe7fc104120 2024-05-20T17:07:03.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.030+0000 7fe7f8ff9640 1 -- 172.21.15.6:0/3184463034 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4018920 con 0x7fe7fc104120 2024-05-20T17:07:03.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.030+0000 7fe802056640 1 -- 172.21.15.6:0/3184463034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7fc1a14c0 con 0x7fe7fc104120 2024-05-20T17:07:03.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.031+0000 7fe802056640 1 -- 172.21.15.6:0/3184463034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7fc0691c0 con 0x7fe7fc104120 2024-05-20T17:07:03.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.033+0000 7fe7f8ff9640 1 -- 172.21.15.6:0/3184463034 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fe7e4010a90 con 0x7fe7fc104120 2024-05-20T17:07:03.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.033+0000 7fe7f8ff9640 1 --2- 172.21.15.6:0/3184463034 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe7e80a2c30 0x7fe7e80a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.034+0000 7fe7f8ff9640 1 -- 172.21.15.6:0/3184463034 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fe7e40cfcb0 con 0x7fe7fc104120 2024-05-20T17:07:03.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.034+0000 7fe7fb7fe640 1 --2- 172.21.15.6:0/3184463034 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe7e80a2c30 0x7fe7e80a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.034+0000 7fe7fb7fe640 1 --2- 172.21.15.6:0/3184463034 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe7e80a2c30 0x7fe7e80a5140 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc1036e0 tx=0x7fe7ec009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.037+0000 7fe7f8ff9640 1 -- 172.21.15.6:0/3184463034 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe7e409c800 con 0x7fe7fc104120 2024-05-20T17:07:03.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:02 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/310901275' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:07:03.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:02 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/446972469' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:07:03.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:02 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2949996130' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:07:03.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.261+0000 7fe802056640 1 -- 172.21.15.6:0/3184463034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7fc02d2a0 con 0x7fe7fc104120 2024-05-20T17:07:03.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.262+0000 7fe7f8ff9640 1 -- 172.21.15.6:0/3184463034 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11914 (secure 0 0 0) 0x7fe7e409c100 con 0x7fe7fc104120 2024-05-20T17:07:03.261 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:07:03.261 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:05:04.455743+0000","modified":"2024-05-20T17:05:35.584679+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24548,"mds_1":24526,"mds_2":24484,"mds_3":24470,"mds_4":24440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/3061403904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":3061403904},{"type":"v1","addr":"172.21.15.6:6839","nonce":3061403904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/223306009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":223306009},{"type":"v1","addr":"172.21.15.6:6841","nonce":223306009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.62:6835/78063155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":78063155},{"type":"v1","addr":"172.21.15.62:6835","nonce":78063155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.171:6835/1542537621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1542537621},{"type":"v1","addr":"172.21.15.171:6835","nonce":1542537621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/732693575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":732693575},{"type":"v1","addr":"172.21.15.171:6837","nonce":732693575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6837/1745943929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1745943929},{"type":"v1","addr":"172.21.15.62:6837","nonce":1745943929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.171:6839/3246292303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3246292303},{"type":"v1","addr":"172.21.15.171:6839","nonce":3246292303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6839/3023093487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3023093487},{"type":"v1","addr":"172.21.15.62:6839","nonce":3023093487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24548,"qdb_cluster":[24440,24548,24526,24470,24484]},"id":1}]} 2024-05-20T17:07:03.262 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 28 2024-05-20T17:07:03.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.264+0000 7fe802056640 1 -- 172.21.15.6:0/3184463034 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe7e80a2c30 msgr2=0x7fe7e80a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.264+0000 7fe802056640 1 --2- 172.21.15.6:0/3184463034 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe7e80a2c30 0x7fe7e80a5140 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc1036e0 tx=0x7fe7ec009500 comp rx=0 tx=0).stop 2024-05-20T17:07:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.264+0000 7fe802056640 1 -- 172.21.15.6:0/3184463034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7fc104120 msgr2=0x7fe7fc199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.264+0000 7fe802056640 1 --2- 172.21.15.6:0/3184463034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7fc104120 0x7fe7fc199740 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400e9f0 tx=0x7fe7e400eeb0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.264+0000 7fe802056640 1 -- 172.21.15.6:0/3184463034 shutdown_connections 2024-05-20T17:07:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.264+0000 7fe802056640 1 --2- 172.21.15.6:0/3184463034 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe7e80a2c30 0x7fe7e80a5140 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.264+0000 7fe802056640 1 --2- 172.21.15.6:0/3184463034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7fc108a20 0x7fe7fc1a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.264+0000 7fe802056640 1 --2- 172.21.15.6:0/3184463034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7fc104120 0x7fe7fc199740 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.264+0000 7fe802056640 1 --2- 172.21.15.6:0/3184463034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7fc1027e0 0x7fe7fc199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.264+0000 7fe802056640 1 -- 172.21.15.6:0/3184463034 >> 172.21.15.6:0/3184463034 conn(0x7fe7fc0fdcf0 msgr2=0x7fe7fc104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.264+0000 7fe802056640 1 -- 172.21.15.6:0/3184463034 shutdown_connections 2024-05-20T17:07:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.264+0000 7fe802056640 1 -- 172.21.15.6:0/3184463034 wait complete. 2024-05-20T17:07:03.275 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-20T17:05:04.455743+0000', 'modified': '2024-05-20T17:05:35.584679+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24548, 'mds_1': 24526, 'mds_2': 24484, 'mds_3': 24470, 'mds_4': 24440}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14631': {'gid': 14631, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.6:6839/3061403904', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6838', 'nonce': 3061403904}, {'type': 'v1', 'addr': '172.21.15.6:6839', 'nonce': 3061403904}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14643': {'gid': 14643, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.6:6841/223306009', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6840', 'nonce': 223306009}, {'type': 'v1', 'addr': '172.21.15.6:6841', 'nonce': 223306009}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24433': {'gid': 24433, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.171:6833/1476847062', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6832', 'nonce': 1476847062}, {'type': 'v1', 'addr': '172.21.15.171:6833', 'nonce': 1476847062}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24440': {'gid': 24440, 'name': 'k', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.62:6833/3854589553', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 3854589553}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 3854589553}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'e', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.62:6835/78063155', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 78063155}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 78063155}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24484': {'gid': 24484, 'name': 'f', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.171:6835/1542537621', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6834', 'nonce': 1542537621}, {'type': 'v1', 'addr': '172.21.15.171:6835', 'nonce': 1542537621}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.171:6837/732693575', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6836', 'nonce': 732693575}, {'type': 'v1', 'addr': '172.21.15.171:6837', 'nonce': 732693575}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24509': {'gid': 24509, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.62:6837/1745943929', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6836', 'nonce': 1745943929}, {'type': 'v1', 'addr': '172.21.15.62:6837', 'nonce': 1745943929}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24526': {'gid': 24526, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.171:6839/3246292303', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6838', 'nonce': 3246292303}, {'type': 'v1', 'addr': '172.21.15.171:6839', 'nonce': 3246292303}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24548': {'gid': 24548, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6839/3023093487', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6838', 'nonce': 3023093487}, {'type': 'v1', 'addr': '172.21.15.62:6839', 'nonce': 3023093487}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24548, 'qdb_cluster': [24440, 24548, 24526, 24470, 24484]} 2024-05-20T17:07:03.276 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-20T17:07:03.276 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.k status 2024-05-20T17:07:03.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.392+0000 7f11df2f0640 1 -- 172.21.15.6:0/2811061663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11d8101990 msgr2=0x7f11d8102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.392+0000 7f11df2f0640 1 --2- 172.21.15.6:0/2811061663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11d8101990 0x7f11d8102690 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f11d4009900 tx=0x7f11d402a3f0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.392+0000 7f11df2f0640 1 -- 172.21.15.6:0/2811061663 shutdown_connections 2024-05-20T17:07:03.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.392+0000 7f11df2f0640 1 --2- 172.21.15.6:0/2811061663 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11d81078d0 0x7f11d8109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.392+0000 7f11df2f0640 1 --2- 172.21.15.6:0/2811061663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11d8102bd0 0x7f11d8102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.392+0000 7f11df2f0640 1 --2- 172.21.15.6:0/2811061663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11d8101990 0x7f11d8102690 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.392+0000 7f11df2f0640 1 -- 172.21.15.6:0/2811061663 >> 172.21.15.6:0/2811061663 conn(0x7f11d80fcb80 msgr2=0x7f11d80ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.392+0000 7f11df2f0640 1 -- 172.21.15.6:0/2811061663 shutdown_connections 2024-05-20T17:07:03.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.392+0000 7f11df2f0640 1 -- 172.21.15.6:0/2811061663 wait complete. 2024-05-20T17:07:03.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.393+0000 7f11df2f0640 1 Processor -- start 2024-05-20T17:07:03.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.393+0000 7f11df2f0640 1 -- start start 2024-05-20T17:07:03.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.393+0000 7f11df2f0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11d8101990 0x7f11d8199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.393+0000 7f11df2f0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11d8102bd0 0x7f11d8199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.393+0000 7f11df2f0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11d81078d0 0x7f11d81a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.393+0000 7f11df2f0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f11d810d470 con 0x7f11d8101990 2024-05-20T17:07:03.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.393+0000 7f11df2f0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f11d810d2f0 con 0x7f11d81078d0 2024-05-20T17:07:03.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.393+0000 7f11df2f0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f11d810d5f0 con 0x7f11d8102bd0 2024-05-20T17:07:03.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.393+0000 7f11dd08c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11d8101990 0x7f11d8199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.393+0000 7f11dd08c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11d8101990 0x7f11d8199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58386/0 (socket says 172.21.15.6:58386) 2024-05-20T17:07:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.393+0000 7f11dd08c640 1 -- 172.21.15.6:0/3851440025 learned_addr learned my addr 172.21.15.6:0/3851440025 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.393+0000 7f11dd88d640 1 --2- 172.21.15.6:0/3851440025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11d81078d0 0x7f11d81a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.393+0000 7f11dc88b640 1 --2- 172.21.15.6:0/3851440025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11d8102bd0 0x7f11d8199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.393+0000 7f11dd08c640 1 -- 172.21.15.6:0/3851440025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11d8102bd0 msgr2=0x7f11d8199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.393+0000 7f11dd08c640 1 --2- 172.21.15.6:0/3851440025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11d8102bd0 0x7f11d8199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.393+0000 7f11dd08c640 1 -- 172.21.15.6:0/3851440025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11d81078d0 msgr2=0x7f11d81a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.393+0000 7f11dd08c640 1 --2- 172.21.15.6:0/3851440025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11d81078d0 0x7f11d81a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.393+0000 7f11dd08c640 1 -- 172.21.15.6:0/3851440025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d81a0c90 con 0x7f11d8101990 2024-05-20T17:07:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.394+0000 7f11dd08c640 1 --2- 172.21.15.6:0/3851440025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11d8101990 0x7f11d8199200 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f11d40314e0 tx=0x7f11d4004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.394+0000 7f11ce7fc640 1 -- 172.21.15.6:0/3851440025 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d403f030 con 0x7f11d8101990 2024-05-20T17:07:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.394+0000 7f11ce7fc640 1 -- 172.21.15.6:0/3851440025 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f11d4003cb0 con 0x7f11d8101990 2024-05-20T17:07:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.394+0000 7f11df2f0640 1 -- 172.21.15.6:0/3851440025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d81a0f20 con 0x7f11d8101990 2024-05-20T17:07:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.394+0000 7f11ce7fc640 1 -- 172.21.15.6:0/3851440025 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d4035070 con 0x7f11d8101990 2024-05-20T17:07:03.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.394+0000 7f11df2f0640 1 -- 172.21.15.6:0/3851440025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d81a1380 con 0x7f11d8101990 2024-05-20T17:07:03.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.397+0000 7f11e619a740 1 Processor -- start 2024-05-20T17:07:03.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.397+0000 7f11ce7fc640 1 -- 172.21.15.6:0/3851440025 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f11d4042030 con 0x7f11d8101990 2024-05-20T17:07:03.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.397+0000 7f11e619a740 1 -- start start 2024-05-20T17:07:03.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.397+0000 7f11e619a740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e43bc270 0x55f7e475c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.397+0000 7f11e619a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f7e43933b0 0x55f7e475c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.397+0000 7f11e619a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e439b590 0x55f7e47638f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.397+0000 7f11e619a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f7e46c04d0 con 0x55f7e439b590 2024-05-20T17:07:03.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.397+0000 7f11e619a740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f7e46683e0 con 0x55f7e43bc270 2024-05-20T17:07:03.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.397+0000 7f11e619a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f7e46bc490 con 0x55f7e43933b0 2024-05-20T17:07:03.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.397+0000 7f11dc88b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e439b590 0x55f7e47638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.397+0000 7f11dc88b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e439b590 0x55f7e47638f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58398/0 (socket says 172.21.15.6:58398) 2024-05-20T17:07:03.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.397+0000 7f11dc88b640 1 -- 172.21.15.6:0/1048296938 learned_addr learned my addr 172.21.15.6:0/1048296938 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.397+0000 7f11dd08c640 1 --2- 172.21.15.6:0/1048296938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f7e43933b0 0x55f7e475c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.397+0000 7f11ce7fc640 1 --2- 172.21.15.6:0/3851440025 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f11c40a2c10 0x7f11c40a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.397+0000 7f11dd88d640 1 --2- 172.21.15.6:0/1048296938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e43bc270 0x55f7e475c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.398+0000 7f11dc88b640 1 -- 172.21.15.6:0/1048296938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f7e43933b0 msgr2=0x55f7e475c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.398+0000 7f11dc88b640 1 --2- 172.21.15.6:0/1048296938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f7e43933b0 0x55f7e475c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.398+0000 7f11dc88b640 1 -- 172.21.15.6:0/1048296938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e43bc270 msgr2=0x55f7e475c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.398+0000 7f11dc88b640 1 --2- 172.21.15.6:0/1048296938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e43bc270 0x55f7e475c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.398+0000 7f11dc88b640 1 -- 172.21.15.6:0/1048296938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7e43d42d0 con 0x55f7e439b590 2024-05-20T17:07:03.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.398+0000 7f11dd88d640 1 --2- 172.21.15.6:0/1048296938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e43bc270 0x55f7e475c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:07:03.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.398+0000 7f11ce7fc640 1 -- 172.21.15.6:0/3851440025 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f11d40efe10 con 0x7f11d8101990 2024-05-20T17:07:03.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.398+0000 7f11dd88d640 1 --2- 172.21.15.6:0/3851440025 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f11c40a2c10 0x7f11c40a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.398+0000 7f11dc88b640 1 --2- 172.21.15.6:0/1048296938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e439b590 0x55f7e47638f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f11c800cbb0 tx=0x7f11c800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0dd10b43f861c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.398+0000 7f11c37fe640 1 -- 172.21.15.6:0/1048296938 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8005220 con 0x55f7e439b590 2024-05-20T17:07:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.398+0000 7f11c37fe640 1 -- 172.21.15.6:0/1048296938 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f11c8004c50 con 0x55f7e439b590 2024-05-20T17:07:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.398+0000 7f11c37fe640 1 -- 172.21.15.6:0/1048296938 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8010720 con 0x55f7e439b590 2024-05-20T17:07:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.399+0000 7f11e619a740 1 -- 172.21.15.6:0/1048296938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e439b590 msgr2=0x55f7e47638f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.399+0000 7f11dd88d640 1 --2- 172.21.15.6:0/3851440025 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f11c40a2c10 0x7f11c40a5120 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55f7e475d640 tx=0x7f11d0004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.399+0000 7f11e619a740 1 --2- 172.21.15.6:0/1048296938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e439b590 0x55f7e47638f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f11c800cbb0 tx=0x7f11c800e720 comp rx=0 tx=0).stop 2024-05-20T17:07:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.399+0000 7f11e619a740 1 -- 172.21.15.6:0/1048296938 shutdown_connections 2024-05-20T17:07:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.399+0000 7f11e619a740 1 --2- 172.21.15.6:0/1048296938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e439b590 0x55f7e47638f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.399+0000 7f11e619a740 1 --2- 172.21.15.6:0/1048296938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f7e43933b0 0x55f7e475c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.399+0000 7f11e619a740 1 --2- 172.21.15.6:0/1048296938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e43bc270 0x55f7e475c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.399+0000 7f11e619a740 1 -- 172.21.15.6:0/1048296938 >> 172.21.15.6:0/1048296938 conn(0x55f7e43b03c0 msgr2=0x55f7e4757e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.399+0000 7f11e619a740 1 -- 172.21.15.6:0/1048296938 shutdown_connections 2024-05-20T17:07:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.399+0000 7f11e619a740 1 -- 172.21.15.6:0/1048296938 wait complete. 2024-05-20T17:07:03.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.399+0000 7f11e619a740 1 -- start start 2024-05-20T17:07:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.399+0000 7f11e619a740 1 Processor -- start 2024-05-20T17:07:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.400+0000 7f11e619a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f7e43933b0 0x55f7e47662a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.400+0000 7f11e619a740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e439b590 0x55f7e47667e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.400+0000 7f11e619a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e43bc270 0x55f7e476d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.400+0000 7f11e619a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f7e4764340 con 0x55f7e43bc270 2024-05-20T17:07:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.400+0000 7f11e619a740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f7e467b8e0 con 0x55f7e439b590 2024-05-20T17:07:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.400+0000 7f11e619a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f7e47644c0 con 0x55f7e43933b0 2024-05-20T17:07:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.400+0000 7f11e619a740 10 client.0 _ll_register_callbacks cb 0x55f7e46489c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:07:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.400+0000 7f11dd88d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e43bc270 0x55f7e476d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.400+0000 7f11dd88d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e43bc270 0x55f7e476d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58406/0 (socket says 172.21.15.6:58406) 2024-05-20T17:07:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.400+0000 7f11dd88d640 1 -- 172.21.15.6:0/32388909 learned_addr learned my addr 172.21.15.6:0/32388909 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.400+0000 7f11dd08c640 1 --2- 172.21.15.6:0/32388909 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f7e43933b0 0x55f7e47662a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.400+0000 7f11dc88b640 1 --2- 172.21.15.6:0/32388909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e439b590 0x55f7e47667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.400+0000 7f11dd88d640 1 -- 172.21.15.6:0/32388909 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f7e43933b0 msgr2=0x55f7e47662a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.400+0000 7f11dd88d640 1 --2- 172.21.15.6:0/32388909 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f7e43933b0 0x55f7e47662a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.400+0000 7f11dd88d640 1 -- 172.21.15.6:0/32388909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e439b590 msgr2=0x55f7e47667e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.400+0000 7f11dd88d640 1 --2- 172.21.15.6:0/32388909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e439b590 0x55f7e47667e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.400+0000 7f11dd88d640 1 -- 172.21.15.6:0/32388909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7e449e6b0 con 0x55f7e43bc270 2024-05-20T17:07:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.401+0000 7f11dd88d640 1 --2- 172.21.15.6:0/32388909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e43bc270 0x55f7e476d740 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f11d0010e00 tx=0x7f11d0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c3555b95262e8d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.401+0000 7f11c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:07:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.401+0000 7f11c0ff9640 1 -- 172.21.15.6:0/32388909 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d0026680 con 0x55f7e43bc270 2024-05-20T17:07:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.401+0000 7f11c0ff9640 1 -- 172.21.15.6:0/32388909 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f11d001d420 con 0x55f7e43bc270 2024-05-20T17:07:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.401+0000 7f11e619a740 1 -- 172.21.15.6:0/32388909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11c8004c50 con 0x55f7e43bc270 2024-05-20T17:07:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.401+0000 7f11c0ff9640 1 -- 172.21.15.6:0/32388909 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f11d0010e30 con 0x55f7e43bc270 2024-05-20T17:07:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.401+0000 7f11e619a740 10 client.15237 fetch_fsmap learned FSMap version 28 2024-05-20T17:07:03.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.401+0000 7f11e619a740 1 -- 172.21.15.6:0/32388909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f7e47706b0 con 0x55f7e43bc270 2024-05-20T17:07:03.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.401+0000 7f11c0ff9640 1 -- 172.21.15.6:0/32388909 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f11c8004c50 con 0x55f7e43bc270 2024-05-20T17:07:03.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.401+0000 7f11c0ff9640 1 -- 172.21.15.6:0/32388909 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f11d001dad0 con 0x55f7e43bc270 2024-05-20T17:07:03.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.401+0000 7f11e619a740 10 client.15237 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:07:03.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.401+0000 7f11e619a740 10 client.15237 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-20T17:07:03.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.401+0000 7f11e619a740 20 client.15237 populate_metadata read hostname 'smithi006' 2024-05-20T17:07:03.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.402+0000 7f11e619a740 1 --2- 172.21.15.6:0/32388909 >> [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] conn(0x55f7e437ae40 0x55f7e47741e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.402+0000 7f11e619a740 4 client.15237 mds_command: new command op to 24440 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:07:03.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.402+0000 7f11e619a740 1 -- 172.21.15.6:0/32388909 --> [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7e46cdc00 con 0x55f7e437ae40 2024-05-20T17:07:03.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.402+0000 7f11dd08c640 1 --2- 172.21.15.6:0/32388909 >> [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] conn(0x55f7e437ae40 0x55f7e47741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.402+0000 7f11dd08c640 1 --2- 172.21.15.6:0/32388909 >> [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] conn(0x55f7e437ae40 0x55f7e47741e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6f22612837a947cd server_cookie=8791727c1da2e272 in_seq=0 out_seq=0 2024-05-20T17:07:03.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.402+0000 7f11c0ff9640 10 client.15237 ms_handle_connect on v2:172.21.15.62:6832/3854589553 2024-05-20T17:07:03.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.404+0000 7f11c0ff9640 1 -- 172.21.15.6:0/32388909 <== mds.4 v2:172.21.15.62:6832/3854589553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f7e46cdc00 con 0x55f7e437ae40 2024-05-20T17:07:03.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.404+0000 7f11c0ff9640 10 client.15237 handle_command_reply: tid=0 2024-05-20T17:07:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.404+0000 7f11e619a740 1 client.15237 shutdown 2024-05-20T17:07:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.404+0000 7f11e619a740 1 -- 172.21.15.6:0/32388909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e43bc270 msgr2=0x55f7e476d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.404+0000 7f11e619a740 1 --2- 172.21.15.6:0/32388909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e43bc270 0x55f7e476d740 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f11d0010e00 tx=0x7f11d0004ab0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.404+0000 7f11e619a740 1 -- 172.21.15.6:0/32388909 shutdown_connections 2024-05-20T17:07:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.404+0000 7f11e619a740 1 --2- 172.21.15.6:0/32388909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e43bc270 0x55f7e476d740 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.404+0000 7f11e619a740 1 --2- 172.21.15.6:0/32388909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e439b590 0x55f7e47667e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.404+0000 7f11e619a740 1 --2- 172.21.15.6:0/32388909 >> [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] conn(0x55f7e437ae40 0x55f7e47741e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.404+0000 7f11e619a740 1 --2- 172.21.15.6:0/32388909 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f7e43933b0 0x55f7e47662a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.404+0000 7f11c0ff9640 0 client.15237 ms_handle_reset on v2:172.21.15.62:6832/3854589553 2024-05-20T17:07:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.404+0000 7f11e619a740 1 -- 172.21.15.6:0/32388909 >> 172.21.15.6:0/32388909 conn(0x55f7e43b03c0 msgr2=0x55f7e4756ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.404+0000 7f11e619a740 1 -- 172.21.15.6:0/32388909 shutdown_connections 2024-05-20T17:07:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.404+0000 7f11e619a740 1 -- 172.21.15.6:0/32388909 wait complete. 2024-05-20T17:07:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.404+0000 7f11e619a740 20 client.15237 trim_cache size 0 max 16384 2024-05-20T17:07:03.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.423+0000 7f11e619a740 1 Processor -- start 2024-05-20T17:07:03.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.423+0000 7f11e619a740 1 -- start start 2024-05-20T17:07:03.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.423+0000 7f11e619a740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e43933b0 0x55f7e47606a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.423+0000 7f11e619a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e439b590 0x55f7e4760be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.423+0000 7f11e619a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f7e43bc270 0x55f7e47648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.423+0000 7f11e619a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f7e4772520 con 0x55f7e439b590 2024-05-20T17:07:03.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.423+0000 7f11e619a740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f7e4772bf0 con 0x55f7e43933b0 2024-05-20T17:07:03.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.423+0000 7f11e619a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f7e47732c0 con 0x55f7e43bc270 2024-05-20T17:07:03.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.423+0000 7f11dc88b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e439b590 0x55f7e4760be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.423+0000 7f11dc88b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e439b590 0x55f7e4760be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58412/0 (socket says 172.21.15.6:58412) 2024-05-20T17:07:03.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.423+0000 7f11dc88b640 1 -- 172.21.15.6:0/3241154063 learned_addr learned my addr 172.21.15.6:0/3241154063 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.424+0000 7f11dd88d640 1 --2- 172.21.15.6:0/3241154063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f7e43bc270 0x55f7e47648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.424+0000 7f11dd08c640 1 --2- 172.21.15.6:0/3241154063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e43933b0 0x55f7e47606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.424+0000 7f11dc88b640 1 -- 172.21.15.6:0/3241154063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f7e43bc270 msgr2=0x55f7e47648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.424+0000 7f11dc88b640 1 --2- 172.21.15.6:0/3241154063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f7e43bc270 0x55f7e47648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.424+0000 7f11dc88b640 1 -- 172.21.15.6:0/3241154063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e43933b0 msgr2=0x55f7e47606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.424+0000 7f11dc88b640 1 --2- 172.21.15.6:0/3241154063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e43933b0 0x55f7e47606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.424+0000 7f11dc88b640 1 -- 172.21.15.6:0/3241154063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7e475c020 con 0x55f7e439b590 2024-05-20T17:07:03.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.424+0000 7f11dd08c640 1 --2- 172.21.15.6:0/3241154063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e43933b0 0x55f7e47606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:07:03.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.424+0000 7f11dc88b640 1 --2- 172.21.15.6:0/3241154063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e439b590 0x55f7e4760be0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f11c800f010 tx=0x7f11c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898d6ecd229746e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.424+0000 7f11c2ffd640 1 -- 172.21.15.6:0/3241154063 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8004220 con 0x55f7e439b590 2024-05-20T17:07:03.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.424+0000 7f11c2ffd640 1 -- 172.21.15.6:0/3241154063 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f11c80043c0 con 0x55f7e439b590 2024-05-20T17:07:03.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.424+0000 7f11c2ffd640 1 -- 172.21.15.6:0/3241154063 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8004e30 con 0x55f7e439b590 2024-05-20T17:07:03.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.425+0000 7f11e619a740 1 -- 172.21.15.6:0/3241154063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e439b590 msgr2=0x55f7e4760be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.425+0000 7f11e619a740 1 --2- 172.21.15.6:0/3241154063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e439b590 0x55f7e4760be0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f11c800f010 tx=0x7f11c800c880 comp rx=0 tx=0).stop 2024-05-20T17:07:03.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.425+0000 7f11e619a740 1 -- 172.21.15.6:0/3241154063 shutdown_connections 2024-05-20T17:07:03.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.425+0000 7f11e619a740 1 --2- 172.21.15.6:0/3241154063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f7e43bc270 0x55f7e47648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.425+0000 7f11e619a740 1 --2- 172.21.15.6:0/3241154063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e439b590 0x55f7e4760be0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.425+0000 7f11e619a740 1 --2- 172.21.15.6:0/3241154063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e43933b0 0x55f7e47606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.425+0000 7f11e619a740 1 -- 172.21.15.6:0/3241154063 >> 172.21.15.6:0/3241154063 conn(0x55f7e43b03c0 msgr2=0x55f7e4771b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.425+0000 7f11e619a740 1 -- 172.21.15.6:0/3241154063 shutdown_connections 2024-05-20T17:07:03.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.425+0000 7f11e619a740 1 -- 172.21.15.6:0/3241154063 wait complete. 2024-05-20T17:07:03.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.425+0000 7f11e619a740 1 -- start start 2024-05-20T17:07:03.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.425+0000 7f11e619a740 1 Processor -- start 2024-05-20T17:07:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.426+0000 7f11e619a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e43933b0 0x55f7e47686b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.426+0000 7f11e619a740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e439b590 0x55f7e4768bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.426+0000 7f11e619a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f7e43bc270 0x55f7e476bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.426+0000 7f11e619a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55f7e4774060 con 0x55f7e43933b0 2024-05-20T17:07:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.426+0000 7f11e619a740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f7e4773990 con 0x55f7e439b590 2024-05-20T17:07:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.426+0000 7f11e619a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f7e4774730 con 0x55f7e43bc270 2024-05-20T17:07:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.426+0000 7f11e619a740 10 client.0 _ll_register_callbacks cb 0x7f11d000ae80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:07:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.426+0000 7f11dd08c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e43933b0 0x55f7e47686b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.426+0000 7f11dd08c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e43933b0 0x55f7e47686b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58416/0 (socket says 172.21.15.6:58416) 2024-05-20T17:07:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.426+0000 7f11dd08c640 1 -- 172.21.15.6:0/1552150059 learned_addr learned my addr 172.21.15.6:0/1552150059 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.426+0000 7f11dd88d640 1 --2- 172.21.15.6:0/1552150059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f7e43bc270 0x55f7e476bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.426+0000 7f11dc88b640 1 --2- 172.21.15.6:0/1552150059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e439b590 0x55f7e4768bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.426+0000 7f11dd08c640 1 -- 172.21.15.6:0/1552150059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f7e43bc270 msgr2=0x55f7e476bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.426+0000 7f11dd08c640 1 --2- 172.21.15.6:0/1552150059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f7e43bc270 0x55f7e476bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.426+0000 7f11dd08c640 1 -- 172.21.15.6:0/1552150059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e439b590 msgr2=0x55f7e4768bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.426+0000 7f11dd08c640 1 --2- 172.21.15.6:0/1552150059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e439b590 0x55f7e4768bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.426+0000 7f11dd08c640 1 -- 172.21.15.6:0/1552150059 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7e476c0f0 con 0x55f7e43933b0 2024-05-20T17:07:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.426+0000 7f11dd08c640 1 --2- 172.21.15.6:0/1552150059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e43933b0 0x55f7e47686b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f11d4009340 tx=0x7f11d40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eee93010632b181 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.426+0000 7f11c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:07:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.426+0000 7f11c0ff9640 1 -- 172.21.15.6:0/1552150059 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d4049040 con 0x55f7e43933b0 2024-05-20T17:07:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.427+0000 7f11c0ff9640 1 -- 172.21.15.6:0/1552150059 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f11d40a54f0 con 0x55f7e43933b0 2024-05-20T17:07:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.427+0000 7f11e619a740 1 -- 172.21.15.6:0/1552150059 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11c80043c0 con 0x55f7e43933b0 2024-05-20T17:07:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.427+0000 7f11c0ff9640 1 -- 172.21.15.6:0/1552150059 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f11d40bc9c0 con 0x55f7e43933b0 2024-05-20T17:07:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.427+0000 7f11e619a740 10 client.15243 fetch_fsmap learned FSMap version 28 2024-05-20T17:07:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.427+0000 7f11e619a740 1 -- 172.21.15.6:0/1552150059 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f7e47dd0c0 con 0x55f7e43933b0 2024-05-20T17:07:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.427+0000 7f11c0ff9640 1 -- 172.21.15.6:0/1552150059 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f11c80043c0 con 0x55f7e43933b0 2024-05-20T17:07:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.427+0000 7f11c0ff9640 1 -- 172.21.15.6:0/1552150059 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f11d40b8930 con 0x55f7e43933b0 2024-05-20T17:07:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.427+0000 7f11e619a740 10 client.15243 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:07:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.427+0000 7f11e619a740 10 client.15243 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-20T17:07:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.427+0000 7f11e619a740 20 client.15243 populate_metadata read hostname 'smithi006' 2024-05-20T17:07:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.427+0000 7f11e619a740 1 --2- 172.21.15.6:0/1552150059 >> [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] conn(0x55f7e4350280 0x55f7e47e0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.427+0000 7f11e619a740 4 client.15243 mds_command: new command op to 24440 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:07:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.427+0000 7f11e619a740 1 -- 172.21.15.6:0/1552150059 --> [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] -- command(tid 0: {"prefix": "status"}) -- 0x55f7e46c7f50 con 0x55f7e4350280 2024-05-20T17:07:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.428+0000 7f11dc88b640 1 --2- 172.21.15.6:0/1552150059 >> [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] conn(0x55f7e4350280 0x55f7e47e0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.428+0000 7f11dc88b640 1 --2- 172.21.15.6:0/1552150059 >> [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] conn(0x55f7e4350280 0x55f7e47e0770 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2e51f9cbd6864bc8 server_cookie=72cbd6f37dec7ae2 in_seq=0 out_seq=0 2024-05-20T17:07:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.428+0000 7f11c0ff9640 10 client.15243 ms_handle_connect on v2:172.21.15.62:6832/3854589553 2024-05-20T17:07:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.428+0000 7f11c0ff9640 1 -- 172.21.15.6:0/1552150059 <== mds.4 v2:172.21.15.62:6832/3854589553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f7e46c7f50 con 0x55f7e4350280 2024-05-20T17:07:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.428+0000 7f11c0ff9640 10 client.15243 handle_command_reply: tid=0 2024-05-20T17:07:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.428+0000 7f11e619a740 1 client.15243 shutdown 2024-05-20T17:07:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.428+0000 7f11e619a740 1 -- 172.21.15.6:0/1552150059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e43933b0 msgr2=0x55f7e47686b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.428+0000 7f11e619a740 1 --2- 172.21.15.6:0/1552150059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e43933b0 0x55f7e47686b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f11d4009340 tx=0x7f11d40045e0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.428+0000 7f11e619a740 1 -- 172.21.15.6:0/1552150059 shutdown_connections 2024-05-20T17:07:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.428+0000 7f11e619a740 1 --2- 172.21.15.6:0/1552150059 >> [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] conn(0x55f7e4350280 0x55f7e47e0770 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.428+0000 7f11e619a740 1 --2- 172.21.15.6:0/1552150059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f7e43bc270 0x55f7e476bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.428+0000 7f11c0ff9640 0 client.15243 ms_handle_reset on v2:172.21.15.62:6832/3854589553 2024-05-20T17:07:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.428+0000 7f11e619a740 1 --2- 172.21.15.6:0/1552150059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e439b590 0x55f7e4768bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.428+0000 7f11e619a740 1 --2- 172.21.15.6:0/1552150059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7e43933b0 0x55f7e47686b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.428+0000 7f11e619a740 1 -- 172.21.15.6:0/1552150059 >> 172.21.15.6:0/1552150059 conn(0x55f7e43b03c0 msgr2=0x55f7e47648c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.429+0000 7f11e619a740 1 -- 172.21.15.6:0/1552150059 shutdown_connections 2024-05-20T17:07:03.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.429+0000 7f11e619a740 1 -- 172.21.15.6:0/1552150059 wait complete. 2024-05-20T17:07:03.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.429+0000 7f11e619a740 20 client.15243 trim_cache size 0 max 16384 2024-05-20T17:07:03.435 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:07:03.435 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c726c954-16c9-11ef-bc9a-c7b262605968", 2024-05-20T17:07:03.435 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 4, 2024-05-20T17:07:03.435 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24440, 2024-05-20T17:07:03.435 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T17:07:03.435 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T17:07:03.435 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T17:07:03.436 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 88.846731306999999, 2024-05-20T17:07:03.436 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 28, 2024-05-20T17:07:03.436 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 94, 2024-05-20T17:07:03.436 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 90, 2024-05-20T17:07:03.436 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 153.58157433100001 2024-05-20T17:07:03.436 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:07:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.429+0000 7f11df2f0640 1 -- 172.21.15.6:0/3851440025 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f11c40a2c10 msgr2=0x7f11c40a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.429+0000 7f11df2f0640 1 --2- 172.21.15.6:0/3851440025 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f11c40a2c10 0x7f11c40a5120 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55f7e475d640 tx=0x7f11d0004a40 comp rx=0 tx=0).stop 2024-05-20T17:07:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.429+0000 7f11df2f0640 1 -- 172.21.15.6:0/3851440025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11d8101990 msgr2=0x7f11d8199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.429+0000 7f11df2f0640 1 --2- 172.21.15.6:0/3851440025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11d8101990 0x7f11d8199200 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f11d40314e0 tx=0x7f11d4004360 comp rx=0 tx=0).stop 2024-05-20T17:07:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.429+0000 7f11df2f0640 1 -- 172.21.15.6:0/3851440025 shutdown_connections 2024-05-20T17:07:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.429+0000 7f11df2f0640 1 --2- 172.21.15.6:0/3851440025 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f11c40a2c10 0x7f11c40a5120 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.429+0000 7f11df2f0640 1 --2- 172.21.15.6:0/3851440025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11d81078d0 0x7f11d81a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.429+0000 7f11df2f0640 1 --2- 172.21.15.6:0/3851440025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11d8102bd0 0x7f11d8199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.429+0000 7f11df2f0640 1 --2- 172.21.15.6:0/3851440025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11d8101990 0x7f11d8199200 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.429+0000 7f11df2f0640 1 -- 172.21.15.6:0/3851440025 >> 172.21.15.6:0/3851440025 conn(0x7f11d80fcb80 msgr2=0x7f11d8108e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.429+0000 7f11df2f0640 1 -- 172.21.15.6:0/3851440025 shutdown_connections 2024-05-20T17:07:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.429+0000 7f11df2f0640 1 -- 172.21.15.6:0/3851440025 wait complete. 2024-05-20T17:07:03.440 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-05-20T17:07:03.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.556+0000 7fd2f91aa640 1 -- 172.21.15.6:0/3024801205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f4108720 msgr2=0x7fd2f410ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.556+0000 7fd2f91aa640 1 --2- 172.21.15.6:0/3024801205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f4108720 0x7fd2f410ac30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009ca0 tx=0x7fd2ec02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.556+0000 7fd2f91aa640 1 -- 172.21.15.6:0/3024801205 shutdown_connections 2024-05-20T17:07:03.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.556+0000 7fd2f91aa640 1 --2- 172.21.15.6:0/3024801205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f4108720 0x7fd2f410ac30 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.556+0000 7fd2f91aa640 1 --2- 172.21.15.6:0/3024801205 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2f4105bb0 0x7fd2f4108090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.556+0000 7fd2f91aa640 1 --2- 172.21.15.6:0/3024801205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2f41031c0 0x7fd2f41055e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.556+0000 7fd2f91aa640 1 -- 172.21.15.6:0/3024801205 >> 172.21.15.6:0/3024801205 conn(0x7fd2f40fcb80 msgr2=0x7fd2f40ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.556+0000 7fd2f91aa640 1 -- 172.21.15.6:0/3024801205 shutdown_connections 2024-05-20T17:07:03.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.556+0000 7fd2f91aa640 1 -- 172.21.15.6:0/3024801205 wait complete. 2024-05-20T17:07:03.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.557+0000 7fd2f91aa640 1 Processor -- start 2024-05-20T17:07:03.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.557+0000 7fd2f91aa640 1 -- start start 2024-05-20T17:07:03.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.557+0000 7fd2f91aa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2f41031c0 0x7fd2f4199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.558+0000 7fd2f91aa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2f4105bb0 0x7fd2f4199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.558+0000 7fd2f91aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f4108720 0x7fd2f41a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.558+0000 7fd2f91aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f410e570 con 0x7fd2f4108720 2024-05-20T17:07:03.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.558+0000 7fd2f91aa640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f410e3f0 con 0x7fd2f4105bb0 2024-05-20T17:07:03.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.558+0000 7fd2f91aa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f410e6f0 con 0x7fd2f41031c0 2024-05-20T17:07:03.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.558+0000 7fd2f359e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f4108720 0x7fd2f41a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.558+0000 7fd2f359e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f4108720 0x7fd2f41a05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58424/0 (socket says 172.21.15.6:58424) 2024-05-20T17:07:03.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.558+0000 7fd2f359e640 1 -- 172.21.15.6:0/1649892813 learned_addr learned my addr 172.21.15.6:0/1649892813 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.558+0000 7fd2f259c640 1 --2- 172.21.15.6:0/1649892813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2f4105bb0 0x7fd2f4199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.558+0000 7fd2f2d9d640 1 --2- 172.21.15.6:0/1649892813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2f41031c0 0x7fd2f4199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.558+0000 7fd2f359e640 1 -- 172.21.15.6:0/1649892813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2f41031c0 msgr2=0x7fd2f4199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.558+0000 7fd2f359e640 1 --2- 172.21.15.6:0/1649892813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2f41031c0 0x7fd2f4199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.558+0000 7fd2f359e640 1 -- 172.21.15.6:0/1649892813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2f4105bb0 msgr2=0x7fd2f4199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.558+0000 7fd2f359e640 1 --2- 172.21.15.6:0/1649892813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2f4105bb0 0x7fd2f4199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.558+0000 7fd2f359e640 1 -- 172.21.15.6:0/1649892813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f41a0c50 con 0x7fd2f4108720 2024-05-20T17:07:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.558+0000 7fd2f359e640 1 --2- 172.21.15.6:0/1649892813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f4108720 0x7fd2f41a05e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009dc0 tx=0x7fd2ec003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.558+0000 7fd2dbfff640 1 -- 172.21.15.6:0/1649892813 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec004040 con 0x7fd2f4108720 2024-05-20T17:07:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.559+0000 7fd2dbfff640 1 -- 172.21.15.6:0/1649892813 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd2ec004690 con 0x7fd2f4108720 2024-05-20T17:07:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.559+0000 7fd2f91aa640 1 -- 172.21.15.6:0/1649892813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f41a0ee0 con 0x7fd2f4108720 2024-05-20T17:07:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.559+0000 7fd2dbfff640 1 -- 172.21.15.6:0/1649892813 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec030c70 con 0x7fd2f4108720 2024-05-20T17:07:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.559+0000 7fd2f91aa640 1 -- 172.21.15.6:0/1649892813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f41a1340 con 0x7fd2f4108720 2024-05-20T17:07:03.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.561+0000 7fd300054740 1 Processor -- start 2024-05-20T17:07:03.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.561+0000 7fd2dbfff640 1 -- 172.21.15.6:0/1649892813 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fd2ec0041e0 con 0x7fd2f4108720 2024-05-20T17:07:03.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.561+0000 7fd300054740 1 -- start start 2024-05-20T17:07:03.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.562+0000 7fd300054740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 0x55b196a72880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.562+0000 7fd300054740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966a53b0 0x55b196a72e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.562+0000 7fd300054740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b1966ad590 0x55b196a79d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.562+0000 7fd300054740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55b1969d24d0 con 0x55b1966ce270 2024-05-20T17:07:03.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.562+0000 7fd300054740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b19697a3e0 con 0x55b1966ad590 2024-05-20T17:07:03.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.562+0000 7fd300054740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b1969ce490 con 0x55b1966a53b0 2024-05-20T17:07:03.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.562+0000 7fd2f259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 0x55b196a72880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.562+0000 7fd2f259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 0x55b196a72880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58428/0 (socket says 172.21.15.6:58428) 2024-05-20T17:07:03.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.562+0000 7fd2f259c640 1 -- 172.21.15.6:0/1053313362 learned_addr learned my addr 172.21.15.6:0/1053313362 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.562+0000 7fd2f2d9d640 1 --2- 172.21.15.6:0/1053313362 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966a53b0 0x55b196a72e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.562+0000 7fd2f259c640 1 --2- 172.21.15.6:0/1053313362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b1966ad590 0x55b196a79d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.562+0000 7fd2f259c640 1 -- 172.21.15.6:0/1053313362 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966a53b0 msgr2=0x55b196a72e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.562+0000 7fd2f259c640 1 --2- 172.21.15.6:0/1053313362 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966a53b0 0x55b196a72e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.562+0000 7fd2f259c640 1 -- 172.21.15.6:0/1053313362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b1966ad590 msgr2=0x55b196a79d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.562+0000 7fd2f259c640 1 --2- 172.21.15.6:0/1053313362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b1966ad590 0x55b196a79d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.562+0000 7fd2dbfff640 1 --2- 172.21.15.6:0/1649892813 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd2dc0a2b90 0x7fd2dc0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.562+0000 7fd2f259c640 1 -- 172.21.15.6:0/1053313362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1966e62d0 con 0x55b1966ce270 2024-05-20T17:07:03.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.562+0000 7fd2f2d9d640 1 --2- 172.21.15.6:0/1053313362 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966a53b0 0x55b196a72e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:07:03.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.562+0000 7fd2f359e640 1 --2- 172.21.15.6:0/1649892813 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd2dc0a2b90 0x7fd2dc0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.563+0000 7fd2f259c640 1 --2- 172.21.15.6:0/1053313362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 0x55b196a72880 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80125e0 tx=0x7fd2e800b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad03efed06f0fde server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.563+0000 7fd2dbfff640 1 -- 172.21.15.6:0/1649892813 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fd2ec0f0b50 con 0x7fd2f4108720 2024-05-20T17:07:03.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.563+0000 7fd2d97fa640 1 -- 172.21.15.6:0/1053313362 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8004030 con 0x55b1966ce270 2024-05-20T17:07:03.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.563+0000 7fd2d97fa640 1 -- 172.21.15.6:0/1053313362 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd2e80041d0 con 0x55b1966ce270 2024-05-20T17:07:03.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.563+0000 7fd2d97fa640 1 -- 172.21.15.6:0/1053313362 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8010660 con 0x55b1966ce270 2024-05-20T17:07:03.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.564+0000 7fd300054740 1 -- 172.21.15.6:0/1053313362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 msgr2=0x55b196a72880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.564+0000 7fd2f359e640 1 --2- 172.21.15.6:0/1649892813 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd2dc0a2b90 0x7fd2dc0a50a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0c5740 tx=0x7fd2ec0e7b90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.564+0000 7fd300054740 1 --2- 172.21.15.6:0/1053313362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 0x55b196a72880 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80125e0 tx=0x7fd2e800b820 comp rx=0 tx=0).stop 2024-05-20T17:07:03.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.564+0000 7fd300054740 1 -- 172.21.15.6:0/1053313362 shutdown_connections 2024-05-20T17:07:03.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.564+0000 7fd300054740 1 --2- 172.21.15.6:0/1053313362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b1966ad590 0x55b196a79d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.564+0000 7fd300054740 1 --2- 172.21.15.6:0/1053313362 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966a53b0 0x55b196a72e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.564+0000 7fd300054740 1 --2- 172.21.15.6:0/1053313362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 0x55b196a72880 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.564+0000 7fd300054740 1 -- 172.21.15.6:0/1053313362 >> 172.21.15.6:0/1053313362 conn(0x55b1966c23c0 msgr2=0x55b196a69e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.564+0000 7fd300054740 1 -- 172.21.15.6:0/1053313362 shutdown_connections 2024-05-20T17:07:03.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.564+0000 7fd300054740 1 -- 172.21.15.6:0/1053313362 wait complete. 2024-05-20T17:07:03.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.564+0000 7fd300054740 1 -- start start 2024-05-20T17:07:03.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.564+0000 7fd300054740 1 Processor -- start 2024-05-20T17:07:03.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.564+0000 7fd300054740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b1966a53b0 0x55b196a7c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.564+0000 7fd300054740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966ad590 0x55b196a7cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.564+0000 7fd300054740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 0x55b196a83bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.564+0000 7fd300054740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55b196a7a750 con 0x55b1966ce270 2024-05-20T17:07:03.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.564+0000 7fd300054740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b19698d8e0 con 0x55b1966a53b0 2024-05-20T17:07:03.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.564+0000 7fd300054740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b196a7a8d0 con 0x55b1966ad590 2024-05-20T17:07:03.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.564+0000 7fd300054740 10 client.0 _ll_register_callbacks cb 0x55b19695a9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:07:03.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.565+0000 7fd2f259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 0x55b196a83bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.565+0000 7fd2f259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 0x55b196a83bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58438/0 (socket says 172.21.15.6:58438) 2024-05-20T17:07:03.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.565+0000 7fd2f259c640 1 -- 172.21.15.6:0/4293953045 learned_addr learned my addr 172.21.15.6:0/4293953045 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.565+0000 7fd2f259c640 1 --2- 172.21.15.6:0/4293953045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b1966a53b0 0x55b196a7c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.565+0000 7fd2f2d9d640 1 --2- 172.21.15.6:0/4293953045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966ad590 0x55b196a7cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.565+0000 7fd2f259c640 1 -- 172.21.15.6:0/4293953045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966ad590 msgr2=0x55b196a7cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.565+0000 7fd2f259c640 1 --2- 172.21.15.6:0/4293953045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966ad590 0x55b196a7cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.565+0000 7fd2f259c640 1 -- 172.21.15.6:0/4293953045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b1966a53b0 msgr2=0x55b196a7c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.565+0000 7fd2f259c640 1 --2- 172.21.15.6:0/4293953045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b1966a53b0 0x55b196a7c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.565+0000 7fd2f259c640 1 -- 172.21.15.6:0/4293953045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1967b06b0 con 0x55b1966ce270 2024-05-20T17:07:03.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.565+0000 7fd2f259c640 1 --2- 172.21.15.6:0/4293953045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 0x55b196a83bd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80125b0 tx=0x7fd2e8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cca8f929a062917 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.565+0000 7fd2d6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:07:03.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.565+0000 7fd2d6ff5640 1 -- 172.21.15.6:0/4293953045 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8027040 con 0x55b1966ce270 2024-05-20T17:07:03.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.565+0000 7fd2d6ff5640 1 -- 172.21.15.6:0/4293953045 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fd2e80037f0 con 0x55b1966ce270 2024-05-20T17:07:03.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.565+0000 7fd300054740 1 -- 172.21.15.6:0/4293953045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2e80041d0 con 0x55b1966ce270 2024-05-20T17:07:03.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.565+0000 7fd2d6ff5640 1 -- 172.21.15.6:0/4293953045 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd2e8005030 con 0x55b1966ce270 2024-05-20T17:07:03.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.565+0000 7fd300054740 10 client.15255 fetch_fsmap learned FSMap version 28 2024-05-20T17:07:03.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.565+0000 7fd300054740 1 -- 172.21.15.6:0/4293953045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b196a86b00 con 0x55b1966ce270 2024-05-20T17:07:03.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.566+0000 7fd2d6ff5640 1 -- 172.21.15.6:0/4293953045 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd2e80041d0 con 0x55b1966ce270 2024-05-20T17:07:03.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.566+0000 7fd2d6ff5640 1 -- 172.21.15.6:0/4293953045 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd2e8004900 con 0x55b1966ce270 2024-05-20T17:07:03.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.566+0000 7fd300054740 10 client.15255 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:07:03.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.566+0000 7fd300054740 10 client.15255 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-20T17:07:03.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.566+0000 7fd300054740 20 client.15255 populate_metadata read hostname 'smithi006' 2024-05-20T17:07:03.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.566+0000 7fd300054740 1 --2- 172.21.15.6:0/4293953045 >> [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] conn(0x55b19668ce40 0x55b196a8a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.566+0000 7fd300054740 4 client.15255 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:07:03.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.566+0000 7fd300054740 1 -- 172.21.15.6:0/4293953045 --> [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1969dfc00 con 0x55b19668ce40 2024-05-20T17:07:03.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.566+0000 7fd2f2d9d640 1 --2- 172.21.15.6:0/4293953045 >> [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] conn(0x55b19668ce40 0x55b196a8a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.567+0000 7fd2f2d9d640 1 --2- 172.21.15.6:0/4293953045 >> [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] conn(0x55b19668ce40 0x55b196a8a340 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8e518664db58e5b9 server_cookie=b5f663332dfecf3a in_seq=0 out_seq=0 2024-05-20T17:07:03.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.567+0000 7fd2d6ff5640 10 client.15255 ms_handle_connect on v2:172.21.15.62:6834/78063155 2024-05-20T17:07:03.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.568+0000 7fd2d6ff5640 1 -- 172.21.15.6:0/4293953045 <== mds.3 v2:172.21.15.62:6834/78063155 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b1969dfc00 con 0x55b19668ce40 2024-05-20T17:07:03.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.568+0000 7fd2d6ff5640 10 client.15255 handle_command_reply: tid=0 2024-05-20T17:07:03.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.568+0000 7fd300054740 1 client.15255 shutdown 2024-05-20T17:07:03.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.568+0000 7fd300054740 1 -- 172.21.15.6:0/4293953045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 msgr2=0x55b196a83bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.568+0000 7fd300054740 1 --2- 172.21.15.6:0/4293953045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 0x55b196a83bd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80125b0 tx=0x7fd2e8004600 comp rx=0 tx=0).stop 2024-05-20T17:07:03.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.568+0000 7fd300054740 1 -- 172.21.15.6:0/4293953045 shutdown_connections 2024-05-20T17:07:03.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.568+0000 7fd300054740 1 --2- 172.21.15.6:0/4293953045 >> [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] conn(0x55b19668ce40 0x55b196a8a340 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.568+0000 7fd300054740 1 --2- 172.21.15.6:0/4293953045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 0x55b196a83bd0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.568+0000 7fd300054740 1 --2- 172.21.15.6:0/4293953045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966ad590 0x55b196a7cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.568+0000 7fd2d6ff5640 0 client.15255 ms_handle_reset on v2:172.21.15.62:6834/78063155 2024-05-20T17:07:03.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.568+0000 7fd300054740 1 --2- 172.21.15.6:0/4293953045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b1966a53b0 0x55b196a7c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.568+0000 7fd300054740 1 -- 172.21.15.6:0/4293953045 >> 172.21.15.6:0/4293953045 conn(0x55b1966c23c0 msgr2=0x55b196a68ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.568+0000 7fd300054740 1 -- 172.21.15.6:0/4293953045 shutdown_connections 2024-05-20T17:07:03.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.568+0000 7fd300054740 1 -- 172.21.15.6:0/4293953045 wait complete. 2024-05-20T17:07:03.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.568+0000 7fd300054740 20 client.15255 trim_cache size 0 max 16384 2024-05-20T17:07:03.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.587+0000 7fd300054740 1 Processor -- start 2024-05-20T17:07:03.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.587+0000 7fd300054740 1 -- start start 2024-05-20T17:07:03.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.587+0000 7fd300054740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966a53b0 0x55b196a72800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.587+0000 7fd300054740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b1966ad590 0x55b196a697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.587+0000 7fd300054740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 0x55b196a69d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.587+0000 7fd300054740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55b196a88680 con 0x55b1966ce270 2024-05-20T17:07:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.587+0000 7fd300054740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b196a88d50 con 0x55b1966ad590 2024-05-20T17:07:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.587+0000 7fd300054740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b196a89420 con 0x55b1966a53b0 2024-05-20T17:07:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.587+0000 7fd2f259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 0x55b196a69d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.587+0000 7fd2f259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 0x55b196a69d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58454/0 (socket says 172.21.15.6:58454) 2024-05-20T17:07:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.587+0000 7fd2f259c640 1 -- 172.21.15.6:0/75479161 learned_addr learned my addr 172.21.15.6:0/75479161 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.587+0000 7fd2f2d9d640 1 --2- 172.21.15.6:0/75479161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b1966ad590 0x55b196a697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.587+0000 7fd2f259c640 1 --2- 172.21.15.6:0/75479161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966a53b0 0x55b196a72800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.588+0000 7fd2f259c640 1 -- 172.21.15.6:0/75479161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966a53b0 msgr2=0x55b196a72800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.588+0000 7fd2f259c640 1 --2- 172.21.15.6:0/75479161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966a53b0 0x55b196a72800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.588+0000 7fd2f259c640 1 -- 172.21.15.6:0/75479161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b1966ad590 msgr2=0x55b196a697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.588+0000 7fd2f259c640 1 --2- 172.21.15.6:0/75479161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b1966ad590 0x55b196a697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.588+0000 7fd2f259c640 1 -- 172.21.15.6:0/75479161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b196a84c10 con 0x55b1966ce270 2024-05-20T17:07:03.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.588+0000 7fd2f259c640 1 --2- 172.21.15.6:0/75479161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 0x55b196a69d30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd2e800bec0 tx=0x7fd2e800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c77bb1bff5dd63 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.588+0000 7fd2d8ff9640 1 -- 172.21.15.6:0/75479161 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e800b3d0 con 0x55b1966ce270 2024-05-20T17:07:03.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.588+0000 7fd2d8ff9640 1 -- 172.21.15.6:0/75479161 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd2e80120d0 con 0x55b1966ce270 2024-05-20T17:07:03.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.588+0000 7fd2d8ff9640 1 -- 172.21.15.6:0/75479161 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e80048e0 con 0x55b1966ce270 2024-05-20T17:07:03.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.589+0000 7fd300054740 1 -- 172.21.15.6:0/75479161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 msgr2=0x55b196a69d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.589+0000 7fd300054740 1 --2- 172.21.15.6:0/75479161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 0x55b196a69d30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd2e800bec0 tx=0x7fd2e800be50 comp rx=0 tx=0).stop 2024-05-20T17:07:03.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.589+0000 7fd300054740 1 -- 172.21.15.6:0/75479161 shutdown_connections 2024-05-20T17:07:03.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.589+0000 7fd300054740 1 --2- 172.21.15.6:0/75479161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ce270 0x55b196a69d30 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.589+0000 7fd300054740 1 --2- 172.21.15.6:0/75479161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b1966ad590 0x55b196a697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.589+0000 7fd300054740 1 --2- 172.21.15.6:0/75479161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966a53b0 0x55b196a72800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.589+0000 7fd300054740 1 -- 172.21.15.6:0/75479161 >> 172.21.15.6:0/75479161 conn(0x55b1966c23c0 msgr2=0x55b196a7c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.589+0000 7fd300054740 1 -- 172.21.15.6:0/75479161 shutdown_connections 2024-05-20T17:07:03.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.589+0000 7fd300054740 1 -- 172.21.15.6:0/75479161 wait complete. 2024-05-20T17:07:03.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.589+0000 7fd300054740 1 -- start start 2024-05-20T17:07:03.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.589+0000 7fd300054740 1 Processor -- start 2024-05-20T17:07:03.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.589+0000 7fd300054740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966a53b0 0x55b196a7e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.589+0000 7fd300054740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ad590 0x55b196a7e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.589+0000 7fd300054740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b1966ce270 0x55b196af11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.589+0000 7fd300054740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55b196a8a1c0 con 0x55b1966ad590 2024-05-20T17:07:03.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.589+0000 7fd300054740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b196a89af0 con 0x55b1966ce270 2024-05-20T17:07:03.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.589+0000 7fd300054740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b196a8a890 con 0x55b1966a53b0 2024-05-20T17:07:03.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.590+0000 7fd300054740 10 client.0 _ll_register_callbacks cb 0x7fd2e400b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:07:03.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.590+0000 7fd2f2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ad590 0x55b196a7e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.590+0000 7fd2f2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ad590 0x55b196a7e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58462/0 (socket says 172.21.15.6:58462) 2024-05-20T17:07:03.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.590+0000 7fd2f2d9d640 1 -- 172.21.15.6:0/2122549601 learned_addr learned my addr 172.21.15.6:0/2122549601 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.590+0000 7fd2f259c640 1 --2- 172.21.15.6:0/2122549601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b1966ce270 0x55b196af11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.590+0000 7fd2f259c640 1 --2- 172.21.15.6:0/2122549601 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966a53b0 0x55b196a7e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.590+0000 7fd2f2d9d640 1 -- 172.21.15.6:0/2122549601 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966a53b0 msgr2=0x55b196a7e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.590+0000 7fd2f2d9d640 1 --2- 172.21.15.6:0/2122549601 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966a53b0 0x55b196a7e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.590+0000 7fd2f2d9d640 1 -- 172.21.15.6:0/2122549601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b1966ce270 msgr2=0x55b196af11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.590+0000 7fd2f2d9d640 1 --2- 172.21.15.6:0/2122549601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b1966ce270 0x55b196af11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.590+0000 7fd2f2d9d640 1 -- 172.21.15.6:0/2122549601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b196a834c0 con 0x55b1966ad590 2024-05-20T17:07:03.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.590+0000 7fd2f259c640 1 --2- 172.21.15.6:0/2122549601 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966a53b0 0x55b196a7e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:03.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.590+0000 7fd2f2d9d640 1 --2- 172.21.15.6:0/2122549601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ad590 0x55b196a7e700 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55b196a73c60 tx=0x7fd2e401d700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2067970a6555c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.590+0000 7fd2d6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:07:03.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.590+0000 7fd2d6ff5640 1 -- 172.21.15.6:0/2122549601 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4005220 con 0x55b1966ad590 2024-05-20T17:07:03.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.590+0000 7fd2d6ff5640 1 -- 172.21.15.6:0/2122549601 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fd2e40053c0 con 0x55b1966ad590 2024-05-20T17:07:03.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.590+0000 7fd300054740 1 -- 172.21.15.6:0/2122549601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2e80120d0 con 0x55b1966ad590 2024-05-20T17:07:03.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.590+0000 7fd2d6ff5640 1 -- 172.21.15.6:0/2122549601 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd2e402c050 con 0x55b1966ad590 2024-05-20T17:07:03.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.591+0000 7fd300054740 10 client.15261 fetch_fsmap learned FSMap version 28 2024-05-20T17:07:03.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.591+0000 7fd300054740 1 -- 172.21.15.6:0/2122549601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b196af2740 con 0x55b1966ad590 2024-05-20T17:07:03.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.591+0000 7fd2d6ff5640 1 -- 172.21.15.6:0/2122549601 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd2e80120d0 con 0x55b1966ad590 2024-05-20T17:07:03.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.591+0000 7fd2d6ff5640 1 -- 172.21.15.6:0/2122549601 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd2e4004b00 con 0x55b1966ad590 2024-05-20T17:07:03.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.591+0000 7fd300054740 10 client.15261 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:07:03.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.591+0000 7fd300054740 10 client.15261 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-20T17:07:03.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.591+0000 7fd300054740 20 client.15261 populate_metadata read hostname 'smithi006' 2024-05-20T17:07:03.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.591+0000 7fd300054740 1 --2- 172.21.15.6:0/2122549601 >> [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] conn(0x55b196662280 0x55b196af6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.591+0000 7fd300054740 4 client.15261 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:07:03.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.591+0000 7fd300054740 1 -- 172.21.15.6:0/2122549601 --> [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] -- command(tid 0: {"prefix": "status"}) -- 0x55b1969d9f50 con 0x55b196662280 2024-05-20T17:07:03.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.591+0000 7fd2f259c640 1 --2- 172.21.15.6:0/2122549601 >> [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] conn(0x55b196662280 0x55b196af6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.592+0000 7fd2d6ff5640 10 client.15261 ms_handle_connect on v2:172.21.15.62:6834/78063155 2024-05-20T17:07:03.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.592+0000 7fd2f259c640 1 --2- 172.21.15.6:0/2122549601 >> [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] conn(0x55b196662280 0x55b196af6050 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=29e295930e0c310 server_cookie=8eadca6b2cd3a1d3 in_seq=0 out_seq=0 2024-05-20T17:07:03.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.592+0000 7fd2d6ff5640 1 -- 172.21.15.6:0/2122549601 <== mds.3 v2:172.21.15.62:6834/78063155 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b1969d9f50 con 0x55b196662280 2024-05-20T17:07:03.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.592+0000 7fd2d6ff5640 10 client.15261 handle_command_reply: tid=0 2024-05-20T17:07:03.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.592+0000 7fd300054740 1 client.15261 shutdown 2024-05-20T17:07:03.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.592+0000 7fd300054740 1 -- 172.21.15.6:0/2122549601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ad590 msgr2=0x55b196a7e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.592+0000 7fd300054740 1 --2- 172.21.15.6:0/2122549601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ad590 0x55b196a7e700 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55b196a73c60 tx=0x7fd2e401d700 comp rx=0 tx=0).stop 2024-05-20T17:07:03.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.592+0000 7fd300054740 1 -- 172.21.15.6:0/2122549601 shutdown_connections 2024-05-20T17:07:03.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.592+0000 7fd300054740 1 --2- 172.21.15.6:0/2122549601 >> [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] conn(0x55b196662280 0x55b196af6050 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.592+0000 7fd300054740 1 --2- 172.21.15.6:0/2122549601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b1966ce270 0x55b196af11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.592+0000 7fd300054740 1 --2- 172.21.15.6:0/2122549601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1966ad590 0x55b196a7e700 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.592+0000 7fd300054740 1 --2- 172.21.15.6:0/2122549601 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b1966a53b0 0x55b196a7e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.592+0000 7fd2d6ff5640 0 client.15261 ms_handle_reset on v2:172.21.15.62:6834/78063155 2024-05-20T17:07:03.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.592+0000 7fd300054740 1 -- 172.21.15.6:0/2122549601 >> 172.21.15.6:0/2122549601 conn(0x55b1966c23c0 msgr2=0x55b196a76af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.592+0000 7fd300054740 1 -- 172.21.15.6:0/2122549601 shutdown_connections 2024-05-20T17:07:03.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.592+0000 7fd300054740 1 -- 172.21.15.6:0/2122549601 wait complete. 2024-05-20T17:07:03.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.592+0000 7fd300054740 20 client.15261 trim_cache size 0 max 16384 2024-05-20T17:07:03.602 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:07:03.602 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c726c954-16c9-11ef-bc9a-c7b262605968", 2024-05-20T17:07:03.602 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 3, 2024-05-20T17:07:03.602 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24470, 2024-05-20T17:07:03.602 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T17:07:03.602 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T17:07:03.602 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T17:07:03.603 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 90.017287254999999, 2024-05-20T17:07:03.603 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 28, 2024-05-20T17:07:03.603 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 94, 2024-05-20T17:07:03.603 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 90, 2024-05-20T17:07:03.603 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 144.96358397099999 2024-05-20T17:07:03.603 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:07:03.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.593+0000 7fd2f91aa640 1 -- 172.21.15.6:0/1649892813 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd2dc0a2b90 msgr2=0x7fd2dc0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.593+0000 7fd2f91aa640 1 --2- 172.21.15.6:0/1649892813 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd2dc0a2b90 0x7fd2dc0a50a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0c5740 tx=0x7fd2ec0e7b90 comp rx=0 tx=0).stop 2024-05-20T17:07:03.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.593+0000 7fd2f91aa640 1 -- 172.21.15.6:0/1649892813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f4108720 msgr2=0x7fd2f41a05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.593+0000 7fd2f91aa640 1 --2- 172.21.15.6:0/1649892813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f4108720 0x7fd2f41a05e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009dc0 tx=0x7fd2ec003ba0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.593+0000 7fd2f91aa640 1 -- 172.21.15.6:0/1649892813 shutdown_connections 2024-05-20T17:07:03.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.593+0000 7fd2f91aa640 1 --2- 172.21.15.6:0/1649892813 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd2dc0a2b90 0x7fd2dc0a50a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.593+0000 7fd2f91aa640 1 --2- 172.21.15.6:0/1649892813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f4108720 0x7fd2f41a05e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.593+0000 7fd2f91aa640 1 --2- 172.21.15.6:0/1649892813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2f4105bb0 0x7fd2f4199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.593+0000 7fd2f91aa640 1 --2- 172.21.15.6:0/1649892813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2f41031c0 0x7fd2f4199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.593+0000 7fd2f91aa640 1 -- 172.21.15.6:0/1649892813 >> 172.21.15.6:0/1649892813 conn(0x7fd2f40fcb80 msgr2=0x7fd2f4103c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.593+0000 7fd2f91aa640 1 -- 172.21.15.6:0/1649892813 shutdown_connections 2024-05-20T17:07:03.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.593+0000 7fd2f91aa640 1 -- 172.21.15.6:0/1649892813 wait complete. 2024-05-20T17:07:03.607 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-05-20T17:07:03.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.726+0000 7fbb53d09640 1 -- 172.21.15.6:0/1744708622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb4c101980 msgr2=0x7fbb4c102680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.726+0000 7fbb53d09640 1 --2- 172.21.15.6:0/1744708622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb4c101980 0x7fbb4c102680 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009900 tx=0x7fbb4402a410 comp rx=0 tx=0).stop 2024-05-20T17:07:03.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.726+0000 7fbb53d09640 1 -- 172.21.15.6:0/1744708622 shutdown_connections 2024-05-20T17:07:03.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.726+0000 7fbb53d09640 1 --2- 172.21.15.6:0/1744708622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb4c1078c0 0x7fbb4c109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.726+0000 7fbb53d09640 1 --2- 172.21.15.6:0/1744708622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb4c102bc0 0x7fbb4c102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.726+0000 7fbb53d09640 1 --2- 172.21.15.6:0/1744708622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb4c101980 0x7fbb4c102680 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.726+0000 7fbb53d09640 1 -- 172.21.15.6:0/1744708622 >> 172.21.15.6:0/1744708622 conn(0x7fbb4c0fcb70 msgr2=0x7fbb4c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.726+0000 7fbb53d09640 1 -- 172.21.15.6:0/1744708622 shutdown_connections 2024-05-20T17:07:03.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.726+0000 7fbb53d09640 1 -- 172.21.15.6:0/1744708622 wait complete. 2024-05-20T17:07:03.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.727+0000 7fbb53d09640 1 Processor -- start 2024-05-20T17:07:03.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.727+0000 7fbb53d09640 1 -- start start 2024-05-20T17:07:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.727+0000 7fbb53d09640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb4c101980 0x7fbb4c069a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.727+0000 7fbb53d09640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb4c102bc0 0x7fbb4c19df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.727+0000 7fbb53d09640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb4c1078c0 0x7fbb4c1a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.727+0000 7fbb53d09640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c10d500 con 0x7fbb4c102bc0 2024-05-20T17:07:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.727+0000 7fbb53d09640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c10d380 con 0x7fbb4c101980 2024-05-20T17:07:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.727+0000 7fbb53d09640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c10d680 con 0x7fbb4c1078c0 2024-05-20T17:07:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.727+0000 7fbb512a4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb4c102bc0 0x7fbb4c19df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.727+0000 7fbb512a4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb4c102bc0 0x7fbb4c19df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58476/0 (socket says 172.21.15.6:58476) 2024-05-20T17:07:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.727+0000 7fbb512a4640 1 -- 172.21.15.6:0/4190925568 learned_addr learned my addr 172.21.15.6:0/4190925568 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.727+0000 7fbb522a6640 1 --2- 172.21.15.6:0/4190925568 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb4c1078c0 0x7fbb4c1a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.727+0000 7fbb51aa5640 1 --2- 172.21.15.6:0/4190925568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb4c101980 0x7fbb4c069a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.727+0000 7fbb512a4640 1 -- 172.21.15.6:0/4190925568 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb4c1078c0 msgr2=0x7fbb4c1a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.727+0000 7fbb512a4640 1 --2- 172.21.15.6:0/4190925568 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb4c1078c0 0x7fbb4c1a04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.727+0000 7fbb512a4640 1 -- 172.21.15.6:0/4190925568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb4c101980 msgr2=0x7fbb4c069a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.727+0000 7fbb512a4640 1 --2- 172.21.15.6:0/4190925568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb4c101980 0x7fbb4c069a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.727+0000 7fbb512a4640 1 -- 172.21.15.6:0/4190925568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4c1a0cc0 con 0x7fbb4c102bc0 2024-05-20T17:07:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.727+0000 7fbb51aa5640 1 --2- 172.21.15.6:0/4190925568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb4c101980 0x7fbb4c069a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.728+0000 7fbb512a4640 1 --2- 172.21.15.6:0/4190925568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb4c102bc0 0x7fbb4c19df30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000d770 tx=0x7fbb4000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.728+0000 7fbb4affd640 1 -- 172.21.15.6:0/4190925568 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40017070 con 0x7fbb4c102bc0 2024-05-20T17:07:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.728+0000 7fbb4affd640 1 -- 172.21.15.6:0/4190925568 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb400054d0 con 0x7fbb4c102bc0 2024-05-20T17:07:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.728+0000 7fbb53d09640 1 -- 172.21.15.6:0/4190925568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb4c1a0fb0 con 0x7fbb4c102bc0 2024-05-20T17:07:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.728+0000 7fbb4affd640 1 -- 172.21.15.6:0/4190925568 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40004cf0 con 0x7fbb4c102bc0 2024-05-20T17:07:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.728+0000 7fbb53d09640 1 -- 172.21.15.6:0/4190925568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb4c1a1410 con 0x7fbb4c102bc0 2024-05-20T17:07:03.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.731+0000 7fbb4affd640 1 -- 172.21.15.6:0/4190925568 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fbb40004e90 con 0x7fbb4c102bc0 2024-05-20T17:07:03.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.731+0000 7fbb5abb1740 1 Processor -- start 2024-05-20T17:07:03.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.731+0000 7fbb5abb1740 1 -- start start 2024-05-20T17:07:03.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.731+0000 7fbb5abb1740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ec2005270 0x562ec23a9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.731+0000 7fbb5abb1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec1fdc3b0 0x562ec23a9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.731+0000 7fbb5abb1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 0x562ec23b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.731+0000 7fbb5abb1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562ec23094d0 con 0x562ec1fe4590 2024-05-20T17:07:03.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.731+0000 7fbb5abb1740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562ec22b13e0 con 0x562ec2005270 2024-05-20T17:07:03.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.731+0000 7fbb5abb1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562ec2305490 con 0x562ec1fdc3b0 2024-05-20T17:07:03.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.731+0000 7fbb512a4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 0x562ec23b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.732+0000 7fbb512a4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 0x562ec23b0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58488/0 (socket says 172.21.15.6:58488) 2024-05-20T17:07:03.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.732+0000 7fbb512a4640 1 -- 172.21.15.6:0/1541548905 learned_addr learned my addr 172.21.15.6:0/1541548905 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.732+0000 7fbb51aa5640 1 --2- 172.21.15.6:0/1541548905 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec1fdc3b0 0x562ec23a9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.732+0000 7fbb522a6640 1 --2- 172.21.15.6:0/1541548905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ec2005270 0x562ec23a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.732+0000 7fbb512a4640 1 -- 172.21.15.6:0/1541548905 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec1fdc3b0 msgr2=0x562ec23a9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.732+0000 7fbb512a4640 1 --2- 172.21.15.6:0/1541548905 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec1fdc3b0 0x562ec23a9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.732+0000 7fbb512a4640 1 -- 172.21.15.6:0/1541548905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ec2005270 msgr2=0x562ec23a9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.732+0000 7fbb512a4640 1 --2- 172.21.15.6:0/1541548905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ec2005270 0x562ec23a9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.732+0000 7fbb4affd640 1 --2- 172.21.15.6:0/4190925568 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbb340a2c10 0x7fbb340a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.732+0000 7fbb512a4640 1 -- 172.21.15.6:0/1541548905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ec201d2d0 con 0x562ec1fe4590 2024-05-20T17:07:03.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.732+0000 7fbb51aa5640 1 --2- 172.21.15.6:0/4190925568 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbb340a2c10 0x7fbb340a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.732+0000 7fbb512a4640 1 --2- 172.21.15.6:0/1541548905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 0x562ec23b0d00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbb4009f180 tx=0x7fbb40097530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb9a77ab860d84c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.732+0000 7fbb4affd640 1 -- 172.21.15.6:0/4190925568 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fbb400cede0 con 0x7fbb4c102bc0 2024-05-20T17:07:03.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.732+0000 7fbb33fff640 1 -- 172.21.15.6:0/1541548905 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40020030 con 0x562ec1fe4590 2024-05-20T17:07:03.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.732+0000 7fbb33fff640 1 -- 172.21.15.6:0/1541548905 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb400a29c0 con 0x562ec1fe4590 2024-05-20T17:07:03.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.732+0000 7fbb33fff640 1 -- 172.21.15.6:0/1541548905 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4009b060 con 0x562ec1fe4590 2024-05-20T17:07:03.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.733+0000 7fbb5abb1740 1 -- 172.21.15.6:0/1541548905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 msgr2=0x562ec23b0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.733+0000 7fbb5abb1740 1 --2- 172.21.15.6:0/1541548905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 0x562ec23b0d00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbb4009f180 tx=0x7fbb40097530 comp rx=0 tx=0).stop 2024-05-20T17:07:03.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.733+0000 7fbb51aa5640 1 --2- 172.21.15.6:0/4190925568 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbb340a2c10 0x7fbb340a5120 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbb4402a930 tx=0x7fbb44000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.733+0000 7fbb5abb1740 1 -- 172.21.15.6:0/1541548905 shutdown_connections 2024-05-20T17:07:03.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.733+0000 7fbb5abb1740 1 --2- 172.21.15.6:0/1541548905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 0x562ec23b0d00 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.733+0000 7fbb5abb1740 1 --2- 172.21.15.6:0/1541548905 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec1fdc3b0 0x562ec23a9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.733+0000 7fbb5abb1740 1 --2- 172.21.15.6:0/1541548905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ec2005270 0x562ec23a9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.733+0000 7fbb5abb1740 1 -- 172.21.15.6:0/1541548905 >> 172.21.15.6:0/1541548905 conn(0x562ec1ff93c0 msgr2=0x562ec23a0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.734+0000 7fbb5abb1740 1 -- 172.21.15.6:0/1541548905 shutdown_connections 2024-05-20T17:07:03.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.734+0000 7fbb5abb1740 1 -- 172.21.15.6:0/1541548905 wait complete. 2024-05-20T17:07:03.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.734+0000 7fbb5abb1740 1 -- start start 2024-05-20T17:07:03.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.734+0000 7fbb5abb1740 1 Processor -- start 2024-05-20T17:07:03.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.734+0000 7fbb5abb1740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ec1fdc3b0 0x562ec23b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.734+0000 7fbb5abb1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 0x562ec23b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.734+0000 7fbb5abb1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec2005270 0x562ec23babf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.734+0000 7fbb5abb1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562ec23b1750 con 0x562ec1fe4590 2024-05-20T17:07:03.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.734+0000 7fbb5abb1740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562ec22c48e0 con 0x562ec1fdc3b0 2024-05-20T17:07:03.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.734+0000 7fbb5abb1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562ec23b18d0 con 0x562ec2005270 2024-05-20T17:07:03.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.734+0000 7fbb5abb1740 10 client.0 _ll_register_callbacks cb 0x562ec22919c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:07:03.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.734+0000 7fbb512a4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 0x562ec23b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.735+0000 7fbb512a4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 0x562ec23b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58496/0 (socket says 172.21.15.6:58496) 2024-05-20T17:07:03.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.735+0000 7fbb512a4640 1 -- 172.21.15.6:0/990195982 learned_addr learned my addr 172.21.15.6:0/990195982 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.735+0000 7fbb51aa5640 1 --2- 172.21.15.6:0/990195982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ec1fdc3b0 0x562ec23b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.735+0000 7fbb522a6640 1 --2- 172.21.15.6:0/990195982 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec2005270 0x562ec23babf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.735+0000 7fbb512a4640 1 -- 172.21.15.6:0/990195982 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec2005270 msgr2=0x562ec23babf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.735+0000 7fbb512a4640 1 --2- 172.21.15.6:0/990195982 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec2005270 0x562ec23babf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.735+0000 7fbb512a4640 1 -- 172.21.15.6:0/990195982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ec1fdc3b0 msgr2=0x562ec23b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.735+0000 7fbb512a4640 1 --2- 172.21.15.6:0/990195982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ec1fdc3b0 0x562ec23b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.735+0000 7fbb512a4640 1 -- 172.21.15.6:0/990195982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ec20e76b0 con 0x562ec1fe4590 2024-05-20T17:07:03.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.735+0000 7fbb512a4640 1 --2- 172.21.15.6:0/990195982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 0x562ec23b3c90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbb400cc580 tx=0x7fbb400cf0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2fba3f461bcc7a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.735+0000 7fbb317fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:07:03.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.735+0000 7fbb317fa640 1 -- 172.21.15.6:0/990195982 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb400b4060 con 0x562ec1fe4590 2024-05-20T17:07:03.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.735+0000 7fbb5abb1740 1 -- 172.21.15.6:0/990195982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562ec2316c00 con 0x562ec1fe4590 2024-05-20T17:07:03.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.735+0000 7fbb317fa640 1 -- 172.21.15.6:0/990195982 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fbb400b4200 con 0x562ec1fe4590 2024-05-20T17:07:03.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.735+0000 7fbb317fa640 1 -- 172.21.15.6:0/990195982 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbb40020040 con 0x562ec1fe4590 2024-05-20T17:07:03.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.735+0000 7fbb5abb1740 10 client.15273 fetch_fsmap learned FSMap version 28 2024-05-20T17:07:03.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.735+0000 7fbb5abb1740 1 -- 172.21.15.6:0/990195982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562ec23bdb20 con 0x562ec1fe4590 2024-05-20T17:07:03.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.736+0000 7fbb317fa640 1 -- 172.21.15.6:0/990195982 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x562ec2316c00 con 0x562ec1fe4590 2024-05-20T17:07:03.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.736+0000 7fbb317fa640 1 -- 172.21.15.6:0/990195982 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbb40097900 con 0x562ec1fe4590 2024-05-20T17:07:03.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.736+0000 7fbb5abb1740 10 client.15273 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:07:03.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.736+0000 7fbb5abb1740 10 client.15273 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-20T17:07:03.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.736+0000 7fbb5abb1740 20 client.15273 populate_metadata read hostname 'smithi006' 2024-05-20T17:07:03.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.736+0000 7fbb5abb1740 1 --2- 172.21.15.6:0/990195982 >> [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] conn(0x562ec1fc3e40 0x562ec23bee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.736+0000 7fbb5abb1740 4 client.15273 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:07:03.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.736+0000 7fbb5abb1740 1 -- 172.21.15.6:0/990195982 --> [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ec2310f50 con 0x562ec1fc3e40 2024-05-20T17:07:03.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.736+0000 7fbb51aa5640 1 --2- 172.21.15.6:0/990195982 >> [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] conn(0x562ec1fc3e40 0x562ec23bee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.737+0000 7fbb317fa640 10 client.15273 ms_handle_connect on v2:172.21.15.171:6834/1542537621 2024-05-20T17:07:03.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.737+0000 7fbb51aa5640 1 --2- 172.21.15.6:0/990195982 >> [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] conn(0x562ec1fc3e40 0x562ec23bee70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ea096e29fa1d1857 server_cookie=f6c28633deeb3648 in_seq=0 out_seq=0 2024-05-20T17:07:03.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.737+0000 7fbb317fa640 1 -- 172.21.15.6:0/990195982 <== mds.2 v2:172.21.15.171:6834/1542537621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562ec2310f50 con 0x562ec1fc3e40 2024-05-20T17:07:03.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.737+0000 7fbb317fa640 10 client.15273 handle_command_reply: tid=0 2024-05-20T17:07:03.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.737+0000 7fbb5abb1740 1 client.15273 shutdown 2024-05-20T17:07:03.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.738+0000 7fbb5abb1740 1 -- 172.21.15.6:0/990195982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 msgr2=0x562ec23b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.738+0000 7fbb5abb1740 1 --2- 172.21.15.6:0/990195982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 0x562ec23b3c90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbb400cc580 tx=0x7fbb400cf0e0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.738+0000 7fbb5abb1740 1 -- 172.21.15.6:0/990195982 shutdown_connections 2024-05-20T17:07:03.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.738+0000 7fbb5abb1740 1 --2- 172.21.15.6:0/990195982 >> [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] conn(0x562ec1fc3e40 0x562ec23bee70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.738+0000 7fbb5abb1740 1 --2- 172.21.15.6:0/990195982 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec2005270 0x562ec23babf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.738+0000 7fbb5abb1740 1 --2- 172.21.15.6:0/990195982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 0x562ec23b3c90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.738+0000 7fbb317fa640 0 client.15273 ms_handle_reset on v2:172.21.15.171:6834/1542537621 2024-05-20T17:07:03.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.738+0000 7fbb5abb1740 1 --2- 172.21.15.6:0/990195982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ec1fdc3b0 0x562ec23b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.738+0000 7fbb5abb1740 1 -- 172.21.15.6:0/990195982 >> 172.21.15.6:0/990195982 conn(0x562ec1ff93c0 msgr2=0x562ec239fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.738+0000 7fbb5abb1740 1 -- 172.21.15.6:0/990195982 shutdown_connections 2024-05-20T17:07:03.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.738+0000 7fbb5abb1740 1 -- 172.21.15.6:0/990195982 wait complete. 2024-05-20T17:07:03.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.738+0000 7fbb5abb1740 20 client.15273 trim_cache size 0 max 16384 2024-05-20T17:07:03.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.757+0000 7fbb5abb1740 1 Processor -- start 2024-05-20T17:07:03.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.757+0000 7fbb5abb1740 1 -- start start 2024-05-20T17:07:03.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.757+0000 7fbb5abb1740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ec1fdc3b0 0x562ec23b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.757+0000 7fbb5abb1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec1fe4590 0x562ec23bab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.757+0000 7fbb5abb1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec2005270 0x562ec23b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.757+0000 7fbb5abb1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562ec23bf3c0 con 0x562ec2005270 2024-05-20T17:07:03.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.757+0000 7fbb5abb1740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562ec23bfa90 con 0x562ec1fdc3b0 2024-05-20T17:07:03.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.757+0000 7fbb5abb1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562ec23c0160 con 0x562ec1fe4590 2024-05-20T17:07:03.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.757+0000 7fbb522a6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec2005270 0x562ec23b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.757+0000 7fbb522a6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec2005270 0x562ec23b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58512/0 (socket says 172.21.15.6:58512) 2024-05-20T17:07:03.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.757+0000 7fbb512a4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec1fe4590 0x562ec23bab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.757+0000 7fbb522a6640 1 -- 172.21.15.6:0/3754921029 learned_addr learned my addr 172.21.15.6:0/3754921029 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.758+0000 7fbb51aa5640 1 --2- 172.21.15.6:0/3754921029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ec1fdc3b0 0x562ec23b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.758+0000 7fbb522a6640 1 -- 172.21.15.6:0/3754921029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec1fe4590 msgr2=0x562ec23bab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.758+0000 7fbb522a6640 1 --2- 172.21.15.6:0/3754921029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec1fe4590 0x562ec23bab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.758+0000 7fbb522a6640 1 -- 172.21.15.6:0/3754921029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ec1fdc3b0 msgr2=0x562ec23b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.758+0000 7fbb522a6640 1 --2- 172.21.15.6:0/3754921029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ec1fdc3b0 0x562ec23b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.758+0000 7fbb522a6640 1 -- 172.21.15.6:0/3754921029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ec23ae5e0 con 0x562ec2005270 2024-05-20T17:07:03.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.758+0000 7fbb522a6640 1 --2- 172.21.15.6:0/3754921029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec2005270 0x562ec23b3c30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c012470 tx=0x7fbb3c012870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a023d7252176d126 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.758+0000 7fbb337fe640 1 -- 172.21.15.6:0/3754921029 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c004b20 con 0x562ec2005270 2024-05-20T17:07:03.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.758+0000 7fbb337fe640 1 -- 172.21.15.6:0/3754921029 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb3c003e20 con 0x562ec2005270 2024-05-20T17:07:03.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.758+0000 7fbb337fe640 1 -- 172.21.15.6:0/3754921029 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c005020 con 0x562ec2005270 2024-05-20T17:07:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.759+0000 7fbb5abb1740 1 -- 172.21.15.6:0/3754921029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec2005270 msgr2=0x562ec23b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.759+0000 7fbb5abb1740 1 --2- 172.21.15.6:0/3754921029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec2005270 0x562ec23b3c30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c012470 tx=0x7fbb3c012870 comp rx=0 tx=0).stop 2024-05-20T17:07:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.759+0000 7fbb5abb1740 1 -- 172.21.15.6:0/3754921029 shutdown_connections 2024-05-20T17:07:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.759+0000 7fbb5abb1740 1 --2- 172.21.15.6:0/3754921029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec2005270 0x562ec23b3c30 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.759+0000 7fbb5abb1740 1 --2- 172.21.15.6:0/3754921029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec1fe4590 0x562ec23bab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.759+0000 7fbb5abb1740 1 --2- 172.21.15.6:0/3754921029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ec1fdc3b0 0x562ec23b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.759+0000 7fbb5abb1740 1 -- 172.21.15.6:0/3754921029 >> 172.21.15.6:0/3754921029 conn(0x562ec1ff93c0 msgr2=0x562ec23b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.759+0000 7fbb5abb1740 1 -- 172.21.15.6:0/3754921029 shutdown_connections 2024-05-20T17:07:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.759+0000 7fbb5abb1740 1 -- 172.21.15.6:0/3754921029 wait complete. 2024-05-20T17:07:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.759+0000 7fbb5abb1740 1 -- start start 2024-05-20T17:07:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.759+0000 7fbb5abb1740 1 Processor -- start 2024-05-20T17:07:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb5abb1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec1fdc3b0 0x562ec23b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb5abb1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 0x562ec23b6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb5abb1740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ec2005270 0x562ec23b97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb5abb1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562ec23c0f00 con 0x562ec1fe4590 2024-05-20T17:07:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb5abb1740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562ec23c0830 con 0x562ec2005270 2024-05-20T17:07:03.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb5abb1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562ec23c15d0 con 0x562ec1fdc3b0 2024-05-20T17:07:03.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb5abb1740 10 client.0 _ll_register_callbacks cb 0x7fbb3c009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:07:03.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb512a4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 0x562ec23b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb512a4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 0x562ec23b6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58528/0 (socket says 172.21.15.6:58528) 2024-05-20T17:07:03.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb512a4640 1 -- 172.21.15.6:0/4009753211 learned_addr learned my addr 172.21.15.6:0/4009753211 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb51aa5640 1 --2- 172.21.15.6:0/4009753211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec1fdc3b0 0x562ec23b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb522a6640 1 --2- 172.21.15.6:0/4009753211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ec2005270 0x562ec23b97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb512a4640 1 -- 172.21.15.6:0/4009753211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec1fdc3b0 msgr2=0x562ec23b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb512a4640 1 --2- 172.21.15.6:0/4009753211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec1fdc3b0 0x562ec23b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb512a4640 1 -- 172.21.15.6:0/4009753211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ec2005270 msgr2=0x562ec23b97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb512a4640 1 --2- 172.21.15.6:0/4009753211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ec2005270 0x562ec23b97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb512a4640 1 -- 172.21.15.6:0/4009753211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ec23b9d90 con 0x562ec1fe4590 2024-05-20T17:07:03.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb512a4640 1 --2- 172.21.15.6:0/4009753211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 0x562ec23b6930 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbb4009b450 tx=0x7fbb40097530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b5ae0c56987f2f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb317fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:07:03.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb317fa640 1 -- 172.21.15.6:0/4009753211 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb400b4040 con 0x562ec1fe4590 2024-05-20T17:07:03.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb317fa640 1 -- 172.21.15.6:0/4009753211 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fbb40099590 con 0x562ec1fe4590 2024-05-20T17:07:03.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.760+0000 7fbb5abb1740 1 -- 172.21.15.6:0/4009753211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb3c003e20 con 0x562ec1fe4590 2024-05-20T17:07:03.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.761+0000 7fbb317fa640 1 -- 172.21.15.6:0/4009753211 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbb40005180 con 0x562ec1fe4590 2024-05-20T17:07:03.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.761+0000 7fbb5abb1740 10 client.15279 fetch_fsmap learned FSMap version 28 2024-05-20T17:07:03.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.761+0000 7fbb5abb1740 1 -- 172.21.15.6:0/4009753211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562ec23b9d90 con 0x562ec1fe4590 2024-05-20T17:07:03.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.761+0000 7fbb317fa640 1 -- 172.21.15.6:0/4009753211 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb3c003e20 con 0x562ec1fe4590 2024-05-20T17:07:03.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.761+0000 7fbb317fa640 1 -- 172.21.15.6:0/4009753211 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbb40097900 con 0x562ec1fe4590 2024-05-20T17:07:03.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.761+0000 7fbb5abb1740 10 client.15279 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:07:03.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.761+0000 7fbb5abb1740 10 client.15279 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-20T17:07:03.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.761+0000 7fbb5abb1740 20 client.15279 populate_metadata read hostname 'smithi006' 2024-05-20T17:07:03.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.761+0000 7fbb5abb1740 1 --2- 172.21.15.6:0/4009753211 >> [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] conn(0x562ec1f99280 0x562ec242d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.761+0000 7fbb5abb1740 4 client.15279 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:07:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.761+0000 7fbb5abb1740 1 -- 172.21.15.6:0/4009753211 --> [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] -- command(tid 0: {"prefix": "status"}) -- 0x562ec228eb80 con 0x562ec1f99280 2024-05-20T17:07:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.761+0000 7fbb51aa5640 1 --2- 172.21.15.6:0/4009753211 >> [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] conn(0x562ec1f99280 0x562ec242d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.762+0000 7fbb317fa640 10 client.15279 ms_handle_connect on v2:172.21.15.171:6834/1542537621 2024-05-20T17:07:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.762+0000 7fbb51aa5640 1 --2- 172.21.15.6:0/4009753211 >> [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] conn(0x562ec1f99280 0x562ec242d390 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=198e20ac9dce54e0 server_cookie=1aa0e4bd078f3299 in_seq=0 out_seq=0 2024-05-20T17:07:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.762+0000 7fbb317fa640 1 -- 172.21.15.6:0/4009753211 <== mds.2 v2:172.21.15.171:6834/1542537621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562ec228eb80 con 0x562ec1f99280 2024-05-20T17:07:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.762+0000 7fbb317fa640 10 client.15279 handle_command_reply: tid=0 2024-05-20T17:07:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.762+0000 7fbb5abb1740 1 client.15279 shutdown 2024-05-20T17:07:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.762+0000 7fbb5abb1740 1 -- 172.21.15.6:0/4009753211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 msgr2=0x562ec23b6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.762+0000 7fbb5abb1740 1 --2- 172.21.15.6:0/4009753211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 0x562ec23b6930 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbb4009b450 tx=0x7fbb40097530 comp rx=0 tx=0).stop 2024-05-20T17:07:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.762+0000 7fbb5abb1740 1 -- 172.21.15.6:0/4009753211 shutdown_connections 2024-05-20T17:07:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.762+0000 7fbb5abb1740 1 --2- 172.21.15.6:0/4009753211 >> [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] conn(0x562ec1f99280 0x562ec242d390 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.762+0000 7fbb5abb1740 1 --2- 172.21.15.6:0/4009753211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562ec2005270 0x562ec23b97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.762+0000 7fbb5abb1740 1 --2- 172.21.15.6:0/4009753211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ec1fe4590 0x562ec23b6930 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.762+0000 7fbb317fa640 0 client.15279 ms_handle_reset on v2:172.21.15.171:6834/1542537621 2024-05-20T17:07:03.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.762+0000 7fbb5abb1740 1 --2- 172.21.15.6:0/4009753211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562ec1fdc3b0 0x562ec23b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.762+0000 7fbb5abb1740 1 -- 172.21.15.6:0/4009753211 >> 172.21.15.6:0/4009753211 conn(0x562ec1ff93c0 msgr2=0x562ec23b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.762+0000 7fbb5abb1740 1 -- 172.21.15.6:0/4009753211 shutdown_connections 2024-05-20T17:07:03.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.762+0000 7fbb5abb1740 1 -- 172.21.15.6:0/4009753211 wait complete. 2024-05-20T17:07:03.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.762+0000 7fbb5abb1740 20 client.15279 trim_cache size 0 max 16384 2024-05-20T17:07:03.768 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:07:03.768 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c726c954-16c9-11ef-bc9a-c7b262605968", 2024-05-20T17:07:03.768 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 2, 2024-05-20T17:07:03.768 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24484, 2024-05-20T17:07:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T17:07:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T17:07:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T17:07:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 91.194132049000004, 2024-05-20T17:07:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 28, 2024-05-20T17:07:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 94, 2024-05-20T17:07:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 90, 2024-05-20T17:07:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 142.28588012200001 2024-05-20T17:07:03.769 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:07:03.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.763+0000 7fbb53d09640 1 -- 172.21.15.6:0/4190925568 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbb340a2c10 msgr2=0x7fbb340a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.763+0000 7fbb53d09640 1 --2- 172.21.15.6:0/4190925568 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbb340a2c10 0x7fbb340a5120 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbb4402a930 tx=0x7fbb44000bc0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.763+0000 7fbb53d09640 1 -- 172.21.15.6:0/4190925568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb4c102bc0 msgr2=0x7fbb4c19df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.763+0000 7fbb53d09640 1 --2- 172.21.15.6:0/4190925568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb4c102bc0 0x7fbb4c19df30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000d770 tx=0x7fbb4000dc30 comp rx=0 tx=0).stop 2024-05-20T17:07:03.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.763+0000 7fbb53d09640 1 -- 172.21.15.6:0/4190925568 shutdown_connections 2024-05-20T17:07:03.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.763+0000 7fbb53d09640 1 --2- 172.21.15.6:0/4190925568 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbb340a2c10 0x7fbb340a5120 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.763+0000 7fbb53d09640 1 --2- 172.21.15.6:0/4190925568 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb4c1078c0 0x7fbb4c1a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.763+0000 7fbb53d09640 1 --2- 172.21.15.6:0/4190925568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb4c102bc0 0x7fbb4c19df30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.763+0000 7fbb53d09640 1 --2- 172.21.15.6:0/4190925568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb4c101980 0x7fbb4c069a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.763+0000 7fbb53d09640 1 -- 172.21.15.6:0/4190925568 >> 172.21.15.6:0/4190925568 conn(0x7fbb4c0fcb70 msgr2=0x7fbb4c1038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.763+0000 7fbb53d09640 1 -- 172.21.15.6:0/4190925568 shutdown_connections 2024-05-20T17:07:03.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.763+0000 7fbb53d09640 1 -- 172.21.15.6:0/4190925568 wait complete. 2024-05-20T17:07:03.774 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-05-20T17:07:03.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:03 smithi006 ceph-mon[32486]: pgmap v364: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:07:03.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:03 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2807621347' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:07:03.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:03 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3184463034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:07:03.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.891+0000 7f0875275640 1 -- 172.21.15.6:0/3826912044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0870100710 msgr2=0x7f0870100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.891+0000 7f0875275640 1 --2- 172.21.15.6:0/3826912044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0870100710 0x7f0870100b80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0864009900 tx=0x7f086402a410 comp rx=0 tx=0).stop 2024-05-20T17:07:03.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.891+0000 7f0875275640 1 -- 172.21.15.6:0/3826912044 shutdown_connections 2024-05-20T17:07:03.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.891+0000 7f0875275640 1 --2- 172.21.15.6:0/3826912044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0870101210 0x7f087010ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.891+0000 7f0875275640 1 --2- 172.21.15.6:0/3826912044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0870100710 0x7f0870100b80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.891+0000 7f0875275640 1 --2- 172.21.15.6:0/3826912044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0870104060 0x7f0870104470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.891+0000 7f0875275640 1 -- 172.21.15.6:0/3826912044 >> 172.21.15.6:0/3826912044 conn(0x7f08700fc330 msgr2=0x7f08700fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.891+0000 7f0875275640 1 -- 172.21.15.6:0/3826912044 shutdown_connections 2024-05-20T17:07:03.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.891+0000 7f0875275640 1 -- 172.21.15.6:0/3826912044 wait complete. 2024-05-20T17:07:03.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.892+0000 7f0875275640 1 Processor -- start 2024-05-20T17:07:03.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.892+0000 7f0875275640 1 -- start start 2024-05-20T17:07:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.892+0000 7f0875275640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0870100710 0x7f08701991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.892+0000 7f0875275640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0870101210 0x7f0870199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.892+0000 7f0875275640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0870104060 0x7f08701a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.892+0000 7f0875275640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f087010e5f0 con 0x7f0870100710 2024-05-20T17:07:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.892+0000 7f0875275640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f087010e470 con 0x7f0870104060 2024-05-20T17:07:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.892+0000 7f0875275640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f087010e770 con 0x7f0870101210 2024-05-20T17:07:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.892+0000 7f086effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0870100710 0x7f08701991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.892+0000 7f086effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0870100710 0x7f08701991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58554/0 (socket says 172.21.15.6:58554) 2024-05-20T17:07:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.892+0000 7f086effd640 1 -- 172.21.15.6:0/1376103607 learned_addr learned my addr 172.21.15.6:0/1376103607 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.892+0000 7f086e7fc640 1 --2- 172.21.15.6:0/1376103607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0870101210 0x7f0870199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.892+0000 7f086f7fe640 1 --2- 172.21.15.6:0/1376103607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0870104060 0x7f08701a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.893+0000 7f086effd640 1 -- 172.21.15.6:0/1376103607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0870101210 msgr2=0x7f0870199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.893+0000 7f086effd640 1 --2- 172.21.15.6:0/1376103607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0870101210 0x7f0870199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.893+0000 7f086effd640 1 -- 172.21.15.6:0/1376103607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0870104060 msgr2=0x7f08701a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.893+0000 7f086effd640 1 --2- 172.21.15.6:0/1376103607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0870104060 0x7f08701a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.893+0000 7f086effd640 1 -- 172.21.15.6:0/1376103607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08701a0d00 con 0x7f0870100710 2024-05-20T17:07:03.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.893+0000 7f086f7fe640 1 --2- 172.21.15.6:0/1376103607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0870104060 0x7f08701a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:03.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.893+0000 7f086effd640 1 --2- 172.21.15.6:0/1376103607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0870100710 0x7f08701991c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f086000c970 tx=0x7f086000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.893+0000 7f0857fff640 1 -- 172.21.15.6:0/1376103607 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860004220 con 0x7f0870100710 2024-05-20T17:07:03.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.893+0000 7f0857fff640 1 -- 172.21.15.6:0/1376103607 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f08600043c0 con 0x7f0870100710 2024-05-20T17:07:03.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.893+0000 7f0875275640 1 -- 172.21.15.6:0/1376103607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08701a0ff0 con 0x7f0870100710 2024-05-20T17:07:03.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.893+0000 7f0857fff640 1 -- 172.21.15.6:0/1376103607 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860004a00 con 0x7f0870100710 2024-05-20T17:07:03.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.893+0000 7f0875275640 1 -- 172.21.15.6:0/1376103607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08701a1400 con 0x7f0870100710 2024-05-20T17:07:03.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.895+0000 7f0857fff640 1 -- 172.21.15.6:0/1376103607 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f08600079b0 con 0x7f0870100710 2024-05-20T17:07:03.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.896+0000 7f087c1f1740 1 Processor -- start 2024-05-20T17:07:03.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.896+0000 7f087c1f1740 1 -- start start 2024-05-20T17:07:03.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.896+0000 7f087c1f1740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97dc6270 0x561c98166470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.896+0000 7f087c1f1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c97d9d3b0 0x561c981669f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.896+0000 7f087c1f1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97da5590 0x561c9816d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.896+0000 7f087c1f1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561c980ca4d0 con 0x561c97da5590 2024-05-20T17:07:03.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.896+0000 7f087c1f1740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561c980723e0 con 0x561c97dc6270 2024-05-20T17:07:03.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.896+0000 7f087c1f1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561c980c6490 con 0x561c97d9d3b0 2024-05-20T17:07:03.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.896+0000 7f0857fff640 1 --2- 172.21.15.6:0/1376103607 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f08580a2b90 0x7f08580a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.896+0000 7f086e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97da5590 0x561c9816d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.896+0000 7f086e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97da5590 0x561c9816d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58566/0 (socket says 172.21.15.6:58566) 2024-05-20T17:07:03.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.896+0000 7f086e7fc640 1 -- 172.21.15.6:0/1742063404 learned_addr learned my addr 172.21.15.6:0/1742063404 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.896+0000 7f086f7fe640 1 --2- 172.21.15.6:0/1376103607 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f08580a2b90 0x7f08580a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.896+0000 7f0857fff640 1 -- 172.21.15.6:0/1376103607 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f08600cf240 con 0x7f0870100710 2024-05-20T17:07:03.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.897+0000 7f086effd640 1 --2- 172.21.15.6:0/1742063404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c97d9d3b0 0x561c981669f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.897+0000 7f086f7fe640 1 --2- 172.21.15.6:0/1742063404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97dc6270 0x561c98166470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.897+0000 7f086e7fc640 1 -- 172.21.15.6:0/1742063404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c97d9d3b0 msgr2=0x561c981669f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.897+0000 7f086e7fc640 1 --2- 172.21.15.6:0/1742063404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c97d9d3b0 0x561c981669f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.897+0000 7f086e7fc640 1 -- 172.21.15.6:0/1742063404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97dc6270 msgr2=0x561c98166470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.897+0000 7f086e7fc640 1 --2- 172.21.15.6:0/1742063404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97dc6270 0x561c98166470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.897+0000 7f086e7fc640 1 -- 172.21.15.6:0/1742063404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c97dde2d0 con 0x561c97da5590 2024-05-20T17:07:03.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.897+0000 7f086f7fe640 1 --2- 172.21.15.6:0/1742063404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97dc6270 0x561c98166470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:07:03.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.897+0000 7f086e7fc640 1 --2- 172.21.15.6:0/1742063404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97da5590 0x561c9816d8f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f086402a930 tx=0x7f0864031c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456b25d7e5578498 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.897+0000 7f086f7fe640 1 --2- 172.21.15.6:0/1376103607 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f08580a2b90 0x7f08580a50a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0868005c40 tx=0x7f0868009590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.897+0000 7f08557fa640 1 -- 172.21.15.6:0/1742063404 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0864035030 con 0x561c97da5590 2024-05-20T17:07:03.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.897+0000 7f08557fa640 1 -- 172.21.15.6:0/1742063404 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0864040070 con 0x561c97da5590 2024-05-20T17:07:03.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.897+0000 7f08557fa640 1 -- 172.21.15.6:0/1742063404 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0864003bb0 con 0x561c97da5590 2024-05-20T17:07:03.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.898+0000 7f087c1f1740 1 -- 172.21.15.6:0/1742063404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97da5590 msgr2=0x561c9816d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.898+0000 7f087c1f1740 1 --2- 172.21.15.6:0/1742063404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97da5590 0x561c9816d8f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f086402a930 tx=0x7f0864031c20 comp rx=0 tx=0).stop 2024-05-20T17:07:03.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.898+0000 7f087c1f1740 1 -- 172.21.15.6:0/1742063404 shutdown_connections 2024-05-20T17:07:03.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.898+0000 7f087c1f1740 1 --2- 172.21.15.6:0/1742063404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97da5590 0x561c9816d8f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.898+0000 7f087c1f1740 1 --2- 172.21.15.6:0/1742063404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c97d9d3b0 0x561c981669f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.898+0000 7f087c1f1740 1 --2- 172.21.15.6:0/1742063404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97dc6270 0x561c98166470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.898+0000 7f087c1f1740 1 -- 172.21.15.6:0/1742063404 >> 172.21.15.6:0/1742063404 conn(0x561c97dba3c0 msgr2=0x561c98161e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.898+0000 7f087c1f1740 1 -- 172.21.15.6:0/1742063404 shutdown_connections 2024-05-20T17:07:03.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.898+0000 7f087c1f1740 1 -- 172.21.15.6:0/1742063404 wait complete. 2024-05-20T17:07:03.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.898+0000 7f087c1f1740 1 -- start start 2024-05-20T17:07:03.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f087c1f1740 1 Processor -- start 2024-05-20T17:07:03.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f087c1f1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 0x561c98170230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f087c1f1740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97da5590 0x561c98170770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f087c1f1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c97dc6270 0x561c981776d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f087c1f1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561c9816e2e0 con 0x561c97d9d3b0 2024-05-20T17:07:03.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f087c1f1740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561c980858e0 con 0x561c97da5590 2024-05-20T17:07:03.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f087c1f1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561c9816e460 con 0x561c97dc6270 2024-05-20T17:07:03.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f087c1f1740 10 client.0 _ll_register_callbacks cb 0x561c980529c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:07:03.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f086effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 0x561c98170230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f086effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 0x561c98170230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58570/0 (socket says 172.21.15.6:58570) 2024-05-20T17:07:03.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f086effd640 1 -- 172.21.15.6:0/327245785 learned_addr learned my addr 172.21.15.6:0/327245785 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f086e7fc640 1 --2- 172.21.15.6:0/327245785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97da5590 0x561c98170770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f086f7fe640 1 --2- 172.21.15.6:0/327245785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c97dc6270 0x561c981776d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f086effd640 1 -- 172.21.15.6:0/327245785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c97dc6270 msgr2=0x561c981776d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f086effd640 1 --2- 172.21.15.6:0/327245785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c97dc6270 0x561c981776d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f086effd640 1 -- 172.21.15.6:0/327245785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97da5590 msgr2=0x561c98170770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f086effd640 1 --2- 172.21.15.6:0/327245785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97da5590 0x561c98170770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f086effd640 1 -- 172.21.15.6:0/327245785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c97ea86b0 con 0x561c97d9d3b0 2024-05-20T17:07:03.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f086f7fe640 1 --2- 172.21.15.6:0/327245785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c97dc6270 0x561c981776d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:07:03.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f086effd640 1 --2- 172.21.15.6:0/327245785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 0x561c98170230 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f086000c940 tx=0x7f0860005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c28ce37857db7b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.899+0000 7f0852ff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:07:03.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.900+0000 7f0852ff5640 1 -- 172.21.15.6:0/327245785 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086001d040 con 0x561c97d9d3b0 2024-05-20T17:07:03.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.900+0000 7f0852ff5640 1 -- 172.21.15.6:0/327245785 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f08600cca40 con 0x561c97d9d3b0 2024-05-20T17:07:03.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.900+0000 7f087c1f1740 1 -- 172.21.15.6:0/327245785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0864040070 con 0x561c97d9d3b0 2024-05-20T17:07:03.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.900+0000 7f0852ff5640 1 -- 172.21.15.6:0/327245785 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f086009fa40 con 0x561c97d9d3b0 2024-05-20T17:07:03.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.900+0000 7f087c1f1740 10 client.15291 fetch_fsmap learned FSMap version 28 2024-05-20T17:07:03.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.900+0000 7f087c1f1740 1 -- 172.21.15.6:0/327245785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561c9817a5e0 con 0x561c97d9d3b0 2024-05-20T17:07:03.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.900+0000 7f0852ff5640 1 -- 172.21.15.6:0/327245785 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0864040070 con 0x561c97d9d3b0 2024-05-20T17:07:03.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.900+0000 7f0852ff5640 1 -- 172.21.15.6:0/327245785 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f08600afc40 con 0x561c97d9d3b0 2024-05-20T17:07:03.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.900+0000 7f087c1f1740 10 client.15291 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:07:03.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.900+0000 7f087c1f1740 10 client.15291 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-20T17:07:03.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.900+0000 7f087c1f1740 20 client.15291 populate_metadata read hostname 'smithi006' 2024-05-20T17:07:03.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.900+0000 7f087c1f1740 1 --2- 172.21.15.6:0/327245785 >> [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] conn(0x561c97d84e40 0x561c9817e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.900+0000 7f087c1f1740 4 client.15291 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:07:03.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.900+0000 7f087c1f1740 1 -- 172.21.15.6:0/327245785 --> [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c980d7c00 con 0x561c97d84e40 2024-05-20T17:07:03.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.901+0000 7f086e7fc640 1 --2- 172.21.15.6:0/327245785 >> [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] conn(0x561c97d84e40 0x561c9817e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.901+0000 7f086e7fc640 1 --2- 172.21.15.6:0/327245785 >> [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] conn(0x561c97d84e40 0x561c9817e140 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=363cf0dedce07865 server_cookie=da46632e9d1d28f9 in_seq=0 out_seq=0 2024-05-20T17:07:03.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.901+0000 7f0852ff5640 10 client.15291 ms_handle_connect on v2:172.21.15.171:6838/3246292303 2024-05-20T17:07:03.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.902+0000 7f0852ff5640 1 -- 172.21.15.6:0/327245785 <== mds.1 v2:172.21.15.171:6838/3246292303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561c980d7c00 con 0x561c97d84e40 2024-05-20T17:07:03.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.902+0000 7f0852ff5640 10 client.15291 handle_command_reply: tid=0 2024-05-20T17:07:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.902+0000 7f087c1f1740 1 client.15291 shutdown 2024-05-20T17:07:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.902+0000 7f087c1f1740 1 -- 172.21.15.6:0/327245785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 msgr2=0x561c98170230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.902+0000 7f087c1f1740 1 --2- 172.21.15.6:0/327245785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 0x561c98170230 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f086000c940 tx=0x7f0860005770 comp rx=0 tx=0).stop 2024-05-20T17:07:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.902+0000 7f087c1f1740 1 -- 172.21.15.6:0/327245785 shutdown_connections 2024-05-20T17:07:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.902+0000 7f087c1f1740 1 --2- 172.21.15.6:0/327245785 >> [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] conn(0x561c97d84e40 0x561c9817e140 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.902+0000 7f087c1f1740 1 --2- 172.21.15.6:0/327245785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c97dc6270 0x561c981776d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.902+0000 7f087c1f1740 1 --2- 172.21.15.6:0/327245785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97da5590 0x561c98170770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.902+0000 7f087c1f1740 1 --2- 172.21.15.6:0/327245785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 0x561c98170230 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.902+0000 7f0852ff5640 0 client.15291 ms_handle_reset on v2:172.21.15.171:6838/3246292303 2024-05-20T17:07:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.902+0000 7f087c1f1740 1 -- 172.21.15.6:0/327245785 >> 172.21.15.6:0/327245785 conn(0x561c97dba3c0 msgr2=0x561c98160ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.902+0000 7f087c1f1740 1 -- 172.21.15.6:0/327245785 shutdown_connections 2024-05-20T17:07:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.902+0000 7f087c1f1740 1 -- 172.21.15.6:0/327245785 wait complete. 2024-05-20T17:07:03.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.902+0000 7f087c1f1740 20 client.15291 trim_cache size 0 max 16384 2024-05-20T17:07:03.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.921+0000 7f087c1f1740 1 Processor -- start 2024-05-20T17:07:03.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.921+0000 7f087c1f1740 1 -- start start 2024-05-20T17:07:03.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.922+0000 7f087c1f1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 0x561c98161e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.922+0000 7f087c1f1740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97da5590 0x561c981697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.922+0000 7f087c1f1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c97dc6270 0x561c9816e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.922+0000 7f087c1f1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561c9817c480 con 0x561c97d9d3b0 2024-05-20T17:07:03.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.922+0000 7f087c1f1740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561c9817cb50 con 0x561c97da5590 2024-05-20T17:07:03.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.922+0000 7f087c1f1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561c9817d220 con 0x561c97dc6270 2024-05-20T17:07:03.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.922+0000 7f086effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 0x561c98161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.922+0000 7f086effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 0x561c98161e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58572/0 (socket says 172.21.15.6:58572) 2024-05-20T17:07:03.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.922+0000 7f086effd640 1 -- 172.21.15.6:0/355173399 learned_addr learned my addr 172.21.15.6:0/355173399 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.922+0000 7f086e7fc640 1 --2- 172.21.15.6:0/355173399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97da5590 0x561c981697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.922+0000 7f086effd640 1 -- 172.21.15.6:0/355173399 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c97dc6270 msgr2=0x561c9816e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.922+0000 7f086effd640 1 --2- 172.21.15.6:0/355173399 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c97dc6270 0x561c9816e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.922+0000 7f086effd640 1 -- 172.21.15.6:0/355173399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97da5590 msgr2=0x561c981697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.922+0000 7f086effd640 1 --2- 172.21.15.6:0/355173399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97da5590 0x561c981697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.922+0000 7f086effd640 1 -- 172.21.15.6:0/355173399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c98166020 con 0x561c97d9d3b0 2024-05-20T17:07:03.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.922+0000 7f086effd640 1 --2- 172.21.15.6:0/355173399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 0x561c98161e60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f086009fc00 tx=0x7f08600ba1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617545752e729f08 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.922+0000 7f0854ff9640 1 -- 172.21.15.6:0/355173399 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086001d040 con 0x561c97d9d3b0 2024-05-20T17:07:03.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.922+0000 7f0854ff9640 1 -- 172.21.15.6:0/355173399 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f086007e020 con 0x561c97d9d3b0 2024-05-20T17:07:03.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.922+0000 7f0854ff9640 1 -- 172.21.15.6:0/355173399 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860097520 con 0x561c97d9d3b0 2024-05-20T17:07:03.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.923+0000 7f087c1f1740 1 -- 172.21.15.6:0/355173399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 msgr2=0x561c98161e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.923+0000 7f087c1f1740 1 --2- 172.21.15.6:0/355173399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 0x561c98161e60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f086009fc00 tx=0x7f08600ba1c0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.923+0000 7f087c1f1740 1 -- 172.21.15.6:0/355173399 shutdown_connections 2024-05-20T17:07:03.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.923+0000 7f087c1f1740 1 --2- 172.21.15.6:0/355173399 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c97dc6270 0x561c9816e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.923+0000 7f087c1f1740 1 --2- 172.21.15.6:0/355173399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97da5590 0x561c981697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.923+0000 7f087c1f1740 1 --2- 172.21.15.6:0/355173399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 0x561c98161e60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.923+0000 7f087c1f1740 1 -- 172.21.15.6:0/355173399 >> 172.21.15.6:0/355173399 conn(0x561c97dba3c0 msgr2=0x561c98177a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.923+0000 7f087c1f1740 1 -- 172.21.15.6:0/355173399 shutdown_connections 2024-05-20T17:07:03.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.923+0000 7f087c1f1740 1 -- 172.21.15.6:0/355173399 wait complete. 2024-05-20T17:07:03.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.923+0000 7f087c1f1740 1 -- start start 2024-05-20T17:07:03.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.924+0000 7f087c1f1740 1 Processor -- start 2024-05-20T17:07:03.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.924+0000 7f087c1f1740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 0x561c98177310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.924+0000 7f087c1f1740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97da5590 0x561c98177850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.924+0000 7f087c1f1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c97dc6270 0x561c981e9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.924+0000 7f087c1f1740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561c9817dfc0 con 0x561c97d9d3b0 2024-05-20T17:07:03.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.924+0000 7f087c1f1740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561c9817d8f0 con 0x561c97da5590 2024-05-20T17:07:03.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.924+0000 7f087c1f1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561c9817e690 con 0x561c97dc6270 2024-05-20T17:07:03.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.924+0000 7f087c1f1740 10 client.0 _ll_register_callbacks cb 0x7f086009b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:07:03.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.924+0000 7f086effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 0x561c98177310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.924+0000 7f086effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 0x561c98177310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58584/0 (socket says 172.21.15.6:58584) 2024-05-20T17:07:03.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.924+0000 7f086effd640 1 -- 172.21.15.6:0/3835517887 learned_addr learned my addr 172.21.15.6:0/3835517887 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:03.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.924+0000 7f086e7fc640 1 --2- 172.21.15.6:0/3835517887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97da5590 0x561c98177850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.924+0000 7f086effd640 1 -- 172.21.15.6:0/3835517887 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c97dc6270 msgr2=0x561c981e9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.924+0000 7f086effd640 1 --2- 172.21.15.6:0/3835517887 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c97dc6270 0x561c981e9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.924+0000 7f086effd640 1 -- 172.21.15.6:0/3835517887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97da5590 msgr2=0x561c98177850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:03.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.924+0000 7f086effd640 1 --2- 172.21.15.6:0/3835517887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97da5590 0x561c98177850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.924+0000 7f086effd640 1 -- 172.21.15.6:0/3835517887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c981e9bb0 con 0x561c97d9d3b0 2024-05-20T17:07:03.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.924+0000 7f086effd640 1 --2- 172.21.15.6:0/3835517887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 0x561c98177310 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0860098060 tx=0x7f086009b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e9e79f4524a259 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:03.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.924+0000 7f0852ff5640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:07:03.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.925+0000 7f0852ff5640 1 -- 172.21.15.6:0/3835517887 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08600a4300 con 0x561c97d9d3b0 2024-05-20T17:07:03.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.925+0000 7f0852ff5640 1 -- 172.21.15.6:0/3835517887 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f0860097520 con 0x561c97d9d3b0 2024-05-20T17:07:03.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.925+0000 7f087c1f1740 1 -- 172.21.15.6:0/3835517887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f086007e020 con 0x561c97d9d3b0 2024-05-20T17:07:03.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.925+0000 7f0852ff5640 1 -- 172.21.15.6:0/3835517887 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0860097720 con 0x561c97d9d3b0 2024-05-20T17:07:03.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.925+0000 7f087c1f1740 10 client.15297 fetch_fsmap learned FSMap version 28 2024-05-20T17:07:03.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.925+0000 7f087c1f1740 1 -- 172.21.15.6:0/3835517887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561c981eae30 con 0x561c97d9d3b0 2024-05-20T17:07:03.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.925+0000 7f0852ff5640 1 -- 172.21.15.6:0/3835517887 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f086007e020 con 0x561c97d9d3b0 2024-05-20T17:07:03.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.925+0000 7f0852ff5640 1 -- 172.21.15.6:0/3835517887 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f08600bb340 con 0x561c97d9d3b0 2024-05-20T17:07:03.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.925+0000 7f087c1f1740 10 client.15297 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:07:03.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.925+0000 7f087c1f1740 10 client.15297 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-20T17:07:03.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.925+0000 7f087c1f1740 20 client.15297 populate_metadata read hostname 'smithi006' 2024-05-20T17:07:03.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.925+0000 7f087c1f1740 1 --2- 172.21.15.6:0/3835517887 >> [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] conn(0x561c97d5a280 0x561c981ee5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:03.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.925+0000 7f087c1f1740 4 client.15297 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:07:03.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.925+0000 7f087c1f1740 1 -- 172.21.15.6:0/3835517887 --> [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] -- command(tid 0: {"prefix": "status"}) -- 0x561c9815cee0 con 0x561c97d5a280 2024-05-20T17:07:03.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.925+0000 7f086e7fc640 1 --2- 172.21.15.6:0/3835517887 >> [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] conn(0x561c97d5a280 0x561c981ee5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:03.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.926+0000 7f0852ff5640 10 client.15297 ms_handle_connect on v2:172.21.15.171:6838/3246292303 2024-05-20T17:07:03.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.926+0000 7f086e7fc640 1 --2- 172.21.15.6:0/3835517887 >> [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] conn(0x561c97d5a280 0x561c981ee5c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=75db2b3d387cb96a server_cookie=e9e6b8f5ad5ad986 in_seq=0 out_seq=0 2024-05-20T17:07:03.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.926+0000 7f0852ff5640 1 -- 172.21.15.6:0/3835517887 <== mds.1 v2:172.21.15.171:6838/3246292303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x561c9815cee0 con 0x561c97d5a280 2024-05-20T17:07:03.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.926+0000 7f0852ff5640 10 client.15297 handle_command_reply: tid=0 2024-05-20T17:07:03.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.926+0000 7f087c1f1740 1 client.15297 shutdown 2024-05-20T17:07:03.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.926+0000 7f087c1f1740 1 -- 172.21.15.6:0/3835517887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 msgr2=0x561c98177310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.926+0000 7f087c1f1740 1 --2- 172.21.15.6:0/3835517887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 0x561c98177310 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0860098060 tx=0x7f086009b260 comp rx=0 tx=0).stop 2024-05-20T17:07:03.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.926+0000 7f087c1f1740 1 -- 172.21.15.6:0/3835517887 shutdown_connections 2024-05-20T17:07:03.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.926+0000 7f087c1f1740 1 --2- 172.21.15.6:0/3835517887 >> [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] conn(0x561c97d5a280 0x561c981ee5c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.926+0000 7f087c1f1740 1 --2- 172.21.15.6:0/3835517887 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c97dc6270 0x561c981e9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.926+0000 7f087c1f1740 1 --2- 172.21.15.6:0/3835517887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c97da5590 0x561c98177850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.926+0000 7f0852ff5640 0 client.15297 ms_handle_reset on v2:172.21.15.171:6838/3246292303 2024-05-20T17:07:03.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.926+0000 7f087c1f1740 1 --2- 172.21.15.6:0/3835517887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c97d9d3b0 0x561c98177310 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.926+0000 7f087c1f1740 1 -- 172.21.15.6:0/3835517887 >> 172.21.15.6:0/3835517887 conn(0x561c97dba3c0 msgr2=0x561c9816fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.926+0000 7f087c1f1740 1 -- 172.21.15.6:0/3835517887 shutdown_connections 2024-05-20T17:07:03.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.926+0000 7f087c1f1740 1 -- 172.21.15.6:0/3835517887 wait complete. 2024-05-20T17:07:03.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.927+0000 7f087c1f1740 20 client.15297 trim_cache size 0 max 16384 2024-05-20T17:07:03.932 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:07:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c726c954-16c9-11ef-bc9a-c7b262605968", 2024-05-20T17:07:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 1, 2024-05-20T17:07:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24526, 2024-05-20T17:07:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T17:07:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T17:07:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T17:07:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 92.288496582999997, 2024-05-20T17:07:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 28, 2024-05-20T17:07:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 94, 2024-05-20T17:07:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 90, 2024-05-20T17:07:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 133.84610479700001 2024-05-20T17:07:03.933 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:07:03.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.927+0000 7f0875275640 1 -- 172.21.15.6:0/1376103607 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f08580a2b90 msgr2=0x7f08580a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.927+0000 7f0875275640 1 --2- 172.21.15.6:0/1376103607 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f08580a2b90 0x7f08580a50a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0868005c40 tx=0x7f0868009590 comp rx=0 tx=0).stop 2024-05-20T17:07:03.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.927+0000 7f0875275640 1 -- 172.21.15.6:0/1376103607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0870100710 msgr2=0x7f08701991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:03.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.927+0000 7f0875275640 1 --2- 172.21.15.6:0/1376103607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0870100710 0x7f08701991c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f086000c970 tx=0x7f086000ce30 comp rx=0 tx=0).stop 2024-05-20T17:07:03.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.927+0000 7f0875275640 1 -- 172.21.15.6:0/1376103607 shutdown_connections 2024-05-20T17:07:03.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.927+0000 7f0875275640 1 --2- 172.21.15.6:0/1376103607 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f08580a2b90 0x7f08580a50a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.927+0000 7f0875275640 1 --2- 172.21.15.6:0/1376103607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0870104060 0x7f08701a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.927+0000 7f0875275640 1 --2- 172.21.15.6:0/1376103607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0870101210 0x7f0870199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.927+0000 7f0875275640 1 --2- 172.21.15.6:0/1376103607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0870100710 0x7f08701991c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:03.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.927+0000 7f0875275640 1 -- 172.21.15.6:0/1376103607 >> 172.21.15.6:0/1376103607 conn(0x7f08700fc330 msgr2=0x7f0870104bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:03.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.927+0000 7f0875275640 1 -- 172.21.15.6:0/1376103607 shutdown_connections 2024-05-20T17:07:03.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:03.927+0000 7f0875275640 1 -- 172.21.15.6:0/1376103607 wait complete. 2024-05-20T17:07:03.938 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-20T17:07:04.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:03 smithi062 ceph-mon[35425]: pgmap v364: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:07:04.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:03 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2807621347' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:07:04.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:03 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3184463034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:07:04.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.055+0000 7f2c9ef45640 1 -- 172.21.15.6:0/2226875177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c981078c0 msgr2=0x7f2c98109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.055+0000 7f2c9ef45640 1 --2- 172.21.15.6:0/2226875177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c981078c0 0x7f2c98109ce0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2c80009900 tx=0x7f2c8002a410 comp rx=0 tx=0).stop 2024-05-20T17:07:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.055+0000 7f2c9ef45640 1 -- 172.21.15.6:0/2226875177 shutdown_connections 2024-05-20T17:07:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.055+0000 7f2c9ef45640 1 --2- 172.21.15.6:0/2226875177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c981078c0 0x7f2c98109ce0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.055+0000 7f2c9ef45640 1 --2- 172.21.15.6:0/2226875177 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c98102bc0 0x7f2c98102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.055+0000 7f2c9ef45640 1 --2- 172.21.15.6:0/2226875177 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c98101980 0x7f2c98102680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.055+0000 7f2c9ef45640 1 -- 172.21.15.6:0/2226875177 >> 172.21.15.6:0/2226875177 conn(0x7f2c980fcb70 msgr2=0x7f2c980ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.055+0000 7f2c9ef45640 1 -- 172.21.15.6:0/2226875177 shutdown_connections 2024-05-20T17:07:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.055+0000 7f2c9ef45640 1 -- 172.21.15.6:0/2226875177 wait complete. 2024-05-20T17:07:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.056+0000 7f2c9ef45640 1 Processor -- start 2024-05-20T17:07:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.056+0000 7f2c9ef45640 1 -- start start 2024-05-20T17:07:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.056+0000 7f2c9ef45640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c98101980 0x7f2c98198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.056+0000 7f2c9ef45640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c98102bc0 0x7f2c98198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.056+0000 7f2c9ef45640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c981078c0 0x7f2c9819f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.056+0000 7f2c9ef45640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9810d4b0 con 0x7f2c98102bc0 2024-05-20T17:07:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.056+0000 7f2c9ef45640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9810d330 con 0x7f2c981078c0 2024-05-20T17:07:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.056+0000 7f2c9ef45640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9810d630 con 0x7f2c98101980 2024-05-20T17:07:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.056+0000 7f2c97fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c98102bc0 0x7f2c98198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.056+0000 7f2c97fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c98102bc0 0x7f2c98198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58596/0 (socket says 172.21.15.6:58596) 2024-05-20T17:07:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.056+0000 7f2c97fff640 1 -- 172.21.15.6:0/582240405 learned_addr learned my addr 172.21.15.6:0/582240405 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.056+0000 7f2c9cce1640 1 --2- 172.21.15.6:0/582240405 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c98101980 0x7f2c98198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.056+0000 7f2c97fff640 1 -- 172.21.15.6:0/582240405 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c98101980 msgr2=0x7f2c98198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.056+0000 7f2c97fff640 1 --2- 172.21.15.6:0/582240405 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c98101980 0x7f2c98198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.056+0000 7f2c97fff640 1 -- 172.21.15.6:0/582240405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c981078c0 msgr2=0x7f2c9819f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.056+0000 7f2c9d4e2640 1 --2- 172.21.15.6:0/582240405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c981078c0 0x7f2c9819f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.056+0000 7f2c97fff640 1 --2- 172.21.15.6:0/582240405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c981078c0 0x7f2c9819f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.056+0000 7f2c97fff640 1 -- 172.21.15.6:0/582240405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9819fab0 con 0x7f2c98102bc0 2024-05-20T17:07:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.056+0000 7f2c9cce1640 1 --2- 172.21.15.6:0/582240405 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c98101980 0x7f2c98198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.057+0000 7f2c97fff640 1 --2- 172.21.15.6:0/582240405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c98102bc0 0x7f2c98198560 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800cce0 tx=0x7f2c8800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.057+0000 7f2c95ffb640 1 -- 172.21.15.6:0/582240405 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8800f650 con 0x7f2c98102bc0 2024-05-20T17:07:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.057+0000 7f2c9ef45640 1 -- 172.21.15.6:0/582240405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c9819fda0 con 0x7f2c98102bc0 2024-05-20T17:07:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.057+0000 7f2c95ffb640 1 -- 172.21.15.6:0/582240405 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c8800fca0 con 0x7f2c98102bc0 2024-05-20T17:07:04.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.057+0000 7f2c95ffb640 1 -- 172.21.15.6:0/582240405 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c88018b90 con 0x7f2c98102bc0 2024-05-20T17:07:04.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.057+0000 7f2c9ef45640 1 -- 172.21.15.6:0/582240405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c981a0210 con 0x7f2c98102bc0 2024-05-20T17:07:04.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.059+0000 7f2ca5df4740 1 Processor -- start 2024-05-20T17:07:04.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.060+0000 7f2c95ffb640 1 -- 172.21.15.6:0/582240405 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f2c8800f7f0 con 0x7f2c98102bc0 2024-05-20T17:07:04.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.060+0000 7f2ca5df4740 1 -- start start 2024-05-20T17:07:04.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.060+0000 7f2ca5df4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222fd270 0x55612269d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:04.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.060+0000 7f2ca5df4740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222d43b0 0x55612269d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:04.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.060+0000 7f2ca5df4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5561222dc590 0x5561226a48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:04.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.060+0000 7f2ca5df4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5561226014d0 con 0x5561222fd270 2024-05-20T17:07:04.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.060+0000 7f2ca5df4740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5561225a93e0 con 0x5561222d43b0 2024-05-20T17:07:04.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.060+0000 7f2ca5df4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5561225fd490 con 0x5561222dc590 2024-05-20T17:07:04.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.060+0000 7f2c9d4e2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222fd270 0x55612269d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:04.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.060+0000 7f2c9d4e2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222fd270 0x55612269d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58610/0 (socket says 172.21.15.6:58610) 2024-05-20T17:07:04.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.060+0000 7f2c9d4e2640 1 -- 172.21.15.6:0/3198587285 learned_addr learned my addr 172.21.15.6:0/3198587285 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:04.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.060+0000 7f2c9cce1640 1 --2- 172.21.15.6:0/3198587285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222d43b0 0x55612269d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:04.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.060+0000 7f2c97fff640 1 --2- 172.21.15.6:0/3198587285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5561222dc590 0x5561226a48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:04.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.060+0000 7f2c9d4e2640 1 -- 172.21.15.6:0/3198587285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5561222dc590 msgr2=0x5561226a48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:04.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.060+0000 7f2c9d4e2640 1 --2- 172.21.15.6:0/3198587285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5561222dc590 0x5561226a48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.060+0000 7f2c9d4e2640 1 -- 172.21.15.6:0/3198587285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222d43b0 msgr2=0x55612269d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:04.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.060+0000 7f2c9d4e2640 1 --2- 172.21.15.6:0/3198587285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222d43b0 0x55612269d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.060+0000 7f2c9d4e2640 1 -- 172.21.15.6:0/3198587285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561223152d0 con 0x5561222fd270 2024-05-20T17:07:04.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.060+0000 7f2c95ffb640 1 --2- 172.21.15.6:0/582240405 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2c840a2b90 0x7f2c840a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:04.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.060+0000 7f2c97fff640 1 --2- 172.21.15.6:0/3198587285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5561222dc590 0x5561226a48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:07:04.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.061+0000 7f2c97fff640 1 --2- 172.21.15.6:0/582240405 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2c840a2b90 0x7f2c840a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:04.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.061+0000 7f2c9d4e2640 1 --2- 172.21.15.6:0/3198587285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222fd270 0x55612269d470 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2c80005ab0 tx=0x7f2c80032b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78d2b138bdc9a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:04.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.061+0000 7f2c95ffb640 1 -- 172.21.15.6:0/582240405 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f2c880cf980 con 0x7f2c98102bc0 2024-05-20T17:07:04.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.061+0000 7f2c8effd640 1 -- 172.21.15.6:0/3198587285 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8003f070 con 0x5561222fd270 2024-05-20T17:07:04.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.061+0000 7f2c8effd640 1 -- 172.21.15.6:0/3198587285 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c80004030 con 0x5561222fd270 2024-05-20T17:07:04.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.061+0000 7f2c8effd640 1 -- 172.21.15.6:0/3198587285 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c80035070 con 0x5561222fd270 2024-05-20T17:07:04.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.062+0000 7f2ca5df4740 1 -- 172.21.15.6:0/3198587285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222fd270 msgr2=0x55612269d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:04.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.062+0000 7f2c97fff640 1 --2- 172.21.15.6:0/582240405 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2c840a2b90 0x7f2c840a50a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800ab20 tx=0x7f2c88000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:04.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.062+0000 7f2ca5df4740 1 --2- 172.21.15.6:0/3198587285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222fd270 0x55612269d470 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2c80005ab0 tx=0x7f2c80032b80 comp rx=0 tx=0).stop 2024-05-20T17:07:04.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.062+0000 7f2ca5df4740 1 -- 172.21.15.6:0/3198587285 shutdown_connections 2024-05-20T17:07:04.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.062+0000 7f2ca5df4740 1 --2- 172.21.15.6:0/3198587285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5561222dc590 0x5561226a48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.062+0000 7f2ca5df4740 1 --2- 172.21.15.6:0/3198587285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222d43b0 0x55612269d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.062+0000 7f2ca5df4740 1 --2- 172.21.15.6:0/3198587285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222fd270 0x55612269d470 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.062+0000 7f2ca5df4740 1 -- 172.21.15.6:0/3198587285 >> 172.21.15.6:0/3198587285 conn(0x5561222f13c0 msgr2=0x556122698e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:04.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.062+0000 7f2ca5df4740 1 -- 172.21.15.6:0/3198587285 shutdown_connections 2024-05-20T17:07:04.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.062+0000 7f2ca5df4740 1 -- 172.21.15.6:0/3198587285 wait complete. 2024-05-20T17:07:04.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.062+0000 7f2ca5df4740 1 -- start start 2024-05-20T17:07:04.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.062+0000 7f2ca5df4740 1 Processor -- start 2024-05-20T17:07:04.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.063+0000 7f2ca5df4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5561222d43b0 0x5561226a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:04.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.063+0000 7f2ca5df4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222dc590 0x5561226a7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:04.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.063+0000 7f2ca5df4740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222fd270 0x5561226ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:04.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.063+0000 7f2ca5df4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5561226a52e0 con 0x5561222dc590 2024-05-20T17:07:04.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.063+0000 7f2ca5df4740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5561225bc8e0 con 0x5561222fd270 2024-05-20T17:07:04.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.063+0000 7f2ca5df4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5561226a5460 con 0x5561222d43b0 2024-05-20T17:07:04.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.063+0000 7f2ca5df4740 10 client.0 _ll_register_callbacks cb 0x5561225899c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:07:04.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.063+0000 7f2c9cce1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222dc590 0x5561226a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:04.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.063+0000 7f2c9cce1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222dc590 0x5561226a7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58618/0 (socket says 172.21.15.6:58618) 2024-05-20T17:07:04.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.063+0000 7f2c9cce1640 1 -- 172.21.15.6:0/2065184379 learned_addr learned my addr 172.21.15.6:0/2065184379 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:04.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.063+0000 7f2c9d4e2640 1 --2- 172.21.15.6:0/2065184379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222fd270 0x5561226ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:04.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.063+0000 7f2c9d4e2640 1 --2- 172.21.15.6:0/2065184379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5561222d43b0 0x5561226a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:04.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.063+0000 7f2c9cce1640 1 -- 172.21.15.6:0/2065184379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5561222d43b0 msgr2=0x5561226a7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:04.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.063+0000 7f2c9cce1640 1 --2- 172.21.15.6:0/2065184379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5561222d43b0 0x5561226a7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.063+0000 7f2c9cce1640 1 -- 172.21.15.6:0/2065184379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222fd270 msgr2=0x5561226ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:04.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.063+0000 7f2c9cce1640 1 --2- 172.21.15.6:0/2065184379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222fd270 0x5561226ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.063+0000 7f2c9cce1640 1 -- 172.21.15.6:0/2065184379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561223df6b0 con 0x5561222dc590 2024-05-20T17:07:04.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.063+0000 7f2c9d4e2640 1 --2- 172.21.15.6:0/2065184379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5561222d43b0 0x5561226a7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:04.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.063+0000 7f2c9cce1640 1 --2- 172.21.15.6:0/2065184379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222dc590 0x5561226a7740 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000bf00 tx=0x7f2c900129b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9137f27b9b43aab3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:04.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.063+0000 7f2c77fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:07:04.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.064+0000 7f2c77fff640 1 -- 172.21.15.6:0/2065184379 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90004300 con 0x5561222dc590 2024-05-20T17:07:04.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.064+0000 7f2c77fff640 1 -- 172.21.15.6:0/2065184379 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f2c900035f0 con 0x5561222dc590 2024-05-20T17:07:04.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.064+0000 7f2ca5df4740 1 -- 172.21.15.6:0/2065184379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c80004030 con 0x5561222dc590 2024-05-20T17:07:04.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.064+0000 7f2c77fff640 1 -- 172.21.15.6:0/2065184379 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2c90025050 con 0x5561222dc590 2024-05-20T17:07:04.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.064+0000 7f2ca5df4740 10 client.15309 fetch_fsmap learned FSMap version 28 2024-05-20T17:07:04.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.064+0000 7f2ca5df4740 1 -- 172.21.15.6:0/2065184379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5561226b1610 con 0x5561222dc590 2024-05-20T17:07:04.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.064+0000 7f2c77fff640 1 -- 172.21.15.6:0/2065184379 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c80004030 con 0x5561222dc590 2024-05-20T17:07:04.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.064+0000 7f2c77fff640 1 -- 172.21.15.6:0/2065184379 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2c9000f910 con 0x5561222dc590 2024-05-20T17:07:04.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.064+0000 7f2ca5df4740 10 client.15309 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:07:04.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.064+0000 7f2ca5df4740 10 client.15309 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-20T17:07:04.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.064+0000 7f2ca5df4740 20 client.15309 populate_metadata read hostname 'smithi006' 2024-05-20T17:07:04.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.064+0000 7f2ca5df4740 1 --2- 172.21.15.6:0/2065184379 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x5561222bbe40 0x5561226b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:04.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.064+0000 7f2ca5df4740 4 client.15309 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:07:04.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.064+0000 7f2ca5df4740 1 -- 172.21.15.6:0/2065184379 --> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55612260ec00 con 0x5561222bbe40 2024-05-20T17:07:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.065+0000 7f2c9d4e2640 1 --2- 172.21.15.6:0/2065184379 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x5561222bbe40 0x5561226b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.065+0000 7f2c9d4e2640 1 --2- 172.21.15.6:0/2065184379 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x5561222bbe40 0x5561226b5110 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c036125c3b09b83e server_cookie=98643bc8d7938af6 in_seq=0 out_seq=0 2024-05-20T17:07:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.065+0000 7f2c77fff640 10 client.15309 ms_handle_connect on v2:172.21.15.62:6838/3023093487 2024-05-20T17:07:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.066+0000 7f2c77fff640 1 -- 172.21.15.6:0/2065184379 <== mds.0 v2:172.21.15.62:6838/3023093487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55612260ec00 con 0x5561222bbe40 2024-05-20T17:07:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.066+0000 7f2c77fff640 10 client.15309 handle_command_reply: tid=0 2024-05-20T17:07:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.066+0000 7f2ca5df4740 1 client.15309 shutdown 2024-05-20T17:07:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.066+0000 7f2ca5df4740 1 -- 172.21.15.6:0/2065184379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222dc590 msgr2=0x5561226a7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.066+0000 7f2ca5df4740 1 --2- 172.21.15.6:0/2065184379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222dc590 0x5561226a7740 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000bf00 tx=0x7f2c900129b0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.066+0000 7f2ca5df4740 1 -- 172.21.15.6:0/2065184379 shutdown_connections 2024-05-20T17:07:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.066+0000 7f2ca5df4740 1 --2- 172.21.15.6:0/2065184379 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x5561222bbe40 0x5561226b5110 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.066+0000 7f2ca5df4740 1 --2- 172.21.15.6:0/2065184379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222fd270 0x5561226ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.066+0000 7f2ca5df4740 1 --2- 172.21.15.6:0/2065184379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222dc590 0x5561226a7740 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.066+0000 7f2c77fff640 0 client.15309 ms_handle_reset on v2:172.21.15.62:6838/3023093487 2024-05-20T17:07:04.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.066+0000 7f2ca5df4740 1 --2- 172.21.15.6:0/2065184379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5561222d43b0 0x5561226a7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.066+0000 7f2ca5df4740 1 -- 172.21.15.6:0/2065184379 >> 172.21.15.6:0/2065184379 conn(0x5561222f13c0 msgr2=0x556122697ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:04.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.066+0000 7f2ca5df4740 1 -- 172.21.15.6:0/2065184379 shutdown_connections 2024-05-20T17:07:04.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.066+0000 7f2ca5df4740 1 -- 172.21.15.6:0/2065184379 wait complete. 2024-05-20T17:07:04.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.066+0000 7f2ca5df4740 20 client.15309 trim_cache size 0 max 16384 2024-05-20T17:07:04.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.085+0000 7f2ca5df4740 1 Processor -- start 2024-05-20T17:07:04.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.085+0000 7f2ca5df4740 1 -- start start 2024-05-20T17:07:04.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.085+0000 7f2ca5df4740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222d43b0 0x556122698f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:04.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.085+0000 7f2ca5df4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222dc590 0x5561226a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:04.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.085+0000 7f2ca5df4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5561222fd270 0x5561226ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:04.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.085+0000 7f2ca5df4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5561226b3450 con 0x5561222dc590 2024-05-20T17:07:04.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.085+0000 7f2ca5df4740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5561226b3b20 con 0x5561222d43b0 2024-05-20T17:07:04.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.085+0000 7f2ca5df4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5561226b41f0 con 0x5561222fd270 2024-05-20T17:07:04.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.085+0000 7f2c9cce1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222dc590 0x5561226a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:04.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.085+0000 7f2c9cce1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222dc590 0x5561226a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58622/0 (socket says 172.21.15.6:58622) 2024-05-20T17:07:04.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.085+0000 7f2c9cce1640 1 -- 172.21.15.6:0/3907622763 learned_addr learned my addr 172.21.15.6:0/3907622763 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:04.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.086+0000 7f2c9d4e2640 1 --2- 172.21.15.6:0/3907622763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222d43b0 0x556122698f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:04.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.086+0000 7f2c9cce1640 1 -- 172.21.15.6:0/3907622763 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5561222fd270 msgr2=0x5561226ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:04.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.086+0000 7f2c9cce1640 1 --2- 172.21.15.6:0/3907622763 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5561222fd270 0x5561226ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.086+0000 7f2c9cce1640 1 -- 172.21.15.6:0/3907622763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222d43b0 msgr2=0x556122698f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:04.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.086+0000 7f2c9cce1640 1 --2- 172.21.15.6:0/3907622763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222d43b0 0x556122698f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.086+0000 7f2c9cce1640 1 -- 172.21.15.6:0/3907622763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55612269d020 con 0x5561222dc590 2024-05-20T17:07:04.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.086+0000 7f2c9d4e2640 1 --2- 172.21.15.6:0/3907622763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222d43b0 0x556122698f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:04.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.086+0000 7f2c9cce1640 1 --2- 172.21.15.6:0/3907622763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222dc590 0x5561226a5ed0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2c90001eb0 tx=0x7f2c9000ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cafb9d12ee1f8131 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:04.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.086+0000 7f2c8e7fc640 1 -- 172.21.15.6:0/3907622763 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90000e60 con 0x5561222dc590 2024-05-20T17:07:04.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.086+0000 7f2c8e7fc640 1 -- 172.21.15.6:0/3907622763 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c9000f9f0 con 0x5561222dc590 2024-05-20T17:07:04.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.086+0000 7f2c8e7fc640 1 -- 172.21.15.6:0/3907622763 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c900039b0 con 0x5561222dc590 2024-05-20T17:07:04.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.087+0000 7f2ca5df4740 1 -- 172.21.15.6:0/3907622763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222dc590 msgr2=0x5561226a5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:04.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.087+0000 7f2ca5df4740 1 --2- 172.21.15.6:0/3907622763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222dc590 0x5561226a5ed0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2c90001eb0 tx=0x7f2c9000ffd0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.087+0000 7f2ca5df4740 1 -- 172.21.15.6:0/3907622763 shutdown_connections 2024-05-20T17:07:04.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.087+0000 7f2ca5df4740 1 --2- 172.21.15.6:0/3907622763 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5561222fd270 0x5561226ae5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.087+0000 7f2ca5df4740 1 --2- 172.21.15.6:0/3907622763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222dc590 0x5561226a5ed0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.087+0000 7f2ca5df4740 1 --2- 172.21.15.6:0/3907622763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222d43b0 0x556122698f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.087+0000 7f2ca5df4740 1 -- 172.21.15.6:0/3907622763 >> 172.21.15.6:0/3907622763 conn(0x5561222f13c0 msgr2=0x5561226987f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.087+0000 7f2ca5df4740 1 -- 172.21.15.6:0/3907622763 shutdown_connections 2024-05-20T17:07:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.087+0000 7f2ca5df4740 1 -- 172.21.15.6:0/3907622763 wait complete. 2024-05-20T17:07:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.087+0000 7f2ca5df4740 1 -- start start 2024-05-20T17:07:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.087+0000 7f2ca5df4740 1 Processor -- start 2024-05-20T17:07:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2ca5df4740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5561222d43b0 0x5561226a9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2ca5df4740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222dc590 0x5561226a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2ca5df4740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222fd270 0x55612271bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2ca5df4740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5561226b4f90 con 0x5561222fd270 2024-05-20T17:07:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2ca5df4740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5561226b48c0 con 0x5561222dc590 2024-05-20T17:07:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2ca5df4740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5561226b5660 con 0x5561222d43b0 2024-05-20T17:07:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2ca5df4740 10 client.0 _ll_register_callbacks cb 0x7f2c9000b8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:07:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2c9d4e2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222fd270 0x55612271bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2c9d4e2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222fd270 0x55612271bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58634/0 (socket says 172.21.15.6:58634) 2024-05-20T17:07:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2c9d4e2640 1 -- 172.21.15.6:0/3406864696 learned_addr learned my addr 172.21.15.6:0/3406864696 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2c9cce1640 1 --2- 172.21.15.6:0/3406864696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222dc590 0x5561226a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2c9d4e2640 1 -- 172.21.15.6:0/3406864696 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5561222d43b0 msgr2=0x5561226a9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2c9d4e2640 1 --2- 172.21.15.6:0/3406864696 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5561222d43b0 0x5561226a9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2c9d4e2640 1 -- 172.21.15.6:0/3406864696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222dc590 msgr2=0x5561226a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2c9d4e2640 1 --2- 172.21.15.6:0/3406864696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222dc590 0x5561226a9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2c9d4e2640 1 -- 172.21.15.6:0/3406864696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561226ae830 con 0x5561222fd270 2024-05-20T17:07:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2c9d4e2640 1 --2- 172.21.15.6:0/3406864696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222fd270 0x55612271bf80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2c80009a20 tx=0x7f2c8002a9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658ce952f6229b67 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2c77fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:07:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2c77fff640 1 -- 172.21.15.6:0/3406864696 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8003f040 con 0x5561222fd270 2024-05-20T17:07:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2c77fff640 1 -- 172.21.15.6:0/3406864696 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f2c80052c70 con 0x5561222fd270 2024-05-20T17:07:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.088+0000 7f2ca5df4740 1 -- 172.21.15.6:0/3406864696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c9000f9f0 con 0x5561222fd270 2024-05-20T17:07:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.089+0000 7f2c77fff640 1 -- 172.21.15.6:0/3406864696 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2c80060050 con 0x5561222fd270 2024-05-20T17:07:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.089+0000 7f2ca5df4740 10 client.15315 fetch_fsmap learned FSMap version 28 2024-05-20T17:07:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.089+0000 7f2ca5df4740 1 -- 172.21.15.6:0/3406864696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55612271d390 con 0x5561222fd270 2024-05-20T17:07:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.089+0000 7f2c77fff640 1 -- 172.21.15.6:0/3406864696 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c9000f9f0 con 0x5561222fd270 2024-05-20T17:07:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.089+0000 7f2c77fff640 1 -- 172.21.15.6:0/3406864696 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2c800315f0 con 0x5561222fd270 2024-05-20T17:07:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.089+0000 7f2ca5df4740 10 client.15315 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:07:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.089+0000 7f2ca5df4740 10 client.15315 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-20T17:07:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.089+0000 7f2ca5df4740 20 client.15315 populate_metadata read hostname 'smithi006' 2024-05-20T17:07:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.089+0000 7f2ca5df4740 1 --2- 172.21.15.6:0/3406864696 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x556122291280 0x556122720790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.089+0000 7f2ca5df4740 4 client.15315 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:07:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.089+0000 7f2ca5df4740 1 -- 172.21.15.6:0/3406864696 --> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] -- command(tid 0: {"prefix": "status"}) -- 0x556122608f50 con 0x556122291280 2024-05-20T17:07:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.089+0000 7f2c9cce1640 1 --2- 172.21.15.6:0/3406864696 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x556122291280 0x556122720790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.090+0000 7f2c77fff640 10 client.15315 ms_handle_connect on v2:172.21.15.62:6838/3023093487 2024-05-20T17:07:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.090+0000 7f2c9cce1640 1 --2- 172.21.15.6:0/3406864696 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x556122291280 0x556122720790 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=535b13d7b37ca08a server_cookie=277970480d8ff89a in_seq=0 out_seq=0 2024-05-20T17:07:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.090+0000 7f2c77fff640 1 -- 172.21.15.6:0/3406864696 <== mds.0 v2:172.21.15.62:6838/3023093487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x556122608f50 con 0x556122291280 2024-05-20T17:07:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.090+0000 7f2c77fff640 10 client.15315 handle_command_reply: tid=0 2024-05-20T17:07:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.090+0000 7f2ca5df4740 1 client.15315 shutdown 2024-05-20T17:07:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.090+0000 7f2ca5df4740 1 -- 172.21.15.6:0/3406864696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222fd270 msgr2=0x55612271bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.090+0000 7f2ca5df4740 1 --2- 172.21.15.6:0/3406864696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222fd270 0x55612271bf80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2c80009a20 tx=0x7f2c8002a9b0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.090+0000 7f2ca5df4740 1 -- 172.21.15.6:0/3406864696 shutdown_connections 2024-05-20T17:07:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.090+0000 7f2ca5df4740 1 --2- 172.21.15.6:0/3406864696 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x556122291280 0x556122720790 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.090+0000 7f2ca5df4740 1 --2- 172.21.15.6:0/3406864696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561222fd270 0x55612271bf80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.090+0000 7f2ca5df4740 1 --2- 172.21.15.6:0/3406864696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5561222dc590 0x5561226a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.090+0000 7f2c77fff640 0 client.15315 ms_handle_reset on v2:172.21.15.62:6838/3023093487 2024-05-20T17:07:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.090+0000 7f2ca5df4740 1 --2- 172.21.15.6:0/3406864696 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5561222d43b0 0x5561226a9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.090+0000 7f2ca5df4740 1 -- 172.21.15.6:0/3406864696 >> 172.21.15.6:0/3406864696 conn(0x5561222f13c0 msgr2=0x5561226987f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.090+0000 7f2ca5df4740 1 -- 172.21.15.6:0/3406864696 shutdown_connections 2024-05-20T17:07:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.090+0000 7f2ca5df4740 1 -- 172.21.15.6:0/3406864696 wait complete. 2024-05-20T17:07:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.090+0000 7f2ca5df4740 20 client.15315 trim_cache size 0 max 16384 2024-05-20T17:07:04.096 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:07:04.096 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c726c954-16c9-11ef-bc9a-c7b262605968", 2024-05-20T17:07:04.096 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-05-20T17:07:04.096 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24548, 2024-05-20T17:07:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T17:07:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T17:07:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T17:07:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 119.012214543, 2024-05-20T17:07:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 28, 2024-05-20T17:07:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 94, 2024-05-20T17:07:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 90, 2024-05-20T17:07:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 125.248056654 2024-05-20T17:07:04.097 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:07:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.091+0000 7f2c9ef45640 1 -- 172.21.15.6:0/582240405 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2c840a2b90 msgr2=0x7f2c840a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.091+0000 7f2c9ef45640 1 --2- 172.21.15.6:0/582240405 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2c840a2b90 0x7f2c840a50a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800ab20 tx=0x7f2c88000f40 comp rx=0 tx=0).stop 2024-05-20T17:07:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.091+0000 7f2c9ef45640 1 -- 172.21.15.6:0/582240405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c98102bc0 msgr2=0x7f2c98198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.091+0000 7f2c9ef45640 1 --2- 172.21.15.6:0/582240405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c98102bc0 0x7f2c98198560 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800cce0 tx=0x7f2c8800a620 comp rx=0 tx=0).stop 2024-05-20T17:07:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.091+0000 7f2c9ef45640 1 -- 172.21.15.6:0/582240405 shutdown_connections 2024-05-20T17:07:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.091+0000 7f2c9ef45640 1 --2- 172.21.15.6:0/582240405 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2c840a2b90 0x7f2c840a50a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.091+0000 7f2c9ef45640 1 --2- 172.21.15.6:0/582240405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c981078c0 0x7f2c9819f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.091+0000 7f2c9ef45640 1 --2- 172.21.15.6:0/582240405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c98102bc0 0x7f2c98198560 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.091+0000 7f2c9ef45640 1 --2- 172.21.15.6:0/582240405 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c98101980 0x7f2c98198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:04.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.091+0000 7f2c9ef45640 1 -- 172.21.15.6:0/582240405 >> 172.21.15.6:0/582240405 conn(0x7f2c980fcb70 msgr2=0x7f2c981038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:04.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.091+0000 7f2c9ef45640 1 -- 172.21.15.6:0/582240405 shutdown_connections 2024-05-20T17:07:04.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:04.091+0000 7f2c9ef45640 1 -- 172.21.15.6:0/582240405 wait complete. 2024-05-20T17:07:04.103 INFO:tasks.cephadm:Setup complete, yielding 2024-05-20T17:07:04.103 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-20T17:07:04.112 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T17:07:04.113 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- bash -c 'ceph orch status' 2024-05-20T17:07:04.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:03 smithi171 ceph-mon[35901]: pgmap v364: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:07:04.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:03 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2807621347' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:07:04.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:03 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3184463034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:07:04.363 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:07:05.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:05 smithi006 ceph-mon[32486]: pgmap v365: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:07:06.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:05 smithi062 ceph-mon[35425]: pgmap v365: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:07:06.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:05 smithi171 ceph-mon[35901]: pgmap v365: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:07:06.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.143+0000 7f27e9078700 1 -- 172.21.15.6:0/3493430415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27e4103b90 msgr2=0x7f27e410a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:06.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.143+0000 7f27e9078700 1 --2- 172.21.15.6:0/3493430415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27e4103b90 0x7f27e410a440 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f27dc00b0a0 tx=0x7f27dc00b3b0 comp rx=0 tx=0).stop 2024-05-20T17:07:06.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.143+0000 7f27e9078700 1 -- 172.21.15.6:0/3493430415 shutdown_connections 2024-05-20T17:07:06.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.143+0000 7f27e9078700 1 --2- 172.21.15.6:0/3493430415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27e4103b90 0x7f27e410a440 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:06.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.143+0000 7f27e9078700 1 --2- 172.21.15.6:0/3493430415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27e41020c0 0x7f27e41024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:06.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.143+0000 7f27e9078700 1 --2- 172.21.15.6:0/3493430415 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27e41031f0 0x7f27e4103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:06.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.143+0000 7f27e9078700 1 -- 172.21.15.6:0/3493430415 >> 172.21.15.6:0/3493430415 conn(0x7f27e40fd700 msgr2=0x7f27e40ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:06.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.143+0000 7f27e9078700 1 -- 172.21.15.6:0/3493430415 shutdown_connections 2024-05-20T17:07:06.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.143+0000 7f27e9078700 1 -- 172.21.15.6:0/3493430415 wait complete. 2024-05-20T17:07:06.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.144+0000 7f27e9078700 1 Processor -- start 2024-05-20T17:07:06.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.144+0000 7f27e9078700 1 -- start start 2024-05-20T17:07:06.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.145+0000 7f27e9078700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27e41020c0 0x7f27e4199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:06.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.145+0000 7f27e9078700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27e41031f0 0x7f27e4199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:06.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.145+0000 7f27e9078700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27e4103b90 0x7f27e41a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:06.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.145+0000 7f27e9078700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f27e410db30 con 0x7f27e4103b90 2024-05-20T17:07:06.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.145+0000 7f27e9078700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f27e410d9b0 con 0x7f27e41020c0 2024-05-20T17:07:06.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.145+0000 7f27e9078700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f27e410dcb0 con 0x7f27e41031f0 2024-05-20T17:07:06.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.145+0000 7f27e359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27e4103b90 0x7f27e41a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:06.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.145+0000 7f27e359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27e4103b90 0x7f27e41a0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58658/0 (socket says 172.21.15.6:58658) 2024-05-20T17:07:06.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.145+0000 7f27e359e700 1 -- 172.21.15.6:0/343874188 learned_addr learned my addr 172.21.15.6:0/343874188 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:06.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.145+0000 7f27e2d9d700 1 --2- 172.21.15.6:0/343874188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27e41020c0 0x7f27e4199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:06.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.145+0000 7f27e259c700 1 --2- 172.21.15.6:0/343874188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27e41031f0 0x7f27e4199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:06.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.145+0000 7f27e359e700 1 -- 172.21.15.6:0/343874188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27e41031f0 msgr2=0x7f27e4199c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:06.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.145+0000 7f27e359e700 1 --2- 172.21.15.6:0/343874188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27e41031f0 0x7f27e4199c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:06.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.145+0000 7f27e359e700 1 -- 172.21.15.6:0/343874188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27e41020c0 msgr2=0x7f27e4199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:06.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.145+0000 7f27e359e700 1 --2- 172.21.15.6:0/343874188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27e41020c0 0x7f27e4199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:06.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.145+0000 7f27e359e700 1 -- 172.21.15.6:0/343874188 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e41a12a0 con 0x7f27e4103b90 2024-05-20T17:07:06.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.145+0000 7f27e359e700 1 --2- 172.21.15.6:0/343874188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27e4103b90 0x7f27e41a0c20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0062a0 tx=0x7f27dc004e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:06.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.146+0000 7f27cbfff700 1 -- 172.21.15.6:0/343874188 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc021070 con 0x7f27e4103b90 2024-05-20T17:07:06.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.146+0000 7f27e9078700 1 -- 172.21.15.6:0/343874188 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e41a1530 con 0x7f27e4103b90 2024-05-20T17:07:06.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.146+0000 7f27cbfff700 1 -- 172.21.15.6:0/343874188 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f27dc007b80 con 0x7f27e4103b90 2024-05-20T17:07:06.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.146+0000 7f27cbfff700 1 -- 172.21.15.6:0/343874188 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc004670 con 0x7f27e4103b90 2024-05-20T17:07:06.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.146+0000 7f27e9078700 1 -- 172.21.15.6:0/343874188 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e41a1ac0 con 0x7f27e4103b90 2024-05-20T17:07:06.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.147+0000 7f27e9078700 1 -- 172.21.15.6:0/343874188 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27e4050170 con 0x7f27e4103b90 2024-05-20T17:07:06.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.148+0000 7f27cbfff700 1 -- 172.21.15.6:0/343874188 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f27dc003a00 con 0x7f27e4103b90 2024-05-20T17:07:06.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.149+0000 7f27cbfff700 1 --2- 172.21.15.6:0/343874188 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f27cc0a2c20 0x7f27cc0a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:06.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.149+0000 7f27e2d9d700 1 --2- 172.21.15.6:0/343874188 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f27cc0a2c20 0x7f27cc0a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:06.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.149+0000 7f27cbfff700 1 -- 172.21.15.6:0/343874188 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f27dc00f020 con 0x7f27e4103b90 2024-05-20T17:07:06.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.150+0000 7f27e2d9d700 1 --2- 172.21.15.6:0/343874188 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f27cc0a2c20 0x7f27cc0a5130 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f27e41030f0 tx=0x7f27d400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:06.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.153+0000 7f27cbfff700 1 -- 172.21.15.6:0/343874188 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f27dc02a020 con 0x7f27e4103b90 2024-05-20T17:07:06.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.375+0000 7f27e9078700 1 -- 172.21.15.6:0/343874188 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f27e40ff720 con 0x7f27cc0a2c20 2024-05-20T17:07:06.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.376+0000 7f27cbfff700 1 -- 172.21.15.6:0/343874188 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f27e40ff720 con 0x7f27cc0a2c20 2024-05-20T17:07:06.376 INFO:teuthology.orchestra.run.smithi006.stdout:Backend: cephadm 2024-05-20T17:07:06.376 INFO:teuthology.orchestra.run.smithi006.stdout:Available: Yes 2024-05-20T17:07:06.376 INFO:teuthology.orchestra.run.smithi006.stdout:Paused: No 2024-05-20T17:07:06.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.378+0000 7f27e9078700 1 -- 172.21.15.6:0/343874188 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f27cc0a2c20 msgr2=0x7f27cc0a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:06.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.379+0000 7f27e9078700 1 --2- 172.21.15.6:0/343874188 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f27cc0a2c20 0x7f27cc0a5130 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f27e41030f0 tx=0x7f27d400b410 comp rx=0 tx=0).stop 2024-05-20T17:07:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.379+0000 7f27e9078700 1 -- 172.21.15.6:0/343874188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27e4103b90 msgr2=0x7f27e41a0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.379+0000 7f27e9078700 1 --2- 172.21.15.6:0/343874188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27e4103b90 0x7f27e41a0c20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0062a0 tx=0x7f27dc004e40 comp rx=0 tx=0).stop 2024-05-20T17:07:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.379+0000 7f27e9078700 1 -- 172.21.15.6:0/343874188 shutdown_connections 2024-05-20T17:07:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.379+0000 7f27e9078700 1 --2- 172.21.15.6:0/343874188 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f27cc0a2c20 0x7f27cc0a5130 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.379+0000 7f27e9078700 1 --2- 172.21.15.6:0/343874188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27e4103b90 0x7f27e41a0c20 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.379+0000 7f27e9078700 1 --2- 172.21.15.6:0/343874188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27e41020c0 0x7f27e4199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.379+0000 7f27e9078700 1 --2- 172.21.15.6:0/343874188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27e41031f0 0x7f27e4199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.379+0000 7f27e9078700 1 -- 172.21.15.6:0/343874188 >> 172.21.15.6:0/343874188 conn(0x7f27e40fd700 msgr2=0x7f27e40ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.379+0000 7f27e9078700 1 -- 172.21.15.6:0/343874188 shutdown_connections 2024-05-20T17:07:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:06.379+0000 7f27e9078700 1 -- 172.21.15.6:0/343874188 wait complete. 2024-05-20T17:07:07.199 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-20T17:07:07.453 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:07:07.833 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:07 smithi006 ceph-mon[32486]: pgmap v366: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:07:07.833 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:07 smithi006 ceph-mon[32486]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:07:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:07 smithi062 ceph-mon[35425]: pgmap v366: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:07:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:07 smithi062 ceph-mon[35425]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:07:08.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:07 smithi171 ceph-mon[35901]: pgmap v366: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:07:08.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:07 smithi171 ceph-mon[35901]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:07:09.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.170+0000 7f92d74d0700 1 -- 172.21.15.6:0/2535418024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d0106620 msgr2=0x7f92d0108a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:09.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.170+0000 7f92d74d0700 1 --2- 172.21.15.6:0/2535418024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d0106620 0x7f92d0108a40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f92c0009990 tx=0x7f92c0009ca0 comp rx=0 tx=0).stop 2024-05-20T17:07:09.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.170+0000 7f92d74d0700 1 -- 172.21.15.6:0/2535418024 shutdown_connections 2024-05-20T17:07:09.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.170+0000 7f92d74d0700 1 --2- 172.21.15.6:0/2535418024 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92d0108f80 0x7f92d010b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:09.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.170+0000 7f92d74d0700 1 --2- 172.21.15.6:0/2535418024 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92d0103cc0 0x7f92d01060e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:09.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.170+0000 7f92d74d0700 1 --2- 172.21.15.6:0/2535418024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d0106620 0x7f92d0108a40 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:09.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.170+0000 7f92d74d0700 1 -- 172.21.15.6:0/2535418024 >> 172.21.15.6:0/2535418024 conn(0x7f92d00fd700 msgr2=0x7f92d00ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:09.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.170+0000 7f92d74d0700 1 -- 172.21.15.6:0/2535418024 shutdown_connections 2024-05-20T17:07:09.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.170+0000 7f92d74d0700 1 -- 172.21.15.6:0/2535418024 wait complete. 2024-05-20T17:07:09.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.171+0000 7f92d74d0700 1 Processor -- start 2024-05-20T17:07:09.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.171+0000 7f92d74d0700 1 -- start start 2024-05-20T17:07:09.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.171+0000 7f92d74d0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92d0103cc0 0x7f92d0199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.171+0000 7f92d74d0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d0106620 0x7f92d0199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.171+0000 7f92d74d0700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92d0108f80 0x7f92d01a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.171+0000 7f92d74d0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f92d010ec30 con 0x7f92d0106620 2024-05-20T17:07:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.171+0000 7f92d74d0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f92d010eab0 con 0x7f92d0103cc0 2024-05-20T17:07:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.171+0000 7f92d74d0700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f92d010edb0 con 0x7f92d0108f80 2024-05-20T17:07:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.171+0000 7f92d4a6b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d0106620 0x7f92d0199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.171+0000 7f92d4a6b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d0106620 0x7f92d0199cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58684/0 (socket says 172.21.15.6:58684) 2024-05-20T17:07:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.171+0000 7f92d4a6b700 1 -- 172.21.15.6:0/885630520 learned_addr learned my addr 172.21.15.6:0/885630520 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.171+0000 7f92d5a6d700 1 --2- 172.21.15.6:0/885630520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92d0108f80 0x7f92d01a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.171+0000 7f92d526c700 1 --2- 172.21.15.6:0/885630520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92d0103cc0 0x7f92d0199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.172+0000 7f92d4a6b700 1 -- 172.21.15.6:0/885630520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92d0108f80 msgr2=0x7f92d01a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.172+0000 7f92d4a6b700 1 --2- 172.21.15.6:0/885630520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92d0108f80 0x7f92d01a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.172+0000 7f92d4a6b700 1 -- 172.21.15.6:0/885630520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92d0103cc0 msgr2=0x7f92d0199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:09.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.172+0000 7f92d4a6b700 1 --2- 172.21.15.6:0/885630520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92d0103cc0 0x7f92d0199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:09.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.172+0000 7f92d4a6b700 1 -- 172.21.15.6:0/885630520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d01a1250 con 0x7f92d0106620 2024-05-20T17:07:09.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.172+0000 7f92d526c700 1 --2- 172.21.15.6:0/885630520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92d0103cc0 0x7f92d0199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:09.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.172+0000 7f92d4a6b700 1 --2- 172.21.15.6:0/885630520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d0106620 0x7f92d0199cc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f92c000b670 tx=0x7f92c0009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:09.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.172+0000 7f92c67fc700 1 -- 172.21.15.6:0/885630520 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c000fb50 con 0x7f92d0106620 2024-05-20T17:07:09.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.172+0000 7f92c67fc700 1 -- 172.21.15.6:0/885630520 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f92c000fcf0 con 0x7f92d0106620 2024-05-20T17:07:09.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.172+0000 7f92d74d0700 1 -- 172.21.15.6:0/885630520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d01a14e0 con 0x7f92d0106620 2024-05-20T17:07:09.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.172+0000 7f92c67fc700 1 -- 172.21.15.6:0/885630520 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c0017720 con 0x7f92d0106620 2024-05-20T17:07:09.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.172+0000 7f92d74d0700 1 -- 172.21.15.6:0/885630520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d01a18d0 con 0x7f92d0106620 2024-05-20T17:07:09.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.173+0000 7f92d74d0700 1 -- 172.21.15.6:0/885630520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92d0050170 con 0x7f92d0106620 2024-05-20T17:07:09.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.175+0000 7f92c67fc700 1 -- 172.21.15.6:0/885630520 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f92c0009d10 con 0x7f92d0106620 2024-05-20T17:07:09.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.176+0000 7f92c67fc700 1 --2- 172.21.15.6:0/885630520 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f92bc0a2c20 0x7f92bc0a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:09.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.176+0000 7f92d526c700 1 --2- 172.21.15.6:0/885630520 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f92bc0a2c20 0x7f92bc0a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:09.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.176+0000 7f92c67fc700 1 -- 172.21.15.6:0/885630520 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f92c00d0960 con 0x7f92d0106620 2024-05-20T17:07:09.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.176+0000 7f92d526c700 1 --2- 172.21.15.6:0/885630520 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f92bc0a2c20 0x7f92bc0a5130 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f92d006aeb0 tx=0x7f92cc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:09.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.180+0000 7f92c67fc700 1 -- 172.21.15.6:0/885630520 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f92c0013070 con 0x7f92d0106620 2024-05-20T17:07:09.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.396+0000 7f92d74d0700 1 -- 172.21.15.6:0/885630520 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f92d0062b40 con 0x7f92bc0a2c20 2024-05-20T17:07:09.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.410+0000 7f92c67fc700 1 -- 172.21.15.6:0/885630520 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f92d0062b40 con 0x7f92bc0a2c20 2024-05-20T17:07:09.410 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-20T17:07:09.410 INFO:teuthology.orchestra.run.smithi006.stdout:mds.a smithi006 running (2m) 22s ago 2m 83.6M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 feb726a4fc00 2024-05-20T17:07:09.410 INFO:teuthology.orchestra.run.smithi006.stdout:mds.b smithi062 running (2m) 64s ago 2m 94.0M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 4886ecbb7714 2024-05-20T17:07:09.410 INFO:teuthology.orchestra.run.smithi006.stdout:mds.c smithi171 running (2m) 64s ago 2m 83.3M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 7197dc4ef460 2024-05-20T17:07:09.410 INFO:teuthology.orchestra.run.smithi006.stdout:mds.d smithi006 running (2m) 22s ago 2m 81.5M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 7a4a49691aa1 2024-05-20T17:07:09.410 INFO:teuthology.orchestra.run.smithi006.stdout:mds.e smithi062 running (2m) 64s ago 2m 87.2M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 5ef1e1076c99 2024-05-20T17:07:09.410 INFO:teuthology.orchestra.run.smithi006.stdout:mds.f smithi171 running (2m) 64s ago 2m 86.1M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 ece723681401 2024-05-20T17:07:09.410 INFO:teuthology.orchestra.run.smithi006.stdout:mds.g smithi006 running (2m) 22s ago 2m 82.7M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 5956235ee2a2 2024-05-20T17:07:09.410 INFO:teuthology.orchestra.run.smithi006.stdout:mds.h smithi062 running (2m) 64s ago 2m 84.3M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 9c9396a4e440 2024-05-20T17:07:09.410 INFO:teuthology.orchestra.run.smithi006.stdout:mds.i smithi171 running (2m) 64s ago 2m 84.9M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 8a73ef594fab 2024-05-20T17:07:09.410 INFO:teuthology.orchestra.run.smithi006.stdout:mds.j smithi006 running (2m) 22s ago 2m 83.8M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 f878d4d3ffd9 2024-05-20T17:07:09.410 INFO:teuthology.orchestra.run.smithi006.stdout:mds.k smithi062 running (2m) 64s ago 2m 84.2M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 8933224ead3c 2024-05-20T17:07:09.411 INFO:teuthology.orchestra.run.smithi006.stdout:mds.l smithi171 running (2m) 64s ago 2m 85.8M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 92cb114d916b 2024-05-20T17:07:09.411 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.x smithi006 *:9283,8765 running (10m) 22s ago 10m 584M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 b111cb13d067 2024-05-20T17:07:09.411 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.y smithi062 *:8443,8765 running (8m) 64s ago 8m 523M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 30d3544b0d54 2024-05-20T17:07:09.411 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.z smithi171 *:8443,8765 running (8m) 64s ago 8m 521M - 19.0.0-2744-gd2b507c7 cfcc61b2d476 d51aa1f3ec89 2024-05-20T17:07:09.411 INFO:teuthology.orchestra.run.smithi006.stdout:mon.a smithi006 running (10m) 22s ago 10m 117M 2048M 19.0.0-2744-gd2b507c7 cfcc61b2d476 e83671806ab5 2024-05-20T17:07:09.411 INFO:teuthology.orchestra.run.smithi006.stdout:mon.b smithi062 running (8m) 64s ago 8m 109M 2048M 19.0.0-2744-gd2b507c7 cfcc61b2d476 4c3bf039545a 2024-05-20T17:07:09.411 INFO:teuthology.orchestra.run.smithi006.stdout:mon.c smithi171 running (8m) 64s ago 8m 107M 2048M 19.0.0-2744-gd2b507c7 cfcc61b2d476 530c2ec498d0 2024-05-20T17:07:09.411 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (7m) 22s ago 7m 122M 4273M 19.0.0-2744-gd2b507c7 cfcc61b2d476 eda791b43143 2024-05-20T17:07:09.411 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi062 running (7m) 64s ago 7m 121M 4272M 19.0.0-2744-gd2b507c7 cfcc61b2d476 43a497e2e373 2024-05-20T17:07:09.411 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi171 running (7m) 64s ago 7m 114M 4272M 19.0.0-2744-gd2b507c7 cfcc61b2d476 4b9385aa8624 2024-05-20T17:07:09.411 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi006 running (6m) 22s ago 6m 114M 4273M 19.0.0-2744-gd2b507c7 cfcc61b2d476 ecb903efb5f2 2024-05-20T17:07:09.411 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi062 running (6m) 64s ago 6m 118M 4272M 19.0.0-2744-gd2b507c7 cfcc61b2d476 55e4ebca331f 2024-05-20T17:07:09.411 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi171 running (5m) 64s ago 5m 120M 4272M 19.0.0-2744-gd2b507c7 cfcc61b2d476 cc3806aeacf8 2024-05-20T17:07:09.412 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6 smithi006 running (5m) 22s ago 5m 112M 4273M 19.0.0-2744-gd2b507c7 cfcc61b2d476 0195247720b9 2024-05-20T17:07:09.412 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7 smithi062 running (4m) 64s ago 4m 114M 4272M 19.0.0-2744-gd2b507c7 cfcc61b2d476 c634c5aaa369 2024-05-20T17:07:09.412 INFO:teuthology.orchestra.run.smithi006.stdout:osd.8 smithi171 running (4m) 64s ago 4m 121M 4272M 19.0.0-2744-gd2b507c7 cfcc61b2d476 d8e318438dad 2024-05-20T17:07:09.412 INFO:teuthology.orchestra.run.smithi006.stdout:osd.9 smithi006 running (3m) 22s ago 3m 112M 4273M 19.0.0-2744-gd2b507c7 cfcc61b2d476 14ad608f277d 2024-05-20T17:07:09.412 INFO:teuthology.orchestra.run.smithi006.stdout:osd.10 smithi062 running (3m) 64s ago 3m 113M 4272M 19.0.0-2744-gd2b507c7 cfcc61b2d476 b65317c295cf 2024-05-20T17:07:09.412 INFO:teuthology.orchestra.run.smithi006.stdout:osd.11 smithi171 running (3m) 64s ago 3m 116M 4272M 19.0.0-2744-gd2b507c7 cfcc61b2d476 9ebf57a697c6 2024-05-20T17:07:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.412+0000 7f92d74d0700 1 -- 172.21.15.6:0/885630520 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f92bc0a2c20 msgr2=0x7f92bc0a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.412+0000 7f92d74d0700 1 --2- 172.21.15.6:0/885630520 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f92bc0a2c20 0x7f92bc0a5130 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f92d006aeb0 tx=0x7f92cc009260 comp rx=0 tx=0).stop 2024-05-20T17:07:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.412+0000 7f92d74d0700 1 -- 172.21.15.6:0/885630520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d0106620 msgr2=0x7f92d0199cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.412+0000 7f92d74d0700 1 --2- 172.21.15.6:0/885630520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d0106620 0x7f92d0199cc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f92c000b670 tx=0x7f92c0009580 comp rx=0 tx=0).stop 2024-05-20T17:07:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.412+0000 7f92d74d0700 1 -- 172.21.15.6:0/885630520 shutdown_connections 2024-05-20T17:07:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.412+0000 7f92d74d0700 1 --2- 172.21.15.6:0/885630520 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f92bc0a2c20 0x7f92bc0a5130 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.412+0000 7f92d74d0700 1 --2- 172.21.15.6:0/885630520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92d0108f80 0x7f92d01a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.412+0000 7f92d74d0700 1 --2- 172.21.15.6:0/885630520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92d0103cc0 0x7f92d0199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.412+0000 7f92d74d0700 1 --2- 172.21.15.6:0/885630520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92d0106620 0x7f92d0199cc0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.412+0000 7f92d74d0700 1 -- 172.21.15.6:0/885630520 >> 172.21.15.6:0/885630520 conn(0x7f92d00fd700 msgr2=0x7f92d0104790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.412+0000 7f92d74d0700 1 -- 172.21.15.6:0/885630520 shutdown_connections 2024-05-20T17:07:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:09.412+0000 7f92d74d0700 1 -- 172.21.15.6:0/885630520 wait complete. 2024-05-20T17:07:10.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:09 smithi062 ceph-mon[35425]: pgmap v367: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:07:10.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:09 smithi171 ceph-mon[35901]: pgmap v367: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:07:10.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:09 smithi006 ceph-mon[32486]: pgmap v367: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:07:10.227 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-20T17:07:10.487 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:07:10.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:10 smithi006 ceph-mon[32486]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:07:11.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:10 smithi062 ceph-mon[35425]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:07:11.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:10 smithi171 ceph-mon[35901]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:07:11.994 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:11 smithi006 ceph-mon[32486]: pgmap v368: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:07:12.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:11 smithi062 ceph-mon[35425]: pgmap v368: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:07:12.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:11 smithi171 ceph-mon[35901]: pgmap v368: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:07:12.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.542+0000 7fb8786dc700 1 -- 172.21.15.6:0/1315983117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8701042f0 msgr2=0x7fb870104700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:12.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.542+0000 7fb8786dc700 1 --2- 172.21.15.6:0/1315983117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8701042f0 0x7fb870104700 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb864009990 tx=0x7fb864009ca0 comp rx=0 tx=0).stop 2024-05-20T17:07:12.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.542+0000 7fb8786dc700 1 -- 172.21.15.6:0/1315983117 shutdown_connections 2024-05-20T17:07:12.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.542+0000 7fb8786dc700 1 --2- 172.21.15.6:0/1315983117 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb870104c90 0x7fb87010b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:12.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.542+0000 7fb8786dc700 1 --2- 172.21.15.6:0/1315983117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8701031c0 0x7fb8701035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:12.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.542+0000 7fb8786dc700 1 --2- 172.21.15.6:0/1315983117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8701042f0 0x7fb870104700 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:12.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.542+0000 7fb8786dc700 1 -- 172.21.15.6:0/1315983117 >> 172.21.15.6:0/1315983117 conn(0x7fb8700fe840 msgr2=0x7fb870100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:12.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.543+0000 7fb8786dc700 1 -- 172.21.15.6:0/1315983117 shutdown_connections 2024-05-20T17:07:12.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.543+0000 7fb8786dc700 1 -- 172.21.15.6:0/1315983117 wait complete. 2024-05-20T17:07:12.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.543+0000 7fb8786dc700 1 Processor -- start 2024-05-20T17:07:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.543+0000 7fb8786dc700 1 -- start start 2024-05-20T17:07:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.544+0000 7fb8786dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8701031c0 0x7fb870199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.544+0000 7fb8786dc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8701042f0 0x7fb870199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.544+0000 7fb8786dc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb870104c90 0x7fb8701a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.544+0000 7fb8786dc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb87010ec40 con 0x7fb8701031c0 2024-05-20T17:07:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.544+0000 7fb8786dc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb87010eac0 con 0x7fb8701042f0 2024-05-20T17:07:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.544+0000 7fb8786dc700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb87010edc0 con 0x7fb870104c90 2024-05-20T17:07:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.544+0000 7fb876478700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8701031c0 0x7fb870199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.544+0000 7fb876478700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8701031c0 0x7fb870199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36734/0 (socket says 172.21.15.6:36734) 2024-05-20T17:07:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.544+0000 7fb876478700 1 -- 172.21.15.6:0/3282519041 learned_addr learned my addr 172.21.15.6:0/3282519041 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.544+0000 7fb875c77700 1 --2- 172.21.15.6:0/3282519041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8701042f0 0x7fb870199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.544+0000 7fb876c79700 1 --2- 172.21.15.6:0/3282519041 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb870104c90 0x7fb8701a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.544+0000 7fb876478700 1 -- 172.21.15.6:0/3282519041 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb870104c90 msgr2=0x7fb8701a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.544+0000 7fb876478700 1 --2- 172.21.15.6:0/3282519041 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb870104c90 0x7fb8701a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.544+0000 7fb876478700 1 -- 172.21.15.6:0/3282519041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8701042f0 msgr2=0x7fb870199ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.544+0000 7fb876478700 1 --2- 172.21.15.6:0/3282519041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8701042f0 0x7fb870199ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.544+0000 7fb876478700 1 -- 172.21.15.6:0/3282519041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8701a12c0 con 0x7fb8701031c0 2024-05-20T17:07:12.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.544+0000 7fb876478700 1 --2- 172.21.15.6:0/3282519041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8701031c0 0x7fb870199760 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb86000ada0 tx=0x7fb86000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:12.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.545+0000 7fb86f7fe700 1 -- 172.21.15.6:0/3282519041 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb860017070 con 0x7fb8701031c0 2024-05-20T17:07:12.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.545+0000 7fb86f7fe700 1 -- 172.21.15.6:0/3282519041 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb86000a0d0 con 0x7fb8701031c0 2024-05-20T17:07:12.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.545+0000 7fb8786dc700 1 -- 172.21.15.6:0/3282519041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8701a15b0 con 0x7fb8701031c0 2024-05-20T17:07:12.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.545+0000 7fb86f7fe700 1 -- 172.21.15.6:0/3282519041 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86000cda0 con 0x7fb8701031c0 2024-05-20T17:07:12.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.545+0000 7fb8786dc700 1 -- 172.21.15.6:0/3282519041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8701a1af0 con 0x7fb8701031c0 2024-05-20T17:07:12.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.546+0000 7fb8786dc700 1 -- 172.21.15.6:0/3282519041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb870050170 con 0x7fb8701031c0 2024-05-20T17:07:12.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.547+0000 7fb86f7fe700 1 -- 172.21.15.6:0/3282519041 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fb86001a070 con 0x7fb8701031c0 2024-05-20T17:07:12.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.548+0000 7fb86f7fe700 1 --2- 172.21.15.6:0/3282519041 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb8580a2ca0 0x7fb8580a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:12.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.548+0000 7fb875c77700 1 --2- 172.21.15.6:0/3282519041 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb8580a2ca0 0x7fb8580a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:12.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.548+0000 7fb86f7fe700 1 -- 172.21.15.6:0/3282519041 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fb8600ce5e0 con 0x7fb8701031c0 2024-05-20T17:07:12.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.548+0000 7fb875c77700 1 --2- 172.21.15.6:0/3282519041 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb8580a2ca0 0x7fb8580a51b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb86400b5c0 tx=0x7fb86401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:12.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.552+0000 7fb86f7fe700 1 -- 172.21.15.6:0/3282519041 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb86009b190 con 0x7fb8701031c0 2024-05-20T17:07:12.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.769+0000 7fb8786dc700 1 -- 172.21.15.6:0/3282519041 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fb870062a80 con 0x7fb8580a2ca0 2024-05-20T17:07:12.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.777+0000 7fb86f7fe700 1 -- 172.21.15.6:0/3282519041 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fb870062a80 con 0x7fb8580a2ca0 2024-05-20T17:07:12.778 INFO:teuthology.orchestra.run.smithi006.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-20T17:07:12.778 INFO:teuthology.orchestra.run.smithi006.stdout:mds.all 12/12 67s ago 2m smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi062=b;smithi062=e;smithi062=h;smithi062=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l;count:12 2024-05-20T17:07:12.778 INFO:teuthology.orchestra.run.smithi006.stdout:mgr 3/3 67s ago 8m smithi006=x;smithi062=y;smithi171=z;count:3 2024-05-20T17:07:12.778 INFO:teuthology.orchestra.run.smithi006.stdout:mon 3/3 67s ago 8m smithi006:172.21.15.6=a;smithi062:172.21.15.62=b;smithi171:172.21.15.171=c;count:3 2024-05-20T17:07:12.778 INFO:teuthology.orchestra.run.smithi006.stdout:osd 12 67s ago - 2024-05-20T17:07:12.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.779+0000 7fb8786dc700 1 -- 172.21.15.6:0/3282519041 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb8580a2ca0 msgr2=0x7fb8580a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:12.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.779+0000 7fb8786dc700 1 --2- 172.21.15.6:0/3282519041 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb8580a2ca0 0x7fb8580a51b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb86400b5c0 tx=0x7fb86401a040 comp rx=0 tx=0).stop 2024-05-20T17:07:12.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.779+0000 7fb8786dc700 1 -- 172.21.15.6:0/3282519041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8701031c0 msgr2=0x7fb870199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:12.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.779+0000 7fb8786dc700 1 --2- 172.21.15.6:0/3282519041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8701031c0 0x7fb870199760 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb86000ada0 tx=0x7fb86000c330 comp rx=0 tx=0).stop 2024-05-20T17:07:12.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.779+0000 7fb8786dc700 1 -- 172.21.15.6:0/3282519041 shutdown_connections 2024-05-20T17:07:12.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.779+0000 7fb8786dc700 1 --2- 172.21.15.6:0/3282519041 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fb8580a2ca0 0x7fb8580a51b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:12.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.779+0000 7fb8786dc700 1 --2- 172.21.15.6:0/3282519041 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb870104c90 0x7fb8701a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:12.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.779+0000 7fb8786dc700 1 --2- 172.21.15.6:0/3282519041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8701031c0 0x7fb870199760 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:12.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.779+0000 7fb8786dc700 1 --2- 172.21.15.6:0/3282519041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8701042f0 0x7fb870199ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:12.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.779+0000 7fb8786dc700 1 -- 172.21.15.6:0/3282519041 >> 172.21.15.6:0/3282519041 conn(0x7fb8700fe840 msgr2=0x7fb870107520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:12.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.780+0000 7fb8786dc700 1 -- 172.21.15.6:0/3282519041 shutdown_connections 2024-05-20T17:07:12.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:12.780+0000 7fb8786dc700 1 -- 172.21.15.6:0/3282519041 wait complete. 2024-05-20T17:07:13.531 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-20T17:07:13.797 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:07:13.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:13 smithi006 ceph-mon[32486]: pgmap v369: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:07:13.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:13 smithi006 ceph-mon[32486]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:07:14.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:13 smithi062 ceph-mon[35425]: pgmap v369: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:07:14.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:13 smithi062 ceph-mon[35425]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:07:14.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:13 smithi171 ceph-mon[35901]: pgmap v369: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:07:14.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:13 smithi171 ceph-mon[35901]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:07:15.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.524+0000 7f1a8ab55700 1 -- 172.21.15.6:0/2383719813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a841031f0 msgr2=0x7f1a84103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:15.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.524+0000 7f1a8ab55700 1 --2- 172.21.15.6:0/2383719813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a841031f0 0x7f1a84103600 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009990 tx=0x7f1a70009ca0 comp rx=0 tx=0).stop 2024-05-20T17:07:15.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.524+0000 7f1a8ab55700 1 -- 172.21.15.6:0/2383719813 shutdown_connections 2024-05-20T17:07:15.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.524+0000 7f1a8ab55700 1 --2- 172.21.15.6:0/2383719813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a84103b90 0x7f1a8410a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:15.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.524+0000 7f1a8ab55700 1 --2- 172.21.15.6:0/2383719813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a841020c0 0x7f1a841024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:15.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.524+0000 7f1a8ab55700 1 --2- 172.21.15.6:0/2383719813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a841031f0 0x7f1a84103600 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:15.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.524+0000 7f1a8ab55700 1 -- 172.21.15.6:0/2383719813 >> 172.21.15.6:0/2383719813 conn(0x7f1a840fd700 msgr2=0x7f1a840ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:15.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.525+0000 7f1a8ab55700 1 -- 172.21.15.6:0/2383719813 shutdown_connections 2024-05-20T17:07:15.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.525+0000 7f1a8ab55700 1 -- 172.21.15.6:0/2383719813 wait complete. 2024-05-20T17:07:15.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.525+0000 7f1a8ab55700 1 Processor -- start 2024-05-20T17:07:15.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.525+0000 7f1a8ab55700 1 -- start start 2024-05-20T17:07:15.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.525+0000 7f1a8ab55700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a841020c0 0x7f1a841997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:15.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.526+0000 7f1a8ab55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a841031f0 0x7f1a84199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:15.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.526+0000 7f1a8ab55700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a84103b90 0x7f1a841a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:15.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.526+0000 7f1a8ab55700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8410eca0 con 0x7f1a841031f0 2024-05-20T17:07:15.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.526+0000 7f1a8ab55700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8410eb20 con 0x7f1a841020c0 2024-05-20T17:07:15.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.526+0000 7f1a8ab55700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8410ee20 con 0x7f1a84103b90 2024-05-20T17:07:15.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.526+0000 7f1a83fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a841031f0 0x7f1a84199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:15.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.526+0000 7f1a83fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a841031f0 0x7f1a84199d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36750/0 (socket says 172.21.15.6:36750) 2024-05-20T17:07:15.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.526+0000 7f1a83fff700 1 -- 172.21.15.6:0/3318193085 learned_addr learned my addr 172.21.15.6:0/3318193085 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:15.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.526+0000 7f1a888f1700 1 --2- 172.21.15.6:0/3318193085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a841020c0 0x7f1a841997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:15.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.526+0000 7f1a890f2700 1 --2- 172.21.15.6:0/3318193085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a84103b90 0x7f1a841a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:15.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.526+0000 7f1a83fff700 1 -- 172.21.15.6:0/3318193085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a84103b90 msgr2=0x7f1a841a0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:15.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.526+0000 7f1a83fff700 1 --2- 172.21.15.6:0/3318193085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a84103b90 0x7f1a841a0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:15.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.526+0000 7f1a83fff700 1 -- 172.21.15.6:0/3318193085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a841020c0 msgr2=0x7f1a841997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:15.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.526+0000 7f1a83fff700 1 --2- 172.21.15.6:0/3318193085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a841020c0 0x7f1a841997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.526+0000 7f1a83fff700 1 -- 172.21.15.6:0/3318193085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a841a12b0 con 0x7f1a841031f0 2024-05-20T17:07:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.526+0000 7f1a890f2700 1 --2- 172.21.15.6:0/3318193085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a84103b90 0x7f1a841a0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.526+0000 7f1a83fff700 1 --2- 172.21.15.6:0/3318193085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a841031f0 0x7f1a84199d20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1a700098e0 tx=0x7f1a700047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.526+0000 7f1a81ffb700 1 -- 172.21.15.6:0/3318193085 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a70027070 con 0x7f1a841031f0 2024-05-20T17:07:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.526+0000 7f1a81ffb700 1 -- 172.21.15.6:0/3318193085 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a70022470 con 0x7f1a841031f0 2024-05-20T17:07:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.526+0000 7f1a8ab55700 1 -- 172.21.15.6:0/3318193085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a841a1540 con 0x7f1a841031f0 2024-05-20T17:07:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.527+0000 7f1a81ffb700 1 -- 172.21.15.6:0/3318193085 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7000f6c0 con 0x7f1a841031f0 2024-05-20T17:07:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.527+0000 7f1a8ab55700 1 -- 172.21.15.6:0/3318193085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a841a1990 con 0x7f1a841031f0 2024-05-20T17:07:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.528+0000 7f1a8ab55700 1 -- 172.21.15.6:0/3318193085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a84050170 con 0x7f1a841031f0 2024-05-20T17:07:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.529+0000 7f1a81ffb700 1 -- 172.21.15.6:0/3318193085 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f1a7002a070 con 0x7f1a841031f0 2024-05-20T17:07:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.530+0000 7f1a81ffb700 1 --2- 172.21.15.6:0/3318193085 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1a740a2c20 0x7f1a740a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.530+0000 7f1a888f1700 1 --2- 172.21.15.6:0/3318193085 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1a740a2c20 0x7f1a740a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:15.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.530+0000 7f1a81ffb700 1 -- 172.21.15.6:0/3318193085 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f1a700d0a70 con 0x7f1a841031f0 2024-05-20T17:07:15.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.531+0000 7f1a888f1700 1 --2- 172.21.15.6:0/3318193085 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1a740a2c20 0x7f1a740a5130 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1a841030f0 tx=0x7f1a7800a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:15.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.536+0000 7f1a81ffb700 1 -- 172.21.15.6:0/3318193085 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1a70031020 con 0x7f1a841031f0 2024-05-20T17:07:15.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.749+0000 7f1a8ab55700 1 -- 172.21.15.6:0/3318193085 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f1a84062a80 con 0x7f1a740a2c20 2024-05-20T17:07:15.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.750+0000 7f1a81ffb700 1 -- 172.21.15.6:0/3318193085 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f1a84062a80 con 0x7f1a740a2c20 2024-05-20T17:07:15.750 INFO:teuthology.orchestra.run.smithi006.stdout:HOST ADDR LABELS STATUS 2024-05-20T17:07:15.751 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006 172.21.15.6 2024-05-20T17:07:15.751 INFO:teuthology.orchestra.run.smithi006.stdout:smithi062 172.21.15.62 2024-05-20T17:07:15.751 INFO:teuthology.orchestra.run.smithi006.stdout:smithi171 172.21.15.171 2024-05-20T17:07:15.751 INFO:teuthology.orchestra.run.smithi006.stdout:3 hosts in cluster 2024-05-20T17:07:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.752+0000 7f1a8ab55700 1 -- 172.21.15.6:0/3318193085 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1a740a2c20 msgr2=0x7f1a740a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.752+0000 7f1a8ab55700 1 --2- 172.21.15.6:0/3318193085 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1a740a2c20 0x7f1a740a5130 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1a841030f0 tx=0x7f1a7800a3b0 comp rx=0 tx=0).stop 2024-05-20T17:07:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.752+0000 7f1a8ab55700 1 -- 172.21.15.6:0/3318193085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a841031f0 msgr2=0x7f1a84199d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.752+0000 7f1a8ab55700 1 --2- 172.21.15.6:0/3318193085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a841031f0 0x7f1a84199d20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1a700098e0 tx=0x7f1a700047b0 comp rx=0 tx=0).stop 2024-05-20T17:07:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.752+0000 7f1a8ab55700 1 -- 172.21.15.6:0/3318193085 shutdown_connections 2024-05-20T17:07:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.752+0000 7f1a8ab55700 1 --2- 172.21.15.6:0/3318193085 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f1a740a2c20 0x7f1a740a5130 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.752+0000 7f1a8ab55700 1 --2- 172.21.15.6:0/3318193085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a84103b90 0x7f1a841a0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.752+0000 7f1a8ab55700 1 --2- 172.21.15.6:0/3318193085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a841020c0 0x7f1a841997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.752+0000 7f1a8ab55700 1 --2- 172.21.15.6:0/3318193085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a841031f0 0x7f1a84199d20 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:15.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.752+0000 7f1a8ab55700 1 -- 172.21.15.6:0/3318193085 >> 172.21.15.6:0/3318193085 conn(0x7f1a840fd700 msgr2=0x7f1a84106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:15.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.753+0000 7f1a8ab55700 1 -- 172.21.15.6:0/3318193085 shutdown_connections 2024-05-20T17:07:15.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:15.753+0000 7f1a8ab55700 1 -- 172.21.15.6:0/3318193085 wait complete. 2024-05-20T17:07:15.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:15 smithi006 ceph-mon[32486]: pgmap v370: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:07:16.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:15 smithi062 ceph-mon[35425]: pgmap v370: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:07:16.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:15 smithi171 ceph-mon[35901]: pgmap v370: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:07:16.425 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-20T17:07:16.679 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:07:16.974 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:16 smithi006 ceph-mon[32486]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:07:17.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:16 smithi062 ceph-mon[35425]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:07:17.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:16 smithi171 ceph-mon[35901]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:07:17.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:17 smithi006 ceph-mon[32486]: pgmap v371: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-20T17:07:18.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:17 smithi062 ceph-mon[35425]: pgmap v371: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-20T17:07:18.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:17 smithi171 ceph-mon[35901]: pgmap v371: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-20T17:07:18.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.434+0000 7f549dde0700 1 -- 172.21.15.6:0/3489400086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5498106350 msgr2=0x7f54981087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:18.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.434+0000 7f549dde0700 1 --2- 172.21.15.6:0/3489400086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5498106350 0x7f54981087f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f548c009990 tx=0x7f548c009ca0 comp rx=0 tx=0).stop 2024-05-20T17:07:18.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.434+0000 7f549dde0700 1 -- 172.21.15.6:0/3489400086 shutdown_connections 2024-05-20T17:07:18.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.434+0000 7f549dde0700 1 --2- 172.21.15.6:0/3489400086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5498108e80 0x7f549810b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:18.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.434+0000 7f549dde0700 1 --2- 172.21.15.6:0/3489400086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54980754f0 0x7f5498105d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:18.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.434+0000 7f549dde0700 1 --2- 172.21.15.6:0/3489400086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5498106350 0x7f54981087f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:18.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.434+0000 7f549dde0700 1 -- 172.21.15.6:0/3489400086 >> 172.21.15.6:0/3489400086 conn(0x7f54980fd710 msgr2=0x7f54980ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:18.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.434+0000 7f549dde0700 1 -- 172.21.15.6:0/3489400086 shutdown_connections 2024-05-20T17:07:18.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.434+0000 7f549dde0700 1 -- 172.21.15.6:0/3489400086 wait complete. 2024-05-20T17:07:18.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.435+0000 7f549dde0700 1 Processor -- start 2024-05-20T17:07:18.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.435+0000 7f549dde0700 1 -- start start 2024-05-20T17:07:18.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.435+0000 7f549dde0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54980754f0 0x7f5498199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:18.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.435+0000 7f549dde0700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5498106350 0x7f5498199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:18.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.435+0000 7f549dde0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5498108e80 0x7f54981a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:18.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.435+0000 7f549dde0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f549810ed20 con 0x7f54980754f0 2024-05-20T17:07:18.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.435+0000 7f549dde0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f549810eba0 con 0x7f5498108e80 2024-05-20T17:07:18.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.435+0000 7f549dde0700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f549810eea0 con 0x7f5498106350 2024-05-20T17:07:18.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.436+0000 7f54977fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54980754f0 0x7f5498199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:18.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.436+0000 7f54977fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54980754f0 0x7f5498199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36762/0 (socket says 172.21.15.6:36762) 2024-05-20T17:07:18.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.436+0000 7f54977fe700 1 -- 172.21.15.6:0/2490482959 learned_addr learned my addr 172.21.15.6:0/2490482959 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:18.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.436+0000 7f5497fff700 1 --2- 172.21.15.6:0/2490482959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5498108e80 0x7f54981a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:18.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.436+0000 7f5496ffd700 1 --2- 172.21.15.6:0/2490482959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5498106350 0x7f5498199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:18.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.436+0000 7f54977fe700 1 -- 172.21.15.6:0/2490482959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5498106350 msgr2=0x7f5498199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:18.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.436+0000 7f54977fe700 1 --2- 172.21.15.6:0/2490482959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5498106350 0x7f5498199db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:18.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.436+0000 7f54977fe700 1 -- 172.21.15.6:0/2490482959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5498108e80 msgr2=0x7f54981a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:18.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.436+0000 7f54977fe700 1 --2- 172.21.15.6:0/2490482959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5498108e80 0x7f54981a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:18.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.436+0000 7f54977fe700 1 -- 172.21.15.6:0/2490482959 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54981a13d0 con 0x7f54980754f0 2024-05-20T17:07:18.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.436+0000 7f5496ffd700 1 --2- 172.21.15.6:0/2490482959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5498106350 0x7f5498199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:07:18.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.436+0000 7f54977fe700 1 --2- 172.21.15.6:0/2490482959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54980754f0 0x7f5498199870 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f548800b500 tx=0x7f548800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:18.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.436+0000 7f5494ff9700 1 -- 172.21.15.6:0/2490482959 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5488015020 con 0x7f54980754f0 2024-05-20T17:07:18.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.436+0000 7f5494ff9700 1 -- 172.21.15.6:0/2490482959 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5488011ce0 con 0x7f54980754f0 2024-05-20T17:07:18.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.436+0000 7f549dde0700 1 -- 172.21.15.6:0/2490482959 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54981a16c0 con 0x7f54980754f0 2024-05-20T17:07:18.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.436+0000 7f5494ff9700 1 -- 172.21.15.6:0/2490482959 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5488010d40 con 0x7f54980754f0 2024-05-20T17:07:18.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.437+0000 7f549dde0700 1 -- 172.21.15.6:0/2490482959 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54981a1cd0 con 0x7f54980754f0 2024-05-20T17:07:18.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.438+0000 7f549dde0700 1 -- 172.21.15.6:0/2490482959 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5498050170 con 0x7f54980754f0 2024-05-20T17:07:18.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.439+0000 7f5494ff9700 1 -- 172.21.15.6:0/2490482959 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f5488018020 con 0x7f54980754f0 2024-05-20T17:07:18.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.440+0000 7f5494ff9700 1 --2- 172.21.15.6:0/2490482959 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f54800a2ca0 0x7f54800a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:18.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.441+0000 7f5496ffd700 1 --2- 172.21.15.6:0/2490482959 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f54800a2ca0 0x7f54800a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:18.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.441+0000 7f5494ff9700 1 -- 172.21.15.6:0/2490482959 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f54880cf060 con 0x7f54980754f0 2024-05-20T17:07:18.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.441+0000 7f5496ffd700 1 --2- 172.21.15.6:0/2490482959 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f54800a2ca0 0x7f54800a51b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f548c000c00 tx=0x7f548c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:18.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.444+0000 7f5494ff9700 1 -- 172.21.15.6:0/2490482959 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f548801f020 con 0x7f54980754f0 2024-05-20T17:07:18.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.661+0000 7f549dde0700 1 -- 172.21.15.6:0/2490482959 --> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f5498062a80 con 0x7f54800a2ca0 2024-05-20T17:07:18.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.663+0000 7f5494ff9700 1 -- 172.21.15.6:0/2490482959 <== mgr.14152 v2:172.21.15.6:6800/3244338052 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f5498062a80 con 0x7f54800a2ca0 2024-05-20T17:07:18.663 INFO:teuthology.orchestra.run.smithi006.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-20T17:07:18.663 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330000H400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-05-20T17:07:18.663 INFO:teuthology.orchestra.run.smithi006.stdout:smithi062 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT53440094400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-05-20T17:07:18.663 INFO:teuthology.orchestra.run.smithi006.stdout:smithi171 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233001S400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-05-20T17:07:18.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.665+0000 7f549dde0700 1 -- 172.21.15.6:0/2490482959 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f54800a2ca0 msgr2=0x7f54800a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:18.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.665+0000 7f549dde0700 1 --2- 172.21.15.6:0/2490482959 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f54800a2ca0 0x7f54800a51b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f548c000c00 tx=0x7f548c005fd0 comp rx=0 tx=0).stop 2024-05-20T17:07:18.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.665+0000 7f549dde0700 1 -- 172.21.15.6:0/2490482959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54980754f0 msgr2=0x7f5498199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:18.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.665+0000 7f549dde0700 1 --2- 172.21.15.6:0/2490482959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54980754f0 0x7f5498199870 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f548800b500 tx=0x7f548800b810 comp rx=0 tx=0).stop 2024-05-20T17:07:18.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.665+0000 7f549dde0700 1 -- 172.21.15.6:0/2490482959 shutdown_connections 2024-05-20T17:07:18.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.665+0000 7f549dde0700 1 --2- 172.21.15.6:0/2490482959 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f54800a2ca0 0x7f54800a51b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:18.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.665+0000 7f549dde0700 1 --2- 172.21.15.6:0/2490482959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5498108e80 0x7f54981a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:18.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.665+0000 7f549dde0700 1 --2- 172.21.15.6:0/2490482959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54980754f0 0x7f5498199870 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:18.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.665+0000 7f549dde0700 1 --2- 172.21.15.6:0/2490482959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5498106350 0x7f5498199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:18.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.665+0000 7f549dde0700 1 -- 172.21.15.6:0/2490482959 >> 172.21.15.6:0/2490482959 conn(0x7f54980fd710 msgr2=0x7f54981047a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:18.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.666+0000 7f549dde0700 1 -- 172.21.15.6:0/2490482959 shutdown_connections 2024-05-20T17:07:18.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:18.666+0000 7f549dde0700 1 -- 172.21.15.6:0/2490482959 wait complete. 2024-05-20T17:07:19.377 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-20T17:07:19.386 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T17:07:19.387 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-20T17:07:19.642 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:07:20.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:19 smithi006 ceph-mon[32486]: pgmap v372: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-20T17:07:20.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:19 smithi006 ceph-mon[32486]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:07:20.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:19 smithi062 ceph-mon[35425]: pgmap v372: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-20T17:07:20.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:19 smithi062 ceph-mon[35425]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:07:20.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:19 smithi171 ceph-mon[35901]: pgmap v372: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-20T17:07:20.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:19 smithi171 ceph-mon[35901]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-20T17:07:21.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.411+0000 7fbc7cf93700 1 -- 172.21.15.6:0/1095337386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc781020e0 msgr2=0x7fbc781024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:21.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.411+0000 7fbc7cf93700 1 --2- 172.21.15.6:0/1095337386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc781020e0 0x7fbc781024f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbc68009990 tx=0x7fbc68009ca0 comp rx=0 tx=0).stop 2024-05-20T17:07:21.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.411+0000 7fbc7cf93700 1 -- 172.21.15.6:0/1095337386 shutdown_connections 2024-05-20T17:07:21.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.411+0000 7fbc7cf93700 1 --2- 172.21.15.6:0/1095337386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc78103bb0 0x7fbc7810a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:21.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.411+0000 7fbc7cf93700 1 --2- 172.21.15.6:0/1095337386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc781020e0 0x7fbc781024f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:21.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.411+0000 7fbc7cf93700 1 --2- 172.21.15.6:0/1095337386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc78103210 0x7fbc78103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:21.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.411+0000 7fbc7cf93700 1 -- 172.21.15.6:0/1095337386 >> 172.21.15.6:0/1095337386 conn(0x7fbc780fd740 msgr2=0x7fbc780ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:21.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.411+0000 7fbc7cf93700 1 -- 172.21.15.6:0/1095337386 shutdown_connections 2024-05-20T17:07:21.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.411+0000 7fbc7cf93700 1 -- 172.21.15.6:0/1095337386 wait complete. 2024-05-20T17:07:21.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.412+0000 7fbc7cf93700 1 Processor -- start 2024-05-20T17:07:21.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.412+0000 7fbc7cf93700 1 -- start start 2024-05-20T17:07:21.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.412+0000 7fbc7cf93700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc781020e0 0x7fbc78198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.412+0000 7fbc7cf93700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc78103210 0x7fbc78198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.412+0000 7fbc7cf93700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc78103bb0 0x7fbc7819fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.412+0000 7fbc7cf93700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7810db30 con 0x7fbc781020e0 2024-05-20T17:07:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.412+0000 7fbc7cf93700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7810d9b0 con 0x7fbc78103210 2024-05-20T17:07:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.412+0000 7fbc7cf93700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7810dcb0 con 0x7fbc78103bb0 2024-05-20T17:07:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.412+0000 7fbc7659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc781020e0 0x7fbc78198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.412+0000 7fbc7659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc781020e0 0x7fbc78198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55782/0 (socket says 172.21.15.6:55782) 2024-05-20T17:07:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.412+0000 7fbc7659c700 1 -- 172.21.15.6:0/4090402857 learned_addr learned my addr 172.21.15.6:0/4090402857 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.412+0000 7fbc75d9b700 1 --2- 172.21.15.6:0/4090402857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc78103210 0x7fbc78198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.412+0000 7fbc76d9d700 1 --2- 172.21.15.6:0/4090402857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc78103bb0 0x7fbc7819fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.413+0000 7fbc7659c700 1 -- 172.21.15.6:0/4090402857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc78103bb0 msgr2=0x7fbc7819fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.413+0000 7fbc7659c700 1 --2- 172.21.15.6:0/4090402857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc78103bb0 0x7fbc7819fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.413+0000 7fbc7659c700 1 -- 172.21.15.6:0/4090402857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc78103210 msgr2=0x7fbc78198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.413+0000 7fbc7659c700 1 --2- 172.21.15.6:0/4090402857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc78103210 0x7fbc78198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:21.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.413+0000 7fbc7659c700 1 -- 172.21.15.6:0/4090402857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc78074920 con 0x7fbc781020e0 2024-05-20T17:07:21.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.413+0000 7fbc7659c700 1 --2- 172.21.15.6:0/4090402857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc781020e0 0x7fbc78198680 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbc68006010 tx=0x7fbc68009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:21.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.413+0000 7fbc677fe700 1 -- 172.21.15.6:0/4090402857 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc68027070 con 0x7fbc781020e0 2024-05-20T17:07:21.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.413+0000 7fbc677fe700 1 -- 172.21.15.6:0/4090402857 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc68022470 con 0x7fbc781020e0 2024-05-20T17:07:21.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.413+0000 7fbc7cf93700 1 -- 172.21.15.6:0/4090402857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc78074bb0 con 0x7fbc781020e0 2024-05-20T17:07:21.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.413+0000 7fbc677fe700 1 -- 172.21.15.6:0/4090402857 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc68017650 con 0x7fbc781020e0 2024-05-20T17:07:21.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.413+0000 7fbc7cf93700 1 -- 172.21.15.6:0/4090402857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc78075090 con 0x7fbc781020e0 2024-05-20T17:07:21.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.414+0000 7fbc7cf93700 1 -- 172.21.15.6:0/4090402857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc78050170 con 0x7fbc781020e0 2024-05-20T17:07:21.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.416+0000 7fbc677fe700 1 -- 172.21.15.6:0/4090402857 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fbc6802a070 con 0x7fbc781020e0 2024-05-20T17:07:21.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.417+0000 7fbc677fe700 1 --2- 172.21.15.6:0/4090402857 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbc600a2c20 0x7fbc600a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:21.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.417+0000 7fbc75d9b700 1 --2- 172.21.15.6:0/4090402857 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbc600a2c20 0x7fbc600a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:21.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.417+0000 7fbc677fe700 1 -- 172.21.15.6:0/4090402857 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fbc680d09c0 con 0x7fbc781020e0 2024-05-20T17:07:21.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.418+0000 7fbc75d9b700 1 --2- 172.21.15.6:0/4090402857 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbc600a2c20 0x7fbc600a5130 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbc78199730 tx=0x7fbc6c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:21.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.421+0000 7fbc677fe700 1 -- 172.21.15.6:0/4090402857 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbc68031020 con 0x7fbc781020e0 2024-05-20T17:07:21.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.670+0000 7fbc7cf93700 1 -- 172.21.15.6:0/4090402857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fbc780753b0 con 0x7fbc781020e0 2024-05-20T17:07:21.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.671+0000 7fbc677fe700 1 -- 172.21.15.6:0/4090402857 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3080 (secure 0 0 0) 0x7fbc68013070 con 0x7fbc781020e0 2024-05-20T17:07:21.671 INFO:teuthology.orchestra.run.smithi006.stdout:e28 2024-05-20T17:07:21.672 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-20T17:07:21.672 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-20T17:07:21.672 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-05-20T17:07:21.672 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:07:21.672 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-05-20T17:07:21.672 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-05-20T17:07:21.672 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 28 2024-05-20T17:07:21.672 INFO:teuthology.orchestra.run.smithi006.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-05-20T17:07:21.672 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-05-20T17:05:04.455743+0000 2024-05-20T17:07:21.672 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-05-20T17:05:35.584679+0000 2024-05-20T17:07:21.672 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-05-20T17:07:21.672 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-05-20T17:07:21.672 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 300 2024-05-20T17:07:21.673 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-05-20T17:07:21.673 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-05-20T17:07:21.673 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-05-20T17:07:21.673 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-05-20T17:07:21.673 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-05-20T17:07:21.673 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 0 2024-05-20T17:07:21.673 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-20T17:07:21.673 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 5 2024-05-20T17:07:21.673 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1,2,3,4 2024-05-20T17:07:21.673 INFO:teuthology.orchestra.run.smithi006.stdout:up {0=24548,1=24526,2=24484,3=24470,4=24440} 2024-05-20T17:07:21.673 INFO:teuthology.orchestra.run.smithi006.stdout:failed 2024-05-20T17:07:21.673 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-05-20T17:07:21.673 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-05-20T17:07:21.674 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3,4] 2024-05-20T17:07:21.674 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-05-20T17:07:21.674 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-05-20T17:07:21.674 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-05-20T17:07:21.674 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-05-20T17:07:21.674 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 0 2024-05-20T17:07:21.674 INFO:teuthology.orchestra.run.smithi006.stdout:qdb_cluster leader: 24548 members: 24440,24548,24526,24470,24484 2024-05-20T17:07:21.674 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b{0:24548} state up:active seq 3 addr [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:07:21.674 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.h{0:24509} state up:standby-replay seq 1 addr [v2:172.21.15.62:6836/1745943929,v1:172.21.15.62:6837/1745943929] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:07:21.674 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.i{1:24526} state up:active seq 12 addr [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:07:21.674 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c{1:24502} state up:standby-replay seq 1 addr [v2:172.21.15.171:6836/732693575,v1:172.21.15.171:6837/732693575] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:07:21.674 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.f{2:24484} state up:active seq 14 addr [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:07:21.674 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.l{2:24433} state up:standby-replay seq 1 addr [v2:172.21.15.171:6832/1476847062,v1:172.21.15.171:6833/1476847062] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:07:21.675 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.e{3:24470} state up:active seq 15 addr [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:07:21.675 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a{3:14643} state up:standby-replay seq 1 addr [v2:172.21.15.6:6840/223306009,v1:172.21.15.6:6841/223306009] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:07:21.675 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.k{4:24440} state up:active seq 18 addr [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:07:21.675 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.g{4:14631} state up:standby-replay seq 1 addr [v2:172.21.15.6:6838/3061403904,v1:172.21.15.6:6839/3061403904] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:07:21.675 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:07:21.675 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:07:21.675 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-05-20T17:07:21.675 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:07:21.675 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.j{-1:14550} state up:standby seq 1 addr [v2:172.21.15.6:6834/1420996362,v1:172.21.15.6:6835/1420996362] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:07:21.675 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d{-1:14562} state up:standby seq 1 addr [v2:172.21.15.6:6836/1881023641,v1:172.21.15.6:6837/1881023641] compat {c=[1],r=[1],i=[1fff]}] 2024-05-20T17:07:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.673+0000 7fbc7cf93700 1 -- 172.21.15.6:0/4090402857 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbc600a2c20 msgr2=0x7fbc600a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.673+0000 7fbc7cf93700 1 --2- 172.21.15.6:0/4090402857 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbc600a2c20 0x7fbc600a5130 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbc78199730 tx=0x7fbc6c009260 comp rx=0 tx=0).stop 2024-05-20T17:07:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.673+0000 7fbc7cf93700 1 -- 172.21.15.6:0/4090402857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc781020e0 msgr2=0x7fbc78198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.673+0000 7fbc7cf93700 1 --2- 172.21.15.6:0/4090402857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc781020e0 0x7fbc78198680 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbc68006010 tx=0x7fbc68009580 comp rx=0 tx=0).stop 2024-05-20T17:07:21.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.673+0000 7fbc7cf93700 1 -- 172.21.15.6:0/4090402857 shutdown_connections 2024-05-20T17:07:21.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.673+0000 7fbc7cf93700 1 --2- 172.21.15.6:0/4090402857 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbc600a2c20 0x7fbc600a5130 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:21.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.673+0000 7fbc7cf93700 1 --2- 172.21.15.6:0/4090402857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc78103bb0 0x7fbc7819fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:21.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.673+0000 7fbc7cf93700 1 --2- 172.21.15.6:0/4090402857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc781020e0 0x7fbc78198680 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:21.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.673+0000 7fbc7cf93700 1 --2- 172.21.15.6:0/4090402857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc78103210 0x7fbc78198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:21.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.673+0000 7fbc7cf93700 1 -- 172.21.15.6:0/4090402857 >> 172.21.15.6:0/4090402857 conn(0x7fbc780fd740 msgr2=0x7fbc78106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:21.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.673+0000 7fbc7cf93700 1 -- 172.21.15.6:0/4090402857 shutdown_connections 2024-05-20T17:07:21.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:21.673+0000 7fbc7cf93700 1 -- 172.21.15.6:0/4090402857 wait complete. 2024-05-20T17:07:21.677 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 28 2024-05-20T17:07:21.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:21 smithi006 ceph-mon[32486]: pgmap v373: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-20T17:07:21.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:21 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/4090402857' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-20T17:07:22.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:21 smithi062 ceph-mon[35425]: pgmap v373: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-20T17:07:22.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:21 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/4090402857' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-20T17:07:22.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:21 smithi171 ceph-mon[35901]: pgmap v373: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-20T17:07:22.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:21 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/4090402857' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-20T17:07:22.333 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- bash -c 'ceph osd dump' 2024-05-20T17:07:22.590 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:07:23.849 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:23 smithi006 ceph-mon[32486]: pgmap v374: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-20T17:07:24.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:23 smithi062 ceph-mon[35425]: pgmap v374: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-20T17:07:24.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:23 smithi171 ceph-mon[35901]: pgmap v374: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-20T17:07:24.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.372+0000 7fdfc92d8700 1 -- 172.21.15.6:0/2219994268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc41031f0 msgr2=0x7fdfc4103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:24.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.372+0000 7fdfc92d8700 1 --2- 172.21.15.6:0/2219994268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc41031f0 0x7fdfc4103600 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8009990 tx=0x7fdfb8009ca0 comp rx=0 tx=0).stop 2024-05-20T17:07:24.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.372+0000 7fdfc92d8700 1 -- 172.21.15.6:0/2219994268 shutdown_connections 2024-05-20T17:07:24.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.372+0000 7fdfc92d8700 1 --2- 172.21.15.6:0/2219994268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc4103b90 0x7fdfc410a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:24.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.372+0000 7fdfc92d8700 1 --2- 172.21.15.6:0/2219994268 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfc41020c0 0x7fdfc41024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:24.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.372+0000 7fdfc92d8700 1 --2- 172.21.15.6:0/2219994268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc41031f0 0x7fdfc4103600 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:24.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.372+0000 7fdfc92d8700 1 -- 172.21.15.6:0/2219994268 >> 172.21.15.6:0/2219994268 conn(0x7fdfc40fd700 msgr2=0x7fdfc40ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:24.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.372+0000 7fdfc92d8700 1 -- 172.21.15.6:0/2219994268 shutdown_connections 2024-05-20T17:07:24.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.372+0000 7fdfc92d8700 1 -- 172.21.15.6:0/2219994268 wait complete. 2024-05-20T17:07:24.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.373+0000 7fdfc92d8700 1 Processor -- start 2024-05-20T17:07:24.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.373+0000 7fdfc92d8700 1 -- start start 2024-05-20T17:07:24.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.373+0000 7fdfc92d8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc41020c0 0x7fdfc406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.373+0000 7fdfc92d8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc41031f0 0x7fdfc419e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.374+0000 7fdfc92d8700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfc4103b90 0x7fdfc41a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.374+0000 7fdfc92d8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc410db80 con 0x7fdfc41031f0 2024-05-20T17:07:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.374+0000 7fdfc92d8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc410da00 con 0x7fdfc41020c0 2024-05-20T17:07:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.374+0000 7fdfc92d8700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc410dd00 con 0x7fdfc4103b90 2024-05-20T17:07:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.374+0000 7fdfc27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc41031f0 0x7fdfc419e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.374+0000 7fdfc27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc41031f0 0x7fdfc419e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55812/0 (socket says 172.21.15.6:55812) 2024-05-20T17:07:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.374+0000 7fdfc27fc700 1 -- 172.21.15.6:0/1261031877 learned_addr learned my addr 172.21.15.6:0/1261031877 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.374+0000 7fdfc2ffd700 1 --2- 172.21.15.6:0/1261031877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc41020c0 0x7fdfc406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.374+0000 7fdfc37fe700 1 --2- 172.21.15.6:0/1261031877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfc4103b90 0x7fdfc41a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.374+0000 7fdfc27fc700 1 -- 172.21.15.6:0/1261031877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfc4103b90 msgr2=0x7fdfc41a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.374+0000 7fdfc27fc700 1 --2- 172.21.15.6:0/1261031877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfc4103b90 0x7fdfc41a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.374+0000 7fdfc27fc700 1 -- 172.21.15.6:0/1261031877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc41020c0 msgr2=0x7fdfc406aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:24.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.374+0000 7fdfc27fc700 1 --2- 172.21.15.6:0/1261031877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc41020c0 0x7fdfc406aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:24.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.374+0000 7fdfc27fc700 1 -- 172.21.15.6:0/1261031877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc41a1300 con 0x7fdfc41031f0 2024-05-20T17:07:24.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.374+0000 7fdfc27fc700 1 --2- 172.21.15.6:0/1261031877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc41031f0 0x7fdfc419e5f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80036e0 tx=0x7fdfb8009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:24.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.375+0000 7fdfabfff700 1 -- 172.21.15.6:0/1261031877 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8027070 con 0x7fdfc41031f0 2024-05-20T17:07:24.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.375+0000 7fdfabfff700 1 -- 172.21.15.6:0/1261031877 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdfb80040d0 con 0x7fdfc41031f0 2024-05-20T17:07:24.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.375+0000 7fdfc92d8700 1 -- 172.21.15.6:0/1261031877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc41a1590 con 0x7fdfc41031f0 2024-05-20T17:07:24.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.375+0000 7fdfabfff700 1 -- 172.21.15.6:0/1261031877 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8022dd0 con 0x7fdfc41031f0 2024-05-20T17:07:24.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.375+0000 7fdfc92d8700 1 -- 172.21.15.6:0/1261031877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc41a1a40 con 0x7fdfc41031f0 2024-05-20T17:07:24.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.376+0000 7fdfc92d8700 1 -- 172.21.15.6:0/1261031877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc4050170 con 0x7fdfc41031f0 2024-05-20T17:07:24.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.377+0000 7fdfabfff700 1 -- 172.21.15.6:0/1261031877 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fdfb802a070 con 0x7fdfc41031f0 2024-05-20T17:07:24.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.378+0000 7fdfabfff700 1 --2- 172.21.15.6:0/1261031877 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdfac0a2ca0 0x7fdfac0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:24.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.378+0000 7fdfabfff700 1 -- 172.21.15.6:0/1261031877 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fdfb80d0770 con 0x7fdfc41031f0 2024-05-20T17:07:24.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.378+0000 7fdfc2ffd700 1 --2- 172.21.15.6:0/1261031877 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdfac0a2ca0 0x7fdfac0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:24.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.379+0000 7fdfc2ffd700 1 --2- 172.21.15.6:0/1261031877 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdfac0a2ca0 0x7fdfac0a51b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdfc41030f0 tx=0x7fdfb4007a30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:24.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.382+0000 7fdfabfff700 1 -- 172.21.15.6:0/1261031877 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fdfb8031080 con 0x7fdfc41031f0 2024-05-20T17:07:24.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.588+0000 7fdfc92d8700 1 -- 172.21.15.6:0/1261031877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fdfc402dc60 con 0x7fdfc41031f0 2024-05-20T17:07:24.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.589+0000 7fdfabfff700 1 -- 172.21.15.6:0/1261031877 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v94) ==== 56+0+5620 (secure 0 0 0) 0x7fdfb8013070 con 0x7fdfc41031f0 2024-05-20T17:07:24.590 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 94 2024-05-20T17:07:24.590 INFO:teuthology.orchestra.run.smithi006.stdout:fsid c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T17:07:24.590 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-05-20T16:56:45.111458+0000 2024-05-20T17:07:24.590 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-05-20T17:06:44.581646+0000 2024-05-20T17:07:24.590 INFO:teuthology.orchestra.run.smithi006.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-20T17:07:24.590 INFO:teuthology.orchestra.run.smithi006.stdout:crush_version 27 2024-05-20T17:07:24.590 INFO:teuthology.orchestra.run.smithi006.stdout:full_ratio 0.95 2024-05-20T17:07:24.590 INFO:teuthology.orchestra.run.smithi006.stdout:backfillfull_ratio 0.9 2024-05-20T17:07:24.591 INFO:teuthology.orchestra.run.smithi006.stdout:nearfull_ratio 0.85 2024-05-20T17:07:24.591 INFO:teuthology.orchestra.run.smithi006.stdout:require_min_compat_client luminous 2024-05-20T17:07:24.591 INFO:teuthology.orchestra.run.smithi006.stdout:min_compat_client luminous 2024-05-20T17:07:24.591 INFO:teuthology.orchestra.run.smithi006.stdout:require_osd_release squid 2024-05-20T17:07:24.591 INFO:teuthology.orchestra.run.smithi006.stdout:stretch_mode_enabled false 2024-05-20T17:07:24.591 INFO:teuthology.orchestra.run.smithi006.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-05-20T17:07:24.591 INFO:teuthology.orchestra.run.smithi006.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-05-20T17:07:24.591 INFO:teuthology.orchestra.run.smithi006.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-05-20T17:07:24.591 INFO:teuthology.orchestra.run.smithi006.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 90 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-05-20T17:07:24.591 INFO:teuthology.orchestra.run.smithi006.stdout:max_osd 12 2024-05-20T17:07:24.591 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 up in weight 1 up_from 8 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6802/25625798,v1:172.21.15.6:6803/25625798] [v2:172.21.15.6:6804/25625798,v1:172.21.15.6:6805/25625798] exists,up 7fee8c26-c79a-4b9d-aa3a-d31d00941060 2024-05-20T17:07:24.591 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 up in weight 1 up_from 13 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.62:6800/2080543878,v1:172.21.15.62:6801/2080543878] [v2:172.21.15.62:6802/2080543878,v1:172.21.15.62:6803/2080543878] exists,up f5f34ba7-73bc-4b7c-b02e-be24d5f9b458 2024-05-20T17:07:24.591 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 up in weight 1 up_from 18 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.171:6800/56436737,v1:172.21.15.171:6801/56436737] [v2:172.21.15.171:6802/56436737,v1:172.21.15.171:6803/56436737] exists,up e3ceaced-2797-4274-8b88-18b9c6dedb4a 2024-05-20T17:07:24.592 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 up in weight 1 up_from 26 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6810/4226183924,v1:172.21.15.6:6811/4226183924] [v2:172.21.15.6:6812/4226183924,v1:172.21.15.6:6813/4226183924] exists,up 8eabe078-e351-4877-9954-b472a88ca266 2024-05-20T17:07:24.592 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 up in weight 1 up_from 34 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.62:6808/1161846805,v1:172.21.15.62:6809/1161846805] [v2:172.21.15.62:6810/1161846805,v1:172.21.15.62:6811/1161846805] exists,up 20b150c9-3f76-40f5-af1d-9dc70923637a 2024-05-20T17:07:24.592 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 up in weight 1 up_from 39 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.171:6808/2616695062,v1:172.21.15.171:6809/2616695062] [v2:172.21.15.171:6810/2616695062,v1:172.21.15.171:6811/2616695062] exists,up 0183cc90-abec-4ad7-af28-03008fc59528 2024-05-20T17:07:24.592 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6 up in weight 1 up_from 47 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6818/3806628023,v1:172.21.15.6:6819/3806628023] [v2:172.21.15.6:6820/3806628023,v1:172.21.15.6:6821/3806628023] exists,up b2be5095-5b84-41d2-ad24-7696926ebe47 2024-05-20T17:07:24.592 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7 up in weight 1 up_from 52 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.62:6816/598452691,v1:172.21.15.62:6817/598452691] [v2:172.21.15.62:6818/598452691,v1:172.21.15.62:6819/598452691] exists,up 7b04311f-971f-4fff-b8bf-9b8103d97c90 2024-05-20T17:07:24.592 INFO:teuthology.orchestra.run.smithi006.stdout:osd.8 up in weight 1 up_from 60 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.171:6816/1159983887,v1:172.21.15.171:6817/1159983887] [v2:172.21.15.171:6818/1159983887,v1:172.21.15.171:6819/1159983887] exists,up d6c75e8b-23ac-4bfc-8621-11c533acf1a3 2024-05-20T17:07:24.592 INFO:teuthology.orchestra.run.smithi006.stdout:osd.9 up in weight 1 up_from 68 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6826/500627917,v1:172.21.15.6:6827/500627917] [v2:172.21.15.6:6828/500627917,v1:172.21.15.6:6829/500627917] exists,up 23515136-a538-4352-adf4-b988ea887720 2024-05-20T17:07:24.592 INFO:teuthology.orchestra.run.smithi006.stdout:osd.10 up in weight 1 up_from 73 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.62:6824/2012507198,v1:172.21.15.62:6825/2012507198] [v2:172.21.15.62:6826/2012507198,v1:172.21.15.62:6827/2012507198] exists,up 5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f 2024-05-20T17:07:24.592 INFO:teuthology.orchestra.run.smithi006.stdout:osd.11 up in weight 1 up_from 81 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.171:6824/698174151,v1:172.21.15.171:6825/698174151] [v2:172.21.15.171:6826/698174151,v1:172.21.15.171:6827/698174151] exists,up 11cd0c8a-f493-4c30-8324-11adc674c650 2024-05-20T17:07:24.592 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 2.0 [7,11] 2024-05-20T17:07:24.592 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 2.a [2,11] 2024-05-20T17:07:24.592 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 2.b [2,4] 2024-05-20T17:07:24.592 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 2.1a [8,1] 2024-05-20T17:07:24.593 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.2 [3,9] 2024-05-20T17:07:24.593 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.11 [4,6] 2024-05-20T17:07:24.593 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.1b [5,9] 2024-05-20T17:07:24.593 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.27 [4,8] 2024-05-20T17:07:24.593 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.2c [4,9] 2024-05-20T17:07:24.593 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 4.6 [5,8] 2024-05-20T17:07:24.593 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 4.13 [9,8] 2024-05-20T17:07:24.593 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 4.1b [9,8] 2024-05-20T17:07:24.593 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 4.1f [9,10] 2024-05-20T17:07:24.593 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6801/3509827796 expires 2024-05-21T16:57:41.985704+0000 2024-05-20T17:07:24.593 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6800/3509827796 expires 2024-05-21T16:57:41.985704+0000 2024-05-20T17:07:24.593 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/173523304 expires 2024-05-21T16:57:41.985704+0000 2024-05-20T17:07:24.593 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6801/741681069 expires 2024-05-21T16:57:14.356112+0000 2024-05-20T17:07:24.594 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/2415124466 expires 2024-05-21T16:57:14.356112+0000 2024-05-20T17:07:24.594 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/3427029758 expires 2024-05-21T16:57:14.356112+0000 2024-05-20T17:07:24.594 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6800/741681069 expires 2024-05-21T16:57:14.356112+0000 2024-05-20T17:07:24.594 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/3324031224 expires 2024-05-21T16:57:14.356112+0000 2024-05-20T17:07:24.594 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/3781923966 expires 2024-05-21T16:57:41.985704+0000 2024-05-20T17:07:24.594 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/2979361383 expires 2024-05-21T16:57:41.985704+0000 2024-05-20T17:07:24.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.591+0000 7fdfc92d8700 1 -- 172.21.15.6:0/1261031877 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdfac0a2ca0 msgr2=0x7fdfac0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:24.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.591+0000 7fdfc92d8700 1 --2- 172.21.15.6:0/1261031877 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdfac0a2ca0 0x7fdfac0a51b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdfc41030f0 tx=0x7fdfb4007a30 comp rx=0 tx=0).stop 2024-05-20T17:07:24.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.591+0000 7fdfc92d8700 1 -- 172.21.15.6:0/1261031877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc41031f0 msgr2=0x7fdfc419e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:24.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.591+0000 7fdfc92d8700 1 --2- 172.21.15.6:0/1261031877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc41031f0 0x7fdfc419e5f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80036e0 tx=0x7fdfb8009580 comp rx=0 tx=0).stop 2024-05-20T17:07:24.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.592+0000 7fdfc92d8700 1 -- 172.21.15.6:0/1261031877 shutdown_connections 2024-05-20T17:07:24.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.592+0000 7fdfc92d8700 1 --2- 172.21.15.6:0/1261031877 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdfac0a2ca0 0x7fdfac0a51b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:24.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.592+0000 7fdfc92d8700 1 --2- 172.21.15.6:0/1261031877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfc4103b90 0x7fdfc41a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:24.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.592+0000 7fdfc92d8700 1 --2- 172.21.15.6:0/1261031877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfc41020c0 0x7fdfc406aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:24.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.592+0000 7fdfc92d8700 1 --2- 172.21.15.6:0/1261031877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc41031f0 0x7fdfc419e5f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:24.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.592+0000 7fdfc92d8700 1 -- 172.21.15.6:0/1261031877 >> 172.21.15.6:0/1261031877 conn(0x7fdfc40fd700 msgr2=0x7fdfc4106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:24.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.592+0000 7fdfc92d8700 1 -- 172.21.15.6:0/1261031877 shutdown_connections 2024-05-20T17:07:24.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:24.592+0000 7fdfc92d8700 1 -- 172.21.15.6:0/1261031877 wait complete. 2024-05-20T17:07:24.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:24 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1261031877' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-20T17:07:25.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:24 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1261031877' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-20T17:07:25.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:24 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1261031877' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-20T17:07:25.301 INFO:teuthology.run_tasks:Running task fs.ready... 2024-05-20T17:07:25.314 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:07:25.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.436+0000 7f419411a640 1 -- 172.21.15.6:0/555928143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c102ae0 msgr2=0x7f418c1037e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:25.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.436+0000 7f419411a640 1 --2- 172.21.15.6:0/555928143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c102ae0 0x7f418c1037e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4188009ca0 tx=0x7f418802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:07:25.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.436+0000 7f419411a640 1 -- 172.21.15.6:0/555928143 shutdown_connections 2024-05-20T17:07:25.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.436+0000 7f419411a640 1 --2- 172.21.15.6:0/555928143 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f418c108a20 0x7f418c10ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:25.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.436+0000 7f419411a640 1 --2- 172.21.15.6:0/555928143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f418c103d20 0x7f418c104130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:25.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.436+0000 7f419411a640 1 --2- 172.21.15.6:0/555928143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c102ae0 0x7f418c1037e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:25.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.436+0000 7f419411a640 1 -- 172.21.15.6:0/555928143 >> 172.21.15.6:0/555928143 conn(0x7f418c0fdcf0 msgr2=0x7f418c100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:25.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.436+0000 7f419411a640 1 -- 172.21.15.6:0/555928143 shutdown_connections 2024-05-20T17:07:25.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.436+0000 7f419411a640 1 -- 172.21.15.6:0/555928143 wait complete. 2024-05-20T17:07:25.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.437+0000 7f419411a640 1 Processor -- start 2024-05-20T17:07:25.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.437+0000 7f419411a640 1 -- start start 2024-05-20T17:07:25.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.437+0000 7f419411a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f418c102ae0 0x7f418c199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:25.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.437+0000 7f419411a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f418c103d20 0x7f418c1996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.437+0000 7f419411a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c108a20 0x7f418c1a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.437+0000 7f419411a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f418c10e5c0 con 0x7f418c108a20 2024-05-20T17:07:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.437+0000 7f419411a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f418c10e440 con 0x7f418c102ae0 2024-05-20T17:07:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.437+0000 7f419411a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f418c10e740 con 0x7f418c103d20 2024-05-20T17:07:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.438+0000 7f41926b7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c108a20 0x7f418c1a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.438+0000 7f41926b7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c108a20 0x7f418c1a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55838/0 (socket says 172.21.15.6:55838) 2024-05-20T17:07:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.438+0000 7f41926b7640 1 -- 172.21.15.6:0/113276086 learned_addr learned my addr 172.21.15.6:0/113276086 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.438+0000 7f4191eb6640 1 --2- 172.21.15.6:0/113276086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f418c102ae0 0x7f418c199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.438+0000 7f41916b5640 1 --2- 172.21.15.6:0/113276086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f418c103d20 0x7f418c1996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.438+0000 7f41926b7640 1 -- 172.21.15.6:0/113276086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f418c103d20 msgr2=0x7f418c1996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.438+0000 7f41926b7640 1 --2- 172.21.15.6:0/113276086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f418c103d20 0x7f418c1996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.438+0000 7f41926b7640 1 -- 172.21.15.6:0/113276086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f418c102ae0 msgr2=0x7f418c199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.438+0000 7f41926b7640 1 --2- 172.21.15.6:0/113276086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f418c102ae0 0x7f418c199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:25.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.438+0000 7f41926b7640 1 -- 172.21.15.6:0/113276086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418c1a0bf0 con 0x7f418c108a20 2024-05-20T17:07:25.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.438+0000 7f41916b5640 1 --2- 172.21.15.6:0/113276086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f418c103d20 0x7f418c1996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:07:25.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.438+0000 7f41926b7640 1 --2- 172.21.15.6:0/113276086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c108a20 0x7f418c1a0630 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f418400c970 tx=0x7f418400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:25.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.438+0000 7f4182ffd640 1 -- 172.21.15.6:0/113276086 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4184007bb0 con 0x7f418c108a20 2024-05-20T17:07:25.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.438+0000 7f4182ffd640 1 -- 172.21.15.6:0/113276086 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4184007d50 con 0x7f418c108a20 2024-05-20T17:07:25.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.438+0000 7f419411a640 1 -- 172.21.15.6:0/113276086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f418c1a0ee0 con 0x7f418c108a20 2024-05-20T17:07:25.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.438+0000 7f4182ffd640 1 -- 172.21.15.6:0/113276086 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4184018700 con 0x7f418c108a20 2024-05-20T17:07:25.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.439+0000 7f419411a640 1 -- 172.21.15.6:0/113276086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f418c1a1340 con 0x7f418c108a20 2024-05-20T17:07:25.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.440+0000 7f419411a640 1 -- 172.21.15.6:0/113276086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f418c107830 con 0x7f418c108a20 2024-05-20T17:07:25.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.441+0000 7f4182ffd640 1 -- 172.21.15.6:0/113276086 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f418400fa20 con 0x7f418c108a20 2024-05-20T17:07:25.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.442+0000 7f4182ffd640 1 --2- 172.21.15.6:0/113276086 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f41780a2cb0 0x7f41780a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:25.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.442+0000 7f4191eb6640 1 --2- 172.21.15.6:0/113276086 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f41780a2cb0 0x7f41780a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:25.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.442+0000 7f4182ffd640 1 -- 172.21.15.6:0/113276086 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f41840cf550 con 0x7f418c108a20 2024-05-20T17:07:25.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.442+0000 7f4191eb6640 1 --2- 172.21.15.6:0/113276086 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f41780a2cb0 0x7f41780a51c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4188000f80 tx=0x7f4188009900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:25.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.447+0000 7f4182ffd640 1 -- 172.21.15.6:0/113276086 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4184014030 con 0x7f418c108a20 2024-05-20T17:07:25.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.635+0000 7f419411a640 1 -- 172.21.15.6:0/113276086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f418c062820 con 0x7f418c108a20 2024-05-20T17:07:25.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.636+0000 7f4182ffd640 1 -- 172.21.15.6:0/113276086 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+24584 (secure 0 0 0) 0x7f418409c0a0 con 0x7f418c108a20 2024-05-20T17:07:25.637 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:07:25.637 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":94,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:06:44.581646+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:05:02.947896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:05:03.842231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:05:07.551471+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:07:25.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.638+0000 7f419411a640 1 -- 172.21.15.6:0/113276086 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f41780a2cb0 msgr2=0x7f41780a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:25.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.638+0000 7f419411a640 1 --2- 172.21.15.6:0/113276086 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f41780a2cb0 0x7f41780a51c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4188000f80 tx=0x7f4188009900 comp rx=0 tx=0).stop 2024-05-20T17:07:25.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.638+0000 7f419411a640 1 -- 172.21.15.6:0/113276086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c108a20 msgr2=0x7f418c1a0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:25.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.638+0000 7f419411a640 1 --2- 172.21.15.6:0/113276086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c108a20 0x7f418c1a0630 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f418400c970 tx=0x7f418400ce30 comp rx=0 tx=0).stop 2024-05-20T17:07:25.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.638+0000 7f419411a640 1 -- 172.21.15.6:0/113276086 shutdown_connections 2024-05-20T17:07:25.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.638+0000 7f419411a640 1 --2- 172.21.15.6:0/113276086 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f41780a2cb0 0x7f41780a51c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:25.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.638+0000 7f419411a640 1 --2- 172.21.15.6:0/113276086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c108a20 0x7f418c1a0630 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:25.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.638+0000 7f419411a640 1 --2- 172.21.15.6:0/113276086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f418c103d20 0x7f418c1996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:25.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.638+0000 7f419411a640 1 --2- 172.21.15.6:0/113276086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f418c102ae0 0x7f418c199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:25.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.638+0000 7f419411a640 1 -- 172.21.15.6:0/113276086 >> 172.21.15.6:0/113276086 conn(0x7f418c0fdcf0 msgr2=0x7f418c104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:25.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.638+0000 7f419411a640 1 -- 172.21.15.6:0/113276086 shutdown_connections 2024-05-20T17:07:25.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.638+0000 7f419411a640 1 -- 172.21.15.6:0/113276086 wait complete. 2024-05-20T17:07:25.651 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:00:12.516679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:05:02.947896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:05:03.842231+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:05:07.551471+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:07:25.652 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:07:25.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.770+0000 7fc0d8c92640 1 -- 172.21.15.6:0/4248661950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0d41078c0 msgr2=0x7fc0d4109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:25.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.770+0000 7fc0d8c92640 1 --2- 172.21.15.6:0/4248661950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0d41078c0 0x7fc0d4109ce0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc009900 tx=0x7fc0cc02a410 comp rx=0 tx=0).stop 2024-05-20T17:07:25.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.770+0000 7fc0d8c92640 1 -- 172.21.15.6:0/4248661950 shutdown_connections 2024-05-20T17:07:25.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.770+0000 7fc0d8c92640 1 --2- 172.21.15.6:0/4248661950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0d41078c0 0x7fc0d4109ce0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:25.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.770+0000 7fc0d8c92640 1 --2- 172.21.15.6:0/4248661950 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0d4102bc0 0x7fc0d4102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:25.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.770+0000 7fc0d8c92640 1 --2- 172.21.15.6:0/4248661950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0d4101980 0x7fc0d4102680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:25.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.770+0000 7fc0d8c92640 1 -- 172.21.15.6:0/4248661950 >> 172.21.15.6:0/4248661950 conn(0x7fc0d40fcb70 msgr2=0x7fc0d40ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:25.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.770+0000 7fc0d8c92640 1 -- 172.21.15.6:0/4248661950 shutdown_connections 2024-05-20T17:07:25.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.770+0000 7fc0d8c92640 1 -- 172.21.15.6:0/4248661950 wait complete. 2024-05-20T17:07:25.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.771+0000 7fc0d8c92640 1 Processor -- start 2024-05-20T17:07:25.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.771+0000 7fc0d8c92640 1 -- start start 2024-05-20T17:07:25.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.771+0000 7fc0d8c92640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0d4101980 0x7fc0d4199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:25.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.771+0000 7fc0d8c92640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0d4102bc0 0x7fc0d4199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:25.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.771+0000 7fc0d8c92640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0d41078c0 0x7fc0d41a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:25.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.771+0000 7fc0d8c92640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d410e5b0 con 0x7fc0d41078c0 2024-05-20T17:07:25.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.771+0000 7fc0d8c92640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d410e430 con 0x7fc0d4101980 2024-05-20T17:07:25.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.771+0000 7fc0d8c92640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d410e730 con 0x7fc0d4102bc0 2024-05-20T17:07:25.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.771+0000 7fc0d2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0d41078c0 0x7fc0d41a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:25.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.771+0000 7fc0d2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0d41078c0 0x7fc0d41a0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55856/0 (socket says 172.21.15.6:55856) 2024-05-20T17:07:25.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.771+0000 7fc0d2d9d640 1 -- 172.21.15.6:0/1044714964 learned_addr learned my addr 172.21.15.6:0/1044714964 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:25.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.771+0000 7fc0d1d9b640 1 --2- 172.21.15.6:0/1044714964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0d4102bc0 0x7fc0d4199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:25.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.771+0000 7fc0d259c640 1 --2- 172.21.15.6:0/1044714964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0d4101980 0x7fc0d4199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:25.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.771+0000 7fc0d2d9d640 1 -- 172.21.15.6:0/1044714964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0d4102bc0 msgr2=0x7fc0d4199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:25.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.771+0000 7fc0d2d9d640 1 --2- 172.21.15.6:0/1044714964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0d4102bc0 0x7fc0d4199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:25.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.771+0000 7fc0d2d9d640 1 -- 172.21.15.6:0/1044714964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0d4101980 msgr2=0x7fc0d4199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:25.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.772+0000 7fc0d2d9d640 1 --2- 172.21.15.6:0/1044714964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0d4101980 0x7fc0d4199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:25.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.772+0000 7fc0d2d9d640 1 -- 172.21.15.6:0/1044714964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d41a0c90 con 0x7fc0d41078c0 2024-05-20T17:07:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.772+0000 7fc0d2d9d640 1 --2- 172.21.15.6:0/1044714964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0d41078c0 0x7fc0d41a0620 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc031440 tx=0x7fc0cc031a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.772+0000 7fc0c37fe640 1 -- 172.21.15.6:0/1044714964 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc03f030 con 0x7fc0d41078c0 2024-05-20T17:07:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.772+0000 7fc0d8c92640 1 -- 172.21.15.6:0/1044714964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d41a0f20 con 0x7fc0d41078c0 2024-05-20T17:07:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.772+0000 7fc0c37fe640 1 -- 172.21.15.6:0/1044714964 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc0cc003aa0 con 0x7fc0d41078c0 2024-05-20T17:07:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.772+0000 7fc0c37fe640 1 -- 172.21.15.6:0/1044714964 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc035070 con 0x7fc0d41078c0 2024-05-20T17:07:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.772+0000 7fc0d8c92640 1 -- 172.21.15.6:0/1044714964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d41a1380 con 0x7fc0d41078c0 2024-05-20T17:07:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.773+0000 7fc0d8c92640 1 -- 172.21.15.6:0/1044714964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d41066d0 con 0x7fc0d41078c0 2024-05-20T17:07:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.774+0000 7fc0c37fe640 1 -- 172.21.15.6:0/1044714964 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fc0cc042030 con 0x7fc0d41078c0 2024-05-20T17:07:25.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.775+0000 7fc0c37fe640 1 --2- 172.21.15.6:0/1044714964 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc0bc0a2b90 0x7fc0bc0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:25.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.776+0000 7fc0d259c640 1 --2- 172.21.15.6:0/1044714964 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc0bc0a2b90 0x7fc0bc0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:25.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.776+0000 7fc0c37fe640 1 -- 172.21.15.6:0/1044714964 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fc0cc0ef9e0 con 0x7fc0d41078c0 2024-05-20T17:07:25.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.776+0000 7fc0d259c640 1 --2- 172.21.15.6:0/1044714964 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc0bc0a2b90 0x7fc0bc0a50a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4005fd0 tx=0x7fc0c4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:25.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.781+0000 7fc0c37fe640 1 -- 172.21.15.6:0/1044714964 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc0cc0bc590 con 0x7fc0d41078c0 2024-05-20T17:07:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.963+0000 7fc0d8c92640 1 -- 172.21.15.6:0/1044714964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc0d402d2a0 con 0x7fc0d41078c0 2024-05-20T17:07:25.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.964+0000 7fc0c37fe640 1 -- 172.21.15.6:0/1044714964 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) ==== 93+0+10 (secure 0 0 0) 0x7fc0cc0bbe90 con 0x7fc0d41078c0 2024-05-20T17:07:25.964 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:07:25.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.966+0000 7fc0d8c92640 1 -- 172.21.15.6:0/1044714964 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc0bc0a2b90 msgr2=0x7fc0bc0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:25.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.966+0000 7fc0d8c92640 1 --2- 172.21.15.6:0/1044714964 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc0bc0a2b90 0x7fc0bc0a50a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4005fd0 tx=0x7fc0c4005850 comp rx=0 tx=0).stop 2024-05-20T17:07:25.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.966+0000 7fc0d8c92640 1 -- 172.21.15.6:0/1044714964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0d41078c0 msgr2=0x7fc0d41a0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.966+0000 7fc0d8c92640 1 --2- 172.21.15.6:0/1044714964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0d41078c0 0x7fc0d41a0620 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc031440 tx=0x7fc0cc031a30 comp rx=0 tx=0).stop 2024-05-20T17:07:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.966+0000 7fc0d8c92640 1 -- 172.21.15.6:0/1044714964 shutdown_connections 2024-05-20T17:07:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.966+0000 7fc0d8c92640 1 --2- 172.21.15.6:0/1044714964 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc0bc0a2b90 0x7fc0bc0a50a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.966+0000 7fc0d8c92640 1 --2- 172.21.15.6:0/1044714964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0d41078c0 0x7fc0d41a0620 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.966+0000 7fc0d8c92640 1 --2- 172.21.15.6:0/1044714964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0d4102bc0 0x7fc0d4199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.966+0000 7fc0d8c92640 1 --2- 172.21.15.6:0/1044714964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0d4101980 0x7fc0d4199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.966+0000 7fc0d8c92640 1 -- 172.21.15.6:0/1044714964 >> 172.21.15.6:0/1044714964 conn(0x7fc0d40fcb70 msgr2=0x7fc0d41038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.966+0000 7fc0d8c92640 1 -- 172.21.15.6:0/1044714964 shutdown_connections 2024-05-20T17:07:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:25.966+0000 7fc0d8c92640 1 -- 172.21.15.6:0/1044714964 wait complete. 2024-05-20T17:07:25.976 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:25 smithi006 ceph-mon[32486]: pgmap v375: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:07:25.977 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:25 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/113276086' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:07:25.978 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:07:26.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:25 smithi062 ceph-mon[35425]: pgmap v375: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:07:26.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:25 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/113276086' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:07:26.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.095+0000 7f9bf1a8b640 1 -- 172.21.15.6:0/2587785374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bec102bf0 msgr2=0x7f9bec103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:26.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.095+0000 7f9bf1a8b640 1 --2- 172.21.15.6:0/2587785374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bec102bf0 0x7f9bec103000 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9be0009900 tx=0x7f9be002a410 comp rx=0 tx=0).stop 2024-05-20T17:07:26.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.095+0000 7f9bf1a8b640 1 -- 172.21.15.6:0/2587785374 shutdown_connections 2024-05-20T17:07:26.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.095+0000 7f9bf1a8b640 1 --2- 172.21.15.6:0/2587785374 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bec1078f0 0x7f9bec109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.095+0000 7f9bf1a8b640 1 --2- 172.21.15.6:0/2587785374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bec102bf0 0x7f9bec103000 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.095+0000 7f9bf1a8b640 1 --2- 172.21.15.6:0/2587785374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bec1019b0 0x7f9bec1026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.095+0000 7f9bf1a8b640 1 -- 172.21.15.6:0/2587785374 >> 172.21.15.6:0/2587785374 conn(0x7f9bec0fcbe0 msgr2=0x7f9bec0ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:26.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.095+0000 7f9bf1a8b640 1 -- 172.21.15.6:0/2587785374 shutdown_connections 2024-05-20T17:07:26.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.095+0000 7f9bf1a8b640 1 -- 172.21.15.6:0/2587785374 wait complete. 2024-05-20T17:07:26.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.096+0000 7f9bf1a8b640 1 Processor -- start 2024-05-20T17:07:26.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.096+0000 7f9bf1a8b640 1 -- start start 2024-05-20T17:07:26.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.096+0000 7f9bf1a8b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bec1019b0 0x7f9bec1991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:26.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.096+0000 7f9bf1a8b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bec102bf0 0x7f9bec1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:26.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.096+0000 7f9bf1a8b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bec1078f0 0x7f9bec1a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:26.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.096+0000 7f9bf1a8b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec10d4e0 con 0x7f9bec1078f0 2024-05-20T17:07:26.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.096+0000 7f9bf1a8b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec10d360 con 0x7f9bec102bf0 2024-05-20T17:07:26.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.096+0000 7f9bf1a8b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec10d660 con 0x7f9bec1019b0 2024-05-20T17:07:26.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.097+0000 7f9bebfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bec1078f0 0x7f9bec1a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:26.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.097+0000 7f9bebfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bec1078f0 0x7f9bec1a0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55878/0 (socket says 172.21.15.6:55878) 2024-05-20T17:07:26.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.097+0000 7f9bebfff640 1 -- 172.21.15.6:0/3826072665 learned_addr learned my addr 172.21.15.6:0/3826072665 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:26.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.097+0000 7f9beaffd640 1 --2- 172.21.15.6:0/3826072665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bec102bf0 0x7f9bec1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:26.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.097+0000 7f9beb7fe640 1 --2- 172.21.15.6:0/3826072665 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bec1019b0 0x7f9bec1991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:26.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.097+0000 7f9bebfff640 1 -- 172.21.15.6:0/3826072665 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bec1019b0 msgr2=0x7f9bec1991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:26.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.097+0000 7f9bebfff640 1 --2- 172.21.15.6:0/3826072665 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bec1019b0 0x7f9bec1991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.097+0000 7f9bebfff640 1 -- 172.21.15.6:0/3826072665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bec102bf0 msgr2=0x7f9bec1996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:26.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.097+0000 7f9bebfff640 1 --2- 172.21.15.6:0/3826072665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bec102bf0 0x7f9bec1996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.097+0000 7f9bebfff640 1 -- 172.21.15.6:0/3826072665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bec1a0ce0 con 0x7f9bec1078f0 2024-05-20T17:07:26.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.097+0000 7f9bebfff640 1 --2- 172.21.15.6:0/3826072665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bec1078f0 0x7f9bec1a0670 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9be400eaa0 tx=0x7f9be400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:26.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.097+0000 7f9be8ff9640 1 -- 172.21.15.6:0/3826072665 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be400cdb0 con 0x7f9bec1078f0 2024-05-20T17:07:26.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.097+0000 7f9be8ff9640 1 -- 172.21.15.6:0/3826072665 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9be4005020 con 0x7f9bec1078f0 2024-05-20T17:07:26.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.097+0000 7f9bf1a8b640 1 -- 172.21.15.6:0/3826072665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bec1a0fd0 con 0x7f9bec1078f0 2024-05-20T17:07:26.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.097+0000 7f9be8ff9640 1 -- 172.21.15.6:0/3826072665 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be40116d0 con 0x7f9bec1078f0 2024-05-20T17:07:26.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.097+0000 7f9bf1a8b640 1 -- 172.21.15.6:0/3826072665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bec1a1430 con 0x7f9bec1078f0 2024-05-20T17:07:26.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.098+0000 7f9bf1a8b640 1 -- 172.21.15.6:0/3826072665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bec1a16f0 con 0x7f9bec1078f0 2024-05-20T17:07:26.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.100+0000 7f9be8ff9640 1 -- 172.21.15.6:0/3826072665 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f9be40051d0 con 0x7f9bec1078f0 2024-05-20T17:07:26.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.100+0000 7f9be8ff9640 1 --2- 172.21.15.6:0/3826072665 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f9bd40a2b90 0x7f9bd40a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:26.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.100+0000 7f9beb7fe640 1 --2- 172.21.15.6:0/3826072665 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f9bd40a2b90 0x7f9bd40a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:26.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.101+0000 7f9be8ff9640 1 -- 172.21.15.6:0/3826072665 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f9be40cf970 con 0x7f9bec1078f0 2024-05-20T17:07:26.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.101+0000 7f9beb7fe640 1 --2- 172.21.15.6:0/3826072665 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f9bd40a2b90 0x7f9bd40a50a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc005fd0 tx=0x7f9bdc005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:26.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.104+0000 7f9be8ff9640 1 -- 172.21.15.6:0/3826072665 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9be4016030 con 0x7f9bec1078f0 2024-05-20T17:07:26.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:25 smithi171 ceph-mon[35901]: pgmap v375: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:07:26.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:25 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/113276086' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:07:26.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.291+0000 7f9bf1a8b640 1 -- 172.21.15.6:0/3826072665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9bec1a18c0 con 0x7f9bec1078f0 2024-05-20T17:07:26.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.291+0000 7f9be8ff9640 1 -- 172.21.15.6:0/3826072665 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) ==== 104+0+11 (secure 0 0 0) 0x7f9be409c520 con 0x7f9bec1078f0 2024-05-20T17:07:26.292 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:07:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.293+0000 7f9bf1a8b640 1 -- 172.21.15.6:0/3826072665 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f9bd40a2b90 msgr2=0x7f9bd40a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.293+0000 7f9bf1a8b640 1 --2- 172.21.15.6:0/3826072665 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f9bd40a2b90 0x7f9bd40a50a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc005fd0 tx=0x7f9bdc005850 comp rx=0 tx=0).stop 2024-05-20T17:07:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.293+0000 7f9bf1a8b640 1 -- 172.21.15.6:0/3826072665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bec1078f0 msgr2=0x7f9bec1a0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.293+0000 7f9bf1a8b640 1 --2- 172.21.15.6:0/3826072665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bec1078f0 0x7f9bec1a0670 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9be400eaa0 tx=0x7f9be400ef60 comp rx=0 tx=0).stop 2024-05-20T17:07:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.293+0000 7f9bf1a8b640 1 -- 172.21.15.6:0/3826072665 shutdown_connections 2024-05-20T17:07:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.293+0000 7f9bf1a8b640 1 --2- 172.21.15.6:0/3826072665 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f9bd40a2b90 0x7f9bd40a50a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.293+0000 7f9bf1a8b640 1 --2- 172.21.15.6:0/3826072665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9bec1078f0 0x7f9bec1a0670 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.293+0000 7f9bf1a8b640 1 --2- 172.21.15.6:0/3826072665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bec102bf0 0x7f9bec1996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.293+0000 7f9bf1a8b640 1 --2- 172.21.15.6:0/3826072665 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bec1019b0 0x7f9bec1991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.293+0000 7f9bf1a8b640 1 -- 172.21.15.6:0/3826072665 >> 172.21.15.6:0/3826072665 conn(0x7f9bec0fcbe0 msgr2=0x7f9bec073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.293+0000 7f9bf1a8b640 1 -- 172.21.15.6:0/3826072665 shutdown_connections 2024-05-20T17:07:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.293+0000 7f9bf1a8b640 1 -- 172.21.15.6:0/3826072665 wait complete. 2024-05-20T17:07:26.306 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:07:26.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.425+0000 7f634ea80640 1 -- 172.21.15.6:0/3129674017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6348105f10 msgr2=0x7f6348108330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:26.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.425+0000 7f634ea80640 1 --2- 172.21.15.6:0/3129674017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6348105f10 0x7f6348108330 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f633c009900 tx=0x7f633c02a410 comp rx=0 tx=0).stop 2024-05-20T17:07:26.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.425+0000 7f634ea80640 1 -- 172.21.15.6:0/3129674017 shutdown_connections 2024-05-20T17:07:26.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.425+0000 7f634ea80640 1 --2- 172.21.15.6:0/3129674017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6348108870 0x7f634810ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.425+0000 7f634ea80640 1 --2- 172.21.15.6:0/3129674017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6348105f10 0x7f6348108330 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.425+0000 7f634ea80640 1 --2- 172.21.15.6:0/3129674017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63481035b0 0x7f63481059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.425+0000 7f634ea80640 1 -- 172.21.15.6:0/3129674017 >> 172.21.15.6:0/3129674017 conn(0x7f63480fcbb0 msgr2=0x7f63480ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.425+0000 7f634ea80640 1 -- 172.21.15.6:0/3129674017 shutdown_connections 2024-05-20T17:07:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.425+0000 7f634ea80640 1 -- 172.21.15.6:0/3129674017 wait complete. 2024-05-20T17:07:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.425+0000 7f634ea80640 1 Processor -- start 2024-05-20T17:07:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.426+0000 7f634ea80640 1 -- start start 2024-05-20T17:07:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.426+0000 7f634ea80640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63481035b0 0x7f634819b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.426+0000 7f634ea80640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6348105f10 0x7f634819b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.426+0000 7f634ea80640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6348108870 0x7f63481a28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.426+0000 7f634ea80640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f634810e5f0 con 0x7f63481035b0 2024-05-20T17:07:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.426+0000 7f634ea80640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f634810e470 con 0x7f6348108870 2024-05-20T17:07:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.426+0000 7f634ea80640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f634810e770 con 0x7f6348105f10 2024-05-20T17:07:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.426+0000 7f634c81c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63481035b0 0x7f634819b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.426+0000 7f634c81c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63481035b0 0x7f634819b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55900/0 (socket says 172.21.15.6:55900) 2024-05-20T17:07:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.426+0000 7f634c81c640 1 -- 172.21.15.6:0/960090483 learned_addr learned my addr 172.21.15.6:0/960090483 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.426+0000 7f634d01d640 1 --2- 172.21.15.6:0/960090483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6348108870 0x7f63481a28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.426+0000 7f634c81c640 1 -- 172.21.15.6:0/960090483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6348105f10 msgr2=0x7f634819b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.426+0000 7f6347fff640 1 --2- 172.21.15.6:0/960090483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6348105f10 0x7f634819b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.426+0000 7f634c81c640 1 --2- 172.21.15.6:0/960090483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6348105f10 0x7f634819b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.426+0000 7f634c81c640 1 -- 172.21.15.6:0/960090483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6348108870 msgr2=0x7f63481a28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.426+0000 7f634c81c640 1 --2- 172.21.15.6:0/960090483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6348108870 0x7f63481a28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.426+0000 7f634c81c640 1 -- 172.21.15.6:0/960090483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63481a2f40 con 0x7f63481035b0 2024-05-20T17:07:26.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.426+0000 7f634d01d640 1 --2- 172.21.15.6:0/960090483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6348108870 0x7f63481a28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:07:26.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.426+0000 7f634c81c640 1 --2- 172.21.15.6:0/960090483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63481035b0 0x7f634819b400 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f633800e9c0 tx=0x7f633800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:26.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.427+0000 7f6345ffb640 1 -- 172.21.15.6:0/960090483 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633800cd80 con 0x7f63481035b0 2024-05-20T17:07:26.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.427+0000 7f6345ffb640 1 -- 172.21.15.6:0/960090483 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63380054d0 con 0x7f63481035b0 2024-05-20T17:07:26.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.427+0000 7f634ea80640 1 -- 172.21.15.6:0/960090483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63481a3230 con 0x7f63481035b0 2024-05-20T17:07:26.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.427+0000 7f6345ffb640 1 -- 172.21.15.6:0/960090483 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338010430 con 0x7f63481035b0 2024-05-20T17:07:26.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.427+0000 7f634ea80640 1 -- 172.21.15.6:0/960090483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63481a3780 con 0x7f63481035b0 2024-05-20T17:07:26.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.428+0000 7f634ea80640 1 -- 172.21.15.6:0/960090483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63481a3a40 con 0x7f63481035b0 2024-05-20T17:07:26.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.429+0000 7f6345ffb640 1 -- 172.21.15.6:0/960090483 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f6338004fd0 con 0x7f63481035b0 2024-05-20T17:07:26.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.430+0000 7f6345ffb640 1 --2- 172.21.15.6:0/960090483 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f63300a2b90 0x7f63300a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:26.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.430+0000 7f6347fff640 1 --2- 172.21.15.6:0/960090483 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f63300a2b90 0x7f63300a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:26.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.430+0000 7f6345ffb640 1 -- 172.21.15.6:0/960090483 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f63380cf9c0 con 0x7f63481035b0 2024-05-20T17:07:26.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.430+0000 7f6347fff640 1 --2- 172.21.15.6:0/960090483 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f63300a2b90 0x7f63300a50a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f633c005f70 tx=0x7f633c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.435+0000 7f6345ffb640 1 -- 172.21.15.6:0/960090483 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f633800b2c0 con 0x7f63481035b0 2024-05-20T17:07:26.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.620+0000 7f634ea80640 1 -- 172.21.15.6:0/960090483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f63481a3d30 con 0x7f63481035b0 2024-05-20T17:07:26.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.621+0000 7f6345ffb640 1 -- 172.21.15.6:0/960090483 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) ==== 100+0+11 (secure 0 0 0) 0x7f633809c510 con 0x7f63481035b0 2024-05-20T17:07:26.621 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:07:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.622+0000 7f634ea80640 1 -- 172.21.15.6:0/960090483 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f63300a2b90 msgr2=0x7f63300a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.622+0000 7f634ea80640 1 --2- 172.21.15.6:0/960090483 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f63300a2b90 0x7f63300a50a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f633c005f70 tx=0x7f633c000bc0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.622+0000 7f634ea80640 1 -- 172.21.15.6:0/960090483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63481035b0 msgr2=0x7f634819b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.622+0000 7f634ea80640 1 --2- 172.21.15.6:0/960090483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63481035b0 0x7f634819b400 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f633800e9c0 tx=0x7f633800ee80 comp rx=0 tx=0).stop 2024-05-20T17:07:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.622+0000 7f634ea80640 1 -- 172.21.15.6:0/960090483 shutdown_connections 2024-05-20T17:07:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.622+0000 7f634ea80640 1 --2- 172.21.15.6:0/960090483 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f63300a2b90 0x7f63300a50a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.622+0000 7f634ea80640 1 --2- 172.21.15.6:0/960090483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6348108870 0x7f63481a28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.622+0000 7f634ea80640 1 --2- 172.21.15.6:0/960090483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6348105f10 0x7f634819b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.622+0000 7f634ea80640 1 --2- 172.21.15.6:0/960090483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63481035b0 0x7f634819b400 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.623+0000 7f634ea80640 1 -- 172.21.15.6:0/960090483 >> 172.21.15.6:0/960090483 conn(0x7f63480fcbb0 msgr2=0x7f6348100f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:26.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.623+0000 7f634ea80640 1 -- 172.21.15.6:0/960090483 shutdown_connections 2024-05-20T17:07:26.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.623+0000 7f634ea80640 1 -- 172.21.15.6:0/960090483 wait complete. 2024-05-20T17:07:26.635 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:07:26.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.753+0000 7ff0742a2640 1 -- 172.21.15.6:0/1886115462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c107910 msgr2=0x7ff06c109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:26.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.753+0000 7ff0742a2640 1 --2- 172.21.15.6:0/1886115462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c107910 0x7ff06c109d30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff064009ca0 tx=0x7ff06402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.753+0000 7ff0742a2640 1 -- 172.21.15.6:0/1886115462 shutdown_connections 2024-05-20T17:07:26.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.753+0000 7ff0742a2640 1 --2- 172.21.15.6:0/1886115462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c107910 0x7ff06c109d30 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.753+0000 7ff0742a2640 1 --2- 172.21.15.6:0/1886115462 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff06c102c10 0x7ff06c103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.753+0000 7ff0742a2640 1 --2- 172.21.15.6:0/1886115462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff06c1019d0 0x7ff06c1026d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.753+0000 7ff0742a2640 1 -- 172.21.15.6:0/1886115462 >> 172.21.15.6:0/1886115462 conn(0x7ff06c0fcba0 msgr2=0x7ff06c0ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:26.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.753+0000 7ff0742a2640 1 -- 172.21.15.6:0/1886115462 shutdown_connections 2024-05-20T17:07:26.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.753+0000 7ff0742a2640 1 -- 172.21.15.6:0/1886115462 wait complete. 2024-05-20T17:07:26.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.753+0000 7ff0742a2640 1 Processor -- start 2024-05-20T17:07:26.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.754+0000 7ff0742a2640 1 -- start start 2024-05-20T17:07:26.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.754+0000 7ff0742a2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff06c1019d0 0x7ff06c199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:26.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.754+0000 7ff0742a2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff06c102c10 0x7ff06c1996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:26.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.754+0000 7ff0742a2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c107910 0x7ff06c1a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:26.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.754+0000 7ff0742a2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c10e5f0 con 0x7ff06c107910 2024-05-20T17:07:26.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.754+0000 7ff0742a2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c10e470 con 0x7ff06c1019d0 2024-05-20T17:07:26.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.754+0000 7ff0742a2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c10e770 con 0x7ff06c102c10 2024-05-20T17:07:26.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.754+0000 7ff07283f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c107910 0x7ff06c1a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:26.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.754+0000 7ff07283f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c107910 0x7ff06c1a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55926/0 (socket says 172.21.15.6:55926) 2024-05-20T17:07:26.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.754+0000 7ff07283f640 1 -- 172.21.15.6:0/155277456 learned_addr learned my addr 172.21.15.6:0/155277456 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:26.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.754+0000 7ff07203e640 1 --2- 172.21.15.6:0/155277456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff06c1019d0 0x7ff06c199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:26.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.754+0000 7ff07183d640 1 --2- 172.21.15.6:0/155277456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff06c102c10 0x7ff06c1996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:26.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.754+0000 7ff07283f640 1 -- 172.21.15.6:0/155277456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff06c102c10 msgr2=0x7ff06c1996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:26.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.754+0000 7ff07283f640 1 --2- 172.21.15.6:0/155277456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff06c102c10 0x7ff06c1996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.754+0000 7ff07283f640 1 -- 172.21.15.6:0/155277456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff06c1019d0 msgr2=0x7ff06c199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:26.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.754+0000 7ff07283f640 1 --2- 172.21.15.6:0/155277456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff06c1019d0 0x7ff06c199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.754+0000 7ff07283f640 1 -- 172.21.15.6:0/155277456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff06c1a0ca0 con 0x7ff06c107910 2024-05-20T17:07:26.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.754+0000 7ff07183d640 1 --2- 172.21.15.6:0/155277456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff06c102c10 0x7ff06c1996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:26.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.755+0000 7ff07283f640 1 --2- 172.21.15.6:0/155277456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c107910 0x7ff06c1a0630 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff064009dc0 tx=0x7ff064009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:26.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.755+0000 7ff0637fe640 1 -- 172.21.15.6:0/155277456 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff064003cb0 con 0x7ff06c107910 2024-05-20T17:07:26.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.755+0000 7ff0637fe640 1 -- 172.21.15.6:0/155277456 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff064003e50 con 0x7ff06c107910 2024-05-20T17:07:26.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.755+0000 7ff0742a2640 1 -- 172.21.15.6:0/155277456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff06c1a0f30 con 0x7ff06c107910 2024-05-20T17:07:26.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.755+0000 7ff0637fe640 1 -- 172.21.15.6:0/155277456 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff064030a80 con 0x7ff06c107910 2024-05-20T17:07:26.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.755+0000 7ff0742a2640 1 -- 172.21.15.6:0/155277456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff06c1a1390 con 0x7ff06c107910 2024-05-20T17:07:26.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.756+0000 7ff0742a2640 1 -- 172.21.15.6:0/155277456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff06c0691f0 con 0x7ff06c107910 2024-05-20T17:07:26.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.757+0000 7ff0637fe640 1 -- 172.21.15.6:0/155277456 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7ff064004680 con 0x7ff06c107910 2024-05-20T17:07:26.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.758+0000 7ff0637fe640 1 --2- 172.21.15.6:0/155277456 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff0580a2b90 0x7ff0580a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:26.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.758+0000 7ff07203e640 1 --2- 172.21.15.6:0/155277456 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff0580a2b90 0x7ff0580a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:26.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.758+0000 7ff0637fe640 1 -- 172.21.15.6:0/155277456 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7ff0640f0a70 con 0x7ff06c107910 2024-05-20T17:07:26.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.758+0000 7ff07203e640 1 --2- 172.21.15.6:0/155277456 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff0580a2b90 0x7ff0580a50a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff06c1025d0 tx=0x7ff068005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:26.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.762+0000 7ff0637fe640 1 -- 172.21.15.6:0/155277456 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff06c0691f0 con 0x7ff06c107910 2024-05-20T17:07:26.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.949+0000 7ff0742a2640 1 -- 172.21.15.6:0/155277456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff06c02d360 con 0x7ff06c107910 2024-05-20T17:07:26.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.949+0000 7ff0637fe640 1 -- 172.21.15.6:0/155277456 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) ==== 103+0+11 (secure 0 0 0) 0x7ff0640bd620 con 0x7ff06c107910 2024-05-20T17:07:26.950 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:07:26.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.951+0000 7ff0742a2640 1 -- 172.21.15.6:0/155277456 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff0580a2b90 msgr2=0x7ff0580a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:26.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.951+0000 7ff0742a2640 1 --2- 172.21.15.6:0/155277456 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff0580a2b90 0x7ff0580a50a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff06c1025d0 tx=0x7ff068005f90 comp rx=0 tx=0).stop 2024-05-20T17:07:26.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.951+0000 7ff0742a2640 1 -- 172.21.15.6:0/155277456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c107910 msgr2=0x7ff06c1a0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:26.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.951+0000 7ff0742a2640 1 --2- 172.21.15.6:0/155277456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c107910 0x7ff06c1a0630 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff064009dc0 tx=0x7ff064009800 comp rx=0 tx=0).stop 2024-05-20T17:07:26.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.951+0000 7ff0742a2640 1 -- 172.21.15.6:0/155277456 shutdown_connections 2024-05-20T17:07:26.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.951+0000 7ff0742a2640 1 --2- 172.21.15.6:0/155277456 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff0580a2b90 0x7ff0580a50a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.951+0000 7ff0742a2640 1 --2- 172.21.15.6:0/155277456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c107910 0x7ff06c1a0630 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.951+0000 7ff0742a2640 1 --2- 172.21.15.6:0/155277456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff06c102c10 0x7ff06c1996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.951+0000 7ff0742a2640 1 --2- 172.21.15.6:0/155277456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff06c1019d0 0x7ff06c199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:26.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.951+0000 7ff0742a2640 1 -- 172.21.15.6:0/155277456 >> 172.21.15.6:0/155277456 conn(0x7ff06c0fcba0 msgr2=0x7ff06c1038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:26.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.951+0000 7ff0742a2640 1 -- 172.21.15.6:0/155277456 shutdown_connections 2024-05-20T17:07:26.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:26.951+0000 7ff0742a2640 1 -- 172.21.15.6:0/155277456 wait complete. 2024-05-20T17:07:26.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:26 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1044714964' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:07:26.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:26 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3826072665' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:07:26.962 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:26 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/960090483' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:07:26.964 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:07:27.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:26 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1044714964' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:07:27.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:26 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3826072665' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:07:27.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:26 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/960090483' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:07:27.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.078+0000 7f3ab5331640 1 -- 172.21.15.6:0/1589783451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab0102bf0 msgr2=0x7f3ab0103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:27.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.078+0000 7f3ab5331640 1 --2- 172.21.15.6:0/1589783451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab0102bf0 0x7f3ab0103000 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3a98009900 tx=0x7f3a9802a410 comp rx=0 tx=0).stop 2024-05-20T17:07:27.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.078+0000 7f3ab5331640 1 -- 172.21.15.6:0/1589783451 shutdown_connections 2024-05-20T17:07:27.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.078+0000 7f3ab5331640 1 --2- 172.21.15.6:0/1589783451 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ab01078f0 0x7f3ab0109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.078+0000 7f3ab5331640 1 --2- 172.21.15.6:0/1589783451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab0102bf0 0x7f3ab0103000 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.078+0000 7f3ab5331640 1 --2- 172.21.15.6:0/1589783451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ab01019b0 0x7f3ab01026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.078+0000 7f3ab5331640 1 -- 172.21.15.6:0/1589783451 >> 172.21.15.6:0/1589783451 conn(0x7f3ab00fcba0 msgr2=0x7f3ab00ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.078+0000 7f3ab5331640 1 -- 172.21.15.6:0/1589783451 shutdown_connections 2024-05-20T17:07:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.078+0000 7f3ab5331640 1 -- 172.21.15.6:0/1589783451 wait complete. 2024-05-20T17:07:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.079+0000 7f3ab5331640 1 Processor -- start 2024-05-20T17:07:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.079+0000 7f3ab5331640 1 -- start start 2024-05-20T17:07:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.079+0000 7f3ab5331640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ab01019b0 0x7f3ab0199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.079+0000 7f3ab5331640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ab0102bf0 0x7f3ab0199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.079+0000 7f3ab5331640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab01078f0 0x7f3ab01a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.079+0000 7f3ab5331640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab010d4b0 con 0x7f3ab01078f0 2024-05-20T17:07:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.079+0000 7f3ab5331640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab010d330 con 0x7f3ab01019b0 2024-05-20T17:07:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.079+0000 7f3ab5331640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab010d630 con 0x7f3ab0102bf0 2024-05-20T17:07:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.079+0000 7f3aaf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab01078f0 0x7f3ab01a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.079+0000 7f3aaf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab01078f0 0x7f3ab01a0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55942/0 (socket says 172.21.15.6:55942) 2024-05-20T17:07:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.079+0000 7f3aaf7fe640 1 -- 172.21.15.6:0/2311232013 learned_addr learned my addr 172.21.15.6:0/2311232013 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.079+0000 7f3aaeffd640 1 --2- 172.21.15.6:0/2311232013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ab01019b0 0x7f3ab0199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.080+0000 7f3aa7fff640 1 --2- 172.21.15.6:0/2311232013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ab0102bf0 0x7f3ab0199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.080+0000 7f3aaf7fe640 1 -- 172.21.15.6:0/2311232013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ab0102bf0 msgr2=0x7f3ab0199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.080+0000 7f3aaf7fe640 1 --2- 172.21.15.6:0/2311232013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ab0102bf0 0x7f3ab0199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.080+0000 7f3aaf7fe640 1 -- 172.21.15.6:0/2311232013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ab01019b0 msgr2=0x7f3ab0199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.080+0000 7f3aaf7fe640 1 --2- 172.21.15.6:0/2311232013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ab01019b0 0x7f3ab0199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.080+0000 7f3aaf7fe640 1 -- 172.21.15.6:0/2311232013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab01a0c80 con 0x7f3ab01078f0 2024-05-20T17:07:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.080+0000 7f3aa7fff640 1 --2- 172.21.15.6:0/2311232013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ab0102bf0 0x7f3ab0199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:07:27.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.080+0000 7f3aaf7fe640 1 --2- 172.21.15.6:0/2311232013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab01078f0 0x7f3ab01a0610 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009fd0 tx=0x7f3aa800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:27.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.080+0000 7f3aacff9640 1 -- 172.21.15.6:0/2311232013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8017070 con 0x7f3ab01078f0 2024-05-20T17:07:27.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.080+0000 7f3aacff9640 1 -- 172.21.15.6:0/2311232013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3aa8003e20 con 0x7f3ab01078f0 2024-05-20T17:07:27.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.080+0000 7f3aacff9640 1 -- 172.21.15.6:0/2311232013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8010460 con 0x7f3ab01078f0 2024-05-20T17:07:27.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.080+0000 7f3ab5331640 1 -- 172.21.15.6:0/2311232013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab01a0f70 con 0x7f3ab01078f0 2024-05-20T17:07:27.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.080+0000 7f3ab5331640 1 -- 172.21.15.6:0/2311232013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab01a1380 con 0x7f3ab01078f0 2024-05-20T17:07:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.081+0000 7f3ab5331640 1 -- 172.21.15.6:0/2311232013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ab01a15e0 con 0x7f3ab01078f0 2024-05-20T17:07:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.083+0000 7f3aacff9640 1 -- 172.21.15.6:0/2311232013 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f3aa8003970 con 0x7f3ab01078f0 2024-05-20T17:07:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.084+0000 7f3aacff9640 1 --2- 172.21.15.6:0/2311232013 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3a9c0a2c30 0x7f3a9c0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.084+0000 7f3aaeffd640 1 --2- 172.21.15.6:0/2311232013 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3a9c0a2c30 0x7f3a9c0a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.084+0000 7f3aacff9640 1 -- 172.21.15.6:0/2311232013 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f3aa80cf280 con 0x7f3ab01078f0 2024-05-20T17:07:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.085+0000 7f3aaeffd640 1 --2- 172.21.15.6:0/2311232013 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3a9c0a2c30 0x7f3a9c0a5140 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3ab01025b0 tx=0x7f3aa000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.088+0000 7f3aacff9640 1 -- 172.21.15.6:0/2311232013 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3aa809bdd0 con 0x7f3ab01078f0 2024-05-20T17:07:27.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:26 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1044714964' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:07:27.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:26 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3826072665' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:07:27.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:26 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/960090483' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:07:27.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.309+0000 7f3ab5331640 1 -- 172.21.15.6:0/2311232013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ab01a17b0 con 0x7f3ab01078f0 2024-05-20T17:07:27.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.310+0000 7f3aacff9640 1 -- 172.21.15.6:0/2311232013 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11914 (secure 0 0 0) 0x7f3aa809b6d0 con 0x7f3ab01078f0 2024-05-20T17:07:27.311 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:07:27.311 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:05:04.455743+0000","modified":"2024-05-20T17:05:35.584679+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24548,"mds_1":24526,"mds_2":24484,"mds_3":24470,"mds_4":24440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/3061403904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":3061403904},{"type":"v1","addr":"172.21.15.6:6839","nonce":3061403904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/223306009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":223306009},{"type":"v1","addr":"172.21.15.6:6841","nonce":223306009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.62:6835/78063155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":78063155},{"type":"v1","addr":"172.21.15.62:6835","nonce":78063155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.171:6835/1542537621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1542537621},{"type":"v1","addr":"172.21.15.171:6835","nonce":1542537621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/732693575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":732693575},{"type":"v1","addr":"172.21.15.171:6837","nonce":732693575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6837/1745943929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1745943929},{"type":"v1","addr":"172.21.15.62:6837","nonce":1745943929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.171:6839/3246292303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3246292303},{"type":"v1","addr":"172.21.15.171:6839","nonce":3246292303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6839/3023093487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3023093487},{"type":"v1","addr":"172.21.15.62:6839","nonce":3023093487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24548,"qdb_cluster":[24440,24548,24526,24470,24484]},"id":1}]} 2024-05-20T17:07:27.311 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 28 2024-05-20T17:07:27.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.312+0000 7f3ab5331640 1 -- 172.21.15.6:0/2311232013 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3a9c0a2c30 msgr2=0x7f3a9c0a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:27.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.312+0000 7f3ab5331640 1 --2- 172.21.15.6:0/2311232013 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3a9c0a2c30 0x7f3a9c0a5140 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3ab01025b0 tx=0x7f3aa000b390 comp rx=0 tx=0).stop 2024-05-20T17:07:27.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.312+0000 7f3ab5331640 1 -- 172.21.15.6:0/2311232013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab01078f0 msgr2=0x7f3ab01a0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:27.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.312+0000 7f3ab5331640 1 --2- 172.21.15.6:0/2311232013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab01078f0 0x7f3ab01a0610 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009fd0 tx=0x7f3aa800b260 comp rx=0 tx=0).stop 2024-05-20T17:07:27.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.312+0000 7f3ab5331640 1 -- 172.21.15.6:0/2311232013 shutdown_connections 2024-05-20T17:07:27.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.312+0000 7f3ab5331640 1 --2- 172.21.15.6:0/2311232013 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3a9c0a2c30 0x7f3a9c0a5140 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.312+0000 7f3ab5331640 1 --2- 172.21.15.6:0/2311232013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab01078f0 0x7f3ab01a0610 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.312+0000 7f3ab5331640 1 --2- 172.21.15.6:0/2311232013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ab0102bf0 0x7f3ab0199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.312+0000 7f3ab5331640 1 --2- 172.21.15.6:0/2311232013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ab01019b0 0x7f3ab0199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.312+0000 7f3ab5331640 1 -- 172.21.15.6:0/2311232013 >> 172.21.15.6:0/2311232013 conn(0x7f3ab00fcba0 msgr2=0x7f3ab0108da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:27.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.312+0000 7f3ab5331640 1 -- 172.21.15.6:0/2311232013 shutdown_connections 2024-05-20T17:07:27.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.312+0000 7f3ab5331640 1 -- 172.21.15.6:0/2311232013 wait complete. 2024-05-20T17:07:27.325 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:07:27.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.440+0000 7fa2d89c3640 1 -- 172.21.15.6:0/55288718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2d41078f0 msgr2=0x7fa2d4109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:27.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.440+0000 7fa2d89c3640 1 --2- 172.21.15.6:0/55288718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2d41078f0 0x7fa2d4109d10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009ca0 tx=0x7fa2cc02a8c0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.441+0000 7fa2d89c3640 1 -- 172.21.15.6:0/55288718 shutdown_connections 2024-05-20T17:07:27.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.441+0000 7fa2d89c3640 1 --2- 172.21.15.6:0/55288718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2d41078f0 0x7fa2d4109d10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.441+0000 7fa2d89c3640 1 --2- 172.21.15.6:0/55288718 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d4102bf0 0x7fa2d4103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.441+0000 7fa2d89c3640 1 --2- 172.21.15.6:0/55288718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2d41019b0 0x7fa2d41026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.441+0000 7fa2d89c3640 1 -- 172.21.15.6:0/55288718 >> 172.21.15.6:0/55288718 conn(0x7fa2d40fcba0 msgr2=0x7fa2d40ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:27.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.441+0000 7fa2d89c3640 1 -- 172.21.15.6:0/55288718 shutdown_connections 2024-05-20T17:07:27.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.441+0000 7fa2d89c3640 1 -- 172.21.15.6:0/55288718 wait complete. 2024-05-20T17:07:27.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.441+0000 7fa2d89c3640 1 Processor -- start 2024-05-20T17:07:27.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.441+0000 7fa2d89c3640 1 -- start start 2024-05-20T17:07:27.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.442+0000 7fa2d89c3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d41019b0 0x7fa2d4069a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:27.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.442+0000 7fa2d89c3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2d4102bf0 0x7fa2d419de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:27.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.442+0000 7fa2d89c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2d41078f0 0x7fa2d41a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:27.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.442+0000 7fa2d89c3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d410d4c0 con 0x7fa2d41078f0 2024-05-20T17:07:27.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.442+0000 7fa2d89c3640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d410d340 con 0x7fa2d41019b0 2024-05-20T17:07:27.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.442+0000 7fa2d89c3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d410d640 con 0x7fa2d4102bf0 2024-05-20T17:07:27.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.442+0000 7fa2d2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2d41078f0 0x7fa2d41a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:27.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.442+0000 7fa2d2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2d41078f0 0x7fa2d41a03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55964/0 (socket says 172.21.15.6:55964) 2024-05-20T17:07:27.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.442+0000 7fa2d2d9d640 1 -- 172.21.15.6:0/2243064722 learned_addr learned my addr 172.21.15.6:0/2243064722 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:27.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.442+0000 7fa2d259c640 1 --2- 172.21.15.6:0/2243064722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d41019b0 0x7fa2d4069a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:27.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.442+0000 7fa2cbfff640 1 --2- 172.21.15.6:0/2243064722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2d4102bf0 0x7fa2d419de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:27.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.442+0000 7fa2d2d9d640 1 -- 172.21.15.6:0/2243064722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2d4102bf0 msgr2=0x7fa2d419de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:27.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.442+0000 7fa2d2d9d640 1 --2- 172.21.15.6:0/2243064722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2d4102bf0 0x7fa2d419de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.442+0000 7fa2d2d9d640 1 -- 172.21.15.6:0/2243064722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d41019b0 msgr2=0x7fa2d4069a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:27.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.442+0000 7fa2d2d9d640 1 --2- 172.21.15.6:0/2243064722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d41019b0 0x7fa2d4069a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.442+0000 7fa2d2d9d640 1 -- 172.21.15.6:0/2243064722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d41a0bc0 con 0x7fa2d41078f0 2024-05-20T17:07:27.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.442+0000 7fa2d2d9d640 1 --2- 172.21.15.6:0/2243064722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2d41078f0 0x7fa2d41a03a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009dc0 tx=0x7fa2cc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:27.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.443+0000 7fa2cb7fe640 1 -- 172.21.15.6:0/2243064722 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc004040 con 0x7fa2d41078f0 2024-05-20T17:07:27.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.443+0000 7fa2cb7fe640 1 -- 172.21.15.6:0/2243064722 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2cc004690 con 0x7fa2d41078f0 2024-05-20T17:07:27.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.443+0000 7fa2cb7fe640 1 -- 172.21.15.6:0/2243064722 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc030c70 con 0x7fa2d41078f0 2024-05-20T17:07:27.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.443+0000 7fa2d89c3640 1 -- 172.21.15.6:0/2243064722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d41a0e50 con 0x7fa2d41078f0 2024-05-20T17:07:27.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.443+0000 7fa2d89c3640 1 -- 172.21.15.6:0/2243064722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d41a1260 con 0x7fa2d41078f0 2024-05-20T17:07:27.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.444+0000 7fa2d89c3640 1 -- 172.21.15.6:0/2243064722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2d4068da0 con 0x7fa2d41078f0 2024-05-20T17:07:27.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.445+0000 7fa2cb7fe640 1 -- 172.21.15.6:0/2243064722 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fa2cc0041e0 con 0x7fa2d41078f0 2024-05-20T17:07:27.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.446+0000 7fa2cb7fe640 1 --2- 172.21.15.6:0/2243064722 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa2c00a2c30 0x7fa2c00a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:27.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.446+0000 7fa2cb7fe640 1 -- 172.21.15.6:0/2243064722 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fa2cc0f0e50 con 0x7fa2d41078f0 2024-05-20T17:07:27.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.446+0000 7fa2d259c640 1 --2- 172.21.15.6:0/2243064722 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa2c00a2c30 0x7fa2c00a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:27.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.447+0000 7fa2d259c640 1 --2- 172.21.15.6:0/2243064722 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa2c00a2c30 0x7fa2c00a5140 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa2d41025b0 tx=0x7fa2c400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:27.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.455+0000 7fa2cb7fe640 1 -- 172.21.15.6:0/2243064722 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa2cc07f850 con 0x7fa2d41078f0 2024-05-20T17:07:27.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.643+0000 7fa2d89c3640 1 -- 172.21.15.6:0/2243064722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2d402d3a0 con 0x7fa2d41078f0 2024-05-20T17:07:27.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.646+0000 7fa2cb7fe640 1 -- 172.21.15.6:0/2243064722 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+24584 (secure 0 0 0) 0x7fa2d4068da0 con 0x7fa2d41078f0 2024-05-20T17:07:27.646 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:07:27.647 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":94,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:06:44.581646+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:05:02.947896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:05:03.842231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:05:07.551471+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:07:27.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.648+0000 7fa2d89c3640 1 -- 172.21.15.6:0/2243064722 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa2c00a2c30 msgr2=0x7fa2c00a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:27.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.648+0000 7fa2d89c3640 1 --2- 172.21.15.6:0/2243064722 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa2c00a2c30 0x7fa2c00a5140 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa2d41025b0 tx=0x7fa2c400b390 comp rx=0 tx=0).stop 2024-05-20T17:07:27.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.648+0000 7fa2d89c3640 1 -- 172.21.15.6:0/2243064722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2d41078f0 msgr2=0x7fa2d41a03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:27.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.648+0000 7fa2d89c3640 1 --2- 172.21.15.6:0/2243064722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2d41078f0 0x7fa2d41a03a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009dc0 tx=0x7fa2cc003ba0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.648+0000 7fa2d89c3640 1 -- 172.21.15.6:0/2243064722 shutdown_connections 2024-05-20T17:07:27.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.648+0000 7fa2d89c3640 1 --2- 172.21.15.6:0/2243064722 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa2c00a2c30 0x7fa2c00a5140 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.648+0000 7fa2d89c3640 1 --2- 172.21.15.6:0/2243064722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2d41078f0 0x7fa2d41a03a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.648+0000 7fa2d89c3640 1 --2- 172.21.15.6:0/2243064722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2d4102bf0 0x7fa2d419de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.648+0000 7fa2d89c3640 1 --2- 172.21.15.6:0/2243064722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d41019b0 0x7fa2d4069a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.648+0000 7fa2d89c3640 1 -- 172.21.15.6:0/2243064722 >> 172.21.15.6:0/2243064722 conn(0x7fa2d40fcba0 msgr2=0x7fa2d41038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:27.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.648+0000 7fa2d89c3640 1 -- 172.21.15.6:0/2243064722 shutdown_connections 2024-05-20T17:07:27.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.648+0000 7fa2d89c3640 1 -- 172.21.15.6:0/2243064722 wait complete. 2024-05-20T17:07:27.661 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:00:12.516679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:05:02.947896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:05:03.842231+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:05:07.551471+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:07:27.662 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:07:27.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.783+0000 7f150e1a3640 1 -- 172.21.15.6:0/3061143816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1508107900 msgr2=0x7f1508109d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:27.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.783+0000 7f150e1a3640 1 --2- 172.21.15.6:0/3061143816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1508107900 0x7f1508109d20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1500009ca0 tx=0x7f150002a8c0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.783+0000 7f150e1a3640 1 -- 172.21.15.6:0/3061143816 shutdown_connections 2024-05-20T17:07:27.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.783+0000 7f150e1a3640 1 --2- 172.21.15.6:0/3061143816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1508107900 0x7f1508109d20 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.783+0000 7f150e1a3640 1 --2- 172.21.15.6:0/3061143816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1508102c00 0x7f1508103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.783+0000 7f150e1a3640 1 --2- 172.21.15.6:0/3061143816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15081019c0 0x7f15081026c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.783+0000 7f150e1a3640 1 -- 172.21.15.6:0/3061143816 >> 172.21.15.6:0/3061143816 conn(0x7f15080fcbb0 msgr2=0x7f15080ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:27.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.783+0000 7f150e1a3640 1 -- 172.21.15.6:0/3061143816 shutdown_connections 2024-05-20T17:07:27.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.783+0000 7f150e1a3640 1 -- 172.21.15.6:0/3061143816 wait complete. 2024-05-20T17:07:27.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.783+0000 7f150e1a3640 1 Processor -- start 2024-05-20T17:07:27.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.784+0000 7f150e1a3640 1 -- start start 2024-05-20T17:07:27.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.784+0000 7f150e1a3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15081019c0 0x7f1508198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:27.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.784+0000 7f150e1a3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1508102c00 0x7f15081985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:27.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.784+0000 7f150e1a3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1508107900 0x7f150819f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:27.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.784+0000 7f150e1a3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f150810d4d0 con 0x7f1508102c00 2024-05-20T17:07:27.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.784+0000 7f150e1a3640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f150810d350 con 0x7f1508107900 2024-05-20T17:07:27.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.784+0000 7f150e1a3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f150810d650 con 0x7f15081019c0 2024-05-20T17:07:27.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.784+0000 7f1506ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1508102c00 0x7f15081985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:27.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.784+0000 7f1506ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1508102c00 0x7f15081985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55984/0 (socket says 172.21.15.6:55984) 2024-05-20T17:07:27.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.784+0000 7f1506ffd640 1 -- 172.21.15.6:0/2281389930 learned_addr learned my addr 172.21.15.6:0/2281389930 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:27.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.784+0000 7f15077fe640 1 --2- 172.21.15.6:0/2281389930 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15081019c0 0x7f1508198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:27.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.784+0000 7f1507fff640 1 --2- 172.21.15.6:0/2281389930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1508107900 0x7f150819f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:27.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.784+0000 7f1506ffd640 1 -- 172.21.15.6:0/2281389930 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15081019c0 msgr2=0x7f1508198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:27.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.784+0000 7f1506ffd640 1 --2- 172.21.15.6:0/2281389930 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15081019c0 0x7f1508198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.784+0000 7f1506ffd640 1 -- 172.21.15.6:0/2281389930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1508107900 msgr2=0x7f150819f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:27.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.784+0000 7f1506ffd640 1 --2- 172.21.15.6:0/2281389930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1508107900 0x7f150819f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.784+0000 7f1506ffd640 1 -- 172.21.15.6:0/2281389930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f150819fbc0 con 0x7f1508102c00 2024-05-20T17:07:27.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.785+0000 7f1506ffd640 1 --2- 172.21.15.6:0/2281389930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1508102c00 0x7f15081985c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00d950 tx=0x7f14fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:27.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.785+0000 7f1504ff9640 1 -- 172.21.15.6:0/2281389930 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc017030 con 0x7f1508102c00 2024-05-20T17:07:27.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.785+0000 7f1504ff9640 1 -- 172.21.15.6:0/2281389930 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f14fc004020 con 0x7f1508102c00 2024-05-20T17:07:27.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.785+0000 7f150e1a3640 1 -- 172.21.15.6:0/2281389930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f150819feb0 con 0x7f1508102c00 2024-05-20T17:07:27.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.785+0000 7f1504ff9640 1 -- 172.21.15.6:0/2281389930 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc0047a0 con 0x7f1508102c00 2024-05-20T17:07:27.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.785+0000 7f150e1a3640 1 -- 172.21.15.6:0/2281389930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15081a0320 con 0x7f1508102c00 2024-05-20T17:07:27.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.786+0000 7f150e1a3640 1 -- 172.21.15.6:0/2281389930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1508106710 con 0x7f1508102c00 2024-05-20T17:07:27.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.789+0000 7f1504ff9640 1 -- 172.21.15.6:0/2281389930 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f14fc0041d0 con 0x7f1508102c00 2024-05-20T17:07:27.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.789+0000 7f1504ff9640 1 --2- 172.21.15.6:0/2281389930 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f14f00a2b90 0x7f14f00a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:27.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.789+0000 7f1504ff9640 1 -- 172.21.15.6:0/2281389930 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f14fc0cf3a0 con 0x7f1508102c00 2024-05-20T17:07:27.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.789+0000 7f15077fe640 1 --2- 172.21.15.6:0/2281389930 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f14f00a2b90 0x7f14f00a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:27.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.790+0000 7f15077fe640 1 --2- 172.21.15.6:0/2281389930 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f14f00a2b90 0x7f14f00a50a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f15081025c0 tx=0x7f14f8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:27.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.793+0000 7f1504ff9640 1 -- 172.21.15.6:0/2281389930 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f14fc09bff0 con 0x7f1508102c00 2024-05-20T17:07:27.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:27 smithi006 ceph-mon[32486]: pgmap v376: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:07:27.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:27 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/155277456' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:07:27.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:27 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2311232013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:07:27.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:27 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2243064722' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:07:27.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.981+0000 7f150e1a3640 1 -- 172.21.15.6:0/2281389930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f150802d4f0 con 0x7f1508102c00 2024-05-20T17:07:27.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.981+0000 7f1504ff9640 1 -- 172.21.15.6:0/2281389930 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) ==== 93+0+10 (secure 0 0 0) 0x7f14fc09b8f0 con 0x7f1508102c00 2024-05-20T17:07:27.982 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:07:27.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.983+0000 7f150e1a3640 1 -- 172.21.15.6:0/2281389930 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f14f00a2b90 msgr2=0x7f14f00a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:27.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.983+0000 7f150e1a3640 1 --2- 172.21.15.6:0/2281389930 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f14f00a2b90 0x7f14f00a50a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f15081025c0 tx=0x7f14f8005f90 comp rx=0 tx=0).stop 2024-05-20T17:07:27.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.983+0000 7f150e1a3640 1 -- 172.21.15.6:0/2281389930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1508102c00 msgr2=0x7f15081985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:27.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.983+0000 7f150e1a3640 1 --2- 172.21.15.6:0/2281389930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1508102c00 0x7f15081985c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00d950 tx=0x7f14fc00de10 comp rx=0 tx=0).stop 2024-05-20T17:07:27.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.984+0000 7f150e1a3640 1 -- 172.21.15.6:0/2281389930 shutdown_connections 2024-05-20T17:07:27.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.984+0000 7f150e1a3640 1 --2- 172.21.15.6:0/2281389930 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f14f00a2b90 0x7f14f00a50a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.984+0000 7f150e1a3640 1 --2- 172.21.15.6:0/2281389930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1508107900 0x7f150819f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.984+0000 7f150e1a3640 1 --2- 172.21.15.6:0/2281389930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1508102c00 0x7f15081985c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.984+0000 7f150e1a3640 1 --2- 172.21.15.6:0/2281389930 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15081019c0 0x7f1508198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:27.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.984+0000 7f150e1a3640 1 -- 172.21.15.6:0/2281389930 >> 172.21.15.6:0/2281389930 conn(0x7f15080fcbb0 msgr2=0x7f15081038e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:27.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.984+0000 7f150e1a3640 1 -- 172.21.15.6:0/2281389930 shutdown_connections 2024-05-20T17:07:27.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:27.984+0000 7f150e1a3640 1 -- 172.21.15.6:0/2281389930 wait complete. 2024-05-20T17:07:27.996 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:07:28.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:27 smithi062 ceph-mon[35425]: pgmap v376: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:07:28.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:27 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/155277456' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:07:28.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:27 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2311232013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:07:28.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:27 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2243064722' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:07:28.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:27 smithi171 ceph-mon[35901]: pgmap v376: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:07:28.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:27 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/155277456' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:07:28.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:27 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2311232013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:07:28.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:27 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2243064722' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.117+0000 7f80c1c67640 1 -- 172.21.15.6:0/1337086330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc1035b0 msgr2=0x7f80bc1059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.117+0000 7f80c1c67640 1 --2- 172.21.15.6:0/1337086330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc1035b0 0x7f80bc1059d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009900 tx=0x7f80ac02a410 comp rx=0 tx=0).stop 2024-05-20T17:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.117+0000 7f80c1c67640 1 -- 172.21.15.6:0/1337086330 shutdown_connections 2024-05-20T17:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.117+0000 7f80c1c67640 1 --2- 172.21.15.6:0/1337086330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80bc108870 0x7f80bc10ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.117+0000 7f80c1c67640 1 --2- 172.21.15.6:0/1337086330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80bc105f10 0x7f80bc108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.117+0000 7f80c1c67640 1 --2- 172.21.15.6:0/1337086330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc1035b0 0x7f80bc1059d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.117+0000 7f80c1c67640 1 -- 172.21.15.6:0/1337086330 >> 172.21.15.6:0/1337086330 conn(0x7f80bc0fcbb0 msgr2=0x7f80bc0ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.117+0000 7f80c1c67640 1 -- 172.21.15.6:0/1337086330 shutdown_connections 2024-05-20T17:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.117+0000 7f80c1c67640 1 -- 172.21.15.6:0/1337086330 wait complete. 2024-05-20T17:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.118+0000 7f80c1c67640 1 Processor -- start 2024-05-20T17:07:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.118+0000 7f80c1c67640 1 -- start start 2024-05-20T17:07:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.118+0000 7f80c1c67640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc1035b0 0x7f80bc102a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.118+0000 7f80c1c67640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80bc105f10 0x7f80bc1010a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.118+0000 7f80c1c67640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80bc108870 0x7f80bc1015e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.118+0000 7f80c1c67640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc10e620 con 0x7f80bc1035b0 2024-05-20T17:07:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.118+0000 7f80c1c67640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc10e4a0 con 0x7f80bc105f10 2024-05-20T17:07:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.118+0000 7f80c1c67640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc10e7a0 con 0x7f80bc108870 2024-05-20T17:07:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.118+0000 7f80bb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc1035b0 0x7f80bc102a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.118+0000 7f80bb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc1035b0 0x7f80bc102a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56016/0 (socket says 172.21.15.6:56016) 2024-05-20T17:07:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.118+0000 7f80bb7fe640 1 -- 172.21.15.6:0/3444026927 learned_addr learned my addr 172.21.15.6:0/3444026927 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.118+0000 7f80bbfff640 1 --2- 172.21.15.6:0/3444026927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80bc108870 0x7f80bc1015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.118+0000 7f80b2ffd640 1 --2- 172.21.15.6:0/3444026927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80bc105f10 0x7f80bc1010a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.119+0000 7f80bb7fe640 1 -- 172.21.15.6:0/3444026927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80bc108870 msgr2=0x7f80bc1015e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.119+0000 7f80bb7fe640 1 --2- 172.21.15.6:0/3444026927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80bc108870 0x7f80bc1015e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.119+0000 7f80bb7fe640 1 -- 172.21.15.6:0/3444026927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80bc105f10 msgr2=0x7f80bc1010a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.119+0000 7f80bb7fe640 1 --2- 172.21.15.6:0/3444026927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80bc105f10 0x7f80bc1010a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.119+0000 7f80bb7fe640 1 -- 172.21.15.6:0/3444026927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80bc101d10 con 0x7f80bc1035b0 2024-05-20T17:07:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.119+0000 7f80b2ffd640 1 --2- 172.21.15.6:0/3444026927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80bc105f10 0x7f80bc1010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.119+0000 7f80bb7fe640 1 --2- 172.21.15.6:0/3444026927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc1035b0 0x7f80bc102a00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f80ac006010 tx=0x7f80ac031a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.119+0000 7f80b97fa640 1 -- 172.21.15.6:0/3444026927 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac03f030 con 0x7f80bc1035b0 2024-05-20T17:07:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.119+0000 7f80c1c67640 1 -- 172.21.15.6:0/3444026927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80bc1a3370 con 0x7f80bc1035b0 2024-05-20T17:07:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.119+0000 7f80b97fa640 1 -- 172.21.15.6:0/3444026927 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f80ac0044a0 con 0x7f80bc1035b0 2024-05-20T17:07:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.119+0000 7f80b97fa640 1 -- 172.21.15.6:0/3444026927 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac035070 con 0x7f80bc1035b0 2024-05-20T17:07:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.119+0000 7f80c1c67640 1 -- 172.21.15.6:0/3444026927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80bc1a37d0 con 0x7f80bc1035b0 2024-05-20T17:07:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.120+0000 7f80c1c67640 1 -- 172.21.15.6:0/3444026927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80bc068340 con 0x7f80bc1035b0 2024-05-20T17:07:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.122+0000 7f80b97fa640 1 -- 172.21.15.6:0/3444026927 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f80ac042030 con 0x7f80bc1035b0 2024-05-20T17:07:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.122+0000 7f80b97fa640 1 --2- 172.21.15.6:0/3444026927 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f80a80a2b90 0x7f80a80a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.123+0000 7f80b2ffd640 1 --2- 172.21.15.6:0/3444026927 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f80a80a2b90 0x7f80a80a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.123+0000 7f80b97fa640 1 -- 172.21.15.6:0/3444026927 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f80ac0ef640 con 0x7f80bc1035b0 2024-05-20T17:07:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.123+0000 7f80b2ffd640 1 --2- 172.21.15.6:0/3444026927 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f80a80a2b90 0x7f80a80a50a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f80bc1023a0 tx=0x7f80a4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:28.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.132+0000 7f80b97fa640 1 -- 172.21.15.6:0/3444026927 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f80ac0bc1f0 con 0x7f80bc1035b0 2024-05-20T17:07:28.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.319+0000 7f80c1c67640 1 -- 172.21.15.6:0/3444026927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f80bc062750 con 0x7f80bc1035b0 2024-05-20T17:07:28.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.319+0000 7f80b97fa640 1 -- 172.21.15.6:0/3444026927 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) ==== 104+0+11 (secure 0 0 0) 0x7f80ac0bbaf0 con 0x7f80bc1035b0 2024-05-20T17:07:28.319 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:07:28.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.322+0000 7f80c1c67640 1 -- 172.21.15.6:0/3444026927 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f80a80a2b90 msgr2=0x7f80a80a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:28.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.322+0000 7f80c1c67640 1 --2- 172.21.15.6:0/3444026927 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f80a80a2b90 0x7f80a80a50a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f80bc1023a0 tx=0x7f80a4008040 comp rx=0 tx=0).stop 2024-05-20T17:07:28.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.322+0000 7f80c1c67640 1 -- 172.21.15.6:0/3444026927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc1035b0 msgr2=0x7f80bc102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:28.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.322+0000 7f80c1c67640 1 --2- 172.21.15.6:0/3444026927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc1035b0 0x7f80bc102a00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f80ac006010 tx=0x7f80ac031a30 comp rx=0 tx=0).stop 2024-05-20T17:07:28.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.322+0000 7f80c1c67640 1 -- 172.21.15.6:0/3444026927 shutdown_connections 2024-05-20T17:07:28.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.322+0000 7f80c1c67640 1 --2- 172.21.15.6:0/3444026927 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f80a80a2b90 0x7f80a80a50a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.322+0000 7f80c1c67640 1 --2- 172.21.15.6:0/3444026927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f80bc108870 0x7f80bc1015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.322+0000 7f80c1c67640 1 --2- 172.21.15.6:0/3444026927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80bc105f10 0x7f80bc1010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.322+0000 7f80c1c67640 1 --2- 172.21.15.6:0/3444026927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80bc1035b0 0x7f80bc102a00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.322+0000 7f80c1c67640 1 -- 172.21.15.6:0/3444026927 >> 172.21.15.6:0/3444026927 conn(0x7f80bc0fcbb0 msgr2=0x7f80bc1055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:28.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.322+0000 7f80c1c67640 1 -- 172.21.15.6:0/3444026927 shutdown_connections 2024-05-20T17:07:28.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.322+0000 7f80c1c67640 1 -- 172.21.15.6:0/3444026927 wait complete. 2024-05-20T17:07:28.338 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:07:28.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.455+0000 7f912a921640 1 -- 172.21.15.6:0/1231250275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9124101980 msgr2=0x7f9124102680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:28.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.455+0000 7f912a921640 1 --2- 172.21.15.6:0/1231250275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9124101980 0x7f9124102680 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9114009900 tx=0x7f911402a410 comp rx=0 tx=0).stop 2024-05-20T17:07:28.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.455+0000 7f912a921640 1 -- 172.21.15.6:0/1231250275 shutdown_connections 2024-05-20T17:07:28.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.455+0000 7f912a921640 1 --2- 172.21.15.6:0/1231250275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91241078c0 0x7f9124109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.455+0000 7f912a921640 1 --2- 172.21.15.6:0/1231250275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9124102bc0 0x7f9124102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.455+0000 7f912a921640 1 --2- 172.21.15.6:0/1231250275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9124101980 0x7f9124102680 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.455+0000 7f912a921640 1 -- 172.21.15.6:0/1231250275 >> 172.21.15.6:0/1231250275 conn(0x7f91240fcb70 msgr2=0x7f91240ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:28.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.456+0000 7f912a921640 1 -- 172.21.15.6:0/1231250275 shutdown_connections 2024-05-20T17:07:28.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.456+0000 7f912a921640 1 -- 172.21.15.6:0/1231250275 wait complete. 2024-05-20T17:07:28.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.456+0000 7f912a921640 1 Processor -- start 2024-05-20T17:07:28.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.456+0000 7f912a921640 1 -- start start 2024-05-20T17:07:28.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.457+0000 7f912a921640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9124101980 0x7f91241991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:28.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.457+0000 7f912a921640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9124102bc0 0x7f91241996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:28.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.457+0000 7f912a921640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91241078c0 0x7f91241a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:28.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.457+0000 7f912a921640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f912410d480 con 0x7f9124101980 2024-05-20T17:07:28.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.457+0000 7f912a921640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f912410d300 con 0x7f9124102bc0 2024-05-20T17:07:28.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.457+0000 7f912a921640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f912410d600 con 0x7f91241078c0 2024-05-20T17:07:28.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.457+0000 7f9123fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9124101980 0x7f91241991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:28.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.457+0000 7f9123fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9124101980 0x7f91241991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56036/0 (socket says 172.21.15.6:56036) 2024-05-20T17:07:28.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.457+0000 7f9123fff640 1 -- 172.21.15.6:0/2599456654 learned_addr learned my addr 172.21.15.6:0/2599456654 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:28.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.457+0000 7f91237fe640 1 --2- 172.21.15.6:0/2599456654 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9124102bc0 0x7f91241996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:28.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.457+0000 7f9128ebe640 1 --2- 172.21.15.6:0/2599456654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91241078c0 0x7f91241a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:28.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.457+0000 7f9123fff640 1 -- 172.21.15.6:0/2599456654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91241078c0 msgr2=0x7f91241a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:28.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.457+0000 7f9123fff640 1 --2- 172.21.15.6:0/2599456654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91241078c0 0x7f91241a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.457+0000 7f9123fff640 1 -- 172.21.15.6:0/2599456654 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9124102bc0 msgr2=0x7f91241996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:28.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.457+0000 7f9123fff640 1 --2- 172.21.15.6:0/2599456654 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9124102bc0 0x7f91241996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.457+0000 7f9123fff640 1 -- 172.21.15.6:0/2599456654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91241a0ce0 con 0x7f9124101980 2024-05-20T17:07:28.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.458+0000 7f9123fff640 1 --2- 172.21.15.6:0/2599456654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9124101980 0x7f91241991a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f91140314e0 tx=0x7f91140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:28.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.458+0000 7f91217fa640 1 -- 172.21.15.6:0/2599456654 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911403f030 con 0x7f9124101980 2024-05-20T17:07:28.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.458+0000 7f91217fa640 1 -- 172.21.15.6:0/2599456654 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f91140318f0 con 0x7f9124101980 2024-05-20T17:07:28.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.458+0000 7f912a921640 1 -- 172.21.15.6:0/2599456654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91241a0f70 con 0x7f9124101980 2024-05-20T17:07:28.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.458+0000 7f91217fa640 1 -- 172.21.15.6:0/2599456654 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9114035070 con 0x7f9124101980 2024-05-20T17:07:28.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.458+0000 7f912a921640 1 -- 172.21.15.6:0/2599456654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91241a1370 con 0x7f9124101980 2024-05-20T17:07:28.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.459+0000 7f912a921640 1 -- 172.21.15.6:0/2599456654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91241a15a0 con 0x7f9124101980 2024-05-20T17:07:28.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.460+0000 7f91217fa640 1 -- 172.21.15.6:0/2599456654 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f9114042030 con 0x7f9124101980 2024-05-20T17:07:28.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.461+0000 7f91217fa640 1 --2- 172.21.15.6:0/2599456654 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f910c0a2b90 0x7f910c0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:28.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.461+0000 7f91217fa640 1 -- 172.21.15.6:0/2599456654 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f91140efbf0 con 0x7f9124101980 2024-05-20T17:07:28.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.461+0000 7f91237fe640 1 --2- 172.21.15.6:0/2599456654 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f910c0a2b90 0x7f910c0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:28.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.462+0000 7f91237fe640 1 --2- 172.21.15.6:0/2599456654 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f910c0a2b90 0x7f910c0a50a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f912419a240 tx=0x7f911800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:28.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.465+0000 7f91217fa640 1 -- 172.21.15.6:0/2599456654 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f91140bc150 con 0x7f9124101980 2024-05-20T17:07:28.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.666+0000 7f912a921640 1 -- 172.21.15.6:0/2599456654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f91241a1890 con 0x7f9124101980 2024-05-20T17:07:28.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.667+0000 7f91217fa640 1 -- 172.21.15.6:0/2599456654 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) ==== 100+0+11 (secure 0 0 0) 0x7f91140c0450 con 0x7f9124101980 2024-05-20T17:07:28.667 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:07:28.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.669+0000 7f912a921640 1 -- 172.21.15.6:0/2599456654 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f910c0a2b90 msgr2=0x7f910c0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:28.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.669+0000 7f912a921640 1 --2- 172.21.15.6:0/2599456654 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f910c0a2b90 0x7f910c0a50a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f912419a240 tx=0x7f911800b390 comp rx=0 tx=0).stop 2024-05-20T17:07:28.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.669+0000 7f912a921640 1 -- 172.21.15.6:0/2599456654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9124101980 msgr2=0x7f91241991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:28.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.669+0000 7f912a921640 1 --2- 172.21.15.6:0/2599456654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9124101980 0x7f91241991a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f91140314e0 tx=0x7f91140042f0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.669+0000 7f912a921640 1 -- 172.21.15.6:0/2599456654 shutdown_connections 2024-05-20T17:07:28.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.669+0000 7f912a921640 1 --2- 172.21.15.6:0/2599456654 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f910c0a2b90 0x7f910c0a50a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.669+0000 7f912a921640 1 --2- 172.21.15.6:0/2599456654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91241078c0 0x7f91241a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.669+0000 7f912a921640 1 --2- 172.21.15.6:0/2599456654 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9124102bc0 0x7f91241996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.669+0000 7f912a921640 1 --2- 172.21.15.6:0/2599456654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9124101980 0x7f91241991a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.669+0000 7f912a921640 1 -- 172.21.15.6:0/2599456654 >> 172.21.15.6:0/2599456654 conn(0x7f91240fcb70 msgr2=0x7f9124108e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:28.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.669+0000 7f912a921640 1 -- 172.21.15.6:0/2599456654 shutdown_connections 2024-05-20T17:07:28.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.669+0000 7f912a921640 1 -- 172.21.15.6:0/2599456654 wait complete. 2024-05-20T17:07:28.681 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:07:28.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.802+0000 7f28b3a61640 1 -- 172.21.15.6:0/3946942906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ac1078f0 msgr2=0x7f28ac109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:28.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.802+0000 7f28b3a61640 1 --2- 172.21.15.6:0/3946942906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ac1078f0 0x7f28ac109d10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009900 tx=0x7f28a402a410 comp rx=0 tx=0).stop 2024-05-20T17:07:28.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.802+0000 7f28b3a61640 1 -- 172.21.15.6:0/3946942906 shutdown_connections 2024-05-20T17:07:28.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.802+0000 7f28b3a61640 1 --2- 172.21.15.6:0/3946942906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ac1078f0 0x7f28ac109d10 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.802+0000 7f28b3a61640 1 --2- 172.21.15.6:0/3946942906 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28ac102bf0 0x7f28ac103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.802+0000 7f28b3a61640 1 --2- 172.21.15.6:0/3946942906 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28ac1019b0 0x7f28ac1026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.802+0000 7f28b3a61640 1 -- 172.21.15.6:0/3946942906 >> 172.21.15.6:0/3946942906 conn(0x7f28ac0fcbe0 msgr2=0x7f28ac0ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:28.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.802+0000 7f28b3a61640 1 -- 172.21.15.6:0/3946942906 shutdown_connections 2024-05-20T17:07:28.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.802+0000 7f28b3a61640 1 -- 172.21.15.6:0/3946942906 wait complete. 2024-05-20T17:07:28.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.803+0000 7f28b3a61640 1 Processor -- start 2024-05-20T17:07:28.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.803+0000 7f28b3a61640 1 -- start start 2024-05-20T17:07:28.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.803+0000 7f28b3a61640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28ac1019b0 0x7f28ac10c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:28.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.803+0000 7f28b3a61640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28ac102bf0 0x7f28ac10a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.803+0000 7f28b3a61640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ac1078f0 0x7f28ac10ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.803+0000 7f28b3a61640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac10e5e0 con 0x7f28ac1078f0 2024-05-20T17:07:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.803+0000 7f28b3a61640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac10e460 con 0x7f28ac102bf0 2024-05-20T17:07:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.803+0000 7f28b3a61640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac10e760 con 0x7f28ac1019b0 2024-05-20T17:07:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.803+0000 7f28b1ffe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ac1078f0 0x7f28ac10ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.803+0000 7f28b1ffe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ac1078f0 0x7f28ac10ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56048/0 (socket says 172.21.15.6:56048) 2024-05-20T17:07:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.803+0000 7f28b1ffe640 1 -- 172.21.15.6:0/4134994225 learned_addr learned my addr 172.21.15.6:0/4134994225 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.803+0000 7f28b17fd640 1 --2- 172.21.15.6:0/4134994225 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28ac1019b0 0x7f28ac10c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.803+0000 7f28b0ffc640 1 --2- 172.21.15.6:0/4134994225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28ac102bf0 0x7f28ac10a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.803+0000 7f28b1ffe640 1 -- 172.21.15.6:0/4134994225 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28ac1019b0 msgr2=0x7f28ac10c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.803+0000 7f28b1ffe640 1 --2- 172.21.15.6:0/4134994225 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28ac1019b0 0x7f28ac10c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.803+0000 7f28b1ffe640 1 -- 172.21.15.6:0/4134994225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28ac102bf0 msgr2=0x7f28ac10a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.803+0000 7f28b1ffe640 1 --2- 172.21.15.6:0/4134994225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28ac102bf0 0x7f28ac10a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:28.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.803+0000 7f28b1ffe640 1 -- 172.21.15.6:0/4134994225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ac10b590 con 0x7f28ac1078f0 2024-05-20T17:07:28.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.804+0000 7f28b1ffe640 1 --2- 172.21.15.6:0/4134994225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ac1078f0 0x7f28ac10ae60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f28a4031440 tx=0x7f28a4031a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:28.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.804+0000 7f28aa7fc640 1 -- 172.21.15.6:0/4134994225 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a403f030 con 0x7f28ac1078f0 2024-05-20T17:07:28.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.804+0000 7f28b3a61640 1 -- 172.21.15.6:0/4134994225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28ac1a31d0 con 0x7f28ac1078f0 2024-05-20T17:07:28.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.804+0000 7f28aa7fc640 1 -- 172.21.15.6:0/4134994225 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28a4003aa0 con 0x7f28ac1078f0 2024-05-20T17:07:28.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.804+0000 7f28aa7fc640 1 -- 172.21.15.6:0/4134994225 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a4035070 con 0x7f28ac1078f0 2024-05-20T17:07:28.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.804+0000 7f28b3a61640 1 -- 172.21.15.6:0/4134994225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28ac1a3630 con 0x7f28ac1078f0 2024-05-20T17:07:28.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.805+0000 7f28b3a61640 1 -- 172.21.15.6:0/4134994225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28ac106700 con 0x7f28ac1078f0 2024-05-20T17:07:28.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.807+0000 7f28aa7fc640 1 -- 172.21.15.6:0/4134994225 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f28a4042030 con 0x7f28ac1078f0 2024-05-20T17:07:28.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.807+0000 7f28aa7fc640 1 --2- 172.21.15.6:0/4134994225 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f28940a2b90 0x7f28940a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:28.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.807+0000 7f28aa7fc640 1 -- 172.21.15.6:0/4134994225 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f28a40efd10 con 0x7f28ac1078f0 2024-05-20T17:07:28.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.807+0000 7f28b17fd640 1 --2- 172.21.15.6:0/4134994225 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f28940a2b90 0x7f28940a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:28.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.808+0000 7f28b17fd640 1 --2- 172.21.15.6:0/4134994225 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f28940a2b90 0x7f28940a50a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f28ac1025b0 tx=0x7f289c009670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:28.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.811+0000 7f28aa7fc640 1 -- 172.21.15.6:0/4134994225 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f28a40bc270 con 0x7f28ac1078f0 2024-05-20T17:07:28.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:28 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2281389930' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:07:28.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:28 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3444026927' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:07:28.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:28 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2599456654' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:07:28.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.997+0000 7f28b3a61640 1 -- 172.21.15.6:0/4134994225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f28ac02d430 con 0x7f28ac1078f0 2024-05-20T17:07:28.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:28.998+0000 7f28aa7fc640 1 -- 172.21.15.6:0/4134994225 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) ==== 103+0+11 (secure 0 0 0) 0x7f28a40c0570 con 0x7f28ac1078f0 2024-05-20T17:07:28.998 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:07:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.000+0000 7f28b3a61640 1 -- 172.21.15.6:0/4134994225 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f28940a2b90 msgr2=0x7f28940a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.000+0000 7f28b3a61640 1 --2- 172.21.15.6:0/4134994225 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f28940a2b90 0x7f28940a50a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f28ac1025b0 tx=0x7f289c009670 comp rx=0 tx=0).stop 2024-05-20T17:07:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.000+0000 7f28b3a61640 1 -- 172.21.15.6:0/4134994225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ac1078f0 msgr2=0x7f28ac10ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.000+0000 7f28b3a61640 1 --2- 172.21.15.6:0/4134994225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ac1078f0 0x7f28ac10ae60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f28a4031440 tx=0x7f28a4031a30 comp rx=0 tx=0).stop 2024-05-20T17:07:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.000+0000 7f28b3a61640 1 -- 172.21.15.6:0/4134994225 shutdown_connections 2024-05-20T17:07:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.000+0000 7f28b3a61640 1 --2- 172.21.15.6:0/4134994225 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f28940a2b90 0x7f28940a50a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.000+0000 7f28b3a61640 1 --2- 172.21.15.6:0/4134994225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ac1078f0 0x7f28ac10ae60 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.000+0000 7f28b3a61640 1 --2- 172.21.15.6:0/4134994225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28ac102bf0 0x7f28ac10a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.000+0000 7f28b3a61640 1 --2- 172.21.15.6:0/4134994225 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28ac1019b0 0x7f28ac10c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.000+0000 7f28b3a61640 1 -- 172.21.15.6:0/4134994225 >> 172.21.15.6:0/4134994225 conn(0x7f28ac0fcbe0 msgr2=0x7f28ac1038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.000+0000 7f28b3a61640 1 -- 172.21.15.6:0/4134994225 shutdown_connections 2024-05-20T17:07:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.000+0000 7f28b3a61640 1 -- 172.21.15.6:0/4134994225 wait complete. 2024-05-20T17:07:29.012 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:07:29.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:28 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2281389930' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:07:29.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:28 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3444026927' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:07:29.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:28 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2599456654' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:07:29.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:28 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2281389930' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:07:29.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:28 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3444026927' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:07:29.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:28 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2599456654' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:07:29.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.130+0000 7f9f1801b640 1 -- 172.21.15.6:0/3212110456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f101089f0 msgr2=0x7f9f1010ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.130+0000 7f9f1801b640 1 --2- 172.21.15.6:0/3212110456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f101089f0 0x7f9f1010ae10 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9f08009ca0 tx=0x7f9f0802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.130+0000 7f9f1801b640 1 -- 172.21.15.6:0/3212110456 shutdown_connections 2024-05-20T17:07:29.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.130+0000 7f9f1801b640 1 --2- 172.21.15.6:0/3212110456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f101089f0 0x7f9f1010ae10 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.130+0000 7f9f1801b640 1 --2- 172.21.15.6:0/3212110456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f10103cf0 0x7f9f10104100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.130+0000 7f9f1801b640 1 --2- 172.21.15.6:0/3212110456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f10102ab0 0x7f9f101037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.130+0000 7f9f1801b640 1 -- 172.21.15.6:0/3212110456 >> 172.21.15.6:0/3212110456 conn(0x7f9f100fdca0 msgr2=0x7f9f10100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:29.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.130+0000 7f9f1801b640 1 -- 172.21.15.6:0/3212110456 shutdown_connections 2024-05-20T17:07:29.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.130+0000 7f9f1801b640 1 -- 172.21.15.6:0/3212110456 wait complete. 2024-05-20T17:07:29.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.131+0000 7f9f1801b640 1 Processor -- start 2024-05-20T17:07:29.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.131+0000 7f9f1801b640 1 -- start start 2024-05-20T17:07:29.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.131+0000 7f9f1801b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f10102ab0 0x7f9f10199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.131+0000 7f9f1801b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f10103cf0 0x7f9f101995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.131+0000 7f9f1801b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f101089f0 0x7f9f101a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.131+0000 7f9f1801b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1010e5c0 con 0x7f9f10102ab0 2024-05-20T17:07:29.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.131+0000 7f9f1801b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1010e440 con 0x7f9f10103cf0 2024-05-20T17:07:29.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.131+0000 7f9f1801b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1010e740 con 0x7f9f101089f0 2024-05-20T17:07:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.131+0000 7f9f15db7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f10102ab0 0x7f9f10199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.131+0000 7f9f15db7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f10102ab0 0x7f9f10199070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56060/0 (socket says 172.21.15.6:56060) 2024-05-20T17:07:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.131+0000 7f9f15db7640 1 -- 172.21.15.6:0/960186784 learned_addr learned my addr 172.21.15.6:0/960186784 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.131+0000 7f9f165b8640 1 --2- 172.21.15.6:0/960186784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f101089f0 0x7f9f101a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.131+0000 7f9f155b6640 1 --2- 172.21.15.6:0/960186784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f10103cf0 0x7f9f101995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.131+0000 7f9f15db7640 1 -- 172.21.15.6:0/960186784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f101089f0 msgr2=0x7f9f101a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.131+0000 7f9f15db7640 1 --2- 172.21.15.6:0/960186784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f101089f0 0x7f9f101a0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.131+0000 7f9f15db7640 1 -- 172.21.15.6:0/960186784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f10103cf0 msgr2=0x7f9f101995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.131+0000 7f9f15db7640 1 --2- 172.21.15.6:0/960186784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f10103cf0 0x7f9f101995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.131+0000 7f9f15db7640 1 -- 172.21.15.6:0/960186784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f101a0bb0 con 0x7f9f10102ab0 2024-05-20T17:07:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.131+0000 7f9f165b8640 1 --2- 172.21.15.6:0/960186784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f101089f0 0x7f9f101a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.132+0000 7f9f15db7640 1 --2- 172.21.15.6:0/960186784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f10102ab0 0x7f9f10199070 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00e9f0 tx=0x7f9f0c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.132+0000 7f9f06ffd640 1 -- 172.21.15.6:0/960186784 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c00ccc0 con 0x7f9f10102ab0 2024-05-20T17:07:29.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.132+0000 7f9f06ffd640 1 -- 172.21.15.6:0/960186784 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9f0c0035f0 con 0x7f9f10102ab0 2024-05-20T17:07:29.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.132+0000 7f9f06ffd640 1 -- 172.21.15.6:0/960186784 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c00ce60 con 0x7f9f10102ab0 2024-05-20T17:07:29.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.132+0000 7f9f1801b640 1 -- 172.21.15.6:0/960186784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f101a0ea0 con 0x7f9f10102ab0 2024-05-20T17:07:29.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.132+0000 7f9f1801b640 1 -- 172.21.15.6:0/960186784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f101a12b0 con 0x7f9f10102ab0 2024-05-20T17:07:29.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.133+0000 7f9f1801b640 1 -- 172.21.15.6:0/960186784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f10107800 con 0x7f9f10102ab0 2024-05-20T17:07:29.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.135+0000 7f9f06ffd640 1 -- 172.21.15.6:0/960186784 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f9f0c004000 con 0x7f9f10102ab0 2024-05-20T17:07:29.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.135+0000 7f9f06ffd640 1 --2- 172.21.15.6:0/960186784 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f9efc0a2c30 0x7f9efc0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.135+0000 7f9f06ffd640 1 -- 172.21.15.6:0/960186784 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f9f0c0cf8b0 con 0x7f9f10102ab0 2024-05-20T17:07:29.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.135+0000 7f9f155b6640 1 --2- 172.21.15.6:0/960186784 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f9efc0a2c30 0x7f9efc0a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.136+0000 7f9f155b6640 1 --2- 172.21.15.6:0/960186784 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f9efc0a2c30 0x7f9efc0a5140 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9f1019a110 tx=0x7f9f0000b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:29.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.139+0000 7f9f06ffd640 1 -- 172.21.15.6:0/960186784 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9f0c0042f0 con 0x7f9f10102ab0 2024-05-20T17:07:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.363+0000 7f9f1801b640 1 -- 172.21.15.6:0/960186784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f1002d2a0 con 0x7f9f10102ab0 2024-05-20T17:07:29.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.363+0000 7f9f06ffd640 1 -- 172.21.15.6:0/960186784 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11914 (secure 0 0 0) 0x7f9f0c09c460 con 0x7f9f10102ab0 2024-05-20T17:07:29.364 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:07:29.364 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:05:04.455743+0000","modified":"2024-05-20T17:05:35.584679+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24548,"mds_1":24526,"mds_2":24484,"mds_3":24470,"mds_4":24440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/3061403904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":3061403904},{"type":"v1","addr":"172.21.15.6:6839","nonce":3061403904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/223306009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":223306009},{"type":"v1","addr":"172.21.15.6:6841","nonce":223306009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.62:6835/78063155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":78063155},{"type":"v1","addr":"172.21.15.62:6835","nonce":78063155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.171:6835/1542537621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1542537621},{"type":"v1","addr":"172.21.15.171:6835","nonce":1542537621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/732693575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":732693575},{"type":"v1","addr":"172.21.15.171:6837","nonce":732693575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6837/1745943929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1745943929},{"type":"v1","addr":"172.21.15.62:6837","nonce":1745943929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.171:6839/3246292303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3246292303},{"type":"v1","addr":"172.21.15.171:6839","nonce":3246292303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6839/3023093487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3023093487},{"type":"v1","addr":"172.21.15.62:6839","nonce":3023093487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24548,"qdb_cluster":[24440,24548,24526,24470,24484]},"id":1}]} 2024-05-20T17:07:29.364 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 28 2024-05-20T17:07:29.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.366+0000 7f9f1801b640 1 -- 172.21.15.6:0/960186784 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f9efc0a2c30 msgr2=0x7f9efc0a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.366+0000 7f9f1801b640 1 --2- 172.21.15.6:0/960186784 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f9efc0a2c30 0x7f9efc0a5140 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9f1019a110 tx=0x7f9f0000b5b0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.366+0000 7f9f1801b640 1 -- 172.21.15.6:0/960186784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f10102ab0 msgr2=0x7f9f10199070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.366+0000 7f9f1801b640 1 --2- 172.21.15.6:0/960186784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f10102ab0 0x7f9f10199070 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00e9f0 tx=0x7f9f0c00eeb0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.366+0000 7f9f1801b640 1 -- 172.21.15.6:0/960186784 shutdown_connections 2024-05-20T17:07:29.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.366+0000 7f9f1801b640 1 --2- 172.21.15.6:0/960186784 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f9efc0a2c30 0x7f9efc0a5140 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.366+0000 7f9f1801b640 1 --2- 172.21.15.6:0/960186784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f101089f0 0x7f9f101a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.366+0000 7f9f1801b640 1 --2- 172.21.15.6:0/960186784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f10103cf0 0x7f9f101995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.366+0000 7f9f1801b640 1 --2- 172.21.15.6:0/960186784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f10102ab0 0x7f9f10199070 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.366+0000 7f9f1801b640 1 -- 172.21.15.6:0/960186784 >> 172.21.15.6:0/960186784 conn(0x7f9f100fdca0 msgr2=0x7f9f101049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:29.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.366+0000 7f9f1801b640 1 -- 172.21.15.6:0/960186784 shutdown_connections 2024-05-20T17:07:29.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.366+0000 7f9f1801b640 1 -- 172.21.15.6:0/960186784 wait complete. 2024-05-20T17:07:29.378 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:07:29.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.493+0000 7feec7b77640 1 -- 172.21.15.6:0/1755780278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec0108870 msgr2=0x7feec010ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.493+0000 7feec7b77640 1 --2- 172.21.15.6:0/1755780278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec0108870 0x7feec010ac90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7feeb8009ca0 tx=0x7feeb802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.493+0000 7feec7b77640 1 -- 172.21.15.6:0/1755780278 shutdown_connections 2024-05-20T17:07:29.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.493+0000 7feec7b77640 1 --2- 172.21.15.6:0/1755780278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec0108870 0x7feec010ac90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.493+0000 7feec7b77640 1 --2- 172.21.15.6:0/1755780278 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feec0105f10 0x7feec0108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.493+0000 7feec7b77640 1 --2- 172.21.15.6:0/1755780278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec01035b0 0x7feec01059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.493+0000 7feec7b77640 1 -- 172.21.15.6:0/1755780278 >> 172.21.15.6:0/1755780278 conn(0x7feec00fcb90 msgr2=0x7feec00ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:29.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.493+0000 7feec7b77640 1 -- 172.21.15.6:0/1755780278 shutdown_connections 2024-05-20T17:07:29.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.493+0000 7feec7b77640 1 -- 172.21.15.6:0/1755780278 wait complete. 2024-05-20T17:07:29.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.494+0000 7feec7b77640 1 Processor -- start 2024-05-20T17:07:29.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.494+0000 7feec7b77640 1 -- start start 2024-05-20T17:07:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.494+0000 7feec7b77640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feec01035b0 0x7feec01990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.494+0000 7feec7b77640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec0105f10 0x7feec01995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.494+0000 7feec7b77640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec0108870 0x7feec01a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.494+0000 7feec7b77640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7feec010e5d0 con 0x7feec0108870 2024-05-20T17:07:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.494+0000 7feec7b77640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7feec010e450 con 0x7feec0105f10 2024-05-20T17:07:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.494+0000 7feec7b77640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feec010e750 con 0x7feec01035b0 2024-05-20T17:07:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.494+0000 7feec6114640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec0108870 0x7feec01a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.494+0000 7feec6114640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec0108870 0x7feec01a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56074/0 (socket says 172.21.15.6:56074) 2024-05-20T17:07:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.494+0000 7feec6114640 1 -- 172.21.15.6:0/2374734220 learned_addr learned my addr 172.21.15.6:0/2374734220 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.494+0000 7feec5112640 1 --2- 172.21.15.6:0/2374734220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec0105f10 0x7feec01995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.494+0000 7feec5913640 1 --2- 172.21.15.6:0/2374734220 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feec01035b0 0x7feec01990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.494+0000 7feec6114640 1 -- 172.21.15.6:0/2374734220 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feec01035b0 msgr2=0x7feec01990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.494+0000 7feec6114640 1 --2- 172.21.15.6:0/2374734220 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feec01035b0 0x7feec01990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.494+0000 7feec6114640 1 -- 172.21.15.6:0/2374734220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec0105f10 msgr2=0x7feec01995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.494+0000 7feec6114640 1 --2- 172.21.15.6:0/2374734220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec0105f10 0x7feec01995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.494+0000 7feec6114640 1 -- 172.21.15.6:0/2374734220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec01a0bf0 con 0x7feec0108870 2024-05-20T17:07:29.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.495+0000 7feec6114640 1 --2- 172.21.15.6:0/2374734220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec0108870 0x7feec01a0580 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7feeb8003ba0 tx=0x7feeb8003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:29.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.495+0000 7feeb6ffd640 1 -- 172.21.15.6:0/2374734220 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb8003df0 con 0x7feec0108870 2024-05-20T17:07:29.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.495+0000 7feeb6ffd640 1 -- 172.21.15.6:0/2374734220 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feeb80044f0 con 0x7feec0108870 2024-05-20T17:07:29.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.495+0000 7feec7b77640 1 -- 172.21.15.6:0/2374734220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec01a0e80 con 0x7feec0108870 2024-05-20T17:07:29.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.495+0000 7feeb6ffd640 1 -- 172.21.15.6:0/2374734220 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb8030ba0 con 0x7feec0108870 2024-05-20T17:07:29.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.495+0000 7feec7b77640 1 -- 172.21.15.6:0/2374734220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec01a12e0 con 0x7feec0108870 2024-05-20T17:07:29.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.496+0000 7feec7b77640 1 -- 172.21.15.6:0/2374734220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec00691c0 con 0x7feec0108870 2024-05-20T17:07:29.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.497+0000 7feeb6ffd640 1 -- 172.21.15.6:0/2374734220 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7feeb8004040 con 0x7feec0108870 2024-05-20T17:07:29.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.498+0000 7feeb6ffd640 1 --2- 172.21.15.6:0/2374734220 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7feeac0a2c30 0x7feeac0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.498+0000 7feeb6ffd640 1 -- 172.21.15.6:0/2374734220 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7feeb80f0a60 con 0x7feec0108870 2024-05-20T17:07:29.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.498+0000 7feec5913640 1 --2- 172.21.15.6:0/2374734220 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7feeac0a2c30 0x7feeac0a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.499+0000 7feec5913640 1 --2- 172.21.15.6:0/2374734220 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7feeac0a2c30 0x7feeac0a5140 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feec00747a0 tx=0x7feebc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:29.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.502+0000 7feeb6ffd640 1 -- 172.21.15.6:0/2374734220 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7feeb80bd5b0 con 0x7feec0108870 2024-05-20T17:07:29.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.691+0000 7feec7b77640 1 -- 172.21.15.6:0/2374734220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feec002d320 con 0x7feec0108870 2024-05-20T17:07:29.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.693+0000 7feeb6ffd640 1 -- 172.21.15.6:0/2374734220 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+24584 (secure 0 0 0) 0x7feeb80bceb0 con 0x7feec0108870 2024-05-20T17:07:29.693 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:07:29.693 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":94,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:06:44.581646+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:05:02.947896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:05:03.842231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:05:07.551471+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:07:29.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.694+0000 7feec7b77640 1 -- 172.21.15.6:0/2374734220 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7feeac0a2c30 msgr2=0x7feeac0a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.694+0000 7feec7b77640 1 --2- 172.21.15.6:0/2374734220 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7feeac0a2c30 0x7feeac0a5140 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feec00747a0 tx=0x7feebc005f90 comp rx=0 tx=0).stop 2024-05-20T17:07:29.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.694+0000 7feec7b77640 1 -- 172.21.15.6:0/2374734220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec0108870 msgr2=0x7feec01a0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.694+0000 7feec7b77640 1 --2- 172.21.15.6:0/2374734220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec0108870 0x7feec01a0580 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7feeb8003ba0 tx=0x7feeb8003bd0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.695+0000 7feec7b77640 1 -- 172.21.15.6:0/2374734220 shutdown_connections 2024-05-20T17:07:29.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.695+0000 7feec7b77640 1 --2- 172.21.15.6:0/2374734220 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7feeac0a2c30 0x7feeac0a5140 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.695+0000 7feec7b77640 1 --2- 172.21.15.6:0/2374734220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec0108870 0x7feec01a0580 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.695+0000 7feec7b77640 1 --2- 172.21.15.6:0/2374734220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec0105f10 0x7feec01995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.695+0000 7feec7b77640 1 --2- 172.21.15.6:0/2374734220 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feec01035b0 0x7feec01990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.695+0000 7feec7b77640 1 -- 172.21.15.6:0/2374734220 >> 172.21.15.6:0/2374734220 conn(0x7feec00fcb90 msgr2=0x7feec01040a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.695+0000 7feec7b77640 1 -- 172.21.15.6:0/2374734220 shutdown_connections 2024-05-20T17:07:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.695+0000 7feec7b77640 1 -- 172.21.15.6:0/2374734220 wait complete. 2024-05-20T17:07:29.707 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-20T17:05:04.455743+0000', 'modified': '2024-05-20T17:05:35.584679+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24548, 'mds_1': 24526, 'mds_2': 24484, 'mds_3': 24470, 'mds_4': 24440}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14631': {'gid': 14631, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.6:6839/3061403904', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6838', 'nonce': 3061403904}, {'type': 'v1', 'addr': '172.21.15.6:6839', 'nonce': 3061403904}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14643': {'gid': 14643, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.6:6841/223306009', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6840', 'nonce': 223306009}, {'type': 'v1', 'addr': '172.21.15.6:6841', 'nonce': 223306009}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24433': {'gid': 24433, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.171:6833/1476847062', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6832', 'nonce': 1476847062}, {'type': 'v1', 'addr': '172.21.15.171:6833', 'nonce': 1476847062}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24440': {'gid': 24440, 'name': 'k', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.62:6833/3854589553', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6832', 'nonce': 3854589553}, {'type': 'v1', 'addr': '172.21.15.62:6833', 'nonce': 3854589553}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'e', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.62:6835/78063155', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 78063155}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 78063155}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24484': {'gid': 24484, 'name': 'f', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.171:6835/1542537621', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6834', 'nonce': 1542537621}, {'type': 'v1', 'addr': '172.21.15.171:6835', 'nonce': 1542537621}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.171:6837/732693575', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6836', 'nonce': 732693575}, {'type': 'v1', 'addr': '172.21.15.171:6837', 'nonce': 732693575}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24509': {'gid': 24509, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.62:6837/1745943929', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6836', 'nonce': 1745943929}, {'type': 'v1', 'addr': '172.21.15.62:6837', 'nonce': 1745943929}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24526': {'gid': 24526, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.171:6839/3246292303', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6838', 'nonce': 3246292303}, {'type': 'v1', 'addr': '172.21.15.171:6839', 'nonce': 3246292303}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24548': {'gid': 24548, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6839/3023093487', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6838', 'nonce': 3023093487}, {'type': 'v1', 'addr': '172.21.15.62:6839', 'nonce': 3023093487}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24548, 'qdb_cluster': [24440, 24548, 24526, 24470, 24484]} 2024-05-20T17:07:29.708 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-20T17:07:29.708 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.k status 2024-05-20T17:07:29.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.824+0000 7f5f90087640 1 -- 172.21.15.6:0/3684787491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f88108a20 msgr2=0x7f5f8810ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.824+0000 7f5f90087640 1 --2- 172.21.15.6:0/3684787491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f88108a20 0x7f5f8810ae40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009ca0 tx=0x7f5f8002a8c0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.825+0000 7f5f90087640 1 -- 172.21.15.6:0/3684787491 shutdown_connections 2024-05-20T17:07:29.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.825+0000 7f5f90087640 1 --2- 172.21.15.6:0/3684787491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f88108a20 0x7f5f8810ae40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.825+0000 7f5f90087640 1 --2- 172.21.15.6:0/3684787491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f881027e0 0x7f5f88102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.825+0000 7f5f90087640 1 --2- 172.21.15.6:0/3684787491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f88104120 0x7f5f881022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.825+0000 7f5f90087640 1 -- 172.21.15.6:0/3684787491 >> 172.21.15.6:0/3684787491 conn(0x7f5f880fdcf0 msgr2=0x7f5f88100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:29.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.825+0000 7f5f90087640 1 -- 172.21.15.6:0/3684787491 shutdown_connections 2024-05-20T17:07:29.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.825+0000 7f5f90087640 1 -- 172.21.15.6:0/3684787491 wait complete. 2024-05-20T17:07:29.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.825+0000 7f5f90087640 1 Processor -- start 2024-05-20T17:07:29.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.825+0000 7f5f90087640 1 -- start start 2024-05-20T17:07:29.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.825+0000 7f5f90087640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f881027e0 0x7f5f88076910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.825+0000 7f5f90087640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f88104120 0x7f5f88074fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.825+0000 7f5f90087640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f88108a20 0x7f5f880754f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f90087640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8810e720 con 0x7f5f88104120 2024-05-20T17:07:29.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f90087640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8810e5a0 con 0x7f5f88108a20 2024-05-20T17:07:29.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f90087640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8810e8a0 con 0x7f5f881027e0 2024-05-20T17:07:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f8d622640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f88104120 0x7f5f88074fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f8d622640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f88104120 0x7f5f88074fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56094/0 (socket says 172.21.15.6:56094) 2024-05-20T17:07:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f8d622640 1 -- 172.21.15.6:0/3868111711 learned_addr learned my addr 172.21.15.6:0/3868111711 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f8e624640 1 --2- 172.21.15.6:0/3868111711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f88108a20 0x7f5f880754f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f8de23640 1 --2- 172.21.15.6:0/3868111711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f881027e0 0x7f5f88076910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f8d622640 1 -- 172.21.15.6:0/3868111711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f881027e0 msgr2=0x7f5f88076910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f8d622640 1 --2- 172.21.15.6:0/3868111711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f881027e0 0x7f5f88076910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f8d622640 1 -- 172.21.15.6:0/3868111711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f88108a20 msgr2=0x7f5f880754f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f8d622640 1 --2- 172.21.15.6:0/3868111711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f88108a20 0x7f5f880754f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f8d622640 1 -- 172.21.15.6:0/3868111711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f88075c20 con 0x7f5f88104120 2024-05-20T17:07:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f8de23640 1 --2- 172.21.15.6:0/3868111711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f881027e0 0x7f5f88076910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:07:29.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f8e624640 1 --2- 172.21.15.6:0/3868111711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f88108a20 0x7f5f880754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:29.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f8d622640 1 --2- 172.21.15.6:0/3868111711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f88104120 0x7f5f88074fb0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00d950 tx=0x7f5f7c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:29.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f7affd640 1 -- 172.21.15.6:0/3868111711 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c017070 con 0x7f5f88104120 2024-05-20T17:07:29.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f7affd640 1 -- 172.21.15.6:0/3868111711 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f7c009c30 con 0x7f5f88104120 2024-05-20T17:07:29.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f90087640 1 -- 172.21.15.6:0/3868111711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f881a3360 con 0x7f5f88104120 2024-05-20T17:07:29.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f7affd640 1 -- 172.21.15.6:0/3868111711 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c00f620 con 0x7f5f88104120 2024-05-20T17:07:29.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.826+0000 7f5f90087640 1 -- 172.21.15.6:0/3868111711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f881a3820 con 0x7f5f88104120 2024-05-20T17:07:29.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.829+0000 7f5f7affd640 1 -- 172.21.15.6:0/3868111711 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f5f7c0109a0 con 0x7f5f88104120 2024-05-20T17:07:29.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.829+0000 7f5f97005740 1 Processor -- start 2024-05-20T17:07:29.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.829+0000 7f5f97005740 1 -- start start 2024-05-20T17:07:29.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.829+0000 7f5f97005740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a75270 0x560198e15470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.829+0000 7f5f97005740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a4c3b0 0x560198e159f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.829+0000 7f5f97005740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a54590 0x560198e1c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.830+0000 7f5f97005740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560198d794d0 con 0x560198a75270 2024-05-20T17:07:29.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.830+0000 7f5f97005740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560198d213e0 con 0x560198a54590 2024-05-20T17:07:29.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.830+0000 7f5f97005740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560198d75490 con 0x560198a4c3b0 2024-05-20T17:07:29.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.830+0000 7f5f8e624640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a75270 0x560198e15470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.830+0000 7f5f8e624640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a75270 0x560198e15470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56110/0 (socket says 172.21.15.6:56110) 2024-05-20T17:07:29.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.830+0000 7f5f8e624640 1 -- 172.21.15.6:0/3528634526 learned_addr learned my addr 172.21.15.6:0/3528634526 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:29.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.830+0000 7f5f7affd640 1 --2- 172.21.15.6:0/3868111711 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5f740a2b90 0x7f5f740a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.830+0000 7f5f8de23640 1 --2- 172.21.15.6:0/3528634526 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a4c3b0 0x560198e159f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.830+0000 7f5f8e624640 1 --2- 172.21.15.6:0/3868111711 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5f740a2b90 0x7f5f740a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.830+0000 7f5f7affd640 1 -- 172.21.15.6:0/3868111711 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f5f7c0cf150 con 0x7f5f88104120 2024-05-20T17:07:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.830+0000 7f5f8d622640 1 --2- 172.21.15.6:0/3528634526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a54590 0x560198e1c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.830+0000 7f5f8e624640 1 -- 172.21.15.6:0/3528634526 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a4c3b0 msgr2=0x560198e159f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.830+0000 7f5f8e624640 1 --2- 172.21.15.6:0/3528634526 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a4c3b0 0x560198e159f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.830+0000 7f5f8e624640 1 -- 172.21.15.6:0/3528634526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a54590 msgr2=0x560198e1c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.830+0000 7f5f8e624640 1 --2- 172.21.15.6:0/3528634526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a54590 0x560198e1c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.830+0000 7f5f8e624640 1 -- 172.21.15.6:0/3528634526 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560198a8d2d0 con 0x560198a75270 2024-05-20T17:07:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.830+0000 7f5f8e624640 1 --2- 172.21.15.6:0/3528634526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a75270 0x560198e15470 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5f80035000 tx=0x7f5f80031810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b7951182596483 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.830+0000 7f5f73fff640 1 -- 172.21.15.6:0/3528634526 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f80004b40 con 0x560198a75270 2024-05-20T17:07:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.831+0000 7f5f73fff640 1 -- 172.21.15.6:0/3528634526 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f8004e070 con 0x560198a75270 2024-05-20T17:07:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.831+0000 7f5f73fff640 1 -- 172.21.15.6:0/3528634526 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f80030c00 con 0x560198a75270 2024-05-20T17:07:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.831+0000 7f5f8e624640 1 --2- 172.21.15.6:0/3868111711 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5f740a2b90 0x7f5f740a50a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5f8004d000 tx=0x7f5f8004b000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.831+0000 7f5f97005740 1 -- 172.21.15.6:0/3528634526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a75270 msgr2=0x560198e15470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.831+0000 7f5f97005740 1 --2- 172.21.15.6:0/3528634526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a75270 0x560198e15470 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5f80035000 tx=0x7f5f80031810 comp rx=0 tx=0).stop 2024-05-20T17:07:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.831+0000 7f5f97005740 1 -- 172.21.15.6:0/3528634526 shutdown_connections 2024-05-20T17:07:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.831+0000 7f5f97005740 1 --2- 172.21.15.6:0/3528634526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a54590 0x560198e1c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.831+0000 7f5f97005740 1 --2- 172.21.15.6:0/3528634526 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a4c3b0 0x560198e159f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.831+0000 7f5f97005740 1 --2- 172.21.15.6:0/3528634526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a75270 0x560198e15470 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.831+0000 7f5f97005740 1 -- 172.21.15.6:0/3528634526 >> 172.21.15.6:0/3528634526 conn(0x560198a693c0 msgr2=0x560198e10e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.832+0000 7f5f97005740 1 -- 172.21.15.6:0/3528634526 shutdown_connections 2024-05-20T17:07:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.832+0000 7f5f97005740 1 -- 172.21.15.6:0/3528634526 wait complete. 2024-05-20T17:07:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.832+0000 7f5f97005740 1 -- start start 2024-05-20T17:07:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.832+0000 7f5f97005740 1 Processor -- start 2024-05-20T17:07:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.832+0000 7f5f97005740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a4c3b0 0x560198e1f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f97005740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a54590 0x560198e1f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f97005740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a75270 0x560198e26850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f97005740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560198e1d340 con 0x560198a54590 2024-05-20T17:07:29.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f97005740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560198d348e0 con 0x560198a4c3b0 2024-05-20T17:07:29.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f97005740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560198e1d4c0 con 0x560198a75270 2024-05-20T17:07:29.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f97005740 10 client.0 _ll_register_callbacks cb 0x560198d019c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:07:29.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f8d622640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a54590 0x560198e1f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f8d622640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a54590 0x560198e1f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56116/0 (socket says 172.21.15.6:56116) 2024-05-20T17:07:29.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f8d622640 1 -- 172.21.15.6:0/3420229600 learned_addr learned my addr 172.21.15.6:0/3420229600 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:29.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f8de23640 1 --2- 172.21.15.6:0/3420229600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a4c3b0 0x560198e1f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f8e624640 1 --2- 172.21.15.6:0/3420229600 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a75270 0x560198e26850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f8d622640 1 -- 172.21.15.6:0/3420229600 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a75270 msgr2=0x560198e26850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:29.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f8d622640 1 --2- 172.21.15.6:0/3420229600 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a75270 0x560198e26850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f8d622640 1 -- 172.21.15.6:0/3420229600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a4c3b0 msgr2=0x560198e1f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:29.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f8d622640 1 --2- 172.21.15.6:0/3420229600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a4c3b0 0x560198e1f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f8d622640 1 -- 172.21.15.6:0/3420229600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560198b576b0 con 0x560198a54590 2024-05-20T17:07:29.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f8e624640 1 --2- 172.21.15.6:0/3420229600 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a75270 0x560198e26850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:29.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f8d622640 1 --2- 172.21.15.6:0/3420229600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a54590 0x560198e1f8f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0cc840 tx=0x7f5f7c09bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c214b5f3331b48cf server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:29.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f717fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:07:29.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f717fa640 1 -- 172.21.15.6:0/3420229600 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c020040 con 0x560198a54590 2024-05-20T17:07:29.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f717fa640 1 -- 172.21.15.6:0/3420229600 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f5f7c097c10 con 0x560198a54590 2024-05-20T17:07:29.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.833+0000 7f5f97005740 1 -- 172.21.15.6:0/3420229600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f8004e070 con 0x560198a54590 2024-05-20T17:07:29.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.834+0000 7f5f717fa640 1 -- 172.21.15.6:0/3420229600 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5f7c09f950 con 0x560198a54590 2024-05-20T17:07:29.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.834+0000 7f5f97005740 10 client.15447 fetch_fsmap learned FSMap version 28 2024-05-20T17:07:29.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.834+0000 7f5f97005740 1 -- 172.21.15.6:0/3420229600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560198e297b0 con 0x560198a54590 2024-05-20T17:07:29.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.834+0000 7f5f717fa640 1 -- 172.21.15.6:0/3420229600 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f8004e070 con 0x560198a54590 2024-05-20T17:07:29.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.834+0000 7f5f717fa640 1 -- 172.21.15.6:0/3420229600 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5f7c09a9f0 con 0x560198a54590 2024-05-20T17:07:29.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.834+0000 7f5f97005740 10 client.15447 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:07:29.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.834+0000 7f5f97005740 10 client.15447 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-20T17:07:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.834+0000 7f5f97005740 20 client.15447 populate_metadata read hostname 'smithi006' 2024-05-20T17:07:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.834+0000 7f5f97005740 1 --2- 172.21.15.6:0/3420229600 >> [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] conn(0x560198a33e40 0x560198e2d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.834+0000 7f5f97005740 4 client.15447 mds_command: new command op to 24440 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:07:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.834+0000 7f5f97005740 1 -- 172.21.15.6:0/3420229600 --> [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560198d86c00 con 0x560198a33e40 2024-05-20T17:07:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.834+0000 7f5f8de23640 1 --2- 172.21.15.6:0/3420229600 >> [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] conn(0x560198a33e40 0x560198e2d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.835+0000 7f5f8de23640 1 --2- 172.21.15.6:0/3420229600 >> [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] conn(0x560198a33e40 0x560198e2d240 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=421042f4eaf7c289 server_cookie=83ce1a2c90faa91b in_seq=0 out_seq=0 2024-05-20T17:07:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.835+0000 7f5f717fa640 10 client.15447 ms_handle_connect on v2:172.21.15.62:6832/3854589553 2024-05-20T17:07:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.836+0000 7f5f717fa640 1 -- 172.21.15.6:0/3420229600 <== mds.4 v2:172.21.15.62:6832/3854589553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560198d86c00 con 0x560198a33e40 2024-05-20T17:07:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.836+0000 7f5f717fa640 10 client.15447 handle_command_reply: tid=0 2024-05-20T17:07:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.836+0000 7f5f97005740 1 client.15447 shutdown 2024-05-20T17:07:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.836+0000 7f5f97005740 1 -- 172.21.15.6:0/3420229600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a54590 msgr2=0x560198e1f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.836+0000 7f5f97005740 1 --2- 172.21.15.6:0/3420229600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a54590 0x560198e1f8f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0cc840 tx=0x7f5f7c09bca0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.836+0000 7f5f97005740 1 -- 172.21.15.6:0/3420229600 shutdown_connections 2024-05-20T17:07:29.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.836+0000 7f5f97005740 1 --2- 172.21.15.6:0/3420229600 >> [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] conn(0x560198a33e40 0x560198e2d240 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.836+0000 7f5f97005740 1 --2- 172.21.15.6:0/3420229600 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a75270 0x560198e26850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.836+0000 7f5f97005740 1 --2- 172.21.15.6:0/3420229600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a54590 0x560198e1f8f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.836+0000 7f5f717fa640 0 client.15447 ms_handle_reset on v2:172.21.15.62:6832/3854589553 2024-05-20T17:07:29.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.836+0000 7f5f97005740 1 --2- 172.21.15.6:0/3420229600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a4c3b0 0x560198e1f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.836+0000 7f5f97005740 1 -- 172.21.15.6:0/3420229600 >> 172.21.15.6:0/3420229600 conn(0x560198a693c0 msgr2=0x560198e0fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:29.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.836+0000 7f5f97005740 1 -- 172.21.15.6:0/3420229600 shutdown_connections 2024-05-20T17:07:29.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.836+0000 7f5f97005740 1 -- 172.21.15.6:0/3420229600 wait complete. 2024-05-20T17:07:29.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.836+0000 7f5f97005740 20 client.15447 trim_cache size 0 max 16384 2024-05-20T17:07:29.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.855+0000 7f5f97005740 1 Processor -- start 2024-05-20T17:07:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.855+0000 7f5f97005740 1 -- start start 2024-05-20T17:07:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.855+0000 7f5f97005740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a4c3b0 0x560198e1e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.855+0000 7f5f97005740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a54590 0x560198e2ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.855+0000 7f5f97005740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a75270 0x560198e26770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.855+0000 7f5f97005740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560198e2b580 con 0x560198a75270 2024-05-20T17:07:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.855+0000 7f5f97005740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560198e2bc50 con 0x560198a54590 2024-05-20T17:07:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.855+0000 7f5f97005740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560198e2c320 con 0x560198a4c3b0 2024-05-20T17:07:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.855+0000 7f5f8e624640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a75270 0x560198e26770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.856+0000 7f5f8e624640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a75270 0x560198e26770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56120/0 (socket says 172.21.15.6:56120) 2024-05-20T17:07:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.856+0000 7f5f8e624640 1 -- 172.21.15.6:0/2958757827 learned_addr learned my addr 172.21.15.6:0/2958757827 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.856+0000 7f5f8de23640 1 --2- 172.21.15.6:0/2958757827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a4c3b0 0x560198e1e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.856+0000 7f5f8d622640 1 --2- 172.21.15.6:0/2958757827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a54590 0x560198e2ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.856+0000 7f5f8e624640 1 -- 172.21.15.6:0/2958757827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a4c3b0 msgr2=0x560198e1e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:29.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.856+0000 7f5f8e624640 1 --2- 172.21.15.6:0/2958757827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a4c3b0 0x560198e1e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.856+0000 7f5f8e624640 1 -- 172.21.15.6:0/2958757827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a54590 msgr2=0x560198e2ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:29.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.856+0000 7f5f8e624640 1 --2- 172.21.15.6:0/2958757827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a54590 0x560198e2ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.856+0000 7f5f8e624640 1 -- 172.21.15.6:0/2958757827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560198e16670 con 0x560198a75270 2024-05-20T17:07:29.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.856+0000 7f5f8e624640 1 --2- 172.21.15.6:0/2958757827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a75270 0x560198e26770 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5f80005e30 tx=0x7f5f80031f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e98837383784a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:29.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.856+0000 7f5f737fe640 1 -- 172.21.15.6:0/2958757827 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f80031450 con 0x560198a75270 2024-05-20T17:07:29.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.856+0000 7f5f737fe640 1 -- 172.21.15.6:0/2958757827 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f8004e070 con 0x560198a75270 2024-05-20T17:07:29.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.856+0000 7f5f737fe640 1 -- 172.21.15.6:0/2958757827 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f800305c0 con 0x560198a75270 2024-05-20T17:07:29.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.857+0000 7f5f97005740 1 -- 172.21.15.6:0/2958757827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a75270 msgr2=0x560198e26770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.857+0000 7f5f97005740 1 --2- 172.21.15.6:0/2958757827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a75270 0x560198e26770 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5f80005e30 tx=0x7f5f80031f80 comp rx=0 tx=0).stop 2024-05-20T17:07:29.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.857+0000 7f5f97005740 1 -- 172.21.15.6:0/2958757827 shutdown_connections 2024-05-20T17:07:29.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.857+0000 7f5f97005740 1 --2- 172.21.15.6:0/2958757827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a75270 0x560198e26770 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.857+0000 7f5f97005740 1 --2- 172.21.15.6:0/2958757827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a54590 0x560198e2ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.857+0000 7f5f97005740 1 --2- 172.21.15.6:0/2958757827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a4c3b0 0x560198e1e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.857+0000 7f5f97005740 1 -- 172.21.15.6:0/2958757827 >> 172.21.15.6:0/2958757827 conn(0x560198a693c0 msgr2=0x560198e1d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:29.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.857+0000 7f5f97005740 1 -- 172.21.15.6:0/2958757827 shutdown_connections 2024-05-20T17:07:29.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.857+0000 7f5f97005740 1 -- 172.21.15.6:0/2958757827 wait complete. 2024-05-20T17:07:29.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.857+0000 7f5f97005740 1 -- start start 2024-05-20T17:07:29.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.857+0000 7f5f97005740 1 Processor -- start 2024-05-20T17:07:29.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.858+0000 7f5f97005740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a4c3b0 0x560198e21d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.858+0000 7f5f97005740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a54590 0x560198e222a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.858+0000 7f5f97005740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a75270 0x560198e940b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.858+0000 7f5f97005740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560198e2d0c0 con 0x560198a54590 2024-05-20T17:07:29.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.858+0000 7f5f97005740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560198e2c9f0 con 0x560198a4c3b0 2024-05-20T17:07:29.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.858+0000 7f5f97005740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560198e2d790 con 0x560198a75270 2024-05-20T17:07:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.858+0000 7f5f97005740 10 client.0 _ll_register_callbacks cb 0x7f5f7c00df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:07:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.858+0000 7f5f8d622640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a54590 0x560198e222a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.858+0000 7f5f8d622640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a54590 0x560198e222a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56124/0 (socket says 172.21.15.6:56124) 2024-05-20T17:07:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.858+0000 7f5f8d622640 1 -- 172.21.15.6:0/1789565875 learned_addr learned my addr 172.21.15.6:0/1789565875 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.858+0000 7f5f8e624640 1 --2- 172.21.15.6:0/1789565875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a75270 0x560198e940b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.858+0000 7f5f8de23640 1 --2- 172.21.15.6:0/1789565875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a4c3b0 0x560198e21d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.858+0000 7f5f8d622640 1 -- 172.21.15.6:0/1789565875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a75270 msgr2=0x560198e940b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.858+0000 7f5f8d622640 1 --2- 172.21.15.6:0/1789565875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a75270 0x560198e940b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.858+0000 7f5f8d622640 1 -- 172.21.15.6:0/1789565875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a4c3b0 msgr2=0x560198e21d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.858+0000 7f5f8d622640 1 --2- 172.21.15.6:0/1789565875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a4c3b0 0x560198e21d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.858+0000 7f5f8d622640 1 -- 172.21.15.6:0/1789565875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560198e27270 con 0x560198a54590 2024-05-20T17:07:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.858+0000 7f5f8de23640 1 --2- 172.21.15.6:0/1789565875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a4c3b0 0x560198e21d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.858+0000 7f5f8d622640 1 --2- 172.21.15.6:0/1789565875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a54590 0x560198e222a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c09b4e0 tx=0x7f5f7c086120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58b7682b7f7c038 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.858+0000 7f5f717fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:07:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.859+0000 7f5f717fa640 1 -- 172.21.15.6:0/1789565875 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c014020 con 0x560198a54590 2024-05-20T17:07:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.859+0000 7f5f717fa640 1 -- 172.21.15.6:0/1789565875 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f5f7c0665a0 con 0x560198a54590 2024-05-20T17:07:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.859+0000 7f5f97005740 1 -- 172.21.15.6:0/1789565875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f8004e070 con 0x560198a54590 2024-05-20T17:07:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.859+0000 7f5f717fa640 1 -- 172.21.15.6:0/1789565875 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5f7c020030 con 0x560198a54590 2024-05-20T17:07:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.859+0000 7f5f97005740 10 client.15453 fetch_fsmap learned FSMap version 28 2024-05-20T17:07:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.859+0000 7f5f97005740 1 -- 172.21.15.6:0/1789565875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560198e955f0 con 0x560198a54590 2024-05-20T17:07:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.859+0000 7f5f717fa640 1 -- 172.21.15.6:0/1789565875 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f8004e070 con 0x560198a54590 2024-05-20T17:07:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.859+0000 7f5f717fa640 1 -- 172.21.15.6:0/1789565875 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5f7c010460 con 0x560198a54590 2024-05-20T17:07:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.859+0000 7f5f97005740 10 client.15453 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:07:29.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.859+0000 7f5f97005740 10 client.15453 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-20T17:07:29.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.859+0000 7f5f97005740 20 client.15453 populate_metadata read hostname 'smithi006' 2024-05-20T17:07:29.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.859+0000 7f5f97005740 1 --2- 172.21.15.6:0/1789565875 >> [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] conn(0x560198a09280 0x560198e98ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.859+0000 7f5f97005740 4 client.15453 mds_command: new command op to 24440 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:07:29.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.859+0000 7f5f97005740 1 -- 172.21.15.6:0/1789565875 --> [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] -- command(tid 0: {"prefix": "status"}) -- 0x560198e0bee0 con 0x560198a09280 2024-05-20T17:07:29.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.860+0000 7f5f8de23640 1 --2- 172.21.15.6:0/1789565875 >> [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] conn(0x560198a09280 0x560198e98ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.860+0000 7f5f8de23640 1 --2- 172.21.15.6:0/1789565875 >> [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] conn(0x560198a09280 0x560198e98ee0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2ce6dfa01f2c359b server_cookie=ccca4c203771c3cd in_seq=0 out_seq=0 2024-05-20T17:07:29.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.860+0000 7f5f717fa640 10 client.15453 ms_handle_connect on v2:172.21.15.62:6832/3854589553 2024-05-20T17:07:29.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.860+0000 7f5f717fa640 1 -- 172.21.15.6:0/1789565875 <== mds.4 v2:172.21.15.62:6832/3854589553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x560198e0bee0 con 0x560198a09280 2024-05-20T17:07:29.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.860+0000 7f5f717fa640 10 client.15453 handle_command_reply: tid=0 2024-05-20T17:07:29.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.860+0000 7f5f97005740 1 client.15453 shutdown 2024-05-20T17:07:29.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.860+0000 7f5f97005740 1 -- 172.21.15.6:0/1789565875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a54590 msgr2=0x560198e222a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.860+0000 7f5f97005740 1 --2- 172.21.15.6:0/1789565875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a54590 0x560198e222a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c09b4e0 tx=0x7f5f7c086120 comp rx=0 tx=0).stop 2024-05-20T17:07:29.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.860+0000 7f5f97005740 1 -- 172.21.15.6:0/1789565875 shutdown_connections 2024-05-20T17:07:29.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.860+0000 7f5f97005740 1 --2- 172.21.15.6:0/1789565875 >> [v2:172.21.15.62:6832/3854589553,v1:172.21.15.62:6833/3854589553] conn(0x560198a09280 0x560198e98ee0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.860+0000 7f5f97005740 1 --2- 172.21.15.6:0/1789565875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560198a75270 0x560198e940b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.860+0000 7f5f97005740 1 --2- 172.21.15.6:0/1789565875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560198a54590 0x560198e222a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.860+0000 7f5f717fa640 0 client.15453 ms_handle_reset on v2:172.21.15.62:6832/3854589553 2024-05-20T17:07:29.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.861+0000 7f5f97005740 1 --2- 172.21.15.6:0/1789565875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560198a4c3b0 0x560198e21d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.861+0000 7f5f97005740 1 -- 172.21.15.6:0/1789565875 >> 172.21.15.6:0/1789565875 conn(0x560198a693c0 msgr2=0x560198e107f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:29.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.861+0000 7f5f97005740 1 -- 172.21.15.6:0/1789565875 shutdown_connections 2024-05-20T17:07:29.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.861+0000 7f5f97005740 1 -- 172.21.15.6:0/1789565875 wait complete. 2024-05-20T17:07:29.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.861+0000 7f5f97005740 20 client.15453 trim_cache size 0 max 16384 2024-05-20T17:07:29.871 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:07:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c726c954-16c9-11ef-bc9a-c7b262605968", 2024-05-20T17:07:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 4, 2024-05-20T17:07:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24440, 2024-05-20T17:07:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T17:07:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T17:07:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T17:07:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 115.279772808, 2024-05-20T17:07:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 28, 2024-05-20T17:07:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 94, 2024-05-20T17:07:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 90, 2024-05-20T17:07:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 180.014614612 2024-05-20T17:07:29.871 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:07:29.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.861+0000 7f5f90087640 1 -- 172.21.15.6:0/3868111711 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5f740a2b90 msgr2=0x7f5f740a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.861+0000 7f5f90087640 1 --2- 172.21.15.6:0/3868111711 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5f740a2b90 0x7f5f740a50a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5f8004d000 tx=0x7f5f8004b000 comp rx=0 tx=0).stop 2024-05-20T17:07:29.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.861+0000 7f5f90087640 1 -- 172.21.15.6:0/3868111711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f88104120 msgr2=0x7f5f88074fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.861+0000 7f5f90087640 1 --2- 172.21.15.6:0/3868111711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f88104120 0x7f5f88074fb0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00d950 tx=0x7f5f7c00de10 comp rx=0 tx=0).stop 2024-05-20T17:07:29.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.861+0000 7f5f90087640 1 -- 172.21.15.6:0/3868111711 shutdown_connections 2024-05-20T17:07:29.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.861+0000 7f5f90087640 1 --2- 172.21.15.6:0/3868111711 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f5f740a2b90 0x7f5f740a50a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.861+0000 7f5f90087640 1 --2- 172.21.15.6:0/3868111711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f88108a20 0x7f5f880754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.861+0000 7f5f90087640 1 --2- 172.21.15.6:0/3868111711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f88104120 0x7f5f88074fb0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.861+0000 7f5f90087640 1 --2- 172.21.15.6:0/3868111711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f881027e0 0x7f5f88076910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.861+0000 7f5f90087640 1 -- 172.21.15.6:0/3868111711 >> 172.21.15.6:0/3868111711 conn(0x7f5f880fdcf0 msgr2=0x7f5f88104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:29.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.861+0000 7f5f90087640 1 -- 172.21.15.6:0/3868111711 shutdown_connections 2024-05-20T17:07:29.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.861+0000 7f5f90087640 1 -- 172.21.15.6:0/3868111711 wait complete. 2024-05-20T17:07:29.874 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-05-20T17:07:29.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.990+0000 7f6cfe3c3640 1 -- 172.21.15.6:0/3006535872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cf8102910 msgr2=0x7f6cf8102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.990+0000 7f6cfe3c3640 1 --2- 172.21.15.6:0/3006535872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cf8102910 0x7f6cf8102d80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009900 tx=0x7f6cec02a410 comp rx=0 tx=0).stop 2024-05-20T17:07:29.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.990+0000 7f6cfe3c3640 1 -- 172.21.15.6:0/3006535872 shutdown_connections 2024-05-20T17:07:29.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.990+0000 7f6cfe3c3640 1 --2- 172.21.15.6:0/3006535872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cf8103410 0x7f6cf8109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.990+0000 7f6cfe3c3640 1 --2- 172.21.15.6:0/3006535872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cf8102910 0x7f6cf8102d80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.990+0000 7f6cfe3c3640 1 --2- 172.21.15.6:0/3006535872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cf8101f30 0x7f6cf8102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.990+0000 7f6cfe3c3640 1 -- 172.21.15.6:0/3006535872 >> 172.21.15.6:0/3006535872 conn(0x7f6cf80fc330 msgr2=0x7f6cf80fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:29.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.990+0000 7f6cfe3c3640 1 -- 172.21.15.6:0/3006535872 shutdown_connections 2024-05-20T17:07:29.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.990+0000 7f6cfe3c3640 1 -- 172.21.15.6:0/3006535872 wait complete. 2024-05-20T17:07:29.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.991+0000 7f6cfe3c3640 1 Processor -- start 2024-05-20T17:07:29.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.991+0000 7f6cfe3c3640 1 -- start start 2024-05-20T17:07:29.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.991+0000 7f6cfe3c3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cf8101f30 0x7f6cf8199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.991+0000 7f6cfe3c3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cf8102910 0x7f6cf8199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.991+0000 7f6cfe3c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cf8103410 0x7f6cf81a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:29.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.992+0000 7f6cfe3c3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf810d4d0 con 0x7f6cf8103410 2024-05-20T17:07:29.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.992+0000 7f6cfe3c3640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf810d350 con 0x7f6cf8101f30 2024-05-20T17:07:29.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.992+0000 7f6cfe3c3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf810d650 con 0x7f6cf8102910 2024-05-20T17:07:29.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.992+0000 7f6cfc960640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cf8103410 0x7f6cf81a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.992+0000 7f6cfc960640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cf8103410 0x7f6cf81a06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56144/0 (socket says 172.21.15.6:56144) 2024-05-20T17:07:29.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.992+0000 7f6cfc960640 1 -- 172.21.15.6:0/2070706660 learned_addr learned my addr 172.21.15.6:0/2070706660 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:29.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.992+0000 7f6cf7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cf8101f30 0x7f6cf8199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.992+0000 7f6cf77fe640 1 --2- 172.21.15.6:0/2070706660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cf8102910 0x7f6cf8199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:29.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.992+0000 7f6cfc960640 1 -- 172.21.15.6:0/2070706660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cf8102910 msgr2=0x7f6cf8199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.992+0000 7f6cfc960640 1 --2- 172.21.15.6:0/2070706660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cf8102910 0x7f6cf8199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.992+0000 7f6cfc960640 1 -- 172.21.15.6:0/2070706660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cf8101f30 msgr2=0x7f6cf8199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:29.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.992+0000 7f6cfc960640 1 --2- 172.21.15.6:0/2070706660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cf8101f30 0x7f6cf8199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:29.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.992+0000 7f6cfc960640 1 -- 172.21.15.6:0/2070706660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf81a0d10 con 0x7f6cf8103410 2024-05-20T17:07:29.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.992+0000 7f6cf77fe640 1 --2- 172.21.15.6:0/2070706660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cf8102910 0x7f6cf8199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:07:29.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.992+0000 7f6cfc960640 1 --2- 172.21.15.6:0/2070706660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cf8103410 0x7f6cf81a06a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000eaa0 tx=0x7f6cf000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:29.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.992+0000 7f6cf57fa640 1 -- 172.21.15.6:0/2070706660 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf000cdb0 con 0x7f6cf8103410 2024-05-20T17:07:29.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.992+0000 7f6cf57fa640 1 -- 172.21.15.6:0/2070706660 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6cf0005020 con 0x7f6cf8103410 2024-05-20T17:07:29.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.992+0000 7f6cfe3c3640 1 -- 172.21.15.6:0/2070706660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf81a0fa0 con 0x7f6cf8103410 2024-05-20T17:07:29.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.992+0000 7f6cf57fa640 1 -- 172.21.15.6:0/2070706660 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf00116d0 con 0x7f6cf8103410 2024-05-20T17:07:29.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.992+0000 7f6cfe3c3640 1 -- 172.21.15.6:0/2070706660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf81a1410 con 0x7f6cf8103410 2024-05-20T17:07:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.995+0000 7f6cf57fa640 1 -- 172.21.15.6:0/2070706660 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f6cf00051d0 con 0x7f6cf8103410 2024-05-20T17:07:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.995+0000 7f6d0526c740 1 Processor -- start 2024-05-20T17:07:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.995+0000 7f6d0526c740 1 -- start start 2024-05-20T17:07:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.995+0000 7f6d0526c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56337d909270 0x56337dca9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.995+0000 7f6d0526c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d8e03b0 0x56337dca99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.995+0000 7f6d0526c740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 0x56337dcb08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.995+0000 7f6d0526c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56337dc0d4d0 con 0x56337d8e03b0 2024-05-20T17:07:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.995+0000 7f6d0526c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56337dbb53e0 con 0x56337d909270 2024-05-20T17:07:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.995+0000 7f6d0526c740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56337dc09490 con 0x56337d8e8590 2024-05-20T17:07:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.995+0000 7f6cf7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d8e03b0 0x56337dca99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.996+0000 7f6cf57fa640 1 --2- 172.21.15.6:0/2070706660 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6ce00a2b90 0x7f6ce00a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.996+0000 7f6cf7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d8e03b0 0x56337dca99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56146/0 (socket says 172.21.15.6:56146) 2024-05-20T17:07:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.996+0000 7f6cf7fff640 1 -- 172.21.15.6:0/1039579986 learned_addr learned my addr 172.21.15.6:0/1039579986 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.996+0000 7f6cf77fe640 1 --2- 172.21.15.6:0/1039579986 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56337d909270 0x56337dca9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.996+0000 7f6cfc960640 1 --2- 172.21.15.6:0/2070706660 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6ce00a2b90 0x7f6ce00a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.996+0000 7f6cf77fe640 1 --2- 172.21.15.6:0/1039579986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 0x56337dcb08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.996+0000 7f6cf57fa640 1 -- 172.21.15.6:0/2070706660 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f6cf00cf650 con 0x7f6cf8103410 2024-05-20T17:07:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.996+0000 7f6cf7fff640 1 -- 172.21.15.6:0/1039579986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 msgr2=0x56337dcb08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.996+0000 7f6cf7fff640 1 --2- 172.21.15.6:0/1039579986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 0x56337dcb08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.996+0000 7f6cf7fff640 1 -- 172.21.15.6:0/1039579986 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56337d909270 msgr2=0x56337dca9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.996+0000 7f6cf7fff640 1 --2- 172.21.15.6:0/1039579986 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56337d909270 0x56337dca9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.996+0000 7f6cf7fff640 1 -- 172.21.15.6:0/1039579986 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56337d9212d0 con 0x56337d8e03b0 2024-05-20T17:07:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.996+0000 7f6cf77fe640 1 --2- 172.21.15.6:0/1039579986 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56337d909270 0x56337dca9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.996+0000 7f6cf7fff640 1 --2- 172.21.15.6:0/1039579986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d8e03b0 0x56337dca99f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8009c60 tx=0x7f6ce8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aaf8441a76b751c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.996+0000 7f6cfc960640 1 --2- 172.21.15.6:0/2070706660 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6ce00a2b90 0x7f6ce00a50a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00ccd40 tx=0x7f6cf001eb40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.996+0000 7f6cde7fc640 1 -- 172.21.15.6:0/1039579986 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8004220 con 0x56337d8e03b0 2024-05-20T17:07:30.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.996+0000 7f6cde7fc640 1 -- 172.21.15.6:0/1039579986 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ce80043c0 con 0x56337d8e03b0 2024-05-20T17:07:30.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.996+0000 7f6cde7fc640 1 -- 172.21.15.6:0/1039579986 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8019790 con 0x56337d8e03b0 2024-05-20T17:07:30.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.997+0000 7f6d0526c740 1 -- 172.21.15.6:0/1039579986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d8e03b0 msgr2=0x56337dca99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.997+0000 7f6d0526c740 1 --2- 172.21.15.6:0/1039579986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d8e03b0 0x56337dca99f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8009c60 tx=0x7f6ce8011810 comp rx=0 tx=0).stop 2024-05-20T17:07:30.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.997+0000 7f6d0526c740 1 -- 172.21.15.6:0/1039579986 shutdown_connections 2024-05-20T17:07:30.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.997+0000 7f6d0526c740 1 --2- 172.21.15.6:0/1039579986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 0x56337dcb08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.997+0000 7f6d0526c740 1 --2- 172.21.15.6:0/1039579986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d8e03b0 0x56337dca99f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.997+0000 7f6d0526c740 1 --2- 172.21.15.6:0/1039579986 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56337d909270 0x56337dca9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.997+0000 7f6d0526c740 1 -- 172.21.15.6:0/1039579986 >> 172.21.15.6:0/1039579986 conn(0x56337d8fd3c0 msgr2=0x56337dca4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.997+0000 7f6d0526c740 1 -- 172.21.15.6:0/1039579986 shutdown_connections 2024-05-20T17:07:30.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.997+0000 7f6d0526c740 1 -- 172.21.15.6:0/1039579986 wait complete. 2024-05-20T17:07:30.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.998+0000 7f6d0526c740 1 -- start start 2024-05-20T17:07:30.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.998+0000 7f6d0526c740 1 Processor -- start 2024-05-20T17:07:30.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.998+0000 7f6d0526c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56337d8e03b0 0x56337dcb3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.998+0000 7f6d0526c740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 0x56337dcb37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.998+0000 7f6d0526c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d909270 0x56337dcba730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.998+0000 7f6d0526c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56337dcb1340 con 0x56337d909270 2024-05-20T17:07:30.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.998+0000 7f6d0526c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56337dbc88e0 con 0x56337d8e03b0 2024-05-20T17:07:30.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.998+0000 7f6d0526c740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56337dcb14c0 con 0x56337d8e8590 2024-05-20T17:07:30.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.998+0000 7f6d0526c740 10 client.0 _ll_register_callbacks cb 0x56337db959c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:07:30.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.998+0000 7f6cf77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d909270 0x56337dcba730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.998+0000 7f6cf77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d909270 0x56337dcba730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56152/0 (socket says 172.21.15.6:56152) 2024-05-20T17:07:30.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.998+0000 7f6cf77fe640 1 -- 172.21.15.6:0/1531123448 learned_addr learned my addr 172.21.15.6:0/1531123448 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:30.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.998+0000 7f6cf7fff640 1 --2- 172.21.15.6:0/1531123448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 0x56337dcb37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.998+0000 7f6cf77fe640 1 --2- 172.21.15.6:0/1531123448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56337d8e03b0 0x56337dcb3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.999+0000 7f6cf77fe640 1 -- 172.21.15.6:0/1531123448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 msgr2=0x56337dcb37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.999+0000 7f6cf77fe640 1 --2- 172.21.15.6:0/1531123448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 0x56337dcb37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.999+0000 7f6cf77fe640 1 -- 172.21.15.6:0/1531123448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56337d8e03b0 msgr2=0x56337dcb3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.999+0000 7f6cf77fe640 1 --2- 172.21.15.6:0/1531123448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56337d8e03b0 0x56337dcb3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.999+0000 7f6cf77fe640 1 -- 172.21.15.6:0/1531123448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56337d9eb6b0 con 0x56337d909270 2024-05-20T17:07:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.999+0000 7f6cf77fe640 1 --2- 172.21.15.6:0/1531123448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d909270 0x56337dcba730 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6cec005f50 tx=0x7f6cec02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b2466db794b4bb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.999+0000 7f6cd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:07:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.999+0000 7f6cd77fe640 1 -- 172.21.15.6:0/1531123448 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec035040 con 0x56337d909270 2024-05-20T17:07:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.999+0000 7f6cd77fe640 1 -- 172.21.15.6:0/1531123448 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f6cec03e6c0 con 0x56337d909270 2024-05-20T17:07:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.999+0000 7f6d0526c740 1 -- 172.21.15.6:0/1531123448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ce80043c0 con 0x56337d909270 2024-05-20T17:07:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.999+0000 7f6cd77fe640 1 -- 172.21.15.6:0/1531123448 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6cec03e8c0 con 0x56337d909270 2024-05-20T17:07:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.999+0000 7f6d0526c740 10 client.15465 fetch_fsmap learned FSMap version 28 2024-05-20T17:07:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.999+0000 7f6d0526c740 1 -- 172.21.15.6:0/1531123448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56337dcbd6d0 con 0x56337d909270 2024-05-20T17:07:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:29.999+0000 7f6cd77fe640 1 -- 172.21.15.6:0/1531123448 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ce80043c0 con 0x56337d909270 2024-05-20T17:07:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.000+0000 7f6cd77fe640 1 -- 172.21.15.6:0/1531123448 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6cec03a070 con 0x56337d909270 2024-05-20T17:07:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.000+0000 7f6d0526c740 10 client.15465 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:07:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.000+0000 7f6d0526c740 10 client.15465 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-20T17:07:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.000+0000 7f6d0526c740 20 client.15465 populate_metadata read hostname 'smithi006' 2024-05-20T17:07:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.000+0000 7f6d0526c740 1 --2- 172.21.15.6:0/1531123448 >> [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] conn(0x56337d8c7e40 0x56337dcc1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.000+0000 7f6d0526c740 4 client.15465 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:07:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.000+0000 7f6d0526c740 1 -- 172.21.15.6:0/1531123448 --> [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56337dc1ac00 con 0x56337d8c7e40 2024-05-20T17:07:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.000+0000 7f6cf7fff640 1 --2- 172.21.15.6:0/1531123448 >> [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] conn(0x56337d8c7e40 0x56337dcc1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.000+0000 7f6cd77fe640 10 client.15465 ms_handle_connect on v2:172.21.15.62:6834/78063155 2024-05-20T17:07:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.000+0000 7f6cf7fff640 1 --2- 172.21.15.6:0/1531123448 >> [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] conn(0x56337d8c7e40 0x56337dcc1170 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=78dd87d3cc8c8381 server_cookie=861f6a9cd8a53bdb in_seq=0 out_seq=0 2024-05-20T17:07:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.001+0000 7f6cd77fe640 1 -- 172.21.15.6:0/1531123448 <== mds.3 v2:172.21.15.62:6834/78063155 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56337dc1ac00 con 0x56337d8c7e40 2024-05-20T17:07:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.001+0000 7f6cd77fe640 10 client.15465 handle_command_reply: tid=0 2024-05-20T17:07:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.001+0000 7f6d0526c740 1 client.15465 shutdown 2024-05-20T17:07:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.001+0000 7f6d0526c740 1 -- 172.21.15.6:0/1531123448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d909270 msgr2=0x56337dcba730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.001+0000 7f6d0526c740 1 --2- 172.21.15.6:0/1531123448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d909270 0x56337dcba730 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6cec005f50 tx=0x7f6cec02a410 comp rx=0 tx=0).stop 2024-05-20T17:07:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.001+0000 7f6d0526c740 1 -- 172.21.15.6:0/1531123448 shutdown_connections 2024-05-20T17:07:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.001+0000 7f6d0526c740 1 --2- 172.21.15.6:0/1531123448 >> [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] conn(0x56337d8c7e40 0x56337dcc1170 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.001+0000 7f6d0526c740 1 --2- 172.21.15.6:0/1531123448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d909270 0x56337dcba730 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.001+0000 7f6d0526c740 1 --2- 172.21.15.6:0/1531123448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 0x56337dcb37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.001+0000 7f6d0526c740 1 --2- 172.21.15.6:0/1531123448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56337d8e03b0 0x56337dcb3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.001+0000 7f6cd77fe640 0 client.15465 ms_handle_reset on v2:172.21.15.62:6834/78063155 2024-05-20T17:07:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.001+0000 7f6d0526c740 1 -- 172.21.15.6:0/1531123448 >> 172.21.15.6:0/1531123448 conn(0x56337d8fd3c0 msgr2=0x56337dca3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.002+0000 7f6d0526c740 1 -- 172.21.15.6:0/1531123448 shutdown_connections 2024-05-20T17:07:30.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.002+0000 7f6d0526c740 1 -- 172.21.15.6:0/1531123448 wait complete. 2024-05-20T17:07:30.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.002+0000 7f6d0526c740 20 client.15465 trim_cache size 0 max 16384 2024-05-20T17:07:30.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.020+0000 7f6d0526c740 1 Processor -- start 2024-05-20T17:07:30.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.020+0000 7f6d0526c740 1 -- start start 2024-05-20T17:07:30.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.020+0000 7f6d0526c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56337d8e03b0 0x56337dcb2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.020+0000 7f6d0526c740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 0x56337dcba650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.020+0000 7f6d0526c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d909270 0x56337dcb33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.020+0000 7f6d0526c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56337dcbf4b0 con 0x56337d909270 2024-05-20T17:07:30.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.020+0000 7f6d0526c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56337dcbfb80 con 0x56337d8e03b0 2024-05-20T17:07:30.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.020+0000 7f6d0526c740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56337dcc0250 con 0x56337d8e8590 2024-05-20T17:07:30.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.021+0000 7f6cf77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d909270 0x56337dcb33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.021+0000 7f6cf77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d909270 0x56337dcb33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56156/0 (socket says 172.21.15.6:56156) 2024-05-20T17:07:30.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.021+0000 7f6cf77fe640 1 -- 172.21.15.6:0/3581864632 learned_addr learned my addr 172.21.15.6:0/3581864632 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:30.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.021+0000 7f6cf77fe640 1 --2- 172.21.15.6:0/3581864632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56337d8e03b0 0x56337dcb2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.021+0000 7f6cf7fff640 1 --2- 172.21.15.6:0/3581864632 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 0x56337dcba650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.021+0000 7f6cf77fe640 1 -- 172.21.15.6:0/3581864632 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 msgr2=0x56337dcba650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.021+0000 7f6cf77fe640 1 --2- 172.21.15.6:0/3581864632 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 0x56337dcba650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.021+0000 7f6cf77fe640 1 -- 172.21.15.6:0/3581864632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56337d8e03b0 msgr2=0x56337dcb2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.021+0000 7f6cf77fe640 1 --2- 172.21.15.6:0/3581864632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56337d8e03b0 0x56337dcb2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.021+0000 7f6cf77fe640 1 -- 172.21.15.6:0/3581864632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56337dcb0a30 con 0x56337d909270 2024-05-20T17:07:30.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.021+0000 7f6cf77fe640 1 --2- 172.21.15.6:0/3581864632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d909270 0x56337dcb33a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6cec03c4b0 tx=0x7f6cec001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424f33b8325d65cd server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.021+0000 7f6cddffb640 1 -- 172.21.15.6:0/3581864632 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec035040 con 0x56337d909270 2024-05-20T17:07:30.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.021+0000 7f6cddffb640 1 -- 172.21.15.6:0/3581864632 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6cec043070 con 0x56337d909270 2024-05-20T17:07:30.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.021+0000 7f6cddffb640 1 -- 172.21.15.6:0/3581864632 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec0486d0 con 0x56337d909270 2024-05-20T17:07:30.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.022+0000 7f6d0526c740 1 -- 172.21.15.6:0/3581864632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d909270 msgr2=0x56337dcb33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.022+0000 7f6d0526c740 1 --2- 172.21.15.6:0/3581864632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d909270 0x56337dcb33a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6cec03c4b0 tx=0x7f6cec001e70 comp rx=0 tx=0).stop 2024-05-20T17:07:30.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.022+0000 7f6d0526c740 1 -- 172.21.15.6:0/3581864632 shutdown_connections 2024-05-20T17:07:30.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.022+0000 7f6d0526c740 1 --2- 172.21.15.6:0/3581864632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d909270 0x56337dcb33a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.022+0000 7f6d0526c740 1 --2- 172.21.15.6:0/3581864632 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 0x56337dcba650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.022+0000 7f6d0526c740 1 --2- 172.21.15.6:0/3581864632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56337d8e03b0 0x56337dcb2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.022+0000 7f6d0526c740 1 -- 172.21.15.6:0/3581864632 >> 172.21.15.6:0/3581864632 conn(0x56337d8fd3c0 msgr2=0x56337dcad650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.022+0000 7f6d0526c740 1 -- 172.21.15.6:0/3581864632 shutdown_connections 2024-05-20T17:07:30.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.022+0000 7f6d0526c740 1 -- 172.21.15.6:0/3581864632 wait complete. 2024-05-20T17:07:30.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.022+0000 7f6d0526c740 1 -- start start 2024-05-20T17:07:30.026 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:29 smithi062 ceph-mon[35425]: pgmap v377: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:07:30.026 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:29 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/4134994225' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:07:30.027 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:29 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/960186784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:07:30.027 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:29 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2374734220' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:07:30.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.023+0000 7f6d0526c740 1 Processor -- start 2024-05-20T17:07:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.023+0000 7f6d0526c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d8e03b0 0x56337dcb5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.023+0000 7f6d0526c740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 0x56337dcb6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.023+0000 7f6d0526c740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56337d909270 0x56337dcb9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.023+0000 7f6d0526c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56337dcc0ff0 con 0x56337d8e03b0 2024-05-20T17:07:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.023+0000 7f6d0526c740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56337dcc0920 con 0x56337d909270 2024-05-20T17:07:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.023+0000 7f6d0526c740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56337dcc16c0 con 0x56337d8e8590 2024-05-20T17:07:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.023+0000 7f6d0526c740 10 client.0 _ll_register_callbacks cb 0x7f6ce8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:07:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.023+0000 7f6cf77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d8e03b0 0x56337dcb5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.023+0000 7f6cf77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d8e03b0 0x56337dcb5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56166/0 (socket says 172.21.15.6:56166) 2024-05-20T17:07:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.023+0000 7f6cf77fe640 1 -- 172.21.15.6:0/2741287670 learned_addr learned my addr 172.21.15.6:0/2741287670 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.023+0000 7f6cf7fff640 1 --2- 172.21.15.6:0/2741287670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 0x56337dcb6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.023+0000 7f6cf77fe640 1 -- 172.21.15.6:0/2741287670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 msgr2=0x56337dcb6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.023+0000 7f6cf77fe640 1 --2- 172.21.15.6:0/2741287670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 0x56337dcb6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.023+0000 7f6cf77fe640 1 -- 172.21.15.6:0/2741287670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56337d909270 msgr2=0x56337dcb9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.023+0000 7f6cf77fe640 1 --2- 172.21.15.6:0/2741287670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56337d909270 0x56337dcb9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.023+0000 7f6cf77fe640 1 -- 172.21.15.6:0/2741287670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56337dcb9950 con 0x56337d8e03b0 2024-05-20T17:07:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.023+0000 7f6cf7fff640 1 --2- 172.21.15.6:0/2741287670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 0x56337dcb6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.024+0000 7f6cf77fe640 1 --2- 172.21.15.6:0/2741287670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d8e03b0 0x56337dcb5f10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6cec031ac0 tx=0x7f6cec0095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ccba2cc872d9dc server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.024+0000 7f6cd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:07:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.024+0000 7f6cd77fe640 1 -- 172.21.15.6:0/2741287670 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec035070 con 0x56337d8e03b0 2024-05-20T17:07:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.024+0000 7f6cd77fe640 1 -- 172.21.15.6:0/2741287670 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f6cec048670 con 0x56337d8e03b0 2024-05-20T17:07:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.024+0000 7f6d0526c740 1 -- 172.21.15.6:0/2741287670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cec043070 con 0x56337d8e03b0 2024-05-20T17:07:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.024+0000 7f6cd77fe640 1 -- 172.21.15.6:0/2741287670 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6cec048870 con 0x56337d8e03b0 2024-05-20T17:07:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.024+0000 7f6d0526c740 10 client.15471 fetch_fsmap learned FSMap version 28 2024-05-20T17:07:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.024+0000 7f6d0526c740 1 -- 172.21.15.6:0/2741287670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56337dd29ff0 con 0x56337d8e03b0 2024-05-20T17:07:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.024+0000 7f6cd77fe640 1 -- 172.21.15.6:0/2741287670 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6cec043070 con 0x56337d8e03b0 2024-05-20T17:07:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.024+0000 7f6cd77fe640 1 -- 172.21.15.6:0/2741287670 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6cec03a040 con 0x56337d8e03b0 2024-05-20T17:07:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.024+0000 7f6d0526c740 10 client.15471 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:07:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.024+0000 7f6d0526c740 10 client.15471 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-20T17:07:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.024+0000 7f6d0526c740 20 client.15471 populate_metadata read hostname 'smithi006' 2024-05-20T17:07:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.024+0000 7f6d0526c740 1 --2- 172.21.15.6:0/2741287670 >> [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] conn(0x56337d89d280 0x56337dd2b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.024+0000 7f6d0526c740 4 client.15471 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:07:30.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.024+0000 7f6d0526c740 1 -- 172.21.15.6:0/2741287670 --> [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] -- command(tid 0: {"prefix": "status"}) -- 0x56337dc14f50 con 0x56337d89d280 2024-05-20T17:07:30.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.025+0000 7f6cf7fff640 1 --2- 172.21.15.6:0/2741287670 >> [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] conn(0x56337d89d280 0x56337dd2b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.025+0000 7f6cd77fe640 10 client.15471 ms_handle_connect on v2:172.21.15.62:6834/78063155 2024-05-20T17:07:30.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.025+0000 7f6cf7fff640 1 --2- 172.21.15.6:0/2741287670 >> [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] conn(0x56337d89d280 0x56337dd2b180 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=770c72a94847a3db server_cookie=69fce79d8da240fd in_seq=0 out_seq=0 2024-05-20T17:07:30.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.025+0000 7f6cd77fe640 1 -- 172.21.15.6:0/2741287670 <== mds.3 v2:172.21.15.62:6834/78063155 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56337dc14f50 con 0x56337d89d280 2024-05-20T17:07:30.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.025+0000 7f6cd77fe640 10 client.15471 handle_command_reply: tid=0 2024-05-20T17:07:30.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.025+0000 7f6d0526c740 1 client.15471 shutdown 2024-05-20T17:07:30.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6d0526c740 1 -- 172.21.15.6:0/2741287670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d8e03b0 msgr2=0x56337dcb5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6d0526c740 1 --2- 172.21.15.6:0/2741287670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d8e03b0 0x56337dcb5f10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6cec031ac0 tx=0x7f6cec0095e0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6d0526c740 1 -- 172.21.15.6:0/2741287670 shutdown_connections 2024-05-20T17:07:30.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6d0526c740 1 --2- 172.21.15.6:0/2741287670 >> [v2:172.21.15.62:6834/78063155,v1:172.21.15.62:6835/78063155] conn(0x56337d89d280 0x56337dd2b180 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6d0526c740 1 --2- 172.21.15.6:0/2741287670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56337d909270 0x56337dcb9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6cd77fe640 0 client.15471 ms_handle_reset on v2:172.21.15.62:6834/78063155 2024-05-20T17:07:30.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6d0526c740 1 --2- 172.21.15.6:0/2741287670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56337d8e8590 0x56337dcb6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6d0526c740 1 --2- 172.21.15.6:0/2741287670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56337d8e03b0 0x56337dcb5f10 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6d0526c740 1 -- 172.21.15.6:0/2741287670 >> 172.21.15.6:0/2741287670 conn(0x56337d8fd3c0 msgr2=0x56337dcb2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6d0526c740 1 -- 172.21.15.6:0/2741287670 shutdown_connections 2024-05-20T17:07:30.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6d0526c740 1 -- 172.21.15.6:0/2741287670 wait complete. 2024-05-20T17:07:30.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6d0526c740 20 client.15471 trim_cache size 0 max 16384 2024-05-20T17:07:30.036 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:07:30.036 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c726c954-16c9-11ef-bc9a-c7b262605968", 2024-05-20T17:07:30.036 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 3, 2024-05-20T17:07:30.036 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24470, 2024-05-20T17:07:30.036 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T17:07:30.036 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T17:07:30.036 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T17:07:30.036 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 116.451757871, 2024-05-20T17:07:30.036 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 28, 2024-05-20T17:07:30.037 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 94, 2024-05-20T17:07:30.037 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 90, 2024-05-20T17:07:30.037 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 171.39805432200001 2024-05-20T17:07:30.037 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:07:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6cfe3c3640 1 -- 172.21.15.6:0/2070706660 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6ce00a2b90 msgr2=0x7f6ce00a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6cfe3c3640 1 --2- 172.21.15.6:0/2070706660 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6ce00a2b90 0x7f6ce00a50a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00ccd40 tx=0x7f6cf001eb40 comp rx=0 tx=0).stop 2024-05-20T17:07:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6cfe3c3640 1 -- 172.21.15.6:0/2070706660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cf8103410 msgr2=0x7f6cf81a06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6cfe3c3640 1 --2- 172.21.15.6:0/2070706660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cf8103410 0x7f6cf81a06a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000eaa0 tx=0x7f6cf000ef60 comp rx=0 tx=0).stop 2024-05-20T17:07:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6cfe3c3640 1 -- 172.21.15.6:0/2070706660 shutdown_connections 2024-05-20T17:07:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6cfe3c3640 1 --2- 172.21.15.6:0/2070706660 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6ce00a2b90 0x7f6ce00a50a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6cfe3c3640 1 --2- 172.21.15.6:0/2070706660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cf8103410 0x7f6cf81a06a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6cfe3c3640 1 --2- 172.21.15.6:0/2070706660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cf8102910 0x7f6cf8199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6cfe3c3640 1 --2- 172.21.15.6:0/2070706660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cf8101f30 0x7f6cf8199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.026+0000 7f6cfe3c3640 1 -- 172.21.15.6:0/2070706660 >> 172.21.15.6:0/2070706660 conn(0x7f6cf80fc330 msgr2=0x7f6cf8108d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.027+0000 7f6cfe3c3640 1 -- 172.21.15.6:0/2070706660 shutdown_connections 2024-05-20T17:07:30.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.027+0000 7f6cfe3c3640 1 -- 172.21.15.6:0/2070706660 wait complete. 2024-05-20T17:07:30.039 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:29 smithi006 ceph-mon[32486]: pgmap v377: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:07:30.039 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:29 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/4134994225' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:07:30.039 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:29 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/960186784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:07:30.039 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:29 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2374734220' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:07:30.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-05-20T17:07:30.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:29 smithi171 ceph-mon[35901]: pgmap v377: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:07:30.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:29 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/4134994225' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:07:30.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:29 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/960186784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:07:30.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:29 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2374734220' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:07:30.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.156+0000 7f6471873640 1 -- 172.21.15.6:0/2578973411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646c103d20 msgr2=0x7f646c104130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.156+0000 7f6471873640 1 --2- 172.21.15.6:0/2578973411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646c103d20 0x7f646c104130 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6454009900 tx=0x7f645402a410 comp rx=0 tx=0).stop 2024-05-20T17:07:30.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.156+0000 7f6471873640 1 -- 172.21.15.6:0/2578973411 shutdown_connections 2024-05-20T17:07:30.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.156+0000 7f6471873640 1 --2- 172.21.15.6:0/2578973411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f646c108a20 0x7f646c10ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.156+0000 7f6471873640 1 --2- 172.21.15.6:0/2578973411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646c103d20 0x7f646c104130 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.156+0000 7f6471873640 1 --2- 172.21.15.6:0/2578973411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f646c102ae0 0x7f646c1037e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.156+0000 7f6471873640 1 -- 172.21.15.6:0/2578973411 >> 172.21.15.6:0/2578973411 conn(0x7f646c0fdcf0 msgr2=0x7f646c100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.156+0000 7f6471873640 1 -- 172.21.15.6:0/2578973411 shutdown_connections 2024-05-20T17:07:30.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.156+0000 7f6471873640 1 -- 172.21.15.6:0/2578973411 wait complete. 2024-05-20T17:07:30.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.157+0000 7f6471873640 1 Processor -- start 2024-05-20T17:07:30.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.157+0000 7f6471873640 1 -- start start 2024-05-20T17:07:30.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.157+0000 7f6471873640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646c102ae0 0x7f646c076910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.157+0000 7f6471873640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f646c103d20 0x7f646c074fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.157+0000 7f6471873640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f646c108a20 0x7f646c0754f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.157+0000 7f6471873640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f646c10e610 con 0x7f646c102ae0 2024-05-20T17:07:30.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.157+0000 7f6471873640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f646c10e490 con 0x7f646c103d20 2024-05-20T17:07:30.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.157+0000 7f6471873640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f646c10e790 con 0x7f646c108a20 2024-05-20T17:07:30.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.157+0000 7f646affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646c102ae0 0x7f646c076910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.157+0000 7f646affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646c102ae0 0x7f646c076910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56190/0 (socket says 172.21.15.6:56190) 2024-05-20T17:07:30.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.157+0000 7f646affd640 1 -- 172.21.15.6:0/1850790739 learned_addr learned my addr 172.21.15.6:0/1850790739 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:30.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.158+0000 7f6463fff640 1 --2- 172.21.15.6:0/1850790739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f646c103d20 0x7f646c074fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.158+0000 7f646b7fe640 1 --2- 172.21.15.6:0/1850790739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f646c108a20 0x7f646c0754f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.158+0000 7f646affd640 1 -- 172.21.15.6:0/1850790739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f646c108a20 msgr2=0x7f646c0754f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.158+0000 7f646affd640 1 --2- 172.21.15.6:0/1850790739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f646c108a20 0x7f646c0754f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.158+0000 7f646affd640 1 -- 172.21.15.6:0/1850790739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f646c103d20 msgr2=0x7f646c074fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.158+0000 7f646affd640 1 --2- 172.21.15.6:0/1850790739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f646c103d20 0x7f646c074fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.158+0000 7f646affd640 1 -- 172.21.15.6:0/1850790739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646c075b90 con 0x7f646c102ae0 2024-05-20T17:07:30.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.158+0000 7f646b7fe640 1 --2- 172.21.15.6:0/1850790739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f646c108a20 0x7f646c0754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:07:30.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.158+0000 7f646affd640 1 --2- 172.21.15.6:0/1850790739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646c102ae0 0x7f646c076910 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f645c00c970 tx=0x7f645c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.158+0000 7f6470871640 1 -- 172.21.15.6:0/1850790739 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c007c70 con 0x7f646c102ae0 2024-05-20T17:07:30.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.158+0000 7f6470871640 1 -- 172.21.15.6:0/1850790739 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f645c007e10 con 0x7f646c102ae0 2024-05-20T17:07:30.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.158+0000 7f6471873640 1 -- 172.21.15.6:0/1850790739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f646c1a3260 con 0x7f646c102ae0 2024-05-20T17:07:30.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.158+0000 7f6470871640 1 -- 172.21.15.6:0/1850790739 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c0187b0 con 0x7f646c102ae0 2024-05-20T17:07:30.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.158+0000 7f6471873640 1 -- 172.21.15.6:0/1850790739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f646c1a3670 con 0x7f646c102ae0 2024-05-20T17:07:30.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.161+0000 7f64787f8740 1 Processor -- start 2024-05-20T17:07:30.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.161+0000 7f6470871640 1 -- 172.21.15.6:0/1850790739 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f645c00f450 con 0x7f646c102ae0 2024-05-20T17:07:30.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.161+0000 7f64787f8740 1 -- start start 2024-05-20T17:07:30.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.161+0000 7f64787f8740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da48270 0x561c3dde8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.161+0000 7f64787f8740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da1f3b0 0x561c3dde89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.161+0000 7f64787f8740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da27590 0x561c3ddef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.161+0000 7f64787f8740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561c3dd4c4d0 con 0x561c3da1f3b0 2024-05-20T17:07:30.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.161+0000 7f64787f8740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561c3dcf43e0 con 0x561c3da48270 2024-05-20T17:07:30.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.161+0000 7f64787f8740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561c3dd48490 con 0x561c3da27590 2024-05-20T17:07:30.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.161+0000 7f646affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da1f3b0 0x561c3dde89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.161+0000 7f646affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da1f3b0 0x561c3dde89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56204/0 (socket says 172.21.15.6:56204) 2024-05-20T17:07:30.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.161+0000 7f646affd640 1 -- 172.21.15.6:0/4049393402 learned_addr learned my addr 172.21.15.6:0/4049393402 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:30.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.161+0000 7f6463fff640 1 --2- 172.21.15.6:0/4049393402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da27590 0x561c3ddef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.161+0000 7f646b7fe640 1 --2- 172.21.15.6:0/4049393402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da48270 0x561c3dde8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.161+0000 7f646affd640 1 -- 172.21.15.6:0/4049393402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da27590 msgr2=0x561c3ddef8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.161+0000 7f646affd640 1 --2- 172.21.15.6:0/4049393402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da27590 0x561c3ddef8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.161+0000 7f646affd640 1 -- 172.21.15.6:0/4049393402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da48270 msgr2=0x561c3dde8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.161+0000 7f646affd640 1 --2- 172.21.15.6:0/4049393402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da48270 0x561c3dde8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.161+0000 7f646affd640 1 -- 172.21.15.6:0/4049393402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c3da602d0 con 0x561c3da1f3b0 2024-05-20T17:07:30.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.162+0000 7f646b7fe640 1 --2- 172.21.15.6:0/4049393402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da48270 0x561c3dde8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:07:30.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.162+0000 7f6470871640 1 --2- 172.21.15.6:0/1850790739 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f64580a2b90 0x7f64580a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.162+0000 7f646affd640 1 --2- 172.21.15.6:0/4049393402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da1f3b0 0x561c3dde89f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f645c0d55c0 tx=0x7f645c0d5a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42424e0d1553622 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.162+0000 7f646b7fe640 1 --2- 172.21.15.6:0/1850790739 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f64580a2b90 0x7f64580a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.162+0000 7f6470871640 1 -- 172.21.15.6:0/1850790739 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f645c0cf450 con 0x7f646c102ae0 2024-05-20T17:07:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.162+0000 7f6461ffb640 1 -- 172.21.15.6:0/4049393402 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c097ba0 con 0x561c3da1f3b0 2024-05-20T17:07:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.162+0000 7f6461ffb640 1 -- 172.21.15.6:0/4049393402 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f645c09c000 con 0x561c3da1f3b0 2024-05-20T17:07:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.162+0000 7f6461ffb640 1 -- 172.21.15.6:0/4049393402 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c09b260 con 0x561c3da1f3b0 2024-05-20T17:07:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.163+0000 7f64787f8740 1 -- 172.21.15.6:0/4049393402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da1f3b0 msgr2=0x561c3dde89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.163+0000 7f64787f8740 1 --2- 172.21.15.6:0/4049393402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da1f3b0 0x561c3dde89f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f645c0d55c0 tx=0x7f645c0d5a80 comp rx=0 tx=0).stop 2024-05-20T17:07:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.163+0000 7f646b7fe640 1 --2- 172.21.15.6:0/1850790739 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f64580a2b90 0x7f64580a50a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x561c3dde9640 tx=0x7f6464009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.163+0000 7f64787f8740 1 -- 172.21.15.6:0/4049393402 shutdown_connections 2024-05-20T17:07:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.163+0000 7f64787f8740 1 --2- 172.21.15.6:0/4049393402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da27590 0x561c3ddef8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.163+0000 7f64787f8740 1 --2- 172.21.15.6:0/4049393402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da1f3b0 0x561c3dde89f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.163+0000 7f64787f8740 1 --2- 172.21.15.6:0/4049393402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da48270 0x561c3dde8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.163+0000 7f64787f8740 1 -- 172.21.15.6:0/4049393402 >> 172.21.15.6:0/4049393402 conn(0x561c3da3c3c0 msgr2=0x561c3dde3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.163+0000 7f64787f8740 1 -- 172.21.15.6:0/4049393402 shutdown_connections 2024-05-20T17:07:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.163+0000 7f64787f8740 1 -- 172.21.15.6:0/4049393402 wait complete. 2024-05-20T17:07:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.163+0000 7f64787f8740 1 -- start start 2024-05-20T17:07:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.163+0000 7f64787f8740 1 Processor -- start 2024-05-20T17:07:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.164+0000 7f64787f8740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da1f3b0 0x561c3ddf2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.164+0000 7f64787f8740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da27590 0x561c3ddf27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.164+0000 7f64787f8740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da48270 0x561c3ddf9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.164+0000 7f64787f8740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561c3ddf0340 con 0x561c3da27590 2024-05-20T17:07:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.164+0000 7f64787f8740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561c3dd078e0 con 0x561c3da48270 2024-05-20T17:07:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.164+0000 7f64787f8740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561c3ddf04c0 con 0x561c3da1f3b0 2024-05-20T17:07:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.164+0000 7f64787f8740 10 client.0 _ll_register_callbacks cb 0x561c3dcd49c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:07:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.164+0000 7f6463fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da27590 0x561c3ddf27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.164+0000 7f6463fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da27590 0x561c3ddf27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56214/0 (socket says 172.21.15.6:56214) 2024-05-20T17:07:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.164+0000 7f6463fff640 1 -- 172.21.15.6:0/2411552310 learned_addr learned my addr 172.21.15.6:0/2411552310 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.164+0000 7f646affd640 1 --2- 172.21.15.6:0/2411552310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da1f3b0 0x561c3ddf2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.164+0000 7f646b7fe640 1 --2- 172.21.15.6:0/2411552310 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da48270 0x561c3ddf9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.164+0000 7f6463fff640 1 -- 172.21.15.6:0/2411552310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da1f3b0 msgr2=0x561c3ddf2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.164+0000 7f6463fff640 1 --2- 172.21.15.6:0/2411552310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da1f3b0 0x561c3ddf2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.164+0000 7f6463fff640 1 -- 172.21.15.6:0/2411552310 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da48270 msgr2=0x561c3ddf9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.164+0000 7f6463fff640 1 --2- 172.21.15.6:0/2411552310 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da48270 0x561c3ddf9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.164+0000 7f6463fff640 1 -- 172.21.15.6:0/2411552310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c3db2a6b0 con 0x561c3da27590 2024-05-20T17:07:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.164+0000 7f646affd640 1 --2- 172.21.15.6:0/2411552310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da1f3b0 0x561c3ddf2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.164+0000 7f646b7fe640 1 --2- 172.21.15.6:0/2411552310 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da48270 0x561c3ddf9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.165+0000 7f6463fff640 1 --2- 172.21.15.6:0/2411552310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da27590 0x561c3ddf27d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f645402a930 tx=0x7f6454031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f5e3b27698824d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.165+0000 7f644affd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:07:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.165+0000 7f644affd640 1 -- 172.21.15.6:0/2411552310 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454035070 con 0x561c3da27590 2024-05-20T17:07:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.165+0000 7f644affd640 1 -- 172.21.15.6:0/2411552310 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f6454004040 con 0x561c3da27590 2024-05-20T17:07:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.165+0000 7f64787f8740 1 -- 172.21.15.6:0/2411552310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f645c09c000 con 0x561c3da27590 2024-05-20T17:07:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.165+0000 7f644affd640 1 -- 172.21.15.6:0/2411552310 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f645404e050 con 0x561c3da27590 2024-05-20T17:07:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.165+0000 7f64787f8740 10 client.15483 fetch_fsmap learned FSMap version 28 2024-05-20T17:07:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.165+0000 7f64787f8740 1 -- 172.21.15.6:0/2411552310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561c3ddfc640 con 0x561c3da27590 2024-05-20T17:07:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.165+0000 7f644affd640 1 -- 172.21.15.6:0/2411552310 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f645c09c000 con 0x561c3da27590 2024-05-20T17:07:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.165+0000 7f644affd640 1 -- 172.21.15.6:0/2411552310 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6454043020 con 0x561c3da27590 2024-05-20T17:07:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.165+0000 7f64787f8740 10 client.15483 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:07:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.165+0000 7f64787f8740 10 client.15483 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-20T17:07:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.165+0000 7f64787f8740 20 client.15483 populate_metadata read hostname 'smithi006' 2024-05-20T17:07:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.165+0000 7f64787f8740 1 --2- 172.21.15.6:0/2411552310 >> [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] conn(0x561c3da06e40 0x561c3de00130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.165+0000 7f64787f8740 4 client.15483 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:07:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.165+0000 7f64787f8740 1 -- 172.21.15.6:0/2411552310 --> [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c3dd59c00 con 0x561c3da06e40 2024-05-20T17:07:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.166+0000 7f646affd640 1 --2- 172.21.15.6:0/2411552310 >> [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] conn(0x561c3da06e40 0x561c3de00130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.166+0000 7f646affd640 1 --2- 172.21.15.6:0/2411552310 >> [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] conn(0x561c3da06e40 0x561c3de00130 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=69c6c05d47e4e6a0 server_cookie=53a698296e0694e6 in_seq=0 out_seq=0 2024-05-20T17:07:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.166+0000 7f644affd640 10 client.15483 ms_handle_connect on v2:172.21.15.171:6834/1542537621 2024-05-20T17:07:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.167+0000 7f644affd640 1 -- 172.21.15.6:0/2411552310 <== mds.2 v2:172.21.15.171:6834/1542537621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561c3dd59c00 con 0x561c3da06e40 2024-05-20T17:07:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.167+0000 7f644affd640 10 client.15483 handle_command_reply: tid=0 2024-05-20T17:07:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.167+0000 7f64787f8740 1 client.15483 shutdown 2024-05-20T17:07:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.167+0000 7f64787f8740 1 -- 172.21.15.6:0/2411552310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da27590 msgr2=0x561c3ddf27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.167+0000 7f64787f8740 1 --2- 172.21.15.6:0/2411552310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da27590 0x561c3ddf27d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f645402a930 tx=0x7f6454031e60 comp rx=0 tx=0).stop 2024-05-20T17:07:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.167+0000 7f64787f8740 1 -- 172.21.15.6:0/2411552310 shutdown_connections 2024-05-20T17:07:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.167+0000 7f64787f8740 1 --2- 172.21.15.6:0/2411552310 >> [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] conn(0x561c3da06e40 0x561c3de00130 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.167+0000 7f64787f8740 1 --2- 172.21.15.6:0/2411552310 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da48270 0x561c3ddf9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.167+0000 7f64787f8740 1 --2- 172.21.15.6:0/2411552310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da27590 0x561c3ddf27d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.167+0000 7f644affd640 0 client.15483 ms_handle_reset on v2:172.21.15.171:6834/1542537621 2024-05-20T17:07:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.167+0000 7f64787f8740 1 --2- 172.21.15.6:0/2411552310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da1f3b0 0x561c3ddf2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.167+0000 7f64787f8740 1 -- 172.21.15.6:0/2411552310 >> 172.21.15.6:0/2411552310 conn(0x561c3da3c3c0 msgr2=0x561c3dde2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.167+0000 7f64787f8740 1 -- 172.21.15.6:0/2411552310 shutdown_connections 2024-05-20T17:07:30.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.167+0000 7f64787f8740 1 -- 172.21.15.6:0/2411552310 wait complete. 2024-05-20T17:07:30.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.168+0000 7f64787f8740 20 client.15483 trim_cache size 0 max 16384 2024-05-20T17:07:30.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.186+0000 7f64787f8740 1 Processor -- start 2024-05-20T17:07:30.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.186+0000 7f64787f8740 1 -- start start 2024-05-20T17:07:30.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.186+0000 7f64787f8740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da1f3b0 0x561c3ddec690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.186+0000 7f64787f8740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da27590 0x561c3ddf9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.186+0000 7f64787f8740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da48270 0x561c3ddecbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.186+0000 7f64787f8740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561c3ddfe470 con 0x561c3da48270 2024-05-20T17:07:30.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.186+0000 7f64787f8740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561c3ddfeb40 con 0x561c3da27590 2024-05-20T17:07:30.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.186+0000 7f64787f8740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561c3ddff210 con 0x561c3da1f3b0 2024-05-20T17:07:30.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.186+0000 7f646b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da48270 0x561c3ddecbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.186+0000 7f646b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da48270 0x561c3ddecbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56216/0 (socket says 172.21.15.6:56216) 2024-05-20T17:07:30.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.186+0000 7f646b7fe640 1 -- 172.21.15.6:0/3168254339 learned_addr learned my addr 172.21.15.6:0/3168254339 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:30.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.187+0000 7f646affd640 1 --2- 172.21.15.6:0/3168254339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da1f3b0 0x561c3ddec690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.187+0000 7f6463fff640 1 --2- 172.21.15.6:0/3168254339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da27590 0x561c3ddf9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.187+0000 7f646b7fe640 1 -- 172.21.15.6:0/3168254339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da1f3b0 msgr2=0x561c3ddec690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.187+0000 7f646b7fe640 1 --2- 172.21.15.6:0/3168254339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da1f3b0 0x561c3ddec690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.187+0000 7f646b7fe640 1 -- 172.21.15.6:0/3168254339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da27590 msgr2=0x561c3ddf9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.187+0000 7f646b7fe640 1 --2- 172.21.15.6:0/3168254339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da27590 0x561c3ddf9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.187+0000 7f646b7fe640 1 -- 172.21.15.6:0/3168254339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c3ddf2040 con 0x561c3da48270 2024-05-20T17:07:30.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.187+0000 7f6463fff640 1 --2- 172.21.15.6:0/3168254339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da27590 0x561c3ddf9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:30.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.187+0000 7f646b7fe640 1 --2- 172.21.15.6:0/3168254339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da48270 0x561c3ddecbd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f64640128a0 tx=0x7f6464013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6ccf7b11a3bd90 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.187+0000 7f64617fa640 1 -- 172.21.15.6:0/3168254339 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6464003b70 con 0x561c3da48270 2024-05-20T17:07:30.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.187+0000 7f64617fa640 1 -- 172.21.15.6:0/3168254339 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6464011e10 con 0x561c3da48270 2024-05-20T17:07:30.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.187+0000 7f64617fa640 1 -- 172.21.15.6:0/3168254339 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64640046f0 con 0x561c3da48270 2024-05-20T17:07:30.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.188+0000 7f64787f8740 1 -- 172.21.15.6:0/3168254339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da48270 msgr2=0x561c3ddecbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.188+0000 7f64787f8740 1 --2- 172.21.15.6:0/3168254339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da48270 0x561c3ddecbd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f64640128a0 tx=0x7f6464013000 comp rx=0 tx=0).stop 2024-05-20T17:07:30.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.188+0000 7f64787f8740 1 -- 172.21.15.6:0/3168254339 shutdown_connections 2024-05-20T17:07:30.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.188+0000 7f64787f8740 1 --2- 172.21.15.6:0/3168254339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da48270 0x561c3ddecbd0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.188+0000 7f64787f8740 1 --2- 172.21.15.6:0/3168254339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da27590 0x561c3ddf9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.188+0000 7f64787f8740 1 --2- 172.21.15.6:0/3168254339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da1f3b0 0x561c3ddec690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.188+0000 7f64787f8740 1 -- 172.21.15.6:0/3168254339 >> 172.21.15.6:0/3168254339 conn(0x561c3da3c3c0 msgr2=0x561c3ddf08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.188+0000 7f64787f8740 1 -- 172.21.15.6:0/3168254339 shutdown_connections 2024-05-20T17:07:30.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.188+0000 7f64787f8740 1 -- 172.21.15.6:0/3168254339 wait complete. 2024-05-20T17:07:30.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.188+0000 7f64787f8740 1 -- start start 2024-05-20T17:07:30.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.188+0000 7f64787f8740 1 Processor -- start 2024-05-20T17:07:30.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.189+0000 7f64787f8740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da1f3b0 0x561c3ddf46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.189+0000 7f64787f8740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da27590 0x561c3ddf4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.189+0000 7f64787f8740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da48270 0x561c3de66fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.189+0000 7f64787f8740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561c3ddfffb0 con 0x561c3da27590 2024-05-20T17:07:30.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.189+0000 7f64787f8740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561c3ddff8e0 con 0x561c3da48270 2024-05-20T17:07:30.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.189+0000 7f64787f8740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561c3de00680 con 0x561c3da1f3b0 2024-05-20T17:07:30.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.189+0000 7f64787f8740 10 client.0 _ll_register_callbacks cb 0x7f6454009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:07:30.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.189+0000 7f6463fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da27590 0x561c3ddf4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.189+0000 7f6463fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da27590 0x561c3ddf4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56230/0 (socket says 172.21.15.6:56230) 2024-05-20T17:07:30.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.189+0000 7f6463fff640 1 -- 172.21.15.6:0/2372317426 learned_addr learned my addr 172.21.15.6:0/2372317426 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:30.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.189+0000 7f646affd640 1 --2- 172.21.15.6:0/2372317426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da1f3b0 0x561c3ddf46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.189+0000 7f646b7fe640 1 --2- 172.21.15.6:0/2372317426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da48270 0x561c3de66fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.189+0000 7f6463fff640 1 -- 172.21.15.6:0/2372317426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da1f3b0 msgr2=0x561c3ddf46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.189+0000 7f6463fff640 1 --2- 172.21.15.6:0/2372317426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da1f3b0 0x561c3ddf46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.189+0000 7f6463fff640 1 -- 172.21.15.6:0/2372317426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da48270 msgr2=0x561c3de66fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.189+0000 7f6463fff640 1 --2- 172.21.15.6:0/2372317426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da48270 0x561c3de66fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.189+0000 7f6463fff640 1 -- 172.21.15.6:0/2372317426 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c3de67510 con 0x561c3da27590 2024-05-20T17:07:30.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.189+0000 7f6463fff640 1 --2- 172.21.15.6:0/2372317426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da27590 0x561c3ddf4c30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6454009850 tx=0x7f6454000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8339566845cc8435 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.189+0000 7f644affd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:07:30.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.190+0000 7f644affd640 1 -- 172.21.15.6:0/2372317426 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454035030 con 0x561c3da27590 2024-05-20T17:07:30.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.190+0000 7f644affd640 1 -- 172.21.15.6:0/2372317426 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f6454045c30 con 0x561c3da27590 2024-05-20T17:07:30.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.190+0000 7f64787f8740 1 -- 172.21.15.6:0/2372317426 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6464011e10 con 0x561c3da27590 2024-05-20T17:07:30.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.190+0000 7f644affd640 1 -- 172.21.15.6:0/2372317426 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6454054080 con 0x561c3da27590 2024-05-20T17:07:30.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.190+0000 7f64787f8740 10 client.15489 fetch_fsmap learned FSMap version 28 2024-05-20T17:07:30.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.190+0000 7f64787f8740 1 -- 172.21.15.6:0/2372317426 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561c3de687d0 con 0x561c3da27590 2024-05-20T17:07:30.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.190+0000 7f644affd640 1 -- 172.21.15.6:0/2372317426 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6464011e10 con 0x561c3da27590 2024-05-20T17:07:30.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.190+0000 7f644affd640 1 -- 172.21.15.6:0/2372317426 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6454043070 con 0x561c3da27590 2024-05-20T17:07:30.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.190+0000 7f64787f8740 10 client.15489 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:07:30.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.190+0000 7f64787f8740 10 client.15489 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-20T17:07:30.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.190+0000 7f64787f8740 20 client.15489 populate_metadata read hostname 'smithi006' 2024-05-20T17:07:30.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.190+0000 7f64787f8740 1 --2- 172.21.15.6:0/2372317426 >> [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] conn(0x561c3d9dc280 0x561c3de6c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.190+0000 7f64787f8740 4 client.15489 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:07:30.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.190+0000 7f64787f8740 1 -- 172.21.15.6:0/2372317426 --> [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] -- command(tid 0: {"prefix": "status"}) -- 0x561c3dd53f50 con 0x561c3d9dc280 2024-05-20T17:07:30.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.190+0000 7f646affd640 1 --2- 172.21.15.6:0/2372317426 >> [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] conn(0x561c3d9dc280 0x561c3de6c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.191+0000 7f644affd640 10 client.15489 ms_handle_connect on v2:172.21.15.171:6834/1542537621 2024-05-20T17:07:30.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.191+0000 7f646affd640 1 --2- 172.21.15.6:0/2372317426 >> [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] conn(0x561c3d9dc280 0x561c3de6c0f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a3d6e119d14fd31e server_cookie=ac44dd1c89103da2 in_seq=0 out_seq=0 2024-05-20T17:07:30.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.191+0000 7f644affd640 1 -- 172.21.15.6:0/2372317426 <== mds.2 v2:172.21.15.171:6834/1542537621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561c3dd53f50 con 0x561c3d9dc280 2024-05-20T17:07:30.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.191+0000 7f644affd640 10 client.15489 handle_command_reply: tid=0 2024-05-20T17:07:30.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.191+0000 7f64787f8740 1 client.15489 shutdown 2024-05-20T17:07:30.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.191+0000 7f64787f8740 1 -- 172.21.15.6:0/2372317426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da27590 msgr2=0x561c3ddf4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.191+0000 7f64787f8740 1 --2- 172.21.15.6:0/2372317426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da27590 0x561c3ddf4c30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6454009850 tx=0x7f6454000bc0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.191+0000 7f64787f8740 1 -- 172.21.15.6:0/2372317426 shutdown_connections 2024-05-20T17:07:30.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.191+0000 7f64787f8740 1 --2- 172.21.15.6:0/2372317426 >> [v2:172.21.15.171:6834/1542537621,v1:172.21.15.171:6835/1542537621] conn(0x561c3d9dc280 0x561c3de6c0f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.191+0000 7f64787f8740 1 --2- 172.21.15.6:0/2372317426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c3da48270 0x561c3de66fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.191+0000 7f64787f8740 1 --2- 172.21.15.6:0/2372317426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c3da27590 0x561c3ddf4c30 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.191+0000 7f64787f8740 1 --2- 172.21.15.6:0/2372317426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c3da1f3b0 0x561c3ddf46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.192+0000 7f64787f8740 1 -- 172.21.15.6:0/2372317426 >> 172.21.15.6:0/2372317426 conn(0x561c3da3c3c0 msgr2=0x561c3ddeb680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.191+0000 7f644affd640 0 client.15489 ms_handle_reset on v2:172.21.15.171:6834/1542537621 2024-05-20T17:07:30.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.192+0000 7f64787f8740 1 -- 172.21.15.6:0/2372317426 shutdown_connections 2024-05-20T17:07:30.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.192+0000 7f64787f8740 1 -- 172.21.15.6:0/2372317426 wait complete. 2024-05-20T17:07:30.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.192+0000 7f64787f8740 20 client.15489 trim_cache size 0 max 16384 2024-05-20T17:07:30.199 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:07:30.199 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c726c954-16c9-11ef-bc9a-c7b262605968", 2024-05-20T17:07:30.200 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 2, 2024-05-20T17:07:30.200 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24484, 2024-05-20T17:07:30.200 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T17:07:30.200 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T17:07:30.200 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T17:07:30.200 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 117.624397358, 2024-05-20T17:07:30.200 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 28, 2024-05-20T17:07:30.200 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 94, 2024-05-20T17:07:30.200 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 90, 2024-05-20T17:07:30.200 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 168.71614537900001 2024-05-20T17:07:30.200 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:07:30.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.192+0000 7f6471873640 1 -- 172.21.15.6:0/1850790739 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f64580a2b90 msgr2=0x7f64580a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.192+0000 7f6471873640 1 --2- 172.21.15.6:0/1850790739 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f64580a2b90 0x7f64580a50a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x561c3dde9640 tx=0x7f6464009500 comp rx=0 tx=0).stop 2024-05-20T17:07:30.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.192+0000 7f6471873640 1 -- 172.21.15.6:0/1850790739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646c102ae0 msgr2=0x7f646c076910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.192+0000 7f6471873640 1 --2- 172.21.15.6:0/1850790739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646c102ae0 0x7f646c076910 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f645c00c970 tx=0x7f645c00ce30 comp rx=0 tx=0).stop 2024-05-20T17:07:30.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.192+0000 7f6471873640 1 -- 172.21.15.6:0/1850790739 shutdown_connections 2024-05-20T17:07:30.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.192+0000 7f6471873640 1 --2- 172.21.15.6:0/1850790739 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f64580a2b90 0x7f64580a50a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.192+0000 7f6471873640 1 --2- 172.21.15.6:0/1850790739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f646c108a20 0x7f646c0754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.192+0000 7f6471873640 1 --2- 172.21.15.6:0/1850790739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f646c103d20 0x7f646c074fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.192+0000 7f6471873640 1 --2- 172.21.15.6:0/1850790739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646c102ae0 0x7f646c076910 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.192+0000 7f6471873640 1 -- 172.21.15.6:0/1850790739 >> 172.21.15.6:0/1850790739 conn(0x7f646c0fdcf0 msgr2=0x7f646c104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.193+0000 7f6471873640 1 -- 172.21.15.6:0/1850790739 shutdown_connections 2024-05-20T17:07:30.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.193+0000 7f6471873640 1 -- 172.21.15.6:0/1850790739 wait complete. 2024-05-20T17:07:30.204 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-05-20T17:07:30.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.321+0000 7feedec56640 1 -- 172.21.15.6:0/4289299233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feed81078d0 msgr2=0x7feed8109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.321+0000 7feedec56640 1 --2- 172.21.15.6:0/4289299233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feed81078d0 0x7feed8109cf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7feed0009ca0 tx=0x7feed002a8c0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.321+0000 7feedec56640 1 -- 172.21.15.6:0/4289299233 shutdown_connections 2024-05-20T17:07:30.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.321+0000 7feedec56640 1 --2- 172.21.15.6:0/4289299233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feed81078d0 0x7feed8109cf0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.321+0000 7feedec56640 1 --2- 172.21.15.6:0/4289299233 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feed8102bd0 0x7feed8102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.321+0000 7feedec56640 1 --2- 172.21.15.6:0/4289299233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed8101990 0x7feed8102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.321+0000 7feedec56640 1 -- 172.21.15.6:0/4289299233 >> 172.21.15.6:0/4289299233 conn(0x7feed80fcb80 msgr2=0x7feed80ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.321+0000 7feedec56640 1 -- 172.21.15.6:0/4289299233 shutdown_connections 2024-05-20T17:07:30.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.321+0000 7feedec56640 1 -- 172.21.15.6:0/4289299233 wait complete. 2024-05-20T17:07:30.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.322+0000 7feedec56640 1 Processor -- start 2024-05-20T17:07:30.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.322+0000 7feedec56640 1 -- start start 2024-05-20T17:07:30.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.322+0000 7feedec56640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feed8101990 0x7feed80747f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.322+0000 7feedec56640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feed8102bd0 0x7feed819df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.322+0000 7feedec56640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed81078d0 0x7feed81a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.322+0000 7feedec56640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7feed810d4c0 con 0x7feed8102bd0 2024-05-20T17:07:30.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.322+0000 7feedec56640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7feed810d340 con 0x7feed81078d0 2024-05-20T17:07:30.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.322+0000 7feedec56640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feed810d640 con 0x7feed8101990 2024-05-20T17:07:30.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.322+0000 7feed7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feed8102bd0 0x7feed819df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.322+0000 7feed7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feed8102bd0 0x7feed819df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56250/0 (socket says 172.21.15.6:56250) 2024-05-20T17:07:30.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.322+0000 7feed7fff640 1 -- 172.21.15.6:0/3977545040 learned_addr learned my addr 172.21.15.6:0/3977545040 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:30.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.322+0000 7feedd1f3640 1 --2- 172.21.15.6:0/3977545040 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed81078d0 0x7feed81a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.322+0000 7feedc9f2640 1 --2- 172.21.15.6:0/3977545040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feed8101990 0x7feed80747f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.322+0000 7feed7fff640 1 -- 172.21.15.6:0/3977545040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feed8101990 msgr2=0x7feed80747f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.322+0000 7feed7fff640 1 --2- 172.21.15.6:0/3977545040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feed8101990 0x7feed80747f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.322+0000 7feed7fff640 1 -- 172.21.15.6:0/3977545040 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed81078d0 msgr2=0x7feed81a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.322+0000 7feed7fff640 1 --2- 172.21.15.6:0/3977545040 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed81078d0 0x7feed81a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.322+0000 7feed7fff640 1 -- 172.21.15.6:0/3977545040 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed81a0c80 con 0x7feed8102bd0 2024-05-20T17:07:30.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.322+0000 7feedd1f3640 1 --2- 172.21.15.6:0/3977545040 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed81078d0 0x7feed81a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:30.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.322+0000 7feedc9f2640 1 --2- 172.21.15.6:0/3977545040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feed8101990 0x7feed80747f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:30.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.323+0000 7feed7fff640 1 --2- 172.21.15.6:0/3977545040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feed8102bd0 0x7feed819df10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7feecc00c970 tx=0x7feecc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.323+0000 7feed5ffb640 1 -- 172.21.15.6:0/3977545040 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc007bb0 con 0x7feed8102bd0 2024-05-20T17:07:30.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.323+0000 7feed5ffb640 1 -- 172.21.15.6:0/3977545040 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feecc007d50 con 0x7feed8102bd0 2024-05-20T17:07:30.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.323+0000 7feed5ffb640 1 -- 172.21.15.6:0/3977545040 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc00f450 con 0x7feed8102bd0 2024-05-20T17:07:30.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.323+0000 7feedec56640 1 -- 172.21.15.6:0/3977545040 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feed81a0f70 con 0x7feed8102bd0 2024-05-20T17:07:30.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.323+0000 7feedec56640 1 -- 172.21.15.6:0/3977545040 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feed81a13e0 con 0x7feed8102bd0 2024-05-20T17:07:30.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.326+0000 7feed5ffb640 1 -- 172.21.15.6:0/3977545040 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7feecc004f20 con 0x7feed8102bd0 2024-05-20T17:07:30.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.326+0000 7feee5bd5740 1 Processor -- start 2024-05-20T17:07:30.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.326+0000 7feee5bd5740 1 -- start start 2024-05-20T17:07:30.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.326+0000 7feee5bd5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290bbb270 0x55d290f5b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.326+0000 7feee5bd5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 0x55d290f5b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.326+0000 7feee5bd5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290b9a590 0x55d290f628f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.326+0000 7feee5bd5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d290ebf4d0 con 0x55d290b923b0 2024-05-20T17:07:30.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.326+0000 7feee5bd5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d290e673e0 con 0x55d290b9a590 2024-05-20T17:07:30.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.326+0000 7feee5bd5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d290ebb490 con 0x55d290bbb270 2024-05-20T17:07:30.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.326+0000 7feedc9f2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 0x55d290f5b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.326+0000 7feedc9f2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 0x55d290f5b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56258/0 (socket says 172.21.15.6:56258) 2024-05-20T17:07:30.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.326+0000 7feedc9f2640 1 -- 172.21.15.6:0/3932133210 learned_addr learned my addr 172.21.15.6:0/3932133210 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:30.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.326+0000 7feed5ffb640 1 --2- 172.21.15.6:0/3977545040 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7feec00a2b90 0x7feec00a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.326+0000 7feedd1f3640 1 --2- 172.21.15.6:0/3932133210 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290bbb270 0x55d290f5b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.327+0000 7feed7fff640 1 --2- 172.21.15.6:0/3932133210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290b9a590 0x55d290f628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.327+0000 7feedd1f3640 1 --2- 172.21.15.6:0/3977545040 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7feec00a2b90 0x7feec00a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.327+0000 7feedc9f2640 1 -- 172.21.15.6:0/3932133210 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290bbb270 msgr2=0x55d290f5b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.327+0000 7feedc9f2640 1 --2- 172.21.15.6:0/3932133210 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290bbb270 0x55d290f5b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.327+0000 7feedc9f2640 1 -- 172.21.15.6:0/3932133210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290b9a590 msgr2=0x55d290f628f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.327+0000 7feed5ffb640 1 -- 172.21.15.6:0/3977545040 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7feecc0cf220 con 0x7feed8102bd0 2024-05-20T17:07:30.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.327+0000 7feedc9f2640 1 --2- 172.21.15.6:0/3932133210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290b9a590 0x55d290f628f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.327+0000 7feedc9f2640 1 -- 172.21.15.6:0/3932133210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d290bd32d0 con 0x55d290b923b0 2024-05-20T17:07:30.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.327+0000 7feed7fff640 1 --2- 172.21.15.6:0/3932133210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290b9a590 0x55d290f628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:07:30.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.327+0000 7feedc9f2640 1 --2- 172.21.15.6:0/3932133210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 0x55d290f5b9f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7feec8009c80 tx=0x7feec80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673b809a4a03aca6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.327+0000 7feedd1f3640 1 --2- 172.21.15.6:0/3977545040 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7feec00a2b90 0x7feec00a50a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55d290f5c640 tx=0x7feed002a8c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.327+0000 7feebeffd640 1 -- 172.21.15.6:0/3932133210 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8005020 con 0x55d290b923b0 2024-05-20T17:07:30.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.327+0000 7feebeffd640 1 -- 172.21.15.6:0/3932133210 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feec80047a0 con 0x55d290b923b0 2024-05-20T17:07:30.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.327+0000 7feebeffd640 1 -- 172.21.15.6:0/3932133210 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8012690 con 0x55d290b923b0 2024-05-20T17:07:30.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.328+0000 7feee5bd5740 1 -- 172.21.15.6:0/3932133210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 msgr2=0x55d290f5b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.328+0000 7feee5bd5740 1 --2- 172.21.15.6:0/3932133210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 0x55d290f5b9f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7feec8009c80 tx=0x7feec80117b0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.328+0000 7feee5bd5740 1 -- 172.21.15.6:0/3932133210 shutdown_connections 2024-05-20T17:07:30.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.328+0000 7feee5bd5740 1 --2- 172.21.15.6:0/3932133210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290b9a590 0x55d290f628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.328+0000 7feee5bd5740 1 --2- 172.21.15.6:0/3932133210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 0x55d290f5b9f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.328+0000 7feee5bd5740 1 --2- 172.21.15.6:0/3932133210 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290bbb270 0x55d290f5b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.328+0000 7feee5bd5740 1 -- 172.21.15.6:0/3932133210 >> 172.21.15.6:0/3932133210 conn(0x55d290baf3c0 msgr2=0x55d290f56e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.328+0000 7feee5bd5740 1 -- 172.21.15.6:0/3932133210 shutdown_connections 2024-05-20T17:07:30.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.328+0000 7feee5bd5740 1 -- 172.21.15.6:0/3932133210 wait complete. 2024-05-20T17:07:30.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.328+0000 7feee5bd5740 1 -- start start 2024-05-20T17:07:30.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.329+0000 7feee5bd5740 1 Processor -- start 2024-05-20T17:07:30.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.329+0000 7feee5bd5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 0x55d290f65290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.329+0000 7feee5bd5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290b9a590 0x55d290f657d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.329+0000 7feee5bd5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290bbb270 0x55d290f6c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.329+0000 7feee5bd5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d290f63340 con 0x55d290b923b0 2024-05-20T17:07:30.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.329+0000 7feee5bd5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d290e7a8e0 con 0x55d290b9a590 2024-05-20T17:07:30.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.329+0000 7feee5bd5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d290f634c0 con 0x55d290bbb270 2024-05-20T17:07:30.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.329+0000 7feee5bd5740 10 client.0 _ll_register_callbacks cb 0x55d290e479c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:07:30.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.329+0000 7feedc9f2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 0x55d290f65290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.329+0000 7feedc9f2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 0x55d290f65290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56268/0 (socket says 172.21.15.6:56268) 2024-05-20T17:07:30.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.329+0000 7feedc9f2640 1 -- 172.21.15.6:0/23617327 learned_addr learned my addr 172.21.15.6:0/23617327 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:30.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.329+0000 7feedd1f3640 1 --2- 172.21.15.6:0/23617327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290bbb270 0x55d290f6c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.329+0000 7feed7fff640 1 --2- 172.21.15.6:0/23617327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290b9a590 0x55d290f657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.330+0000 7feedc9f2640 1 -- 172.21.15.6:0/23617327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290bbb270 msgr2=0x55d290f6c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.330+0000 7feedc9f2640 1 --2- 172.21.15.6:0/23617327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290bbb270 0x55d290f6c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.330+0000 7feedc9f2640 1 -- 172.21.15.6:0/23617327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290b9a590 msgr2=0x55d290f657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.330+0000 7feedc9f2640 1 --2- 172.21.15.6:0/23617327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290b9a590 0x55d290f657d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.330+0000 7feedc9f2640 1 -- 172.21.15.6:0/23617327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d290c9d6b0 con 0x55d290b923b0 2024-05-20T17:07:30.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.330+0000 7feedc9f2640 1 --2- 172.21.15.6:0/23617327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 0x55d290f65290 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7feec8000c00 tx=0x7feec8009df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a474a9e73cd06b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.330+0000 7feeb7fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:07:30.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.330+0000 7feeb7fff640 1 -- 172.21.15.6:0/23617327 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8027030 con 0x55d290b923b0 2024-05-20T17:07:30.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.330+0000 7feeb7fff640 1 -- 172.21.15.6:0/23617327 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7feec801f070 con 0x55d290b923b0 2024-05-20T17:07:30.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.330+0000 7feee5bd5740 1 -- 172.21.15.6:0/23617327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feec80047a0 con 0x55d290b923b0 2024-05-20T17:07:30.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.330+0000 7feeb7fff640 1 -- 172.21.15.6:0/23617327 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feec8031050 con 0x55d290b923b0 2024-05-20T17:07:30.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.330+0000 7feee5bd5740 10 client.15501 fetch_fsmap learned FSMap version 28 2024-05-20T17:07:30.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.330+0000 7feee5bd5740 1 -- 172.21.15.6:0/23617327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d290f6f5d0 con 0x55d290b923b0 2024-05-20T17:07:30.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.330+0000 7feeb7fff640 1 -- 172.21.15.6:0/23617327 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feec80047a0 con 0x55d290b923b0 2024-05-20T17:07:30.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.331+0000 7feeb7fff640 1 -- 172.21.15.6:0/23617327 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7feec8003850 con 0x55d290b923b0 2024-05-20T17:07:30.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.331+0000 7feee5bd5740 10 client.15501 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:07:30.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.331+0000 7feee5bd5740 10 client.15501 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-20T17:07:30.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.331+0000 7feee5bd5740 20 client.15501 populate_metadata read hostname 'smithi006' 2024-05-20T17:07:30.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.331+0000 7feee5bd5740 1 --2- 172.21.15.6:0/23617327 >> [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] conn(0x55d290b79e40 0x55d290f72d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.331+0000 7feee5bd5740 4 client.15501 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:07:30.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.331+0000 7feee5bd5740 1 -- 172.21.15.6:0/23617327 --> [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d290eccc00 con 0x55d290b79e40 2024-05-20T17:07:30.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.331+0000 7feed7fff640 1 --2- 172.21.15.6:0/23617327 >> [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] conn(0x55d290b79e40 0x55d290f72d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.331+0000 7feeb7fff640 10 client.15501 ms_handle_connect on v2:172.21.15.171:6838/3246292303 2024-05-20T17:07:30.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.331+0000 7feed7fff640 1 --2- 172.21.15.6:0/23617327 >> [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] conn(0x55d290b79e40 0x55d290f72d80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=87765e0d3a5a2d40 server_cookie=d5051f30b2748229 in_seq=0 out_seq=0 2024-05-20T17:07:30.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.332+0000 7feeb7fff640 1 -- 172.21.15.6:0/23617327 <== mds.1 v2:172.21.15.171:6838/3246292303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d290eccc00 con 0x55d290b79e40 2024-05-20T17:07:30.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.332+0000 7feeb7fff640 10 client.15501 handle_command_reply: tid=0 2024-05-20T17:07:30.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.332+0000 7feee5bd5740 1 client.15501 shutdown 2024-05-20T17:07:30.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.332+0000 7feee5bd5740 1 -- 172.21.15.6:0/23617327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 msgr2=0x55d290f65290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.332+0000 7feee5bd5740 1 --2- 172.21.15.6:0/23617327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 0x55d290f65290 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7feec8000c00 tx=0x7feec8009df0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.332+0000 7feee5bd5740 1 -- 172.21.15.6:0/23617327 shutdown_connections 2024-05-20T17:07:30.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.332+0000 7feee5bd5740 1 --2- 172.21.15.6:0/23617327 >> [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] conn(0x55d290b79e40 0x55d290f72d80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.332+0000 7feee5bd5740 1 --2- 172.21.15.6:0/23617327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290bbb270 0x55d290f6c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.332+0000 7feee5bd5740 1 --2- 172.21.15.6:0/23617327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290b9a590 0x55d290f657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.332+0000 7feee5bd5740 1 --2- 172.21.15.6:0/23617327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 0x55d290f65290 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.332+0000 7feeb7fff640 0 client.15501 ms_handle_reset on v2:172.21.15.171:6838/3246292303 2024-05-20T17:07:30.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.332+0000 7feee5bd5740 1 -- 172.21.15.6:0/23617327 >> 172.21.15.6:0/23617327 conn(0x55d290baf3c0 msgr2=0x55d290f55ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.332+0000 7feee5bd5740 1 -- 172.21.15.6:0/23617327 shutdown_connections 2024-05-20T17:07:30.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.332+0000 7feee5bd5740 1 -- 172.21.15.6:0/23617327 wait complete. 2024-05-20T17:07:30.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.333+0000 7feee5bd5740 20 client.15501 trim_cache size 0 max 16384 2024-05-20T17:07:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.351+0000 7feee5bd5740 1 Processor -- start 2024-05-20T17:07:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.351+0000 7feee5bd5740 1 -- start start 2024-05-20T17:07:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.351+0000 7feee5bd5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 0x55d290f5ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.351+0000 7feee5bd5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290b9a590 0x55d290f7a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.351+0000 7feee5bd5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290bbb270 0x55d290f7a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.351+0000 7feee5bd5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d290f710c0 con 0x55d290b923b0 2024-05-20T17:07:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.352+0000 7feee5bd5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d290f71790 con 0x55d290bbb270 2024-05-20T17:07:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.352+0000 7feee5bd5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d290f71e60 con 0x55d290b9a590 2024-05-20T17:07:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.352+0000 7feedc9f2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 0x55d290f5ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.352+0000 7feedc9f2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 0x55d290f5ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56274/0 (socket says 172.21.15.6:56274) 2024-05-20T17:07:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.352+0000 7feedc9f2640 1 -- 172.21.15.6:0/3100082752 learned_addr learned my addr 172.21.15.6:0/3100082752 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.352+0000 7feedd1f3640 1 --2- 172.21.15.6:0/3100082752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290bbb270 0x55d290f7a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.352+0000 7feedc9f2640 1 -- 172.21.15.6:0/3100082752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290b9a590 msgr2=0x55d290f7a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.352+0000 7feed7fff640 1 --2- 172.21.15.6:0/3100082752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290b9a590 0x55d290f7a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.352+0000 7feedc9f2640 1 --2- 172.21.15.6:0/3100082752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290b9a590 0x55d290f7a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.352+0000 7feedc9f2640 1 -- 172.21.15.6:0/3100082752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290bbb270 msgr2=0x55d290f7a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.352+0000 7feedc9f2640 1 --2- 172.21.15.6:0/3100082752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290bbb270 0x55d290f7a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.352+0000 7feedc9f2640 1 -- 172.21.15.6:0/3100082752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d290f62a30 con 0x55d290b923b0 2024-05-20T17:07:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.352+0000 7feed7fff640 1 --2- 172.21.15.6:0/3100082752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290b9a590 0x55d290f7a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:07:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.352+0000 7feedd1f3640 1 --2- 172.21.15.6:0/3100082752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290bbb270 0x55d290f7a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:07:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.352+0000 7feedc9f2640 1 --2- 172.21.15.6:0/3100082752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 0x55d290f5ed90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7feec8009bd0 tx=0x7feec8005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1353429431235041 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.352+0000 7feebe7fc640 1 -- 172.21.15.6:0/3100082752 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8027040 con 0x55d290b923b0 2024-05-20T17:07:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.352+0000 7feebe7fc640 1 -- 172.21.15.6:0/3100082752 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feec8004c60 con 0x55d290b923b0 2024-05-20T17:07:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.352+0000 7feebe7fc640 1 -- 172.21.15.6:0/3100082752 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec80044d0 con 0x55d290b923b0 2024-05-20T17:07:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.353+0000 7feee5bd5740 1 -- 172.21.15.6:0/3100082752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 msgr2=0x55d290f5ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.353+0000 7feee5bd5740 1 --2- 172.21.15.6:0/3100082752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 0x55d290f5ed90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7feec8009bd0 tx=0x7feec8005700 comp rx=0 tx=0).stop 2024-05-20T17:07:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.353+0000 7feee5bd5740 1 -- 172.21.15.6:0/3100082752 shutdown_connections 2024-05-20T17:07:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.353+0000 7feee5bd5740 1 --2- 172.21.15.6:0/3100082752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290bbb270 0x55d290f7a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.353+0000 7feee5bd5740 1 --2- 172.21.15.6:0/3100082752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290b9a590 0x55d290f7a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.353+0000 7feee5bd5740 1 --2- 172.21.15.6:0/3100082752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290b923b0 0x55d290f5ed90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.353+0000 7feee5bd5740 1 -- 172.21.15.6:0/3100082752 >> 172.21.15.6:0/3100082752 conn(0x55d290baf3c0 msgr2=0x55d290f5e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.353+0000 7feee5bd5740 1 -- 172.21.15.6:0/3100082752 shutdown_connections 2024-05-20T17:07:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.353+0000 7feee5bd5740 1 -- 172.21.15.6:0/3100082752 wait complete. 2024-05-20T17:07:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.354+0000 7feee5bd5740 1 -- start start 2024-05-20T17:07:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.354+0000 7feee5bd5740 1 Processor -- start 2024-05-20T17:07:30.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.354+0000 7feee5bd5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290b923b0 0x55d290f68f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.354+0000 7feee5bd5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290b9a590 0x55d290f694d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.354+0000 7feee5bd5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290bbb270 0x55d290f6a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.354+0000 7feee5bd5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d290f72c00 con 0x55d290bbb270 2024-05-20T17:07:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.354+0000 7feee5bd5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d290f72530 con 0x55d290b9a590 2024-05-20T17:07:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.354+0000 7feee5bd5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d290f732d0 con 0x55d290b923b0 2024-05-20T17:07:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.354+0000 7feee5bd5740 10 client.0 _ll_register_callbacks cb 0x7feec8009b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:07:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.354+0000 7feedd1f3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290bbb270 0x55d290f6a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.354+0000 7feedd1f3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290bbb270 0x55d290f6a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56280/0 (socket says 172.21.15.6:56280) 2024-05-20T17:07:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.354+0000 7feedd1f3640 1 -- 172.21.15.6:0/2983733803 learned_addr learned my addr 172.21.15.6:0/2983733803 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.354+0000 7feedc9f2640 1 --2- 172.21.15.6:0/2983733803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290b923b0 0x55d290f68f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.354+0000 7feed7fff640 1 --2- 172.21.15.6:0/2983733803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290b9a590 0x55d290f694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.355+0000 7feedd1f3640 1 -- 172.21.15.6:0/2983733803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290b923b0 msgr2=0x55d290f68f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.355+0000 7feedd1f3640 1 --2- 172.21.15.6:0/2983733803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290b923b0 0x55d290f68f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.355+0000 7feedd1f3640 1 -- 172.21.15.6:0/2983733803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290b9a590 msgr2=0x55d290f694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.355+0000 7feedd1f3640 1 --2- 172.21.15.6:0/2983733803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290b9a590 0x55d290f694d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.355+0000 7feedd1f3640 1 -- 172.21.15.6:0/2983733803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d290f6a970 con 0x55d290bbb270 2024-05-20T17:07:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.355+0000 7feedd1f3640 1 --2- 172.21.15.6:0/2983733803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290bbb270 0x55d290f6a3b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7feed0009ca0 tx=0x7feed00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737af7fd4e74267a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.355+0000 7feeb7fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:07:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.355+0000 7feeb7fff640 1 -- 172.21.15.6:0/2983733803 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed0043070 con 0x55d290bbb270 2024-05-20T17:07:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.355+0000 7feeb7fff640 1 -- 172.21.15.6:0/2983733803 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7feed0004450 con 0x55d290bbb270 2024-05-20T17:07:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.355+0000 7feee5bd5740 1 -- 172.21.15.6:0/2983733803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d290ec6f50 con 0x55d290bbb270 2024-05-20T17:07:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.355+0000 7feeb7fff640 1 -- 172.21.15.6:0/2983733803 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feed0004650 con 0x55d290bbb270 2024-05-20T17:07:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.355+0000 7feee5bd5740 10 client.15507 fetch_fsmap learned FSMap version 28 2024-05-20T17:07:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.355+0000 7feee5bd5740 1 -- 172.21.15.6:0/2983733803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d290f6bad0 con 0x55d290bbb270 2024-05-20T17:07:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.355+0000 7feeb7fff640 1 -- 172.21.15.6:0/2983733803 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55d290ec6f50 con 0x55d290bbb270 2024-05-20T17:07:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.356+0000 7feeb7fff640 1 -- 172.21.15.6:0/2983733803 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7feed0053020 con 0x55d290bbb270 2024-05-20T17:07:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.356+0000 7feee5bd5740 10 client.15507 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:07:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.356+0000 7feee5bd5740 10 client.15507 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-20T17:07:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.356+0000 7feee5bd5740 20 client.15507 populate_metadata read hostname 'smithi006' 2024-05-20T17:07:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.356+0000 7feee5bd5740 1 --2- 172.21.15.6:0/2983733803 >> [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] conn(0x55d290b4f280 0x55d290fdc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.356+0000 7feee5bd5740 4 client.15507 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:07:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.356+0000 7feee5bd5740 1 -- 172.21.15.6:0/2983733803 --> [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] -- command(tid 0: {"prefix": "status"}) -- 0x55d290e44b80 con 0x55d290b4f280 2024-05-20T17:07:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.356+0000 7feedc9f2640 1 --2- 172.21.15.6:0/2983733803 >> [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] conn(0x55d290b4f280 0x55d290fdc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.356+0000 7feeb7fff640 10 client.15507 ms_handle_connect on v2:172.21.15.171:6838/3246292303 2024-05-20T17:07:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.356+0000 7feedc9f2640 1 --2- 172.21.15.6:0/2983733803 >> [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] conn(0x55d290b4f280 0x55d290fdc540 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5174b880c628b271 server_cookie=32df4128f2e18855 in_seq=0 out_seq=0 2024-05-20T17:07:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.357+0000 7feeb7fff640 1 -- 172.21.15.6:0/2983733803 <== mds.1 v2:172.21.15.171:6838/3246292303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55d290e44b80 con 0x55d290b4f280 2024-05-20T17:07:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.357+0000 7feeb7fff640 10 client.15507 handle_command_reply: tid=0 2024-05-20T17:07:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.357+0000 7feee5bd5740 1 client.15507 shutdown 2024-05-20T17:07:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.357+0000 7feee5bd5740 1 -- 172.21.15.6:0/2983733803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290bbb270 msgr2=0x55d290f6a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.357+0000 7feee5bd5740 1 --2- 172.21.15.6:0/2983733803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290bbb270 0x55d290f6a3b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7feed0009ca0 tx=0x7feed00095c0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.357+0000 7feee5bd5740 1 -- 172.21.15.6:0/2983733803 shutdown_connections 2024-05-20T17:07:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.357+0000 7feee5bd5740 1 --2- 172.21.15.6:0/2983733803 >> [v2:172.21.15.171:6838/3246292303,v1:172.21.15.171:6839/3246292303] conn(0x55d290b4f280 0x55d290fdc540 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.357+0000 7feee5bd5740 1 --2- 172.21.15.6:0/2983733803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d290bbb270 0x55d290f6a3b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.357+0000 7feeb7fff640 0 client.15507 ms_handle_reset on v2:172.21.15.171:6838/3246292303 2024-05-20T17:07:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.357+0000 7feee5bd5740 1 --2- 172.21.15.6:0/2983733803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d290b9a590 0x55d290f694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.357+0000 7feee5bd5740 1 --2- 172.21.15.6:0/2983733803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d290b923b0 0x55d290f68f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.357+0000 7feee5bd5740 1 -- 172.21.15.6:0/2983733803 >> 172.21.15.6:0/2983733803 conn(0x55d290baf3c0 msgr2=0x55d290f59ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.357+0000 7feee5bd5740 1 -- 172.21.15.6:0/2983733803 shutdown_connections 2024-05-20T17:07:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.357+0000 7feee5bd5740 1 -- 172.21.15.6:0/2983733803 wait complete. 2024-05-20T17:07:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.357+0000 7feee5bd5740 20 client.15507 trim_cache size 0 max 16384 2024-05-20T17:07:30.364 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:07:30.364 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c726c954-16c9-11ef-bc9a-c7b262605968", 2024-05-20T17:07:30.365 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 1, 2024-05-20T17:07:30.365 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24526, 2024-05-20T17:07:30.365 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T17:07:30.365 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T17:07:30.365 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T17:07:30.365 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 118.71987443499999, 2024-05-20T17:07:30.365 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 28, 2024-05-20T17:07:30.365 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 94, 2024-05-20T17:07:30.365 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 90, 2024-05-20T17:07:30.365 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 160.27748207400001 2024-05-20T17:07:30.365 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:07:30.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.357+0000 7feedec56640 1 -- 172.21.15.6:0/3977545040 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7feec00a2b90 msgr2=0x7feec00a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.357+0000 7feedec56640 1 --2- 172.21.15.6:0/3977545040 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7feec00a2b90 0x7feec00a50a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55d290f5c640 tx=0x7feed002a8c0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.357+0000 7feedec56640 1 -- 172.21.15.6:0/3977545040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feed8102bd0 msgr2=0x7feed819df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.357+0000 7feedec56640 1 --2- 172.21.15.6:0/3977545040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feed8102bd0 0x7feed819df10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7feecc00c970 tx=0x7feecc00ce30 comp rx=0 tx=0).stop 2024-05-20T17:07:30.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.358+0000 7feedec56640 1 -- 172.21.15.6:0/3977545040 shutdown_connections 2024-05-20T17:07:30.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.358+0000 7feedec56640 1 --2- 172.21.15.6:0/3977545040 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7feec00a2b90 0x7feec00a50a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.358+0000 7feedec56640 1 --2- 172.21.15.6:0/3977545040 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feed81078d0 0x7feed81a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.358+0000 7feedec56640 1 --2- 172.21.15.6:0/3977545040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feed8102bd0 0x7feed819df10 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.358+0000 7feedec56640 1 --2- 172.21.15.6:0/3977545040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feed8101990 0x7feed80747f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.358+0000 7feedec56640 1 -- 172.21.15.6:0/3977545040 >> 172.21.15.6:0/3977545040 conn(0x7feed80fcb80 msgr2=0x7feed81038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.358+0000 7feedec56640 1 -- 172.21.15.6:0/3977545040 shutdown_connections 2024-05-20T17:07:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.358+0000 7feedec56640 1 -- 172.21.15.6:0/3977545040 wait complete. 2024-05-20T17:07:30.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-20T17:07:30.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.485+0000 7f0696179640 1 -- 172.21.15.6:0/4135747240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0690108a20 msgr2=0x7f069010ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.485+0000 7f0696179640 1 --2- 172.21.15.6:0/4135747240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0690108a20 0x7f069010ae40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0688009ca0 tx=0x7f068802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.485+0000 7f0696179640 1 -- 172.21.15.6:0/4135747240 shutdown_connections 2024-05-20T17:07:30.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.485+0000 7f0696179640 1 --2- 172.21.15.6:0/4135747240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0690108a20 0x7f069010ae40 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.485+0000 7f0696179640 1 --2- 172.21.15.6:0/4135747240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06901027e0 0x7f0690102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.485+0000 7f0696179640 1 --2- 172.21.15.6:0/4135747240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0690104120 0x7f06901022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.485+0000 7f0696179640 1 -- 172.21.15.6:0/4135747240 >> 172.21.15.6:0/4135747240 conn(0x7f06900fdcf0 msgr2=0x7f0690100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.485+0000 7f0696179640 1 -- 172.21.15.6:0/4135747240 shutdown_connections 2024-05-20T17:07:30.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.485+0000 7f0696179640 1 -- 172.21.15.6:0/4135747240 wait complete. 2024-05-20T17:07:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.486+0000 7f0696179640 1 Processor -- start 2024-05-20T17:07:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.486+0000 7f0696179640 1 -- start start 2024-05-20T17:07:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.486+0000 7f0696179640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06901027e0 0x7f06901992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.486+0000 7f0696179640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0690104120 0x7f06901997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.486+0000 7f0696179640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0690108a20 0x7f06901a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.486+0000 7f0696179640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f069010e720 con 0x7f0690108a20 2024-05-20T17:07:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.486+0000 7f0696179640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f069010e5a0 con 0x7f0690104120 2024-05-20T17:07:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.486+0000 7f0696179640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f069010e8a0 con 0x7f06901027e0 2024-05-20T17:07:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.486+0000 7f068ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0690108a20 0x7f06901a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.486+0000 7f068ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0690108a20 0x7f06901a0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56302/0 (socket says 172.21.15.6:56302) 2024-05-20T17:07:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.486+0000 7f068ffff640 1 -- 172.21.15.6:0/995014174 learned_addr learned my addr 172.21.15.6:0/995014174 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.486+0000 7f068f7fe640 1 --2- 172.21.15.6:0/995014174 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06901027e0 0x7f06901992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.486+0000 7f068effd640 1 --2- 172.21.15.6:0/995014174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0690104120 0x7f06901997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.487+0000 7f068ffff640 1 -- 172.21.15.6:0/995014174 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06901027e0 msgr2=0x7f06901992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.487+0000 7f068ffff640 1 --2- 172.21.15.6:0/995014174 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06901027e0 0x7f06901992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.487+0000 7f068ffff640 1 -- 172.21.15.6:0/995014174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0690104120 msgr2=0x7f06901997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.487+0000 7f068ffff640 1 --2- 172.21.15.6:0/995014174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0690104120 0x7f06901997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.487+0000 7f068ffff640 1 -- 172.21.15.6:0/995014174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06901a0de0 con 0x7f0690108a20 2024-05-20T17:07:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.487+0000 7f068ffff640 1 --2- 172.21.15.6:0/995014174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0690108a20 0x7f06901a0770 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0688009dc0 tx=0x7f0688003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.487+0000 7f068cff9640 1 -- 172.21.15.6:0/995014174 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0688004040 con 0x7f0690108a20 2024-05-20T17:07:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.487+0000 7f068cff9640 1 -- 172.21.15.6:0/995014174 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0688004690 con 0x7f0690108a20 2024-05-20T17:07:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.487+0000 7f0696179640 1 -- 172.21.15.6:0/995014174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06901a1070 con 0x7f0690108a20 2024-05-20T17:07:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.487+0000 7f068cff9640 1 -- 172.21.15.6:0/995014174 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0688030c70 con 0x7f0690108a20 2024-05-20T17:07:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.487+0000 7f0696179640 1 -- 172.21.15.6:0/995014174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06901a1610 con 0x7f0690108a20 2024-05-20T17:07:30.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.490+0000 7f068cff9640 1 -- 172.21.15.6:0/995014174 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f06880041e0 con 0x7f0690108a20 2024-05-20T17:07:30.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.490+0000 7f069d01a740 1 Processor -- start 2024-05-20T17:07:30.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.490+0000 7f069d01a740 1 -- start start 2024-05-20T17:07:30.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.490+0000 7f069d01a740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b3d653270 0x562b3d9f3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.490+0000 7f069d01a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b3d62a3b0 0x562b3d9f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.490+0000 7f069d01a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d632590 0x562b3d9fa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.490+0000 7f069d01a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562b3d9574d0 con 0x562b3d632590 2024-05-20T17:07:30.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.490+0000 7f069d01a740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562b3d8ff3e0 con 0x562b3d653270 2024-05-20T17:07:30.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.490+0000 7f069d01a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562b3d953490 con 0x562b3d62a3b0 2024-05-20T17:07:30.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.490+0000 7f068effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d632590 0x562b3d9fa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.491+0000 7f068effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d632590 0x562b3d9fa8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56314/0 (socket says 172.21.15.6:56314) 2024-05-20T17:07:30.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.491+0000 7f068effd640 1 -- 172.21.15.6:0/2375646671 learned_addr learned my addr 172.21.15.6:0/2375646671 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:30.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.491+0000 7f068effd640 1 --2- 172.21.15.6:0/2375646671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b3d653270 0x562b3d9f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.491+0000 7f068f7fe640 1 --2- 172.21.15.6:0/2375646671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b3d62a3b0 0x562b3d9f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.491+0000 7f068effd640 1 -- 172.21.15.6:0/2375646671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b3d62a3b0 msgr2=0x562b3d9f39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.491+0000 7f068effd640 1 --2- 172.21.15.6:0/2375646671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b3d62a3b0 0x562b3d9f39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.491+0000 7f068effd640 1 -- 172.21.15.6:0/2375646671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b3d653270 msgr2=0x562b3d9f3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.491+0000 7f068effd640 1 --2- 172.21.15.6:0/2375646671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b3d653270 0x562b3d9f3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.491+0000 7f068cff9640 1 --2- 172.21.15.6:0/995014174 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f067c0a2c10 0x7f067c0a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.491+0000 7f068effd640 1 -- 172.21.15.6:0/2375646671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b3d66b2d0 con 0x562b3d632590 2024-05-20T17:07:30.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.491+0000 7f068f7fe640 1 --2- 172.21.15.6:0/995014174 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f067c0a2c10 0x7f067c0a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.491+0000 7f068effd640 1 --2- 172.21.15.6:0/2375646671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d632590 0x562b3d9fa8f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f06780058a0 tx=0x7f067800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a803dcc60b19dcc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.491+0000 7f068cff9640 1 -- 172.21.15.6:0/995014174 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f06880f0ba0 con 0x7f0690108a20 2024-05-20T17:07:30.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.491+0000 7f0685ffb640 1 -- 172.21.15.6:0/2375646671 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0678012d00 con 0x562b3d632590 2024-05-20T17:07:30.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.491+0000 7f0685ffb640 1 -- 172.21.15.6:0/2375646671 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0678010c20 con 0x562b3d632590 2024-05-20T17:07:30.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.491+0000 7f0685ffb640 1 -- 172.21.15.6:0/2375646671 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067801e9a0 con 0x562b3d632590 2024-05-20T17:07:30.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.492+0000 7f069d01a740 1 -- 172.21.15.6:0/2375646671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d632590 msgr2=0x562b3d9fa8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.492+0000 7f069d01a740 1 --2- 172.21.15.6:0/2375646671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d632590 0x562b3d9fa8f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f06780058a0 tx=0x7f067800b7c0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.492+0000 7f068f7fe640 1 --2- 172.21.15.6:0/995014174 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f067c0a2c10 0x7f067c0a5120 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x562b3d9f4850 tx=0x7f068000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.492+0000 7f069d01a740 1 -- 172.21.15.6:0/2375646671 shutdown_connections 2024-05-20T17:07:30.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.492+0000 7f069d01a740 1 --2- 172.21.15.6:0/2375646671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d632590 0x562b3d9fa8f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.492+0000 7f069d01a740 1 --2- 172.21.15.6:0/2375646671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b3d62a3b0 0x562b3d9f39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.492+0000 7f069d01a740 1 --2- 172.21.15.6:0/2375646671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b3d653270 0x562b3d9f3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.492+0000 7f069d01a740 1 -- 172.21.15.6:0/2375646671 >> 172.21.15.6:0/2375646671 conn(0x562b3d6473c0 msgr2=0x562b3d9eee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.492+0000 7f069d01a740 1 -- 172.21.15.6:0/2375646671 shutdown_connections 2024-05-20T17:07:30.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.492+0000 7f069d01a740 1 -- 172.21.15.6:0/2375646671 wait complete. 2024-05-20T17:07:30.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.493+0000 7f069d01a740 1 -- start start 2024-05-20T17:07:30.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.493+0000 7f069d01a740 1 Processor -- start 2024-05-20T17:07:30.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.493+0000 7f069d01a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b3d62a3b0 0x562b3d9fd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.493+0000 7f069d01a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d632590 0x562b3d9fd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.493+0000 7f069d01a740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b3d653270 0x562b3da047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.493+0000 7f069d01a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562b3d9fb340 con 0x562b3d632590 2024-05-20T17:07:30.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.493+0000 7f069d01a740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562b3d9128e0 con 0x562b3d653270 2024-05-20T17:07:30.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.493+0000 7f069d01a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562b3d9fb4c0 con 0x562b3d62a3b0 2024-05-20T17:07:30.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.493+0000 7f069d01a740 10 client.0 _ll_register_callbacks cb 0x562b3d8df9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:07:30.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.493+0000 7f068effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d632590 0x562b3d9fd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.493+0000 7f068effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d632590 0x562b3d9fd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56318/0 (socket says 172.21.15.6:56318) 2024-05-20T17:07:30.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.493+0000 7f068effd640 1 -- 172.21.15.6:0/1993795267 learned_addr learned my addr 172.21.15.6:0/1993795267 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:30.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.493+0000 7f068f7fe640 1 --2- 172.21.15.6:0/1993795267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b3d62a3b0 0x562b3d9fd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.493+0000 7f068ffff640 1 --2- 172.21.15.6:0/1993795267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b3d653270 0x562b3da047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.494+0000 7f068effd640 1 -- 172.21.15.6:0/1993795267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b3d62a3b0 msgr2=0x562b3d9fd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.494+0000 7f068effd640 1 --2- 172.21.15.6:0/1993795267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b3d62a3b0 0x562b3d9fd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.494+0000 7f068effd640 1 -- 172.21.15.6:0/1993795267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b3d653270 msgr2=0x562b3da047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.494+0000 7f068effd640 1 --2- 172.21.15.6:0/1993795267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b3d653270 0x562b3da047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.494+0000 7f068effd640 1 -- 172.21.15.6:0/1993795267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b3d7356b0 con 0x562b3d632590 2024-05-20T17:07:30.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.494+0000 7f068f7fe640 1 --2- 172.21.15.6:0/1993795267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b3d62a3b0 0x562b3d9fd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:07:30.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.494+0000 7f068effd640 1 --2- 172.21.15.6:0/1993795267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d632590 0x562b3d9fd870 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0678005d00 tx=0x7f067800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768e59749cee3b07 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.494+0000 7f066effd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:07:30.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.494+0000 7f066effd640 1 -- 172.21.15.6:0/1993795267 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0678025070 con 0x562b3d632590 2024-05-20T17:07:30.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.494+0000 7f066effd640 1 -- 172.21.15.6:0/1993795267 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f0678004040 con 0x562b3d632590 2024-05-20T17:07:30.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.494+0000 7f069d01a740 1 -- 172.21.15.6:0/1993795267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0678010c20 con 0x562b3d632590 2024-05-20T17:07:30.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.494+0000 7f066effd640 1 -- 172.21.15.6:0/1993795267 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0678034050 con 0x562b3d632590 2024-05-20T17:07:30.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.494+0000 7f069d01a740 10 client.15519 fetch_fsmap learned FSMap version 28 2024-05-20T17:07:30.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.494+0000 7f069d01a740 1 -- 172.21.15.6:0/1993795267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562b3da07700 con 0x562b3d632590 2024-05-20T17:07:30.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.494+0000 7f066effd640 1 -- 172.21.15.6:0/1993795267 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0678010c20 con 0x562b3d632590 2024-05-20T17:07:30.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.495+0000 7f066effd640 1 -- 172.21.15.6:0/1993795267 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f06780035f0 con 0x562b3d632590 2024-05-20T17:07:30.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.495+0000 7f069d01a740 10 client.15519 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:07:30.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.495+0000 7f069d01a740 10 client.15519 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-20T17:07:30.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.495+0000 7f069d01a740 20 client.15519 populate_metadata read hostname 'smithi006' 2024-05-20T17:07:30.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.495+0000 7f069d01a740 1 --2- 172.21.15.6:0/1993795267 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x562b3d611e40 0x562b3da0afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.495+0000 7f069d01a740 4 client.15519 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:07:30.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.495+0000 7f069d01a740 1 -- 172.21.15.6:0/1993795267 --> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b3d964c00 con 0x562b3d611e40 2024-05-20T17:07:30.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.495+0000 7f068f7fe640 1 --2- 172.21.15.6:0/1993795267 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x562b3d611e40 0x562b3da0afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.496+0000 7f066effd640 10 client.15519 ms_handle_connect on v2:172.21.15.62:6838/3023093487 2024-05-20T17:07:30.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.495+0000 7f068f7fe640 1 --2- 172.21.15.6:0/1993795267 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x562b3d611e40 0x562b3da0afd0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cc642f96596c071 server_cookie=8f63f300183f9ca0 in_seq=0 out_seq=0 2024-05-20T17:07:30.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.496+0000 7f066effd640 1 -- 172.21.15.6:0/1993795267 <== mds.0 v2:172.21.15.62:6838/3023093487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562b3d964c00 con 0x562b3d611e40 2024-05-20T17:07:30.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.496+0000 7f066effd640 10 client.15519 handle_command_reply: tid=0 2024-05-20T17:07:30.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.496+0000 7f069d01a740 1 client.15519 shutdown 2024-05-20T17:07:30.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.496+0000 7f069d01a740 1 -- 172.21.15.6:0/1993795267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d632590 msgr2=0x562b3d9fd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.496+0000 7f069d01a740 1 --2- 172.21.15.6:0/1993795267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d632590 0x562b3d9fd870 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0678005d00 tx=0x7f067800b390 comp rx=0 tx=0).stop 2024-05-20T17:07:30.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.497+0000 7f069d01a740 1 -- 172.21.15.6:0/1993795267 shutdown_connections 2024-05-20T17:07:30.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.497+0000 7f069d01a740 1 --2- 172.21.15.6:0/1993795267 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x562b3d611e40 0x562b3da0afd0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.497+0000 7f069d01a740 1 --2- 172.21.15.6:0/1993795267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b3d653270 0x562b3da047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.497+0000 7f069d01a740 1 --2- 172.21.15.6:0/1993795267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d632590 0x562b3d9fd870 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.497+0000 7f066effd640 0 client.15519 ms_handle_reset on v2:172.21.15.62:6838/3023093487 2024-05-20T17:07:30.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.497+0000 7f069d01a740 1 --2- 172.21.15.6:0/1993795267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b3d62a3b0 0x562b3d9fd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.497+0000 7f069d01a740 1 -- 172.21.15.6:0/1993795267 >> 172.21.15.6:0/1993795267 conn(0x562b3d6473c0 msgr2=0x562b3d9edea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.497+0000 7f069d01a740 1 -- 172.21.15.6:0/1993795267 shutdown_connections 2024-05-20T17:07:30.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.497+0000 7f069d01a740 1 -- 172.21.15.6:0/1993795267 wait complete. 2024-05-20T17:07:30.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.497+0000 7f069d01a740 20 client.15519 trim_cache size 0 max 16384 2024-05-20T17:07:30.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.515+0000 7f069d01a740 1 Processor -- start 2024-05-20T17:07:30.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.515+0000 7f069d01a740 1 -- start start 2024-05-20T17:07:30.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.516+0000 7f069d01a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d62a3b0 0x562b3d9f7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.516+0000 7f069d01a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b3d632590 0x562b3d9f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.516+0000 7f069d01a740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b3d653270 0x562b3d9ee7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.516+0000 7f069d01a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562b3da09310 con 0x562b3d62a3b0 2024-05-20T17:07:30.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.516+0000 7f069d01a740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562b3da099e0 con 0x562b3d653270 2024-05-20T17:07:30.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.516+0000 7f069d01a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562b3da0a0b0 con 0x562b3d632590 2024-05-20T17:07:30.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.516+0000 7f068f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d62a3b0 0x562b3d9f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.516+0000 7f068f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d62a3b0 0x562b3d9f7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56320/0 (socket says 172.21.15.6:56320) 2024-05-20T17:07:30.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.516+0000 7f068f7fe640 1 -- 172.21.15.6:0/3867207365 learned_addr learned my addr 172.21.15.6:0/3867207365 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:30.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.516+0000 7f068f7fe640 1 -- 172.21.15.6:0/3867207365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b3d632590 msgr2=0x562b3d9f7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.516+0000 7f068f7fe640 1 --2- 172.21.15.6:0/3867207365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b3d632590 0x562b3d9f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.516+0000 7f068f7fe640 1 -- 172.21.15.6:0/3867207365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b3d653270 msgr2=0x562b3d9ee7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.516+0000 7f068f7fe640 1 --2- 172.21.15.6:0/3867207365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b3d653270 0x562b3d9ee7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.516+0000 7f068f7fe640 1 -- 172.21.15.6:0/3867207365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b3d9faae0 con 0x562b3d62a3b0 2024-05-20T17:07:30.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.516+0000 7f068f7fe640 1 --2- 172.21.15.6:0/3867207365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d62a3b0 0x562b3d9f7700 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f06901039f0 tx=0x7f0680019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a81eb7d25426e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.516+0000 7f06857fa640 1 -- 172.21.15.6:0/3867207365 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068002f070 con 0x562b3d62a3b0 2024-05-20T17:07:30.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.516+0000 7f06857fa640 1 -- 172.21.15.6:0/3867207365 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f068001ed80 con 0x562b3d62a3b0 2024-05-20T17:07:30.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.516+0000 7f06857fa640 1 -- 172.21.15.6:0/3867207365 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068001da50 con 0x562b3d62a3b0 2024-05-20T17:07:30.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.517+0000 7f069d01a740 1 -- 172.21.15.6:0/3867207365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d62a3b0 msgr2=0x562b3d9f7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.517+0000 7f069d01a740 1 --2- 172.21.15.6:0/3867207365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d62a3b0 0x562b3d9f7700 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f06901039f0 tx=0x7f0680019000 comp rx=0 tx=0).stop 2024-05-20T17:07:30.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.517+0000 7f069d01a740 1 -- 172.21.15.6:0/3867207365 shutdown_connections 2024-05-20T17:07:30.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.517+0000 7f069d01a740 1 --2- 172.21.15.6:0/3867207365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b3d653270 0x562b3d9ee7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.517+0000 7f069d01a740 1 --2- 172.21.15.6:0/3867207365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b3d632590 0x562b3d9f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.517+0000 7f069d01a740 1 --2- 172.21.15.6:0/3867207365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d62a3b0 0x562b3d9f7700 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.517+0000 7f069d01a740 1 -- 172.21.15.6:0/3867207365 >> 172.21.15.6:0/3867207365 conn(0x562b3d6473c0 msgr2=0x562b3d9f6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.517+0000 7f069d01a740 1 -- 172.21.15.6:0/3867207365 shutdown_connections 2024-05-20T17:07:30.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.517+0000 7f069d01a740 1 -- 172.21.15.6:0/3867207365 wait complete. 2024-05-20T17:07:30.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.518+0000 7f069d01a740 1 -- start start 2024-05-20T17:07:30.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.518+0000 7f069d01a740 1 Processor -- start 2024-05-20T17:07:30.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.518+0000 7f069d01a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b3d632590 0x562b3d9ff050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.518+0000 7f069d01a740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b3d653270 0x562b3d9ff590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.518+0000 7f069d01a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d5e7280 0x562b3da024d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.518+0000 7f069d01a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x562b3da0ae50 con 0x562b3d5e7280 2024-05-20T17:07:30.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.518+0000 7f069d01a740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562b3da0a780 con 0x562b3d653270 2024-05-20T17:07:30.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.518+0000 7f069d01a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562b3da0b520 con 0x562b3d632590 2024-05-20T17:07:30.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.518+0000 7f069d01a740 10 client.0 _ll_register_callbacks cb 0x7f067800beb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:07:30.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.518+0000 7f068ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d5e7280 0x562b3da024d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.518+0000 7f068ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d5e7280 0x562b3da024d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56336/0 (socket says 172.21.15.6:56336) 2024-05-20T17:07:30.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.518+0000 7f068ffff640 1 -- 172.21.15.6:0/2058506105 learned_addr learned my addr 172.21.15.6:0/2058506105 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:30.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.518+0000 7f068f7fe640 1 --2- 172.21.15.6:0/2058506105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b3d632590 0x562b3d9ff050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.518+0000 7f068effd640 1 --2- 172.21.15.6:0/2058506105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b3d653270 0x562b3d9ff590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.518+0000 7f068ffff640 1 -- 172.21.15.6:0/2058506105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b3d632590 msgr2=0x562b3d9ff050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.518+0000 7f068ffff640 1 --2- 172.21.15.6:0/2058506105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b3d632590 0x562b3d9ff050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.518+0000 7f068ffff640 1 -- 172.21.15.6:0/2058506105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b3d653270 msgr2=0x562b3d9ff590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:07:30.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.519+0000 7f068ffff640 1 --2- 172.21.15.6:0/2058506105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b3d653270 0x562b3d9ff590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.519+0000 7f068ffff640 1 -- 172.21.15.6:0/2058506105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b3da02a90 con 0x562b3d5e7280 2024-05-20T17:07:30.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.519+0000 7f068effd640 1 --2- 172.21.15.6:0/2058506105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b3d653270 0x562b3d9ff590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:30.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.519+0000 7f068ffff640 1 --2- 172.21.15.6:0/2058506105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d5e7280 0x562b3da024d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0688005cc0 tx=0x7f06880bcd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c395815f8a6e9d37 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:30.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.519+0000 7f066effd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:07:30.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.519+0000 7f066effd640 1 -- 172.21.15.6:0/2058506105 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06880305c0 con 0x562b3d5e7280 2024-05-20T17:07:30.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.519+0000 7f066effd640 1 -- 172.21.15.6:0/2058506105 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f06880c10b0 con 0x562b3d5e7280 2024-05-20T17:07:30.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.519+0000 7f069d01a740 1 -- 172.21.15.6:0/2058506105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f068001ed80 con 0x562b3d5e7280 2024-05-20T17:07:30.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.519+0000 7f066effd640 1 -- 172.21.15.6:0/2058506105 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f06880bd870 con 0x562b3d5e7280 2024-05-20T17:07:30.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.519+0000 7f069d01a740 10 client.15525 fetch_fsmap learned FSMap version 28 2024-05-20T17:07:30.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.519+0000 7f069d01a740 1 -- 172.21.15.6:0/2058506105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562b3da03d10 con 0x562b3d5e7280 2024-05-20T17:07:30.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.519+0000 7f066effd640 1 -- 172.21.15.6:0/2058506105 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f068001ed80 con 0x562b3d5e7280 2024-05-20T17:07:30.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.519+0000 7f066effd640 1 -- 172.21.15.6:0/2058506105 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f06880c5950 con 0x562b3d5e7280 2024-05-20T17:07:30.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.519+0000 7f069d01a740 10 client.15525 fetch_fsmap finished waiting for FSMap version 28 2024-05-20T17:07:30.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.519+0000 7f069d01a740 10 client.15525 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-20T17:07:30.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.519+0000 7f069d01a740 20 client.15525 populate_metadata read hostname 'smithi006' 2024-05-20T17:07:30.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.520+0000 7f069d01a740 1 --2- 172.21.15.6:0/2058506105 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x562b3da74840 0x562b3da77070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:30.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.520+0000 7f069d01a740 4 client.15525 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:07:30.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.520+0000 7f069d01a740 1 -- 172.21.15.6:0/2058506105 --> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] -- command(tid 0: {"prefix": "status"}) -- 0x562b3d95ef50 con 0x562b3da74840 2024-05-20T17:07:30.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.520+0000 7f068f7fe640 1 --2- 172.21.15.6:0/2058506105 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x562b3da74840 0x562b3da77070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:30.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.520+0000 7f068f7fe640 1 --2- 172.21.15.6:0/2058506105 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x562b3da74840 0x562b3da77070 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4cae36e550ab434 server_cookie=66d890be8cad044e in_seq=0 out_seq=0 2024-05-20T17:07:30.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.520+0000 7f066effd640 10 client.15525 ms_handle_connect on v2:172.21.15.62:6838/3023093487 2024-05-20T17:07:30.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.520+0000 7f066effd640 1 -- 172.21.15.6:0/2058506105 <== mds.0 v2:172.21.15.62:6838/3023093487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562b3d95ef50 con 0x562b3da74840 2024-05-20T17:07:30.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f066effd640 10 client.15525 handle_command_reply: tid=0 2024-05-20T17:07:30.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f069d01a740 1 client.15525 shutdown 2024-05-20T17:07:30.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f069d01a740 1 -- 172.21.15.6:0/2058506105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d5e7280 msgr2=0x562b3da024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f069d01a740 1 --2- 172.21.15.6:0/2058506105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d5e7280 0x562b3da024d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0688005cc0 tx=0x7f06880bcd70 comp rx=0 tx=0).stop 2024-05-20T17:07:30.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f069d01a740 1 -- 172.21.15.6:0/2058506105 shutdown_connections 2024-05-20T17:07:30.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f069d01a740 1 --2- 172.21.15.6:0/2058506105 >> [v2:172.21.15.62:6838/3023093487,v1:172.21.15.62:6839/3023093487] conn(0x562b3da74840 0x562b3da77070 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f069d01a740 1 --2- 172.21.15.6:0/2058506105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562b3d5e7280 0x562b3da024d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f069d01a740 1 --2- 172.21.15.6:0/2058506105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b3d653270 0x562b3d9ff590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f066effd640 0 client.15525 ms_handle_reset on v2:172.21.15.62:6838/3023093487 2024-05-20T17:07:30.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f069d01a740 1 --2- 172.21.15.6:0/2058506105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b3d632590 0x562b3d9ff050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f069d01a740 1 -- 172.21.15.6:0/2058506105 >> 172.21.15.6:0/2058506105 conn(0x562b3d6473c0 msgr2=0x562b3d9f7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f069d01a740 1 -- 172.21.15.6:0/2058506105 shutdown_connections 2024-05-20T17:07:30.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f069d01a740 1 -- 172.21.15.6:0/2058506105 wait complete. 2024-05-20T17:07:30.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f069d01a740 20 client.15525 trim_cache size 0 max 16384 2024-05-20T17:07:30.529 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:07:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "c726c954-16c9-11ef-bc9a-c7b262605968", 2024-05-20T17:07:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-05-20T17:07:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24548, 2024-05-20T17:07:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T17:07:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T17:07:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T17:07:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 145.443704696, 2024-05-20T17:07:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 28, 2024-05-20T17:07:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 94, 2024-05-20T17:07:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 90, 2024-05-20T17:07:30.530 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 151.67956008799999 2024-05-20T17:07:30.530 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:07:30.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f0696179640 1 -- 172.21.15.6:0/995014174 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f067c0a2c10 msgr2=0x7f067c0a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f0696179640 1 --2- 172.21.15.6:0/995014174 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f067c0a2c10 0x7f067c0a5120 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x562b3d9f4850 tx=0x7f068000b390 comp rx=0 tx=0).stop 2024-05-20T17:07:30.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f0696179640 1 -- 172.21.15.6:0/995014174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0690108a20 msgr2=0x7f06901a0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:30.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f0696179640 1 --2- 172.21.15.6:0/995014174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0690108a20 0x7f06901a0770 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0688009dc0 tx=0x7f0688003ba0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f0696179640 1 -- 172.21.15.6:0/995014174 shutdown_connections 2024-05-20T17:07:30.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f0696179640 1 --2- 172.21.15.6:0/995014174 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f067c0a2c10 0x7f067c0a5120 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f0696179640 1 --2- 172.21.15.6:0/995014174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0690108a20 0x7f06901a0770 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f0696179640 1 --2- 172.21.15.6:0/995014174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0690104120 0x7f06901997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f0696179640 1 --2- 172.21.15.6:0/995014174 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06901027e0 0x7f06901992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:30.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.521+0000 7f0696179640 1 -- 172.21.15.6:0/995014174 >> 172.21.15.6:0/995014174 conn(0x7f06900fdcf0 msgr2=0x7f0690104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:30.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.522+0000 7f0696179640 1 -- 172.21.15.6:0/995014174 shutdown_connections 2024-05-20T17:07:30.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:30.522+0000 7f0696179640 1 -- 172.21.15.6:0/995014174 wait complete. 2024-05-20T17:07:30.533 INFO:teuthology.run_tasks:Running task sequential... 2024-05-20T17:07:30.543 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-20T17:07:30.543 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-20T17:07:30.543 INFO:teuthology.task.print:Enabling mgr modules 2024-05-20T17:07:30.543 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-20T17:07:30.563 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-20T17:07:30.564 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-05-20T17:07:30.564 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-05-20T17:07:30.564 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-20T17:07:30.564 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-20T17:07:30.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:07:30.564 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T17:07:30.581 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-20T17:07:30.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:07:30.582 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-20T17:07:30.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:07:30.648 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2024-05-20T17:07:30.743 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-20T17:07:30.743 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph fs ls 2024-05-20T17:07:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:07:32.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:31 smithi062 ceph-mon[35425]: pgmap v378: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:07:32.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:31 smithi171 ceph-mon[35901]: pgmap v378: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:07:32.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:31 smithi006 ceph-mon[32486]: pgmap v378: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:07:32.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.712+0000 7f91a7bf6700 1 -- 172.21.15.6:0/1920447823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a0104360 msgr2=0x7f91a0104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:32.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.712+0000 7f91a7bf6700 1 --2- 172.21.15.6:0/1920447823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a0104360 0x7f91a0104770 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f919c009990 tx=0x7f919c009ca0 comp rx=0 tx=0).stop 2024-05-20T17:07:32.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.712+0000 7f91a7bf6700 1 -- 172.21.15.6:0/1920447823 shutdown_connections 2024-05-20T17:07:32.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.712+0000 7f91a7bf6700 1 --2- 172.21.15.6:0/1920447823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91a010d790 0x7f91a010fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:32.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.712+0000 7f91a7bf6700 1 --2- 172.21.15.6:0/1920447823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a0104360 0x7f91a0104770 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:32.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.712+0000 7f91a7bf6700 1 --2- 172.21.15.6:0/1920447823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91a0104cb0 0x7f91a010d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:32.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.712+0000 7f91a7bf6700 1 -- 172.21.15.6:0/1920447823 >> 172.21.15.6:0/1920447823 conn(0x7f91a00fdc70 msgr2=0x7f91a0100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:32.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.712+0000 7f91a7bf6700 1 -- 172.21.15.6:0/1920447823 shutdown_connections 2024-05-20T17:07:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.712+0000 7f91a7bf6700 1 -- 172.21.15.6:0/1920447823 wait complete. 2024-05-20T17:07:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.713+0000 7f91a7bf6700 1 Processor -- start 2024-05-20T17:07:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.713+0000 7f91a7bf6700 1 -- start start 2024-05-20T17:07:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.713+0000 7f91a7bf6700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91a0104360 0x7f91a0102050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.713+0000 7f91a7bf6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91a0104cb0 0x7f91a0102590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.713+0000 7f91a7bf6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a010d790 0x7f91a0102ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.713+0000 7f91a7bf6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f91a01132d0 con 0x7f91a010d790 2024-05-20T17:07:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.713+0000 7f91a7bf6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f91a0113150 con 0x7f91a0104cb0 2024-05-20T17:07:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.713+0000 7f91a7bf6700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f91a0113450 con 0x7f91a0104360 2024-05-20T17:07:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.713+0000 7f91a6193700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a010d790 0x7f91a0102ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.713+0000 7f91a6193700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a010d790 0x7f91a0102ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34190/0 (socket says 172.21.15.6:34190) 2024-05-20T17:07:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.713+0000 7f91a6193700 1 -- 172.21.15.6:0/2851751875 learned_addr learned my addr 172.21.15.6:0/2851751875 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.713+0000 7f91a5191700 1 --2- 172.21.15.6:0/2851751875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91a0104cb0 0x7f91a0102590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.713+0000 7f91a5992700 1 --2- 172.21.15.6:0/2851751875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91a0104360 0x7f91a0102050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.714+0000 7f91a6193700 1 -- 172.21.15.6:0/2851751875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91a0104360 msgr2=0x7f91a0102050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:32.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.714+0000 7f91a6193700 1 --2- 172.21.15.6:0/2851751875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91a0104360 0x7f91a0102050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:32.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.714+0000 7f91a6193700 1 -- 172.21.15.6:0/2851751875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91a0104cb0 msgr2=0x7f91a0102590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:32.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.714+0000 7f91a6193700 1 --2- 172.21.15.6:0/2851751875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91a0104cb0 0x7f91a0102590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:32.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.714+0000 7f91a6193700 1 -- 172.21.15.6:0/2851751875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a01a7ff0 con 0x7f91a010d790 2024-05-20T17:07:32.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.714+0000 7f91a6193700 1 --2- 172.21.15.6:0/2851751875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a010d790 0x7f91a0102ad0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9198007ee0 tx=0x7f919800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:32.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.714+0000 7f9196ffd700 1 -- 172.21.15.6:0/2851751875 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919800dd20 con 0x7f91a010d790 2024-05-20T17:07:32.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.714+0000 7f9196ffd700 1 -- 172.21.15.6:0/2851751875 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9198004020 con 0x7f91a010d790 2024-05-20T17:07:32.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.714+0000 7f91a7bf6700 1 -- 172.21.15.6:0/2851751875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a01a82e0 con 0x7f91a010d790 2024-05-20T17:07:32.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.714+0000 7f9196ffd700 1 -- 172.21.15.6:0/2851751875 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9198015660 con 0x7f91a010d790 2024-05-20T17:07:32.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.714+0000 7f91a7bf6700 1 -- 172.21.15.6:0/2851751875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a01a8820 con 0x7f91a010d790 2024-05-20T17:07:32.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.715+0000 7f91a7bf6700 1 -- 172.21.15.6:0/2851751875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91a0050170 con 0x7f91a010d790 2024-05-20T17:07:32.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.717+0000 7f9196ffd700 1 -- 172.21.15.6:0/2851751875 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f91980041d0 con 0x7f91a010d790 2024-05-20T17:07:32.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.717+0000 7f9196ffd700 1 --2- 172.21.15.6:0/2851751875 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f918c0a2ca0 0x7f918c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:32.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.718+0000 7f9196ffd700 1 -- 172.21.15.6:0/2851751875 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f91980cf540 con 0x7f91a010d790 2024-05-20T17:07:32.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.718+0000 7f91a5992700 1 --2- 172.21.15.6:0/2851751875 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f918c0a2ca0 0x7f918c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:32.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.718+0000 7f91a5992700 1 --2- 172.21.15.6:0/2851751875 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f918c0a2ca0 0x7f918c0a51b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f919c006010 tx=0x7f919c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:32.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.721+0000 7f9196ffd700 1 -- 172.21.15.6:0/2851751875 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9198010070 con 0x7f91a010d790 2024-05-20T17:07:32.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.976+0000 7f91a7bf6700 1 -- 172.21.15.6:0/2851751875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f91a0103580 con 0x7f91a010d790 2024-05-20T17:07:32.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.976+0000 7f9196ffd700 1 -- 172.21.15.6:0/2851751875 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+88 (secure 0 0 0) 0x7f919809c090 con 0x7f91a010d790 2024-05-20T17:07:32.977 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-20T17:07:32.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.979+0000 7f91a7bf6700 1 -- 172.21.15.6:0/2851751875 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f918c0a2ca0 msgr2=0x7f918c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:32.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.979+0000 7f91a7bf6700 1 --2- 172.21.15.6:0/2851751875 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f918c0a2ca0 0x7f918c0a51b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f919c006010 tx=0x7f919c005960 comp rx=0 tx=0).stop 2024-05-20T17:07:32.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.979+0000 7f91a7bf6700 1 -- 172.21.15.6:0/2851751875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a010d790 msgr2=0x7f91a0102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.979+0000 7f91a7bf6700 1 --2- 172.21.15.6:0/2851751875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a010d790 0x7f91a0102ad0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9198007ee0 tx=0x7f919800d3b0 comp rx=0 tx=0).stop 2024-05-20T17:07:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.979+0000 7f91a7bf6700 1 -- 172.21.15.6:0/2851751875 shutdown_connections 2024-05-20T17:07:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.979+0000 7f91a7bf6700 1 --2- 172.21.15.6:0/2851751875 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f918c0a2ca0 0x7f918c0a51b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.979+0000 7f91a7bf6700 1 --2- 172.21.15.6:0/2851751875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a010d790 0x7f91a0102ad0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.979+0000 7f91a7bf6700 1 --2- 172.21.15.6:0/2851751875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91a0104360 0x7f91a0102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.979+0000 7f91a7bf6700 1 --2- 172.21.15.6:0/2851751875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91a0104cb0 0x7f91a0102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.979+0000 7f91a7bf6700 1 -- 172.21.15.6:0/2851751875 >> 172.21.15.6:0/2851751875 conn(0x7f91a00fdc70 msgr2=0x7f91a00ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.979+0000 7f91a7bf6700 1 -- 172.21.15.6:0/2851751875 shutdown_connections 2024-05-20T17:07:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:32.979+0000 7f91a7bf6700 1 -- 172.21.15.6:0/2851751875 wait complete. 2024-05-20T17:07:33.637 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-20T17:07:33.638 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T17:07:33.638 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-05-20T17:07:33.638 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-20T17:07:33.638 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-20T17:07:33.638 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-20T17:07:33.638 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-20T17:07:33.638 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T17:07:33.638 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:07:33.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:07:33.639 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-05-20T17:07:33.656 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:07:33.657 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:07:33.657 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:07:33.657 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:07:33.657 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-05-20T17:07:33.657 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:07:33.657 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:07:33.657 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:07:33.657 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-05-20T17:07:33.657 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:07:33.657 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:07:33.657 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-05-20T17:07:33.657 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T17:07:33.657 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:07:33.658 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-05-20T17:07:33.658 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-20T17:07:33.658 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42051sec preferred_lft 42051sec 2024-05-20T17:07:33.658 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link noprefixroute 2024-05-20T17:07:33.658 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:07:33.658 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:07:33.658 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:07:33.658 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-05-20T17:07:33.658 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-20T17:07:33.658 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:07:33.659 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:07:33.659 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2024-05-20T17:07:33.659 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2024-05-20T17:07:33.659 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2024-05-20T17:07:33.659 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-20T17:07:33.659 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:07:33.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:07:33.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:07:33.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:07:33.806 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T17:07:33.832 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-05-20T17:07:33.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:07:33.833 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-05-20T17:07:33.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:33 smithi006 ceph-mon[32486]: pgmap v379: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:07:33.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:33 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2851751875' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-20T17:07:33.890 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-05-20T17:07:33.890 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T17:07:33.890 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-20T17:07:33.890 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-20T17:07:33.890 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T17:07:33.891 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:07:33.891 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:07:33.891 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-20T17:07:33.891 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-20T17:07:33.891 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-20T17:07:33.891 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:07:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:07:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:07:34.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:07:34.021 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T17:07:34.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:33 smithi062 ceph-mon[35425]: pgmap v379: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:07:34.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:33 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2851751875' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-20T17:07:34.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:07:34.038 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2024-05-20T17:07:34.094 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:07:34.094 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:07:34.094 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T17:07:34.095 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-20T17:07:34.095 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:07:34.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:33 smithi171 ceph-mon[35901]: pgmap v379: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:07:34.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:33 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2851751875' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-20T17:07:34.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:07:34.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:07:34.215 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-20T17:07:34.215 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:07:34.215 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:07:34.216 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-20T17:07:34.216 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-20T17:07:34.216 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-20T17:07:34.216 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-20T17:07:34.216 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-20T17:07:34.216 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:07:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:07:34.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:07:34.335 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:07:34.335 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:07:34.335 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-05-20T17:07:34.335 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2024-05-20T17:07:34.335 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:07:34.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:07:34.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:07:34.415 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-05-20T17:07:34.415 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:07:34.415 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-20T17:07:34.431 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:07:34.431 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:07:34.431 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-20T17:07:34.487 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-05-20T17:07:34.554 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-05-20T17:07:34.611 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-05-20T17:07:34.611 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-05-20T17:07:34.611 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-05-20T17:07:34.611 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-05-20T17:07:34.611 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-05-20T17:07:34.611 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-05-20T17:07:34.611 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-05-20T17:07:34.611 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-05-20T17:07:34.611 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-05-20T17:07:34.611 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-05-20T17:07:34.611 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-05-20T17:07:34.611 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-05-20T17:07:34.612 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-20T17:07:34.612 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-05-20T17:07:34.612 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-05-20T17:07:34.612 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-05-20T17:07:34.612 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-05-20T17:07:34.612 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-20T17:07:34.612 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-05-20T17:07:34.612 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-05-20T17:07:34.612 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-05-20T17:07:34.612 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-20T17:07:34.612 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-05-20T17:07:34.612 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-05-20T17:07:34.612 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-05-20T17:07:34.612 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay 2024-05-20T17:07:34.612 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/32f03f88c96e7887135ea74e814046280b29fb0cc3583d4ece450916f219076a/merged 2024-05-20T17:07:34.613 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/49c2dd137ecfc953826d652db0a09c838873f42137a2e0a4a0009507683b40cf/merged 2024-05-20T17:07:34.613 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/0 2024-05-20T17:07:34.613 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-20T17:07:34.613 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/6fca35794a9b08fc390d4b4ae84ed83ce0b4406b5effc29a0c402882c2b8d41c/merged 2024-05-20T17:07:34.613 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/8a28c64f6a68a1db76a504dca11c94bb0ca496092db4ef1dbf9c88175ff3fb88/merged 2024-05-20T17:07:34.613 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/5186fe97cd2bdd234edb4876a1a987bcecdf2bc257533922ec6ff80118a7f418/merged 2024-05-20T17:07:34.613 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/26ef61cbcca17a005bed75e09586da508b359627d5a422c0301ceef172b620c0/merged 2024-05-20T17:07:34.613 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/67fc8e1a13e778e97f5336a63a0f434b22d4fd770209f325c6baaafa50ba0c50/merged 2024-05-20T17:07:34.613 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/b586cdd5df2370b8c5089033b8cadeed0396bc2117e2abe2e7b606b467c48328/merged 2024-05-20T17:07:34.613 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/fbc005a16374e329e6f223c6f8139dafa17f5c205281f2550d37e6d8dbdf9628/merged 2024-05-20T17:07:34.613 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/6679033fd5a613663917a094ad5970582eff45f011a84332d0b250886e0a53b9/merged 2024-05-20T17:07:34.613 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-05-20T17:07:34.613 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T17:07:34.613 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T17:07:34.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:07:34.614 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-05-20T17:07:34.667 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-20T17:07:34.667 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/661ab939-67dc-473a-a319-e3f005a94f68 --client_fs=cephfs) 2024-05-20T17:07:34.709 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-05-20T17:07:34.735 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-05-20T17:07:34.793 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-05-20T17:07:34.793 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-05-20T17:07:34.793 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-05-20T17:07:34.794 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-05-20T17:07:34.794 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-05-20T17:07:34.794 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-05-20T17:07:34.794 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-05-20T17:07:34.794 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-05-20T17:07:34.794 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-05-20T17:07:34.794 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-05-20T17:07:34.794 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-05-20T17:07:34.794 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-05-20T17:07:34.794 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-20T17:07:34.794 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-05-20T17:07:34.794 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-05-20T17:07:34.794 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-05-20T17:07:34.795 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-05-20T17:07:34.795 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-20T17:07:34.795 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-05-20T17:07:34.795 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-05-20T17:07:34.795 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-05-20T17:07:34.795 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-20T17:07:34.795 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-05-20T17:07:34.795 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-05-20T17:07:34.795 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-05-20T17:07:34.795 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay 2024-05-20T17:07:34.795 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/32f03f88c96e7887135ea74e814046280b29fb0cc3583d4ece450916f219076a/merged 2024-05-20T17:07:34.795 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/49c2dd137ecfc953826d652db0a09c838873f42137a2e0a4a0009507683b40cf/merged 2024-05-20T17:07:34.795 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/0 2024-05-20T17:07:34.796 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-20T17:07:34.796 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/6fca35794a9b08fc390d4b4ae84ed83ce0b4406b5effc29a0c402882c2b8d41c/merged 2024-05-20T17:07:34.796 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/8a28c64f6a68a1db76a504dca11c94bb0ca496092db4ef1dbf9c88175ff3fb88/merged 2024-05-20T17:07:34.796 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/5186fe97cd2bdd234edb4876a1a987bcecdf2bc257533922ec6ff80118a7f418/merged 2024-05-20T17:07:34.796 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/26ef61cbcca17a005bed75e09586da508b359627d5a422c0301ceef172b620c0/merged 2024-05-20T17:07:34.796 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/67fc8e1a13e778e97f5336a63a0f434b22d4fd770209f325c6baaafa50ba0c50/merged 2024-05-20T17:07:34.796 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/b586cdd5df2370b8c5089033b8cadeed0396bc2117e2abe2e7b606b467c48328/merged 2024-05-20T17:07:34.796 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/fbc005a16374e329e6f223c6f8139dafa17f5c205281f2550d37e6d8dbdf9628/merged 2024-05-20T17:07:34.796 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/6679033fd5a613663917a094ad5970582eff45f011a84332d0b250886e0a53b9/merged 2024-05-20T17:07:34.796 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-05-20T17:07:34.796 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T17:07:34.796 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T17:07:34.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:07:34.797 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-05-20T17:07:34.807 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2024-05-20T17:07:34.806+0000 7f0e09616480 -1 init, newargv = 0x7f0dec003020 newargc=15 2024-05-20T17:07:34.807 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[86272]: starting ceph client 2024-05-20T17:07:34.830 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[86272]: starting fuse 2024-05-20T17:07:35.924 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-05-20T17:07:35.957 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-05-20T17:07:36.016 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-05-20T17:07:36.016 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-05-20T17:07:36.017 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-05-20T17:07:36.017 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-05-20T17:07:36.017 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-05-20T17:07:36.017 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-05-20T17:07:36.017 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-05-20T17:07:36.017 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-05-20T17:07:36.017 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-05-20T17:07:36.017 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-05-20T17:07:36.017 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-05-20T17:07:36.017 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-05-20T17:07:36.017 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-20T17:07:36.017 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-05-20T17:07:36.017 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-05-20T17:07:36.018 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-05-20T17:07:36.018 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-05-20T17:07:36.018 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-20T17:07:36.018 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-05-20T17:07:36.018 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-05-20T17:07:36.018 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-05-20T17:07:36.018 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-20T17:07:36.018 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-05-20T17:07:36.018 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-05-20T17:07:36.018 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-05-20T17:07:36.018 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay 2024-05-20T17:07:36.018 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/32f03f88c96e7887135ea74e814046280b29fb0cc3583d4ece450916f219076a/merged 2024-05-20T17:07:36.018 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/49c2dd137ecfc953826d652db0a09c838873f42137a2e0a4a0009507683b40cf/merged 2024-05-20T17:07:36.019 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/0 2024-05-20T17:07:36.019 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-20T17:07:36.019 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/6fca35794a9b08fc390d4b4ae84ed83ce0b4406b5effc29a0c402882c2b8d41c/merged 2024-05-20T17:07:36.019 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/8a28c64f6a68a1db76a504dca11c94bb0ca496092db4ef1dbf9c88175ff3fb88/merged 2024-05-20T17:07:36.019 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/5186fe97cd2bdd234edb4876a1a987bcecdf2bc257533922ec6ff80118a7f418/merged 2024-05-20T17:07:36.019 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/26ef61cbcca17a005bed75e09586da508b359627d5a422c0301ceef172b620c0/merged 2024-05-20T17:07:36.019 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/67fc8e1a13e778e97f5336a63a0f434b22d4fd770209f325c6baaafa50ba0c50/merged 2024-05-20T17:07:36.019 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/b586cdd5df2370b8c5089033b8cadeed0396bc2117e2abe2e7b606b467c48328/merged 2024-05-20T17:07:36.019 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/fbc005a16374e329e6f223c6f8139dafa17f5c205281f2550d37e6d8dbdf9628/merged 2024-05-20T17:07:36.019 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/containers/storage/overlay/6679033fd5a613663917a094ad5970582eff45f011a84332d0b250886e0a53b9/merged 2024-05-20T17:07:36.019 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-05-20T17:07:36.019 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T17:07:36.019 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T17:07:36.020 INFO:teuthology.orchestra.run.smithi006.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-20T17:07:36.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:07:36.020 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-05-20T17:07:36.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:35 smithi062 ceph-mon[35425]: pgmap v380: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:07:36.079 INFO:teuthology.orchestra.run.smithi006.stdout:119 2024-05-20T17:07:36.080 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [119] 2024-05-20T17:07:36.080 DEBUG:teuthology.orchestra.run.smithi006:> sudo stdin-killer -- python3 -c ' 2024-05-20T17:07:36.080 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2024-05-20T17:07:36.080 DEBUG:teuthology.orchestra.run.smithi006:> import re 2024-05-20T17:07:36.080 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-05-20T17:07:36.080 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2024-05-20T17:07:36.080 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:07:36.080 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2024-05-20T17:07:36.080 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-20T17:07:36.081 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2024-05-20T17:07:36.081 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-20T17:07:36.081 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:07:36.081 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2024-05-20T17:07:36.081 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2024-05-20T17:07:36.081 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2024-05-20T17:07:36.081 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2024-05-20T17:07:36.081 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:07:36.081 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2024-05-20T17:07:36.081 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-20T17:07:36.081 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-20T17:07:36.081 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-20T17:07:36.081 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2024-05-20T17:07:36.081 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2024-05-20T17:07:36.082 DEBUG:teuthology.orchestra.run.smithi006:> return f 2024-05-20T17:07:36.082 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-20T17:07:36.082 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:07:36.082 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2024-05-20T17:07:36.082 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-05-20T17:07:36.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:35 smithi171 ceph-mon[35901]: pgmap v380: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:07:36.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:35 smithi006 ceph-mon[32486]: pgmap v380: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:07:36.208 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.86272.asok 2024-05-20T17:07:36.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:07:36.219 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.86272.asok 2024-05-20T17:07:36.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:07:36.219 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.86272.asok status 2024-05-20T17:07:36.368 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:07:36.368 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2024-05-20T17:07:36.368 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "d2b507c724ef6c8295ee0a35d185cdab167fd61d", 2024-05-20T17:07:36.368 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 19.0.0-2744-gd2b507c7 (d2b507c724ef6c8295ee0a35d185cdab167fd61d) squid (dev)", 2024-05-20T17:07:36.368 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2024-05-20T17:07:36.368 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2024-05-20T17:07:36.368 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-20T17:07:36.368 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "86272", 2024-05-20T17:07:36.369 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/volumes/qa/sv_0/661ab939-67dc-473a-a319-e3f005a94f68" 2024-05-20T17:07:36.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:07:36.369 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2024-05-20T17:07:36.369 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2024-05-20T17:07:36.369 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 15537, 2024-05-20T17:07:36.369 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2024-05-20T17:07:36.369 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2024-05-20T17:07:36.369 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:07:36.369 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 15537 2024-05-20T17:07:36.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:07:36.369 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-05-20T17:07:36.369 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-05-20T17:07:36.369 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-05-20T17:07:36.369 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3800709073 2024-05-20T17:07:36.369 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:07:36.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:07:36.370 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-05-20T17:07:36.370 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-05-20T17:07:36.370 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-05-20T17:07:36.370 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3800709073 2024-05-20T17:07:36.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:07:36.370 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.15537 192.168.0.1:0/3800709073", 2024-05-20T17:07:36.370 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/3800709073", 2024-05-20T17:07:36.370 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 5, 2024-05-20T17:07:36.370 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 28, 2024-05-20T17:07:36.370 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 94, 2024-05-20T17:07:36.370 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2024-05-20T17:07:36.370 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2024-05-20T17:07:36.371 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2024-05-20T17:07:36.371 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:07:36.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:07:36.377 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2024-05-20T17:07:36.377 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-20T17:07:36.394 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2024-05-20T17:07:36.394 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-20T17:07:36.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:07:36.394 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-20T17:07:36.463 INFO:teuthology.run_tasks:Running task exec... 2024-05-20T17:07:36.476 INFO:teuthology.task.exec:Executing custom commands... 2024-05-20T17:07:36.476 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T17:07:36.476 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-05-20T17:07:36.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.618+0000 7f2ea3432640 1 -- 172.21.15.6:0/1675040765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e9c102bf0 msgr2=0x7f2e9c103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:36.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.618+0000 7f2ea3432640 1 --2- 172.21.15.6:0/1675040765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e9c102bf0 0x7f2e9c103000 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009900 tx=0x7f2e8c02a3f0 comp rx=0 tx=0).stop 2024-05-20T17:07:36.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.618+0000 7f2ea3432640 1 -- 172.21.15.6:0/1675040765 shutdown_connections 2024-05-20T17:07:36.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.618+0000 7f2ea3432640 1 --2- 172.21.15.6:0/1675040765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e9c1078f0 0x7f2e9c109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:36.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.618+0000 7f2ea3432640 1 --2- 172.21.15.6:0/1675040765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e9c102bf0 0x7f2e9c103000 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:36.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.618+0000 7f2ea3432640 1 --2- 172.21.15.6:0/1675040765 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e9c1019b0 0x7f2e9c1026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:36.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.618+0000 7f2ea3432640 1 -- 172.21.15.6:0/1675040765 >> 172.21.15.6:0/1675040765 conn(0x7f2e9c0fcba0 msgr2=0x7f2e9c0ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:36.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.618+0000 7f2ea3432640 1 -- 172.21.15.6:0/1675040765 shutdown_connections 2024-05-20T17:07:36.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.618+0000 7f2ea3432640 1 -- 172.21.15.6:0/1675040765 wait complete. 2024-05-20T17:07:36.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.619+0000 7f2ea3432640 1 Processor -- start 2024-05-20T17:07:36.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.619+0000 7f2ea3432640 1 -- start start 2024-05-20T17:07:36.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.619+0000 7f2ea3432640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e9c1019b0 0x7f2e9c0747f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:36.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.619+0000 7f2ea3432640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e9c102bf0 0x7f2e9c19ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:36.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.619+0000 7f2ea3432640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e9c1078f0 0x7f2e9c1a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:36.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.619+0000 7f2ea3432640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9c10d4b0 con 0x7f2e9c1019b0 2024-05-20T17:07:36.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.619+0000 7f2ea3432640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9c10d330 con 0x7f2e9c1078f0 2024-05-20T17:07:36.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.619+0000 7f2ea3432640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9c10d630 con 0x7f2e9c102bf0 2024-05-20T17:07:36.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.619+0000 7f2ea11ce640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e9c1019b0 0x7f2e9c0747f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:36.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.619+0000 7f2ea11ce640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e9c1019b0 0x7f2e9c0747f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34218/0 (socket says 172.21.15.6:34218) 2024-05-20T17:07:36.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.619+0000 7f2ea11ce640 1 -- 172.21.15.6:0/894275100 learned_addr learned my addr 172.21.15.6:0/894275100 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:07:36.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.619+0000 7f2ea19cf640 1 --2- 172.21.15.6:0/894275100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e9c1078f0 0x7f2e9c1a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:36.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.619+0000 7f2ea09cd640 1 --2- 172.21.15.6:0/894275100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e9c102bf0 0x7f2e9c19ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:36.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.620+0000 7f2ea11ce640 1 -- 172.21.15.6:0/894275100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e9c102bf0 msgr2=0x7f2e9c19ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:36.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.620+0000 7f2ea11ce640 1 --2- 172.21.15.6:0/894275100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e9c102bf0 0x7f2e9c19ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:36.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.620+0000 7f2ea11ce640 1 -- 172.21.15.6:0/894275100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e9c1078f0 msgr2=0x7f2e9c1a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:36.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.620+0000 7f2ea11ce640 1 --2- 172.21.15.6:0/894275100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e9c1078f0 0x7f2e9c1a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:36.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.620+0000 7f2ea11ce640 1 -- 172.21.15.6:0/894275100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9c1a0bb0 con 0x7f2e9c1019b0 2024-05-20T17:07:36.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.620+0000 7f2ea19cf640 1 --2- 172.21.15.6:0/894275100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e9c1078f0 0x7f2e9c1a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:07:36.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.620+0000 7f2ea11ce640 1 --2- 172.21.15.6:0/894275100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e9c1019b0 0x7f2e9c0747f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800d740 tx=0x7f2e9800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:36.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.620+0000 7f2e927fc640 1 -- 172.21.15.6:0/894275100 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98017070 con 0x7f2e9c1019b0 2024-05-20T17:07:36.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.620+0000 7f2e927fc640 1 -- 172.21.15.6:0/894275100 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2e9800de50 con 0x7f2e9c1019b0 2024-05-20T17:07:36.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.620+0000 7f2ea3432640 1 -- 172.21.15.6:0/894275100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e9c1a0ea0 con 0x7f2e9c1019b0 2024-05-20T17:07:36.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.620+0000 7f2e927fc640 1 -- 172.21.15.6:0/894275100 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98003cc0 con 0x7f2e9c1019b0 2024-05-20T17:07:36.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.620+0000 7f2ea3432640 1 -- 172.21.15.6:0/894275100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e9c1a1300 con 0x7f2e9c1019b0 2024-05-20T17:07:36.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.621+0000 7f2ea3432640 1 -- 172.21.15.6:0/894275100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e9c04f720 con 0x7f2e9c1019b0 2024-05-20T17:07:36.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.623+0000 7f2e927fc640 1 -- 172.21.15.6:0/894275100 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f2e98003e60 con 0x7f2e9c1019b0 2024-05-20T17:07:36.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.623+0000 7f2e927fc640 1 --2- 172.21.15.6:0/894275100 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2e880a2c30 0x7f2e880a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:07:36.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.623+0000 7f2e927fc640 1 -- 172.21.15.6:0/894275100 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f2e980cf250 con 0x7f2e9c1019b0 2024-05-20T17:07:36.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.623+0000 7f2ea09cd640 1 --2- 172.21.15.6:0/894275100 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2e880a2c30 0x7f2e880a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:07:36.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.624+0000 7f2ea09cd640 1 --2- 172.21.15.6:0/894275100 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2e880a2c30 0x7f2e880a5140 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c000c00 tx=0x7f2e8c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:07:36.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.627+0000 7f2e927fc640 1 -- 172.21.15.6:0/894275100 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2e9809be00 con 0x7f2e9c1019b0 2024-05-20T17:07:36.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:36.852+0000 7f2ea3432640 1 -- 172.21.15.6:0/894275100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f2e9c106700 con 0x7f2e9c1019b0 2024-05-20T17:07:37.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:37.762+0000 7f2e927fc640 1 -- 172.21.15.6:0/894275100 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v29) ==== 117+0+0 (secure 0 0 0) 0x7f2e9809b700 con 0x7f2e9c1019b0 2024-05-20T17:07:37.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:37.765+0000 7f2ea3432640 1 -- 172.21.15.6:0/894275100 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2e880a2c30 msgr2=0x7f2e880a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:37.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:37.765+0000 7f2ea3432640 1 --2- 172.21.15.6:0/894275100 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2e880a2c30 0x7f2e880a5140 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c000c00 tx=0x7f2e8c031400 comp rx=0 tx=0).stop 2024-05-20T17:07:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:37.765+0000 7f2ea3432640 1 -- 172.21.15.6:0/894275100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e9c1019b0 msgr2=0x7f2e9c0747f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:07:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:37.765+0000 7f2ea3432640 1 --2- 172.21.15.6:0/894275100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e9c1019b0 0x7f2e9c0747f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800d740 tx=0x7f2e9800dc00 comp rx=0 tx=0).stop 2024-05-20T17:07:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:37.765+0000 7f2ea3432640 1 -- 172.21.15.6:0/894275100 shutdown_connections 2024-05-20T17:07:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:37.765+0000 7f2ea3432640 1 --2- 172.21.15.6:0/894275100 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2e880a2c30 0x7f2e880a5140 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:37.765+0000 7f2ea3432640 1 --2- 172.21.15.6:0/894275100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e9c1078f0 0x7f2e9c1a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:37.765+0000 7f2ea3432640 1 --2- 172.21.15.6:0/894275100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e9c102bf0 0x7f2e9c19ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:37.765+0000 7f2ea3432640 1 --2- 172.21.15.6:0/894275100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e9c1019b0 0x7f2e9c0747f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:07:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:37.765+0000 7f2ea3432640 1 -- 172.21.15.6:0/894275100 >> 172.21.15.6:0/894275100 conn(0x7f2e9c0fcba0 msgr2=0x7f2e9c1038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:07:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:37.766+0000 7f2ea3432640 1 -- 172.21.15.6:0/894275100 shutdown_connections 2024-05-20T17:07:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:07:37.766+0000 7f2ea3432640 1 -- 172.21.15.6:0/894275100 wait complete. 2024-05-20T17:07:37.781 INFO:teuthology.run_tasks:Running task check-counter... 2024-05-20T17:07:37.795 INFO:teuthology.run_tasks:Running task workunit... 2024-05-20T17:07:37.854 INFO:tasks.workunit:Pulling workunits from ref d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:07:37.854 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-20T17:07:37.854 INFO:tasks.workunit:timeout=3h 2024-05-20T17:07:37.855 INFO:tasks.workunit:cleanup=True 2024-05-20T17:07:37.855 DEBUG:teuthology.orchestra.run.smithi006:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-20T17:07:37.874 INFO:teuthology.orchestra.run.smithi006.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-20T17:07:37.874 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-05-20T17:07:37.874 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 77h/119d Inode: 1 Links: 2 2024-05-20T17:07:37.874 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:07:37.874 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:fusefs_t:s0 2024-05-20T17:07:37.874 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-05-20 17:05:34.970737388 +0000 2024-05-20T17:07:37.874 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-05-20 17:05:34.970737388 +0000 2024-05-20T17:07:37.874 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-05-20 17:07:36.461232229 +0000 2024-05-20T17:07:37.874 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2024-05-20T17:07:37.874 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-20T17:07:37.875 DEBUG:teuthology.orchestra.run.smithi006:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-20T17:07:37.952 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:07:38.011 INFO:tasks.workunit.client.0.smithi006.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-20T17:07:38.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:37 smithi062 ceph-mon[35425]: pgmap v381: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-20T17:07:38.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:37 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/894275100' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-20T17:07:38.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:37 smithi006 ceph-mon[32486]: pgmap v381: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-20T17:07:38.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:37 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/894275100' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-20T17:07:38.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:37 smithi171 ceph-mon[35901]: pgmap v381: 129 pgs: 129 active+clean; 646 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-20T17:07:38.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:37 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/894275100' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-20T17:07:39.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:38 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/894275100' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-20T17:07:39.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:38 smithi171 ceph-mon[35901]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:07:39.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:38 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/894275100' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-20T17:07:39.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:38 smithi006 ceph-mon[32486]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:07:39.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:38 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/894275100' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-20T17:07:39.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:38 smithi062 ceph-mon[35425]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:07:40.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:39 smithi171 ceph-mon[35901]: pgmap v382: 129 pgs: 129 active+clean; 647 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-20T17:07:40.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:39 smithi006 ceph-mon[32486]: pgmap v382: 129 pgs: 129 active+clean; 647 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-20T17:07:40.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:39 smithi062 ceph-mon[35425]: pgmap v382: 129 pgs: 129 active+clean; 647 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-20T17:07:42.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:41 smithi171 ceph-mon[35901]: pgmap v383: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-05-20T17:07:42.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:41 smithi006 ceph-mon[32486]: pgmap v383: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-05-20T17:07:42.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:41 smithi062 ceph-mon[35425]: pgmap v383: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-05-20T17:07:44.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:43 smithi171 ceph-mon[35901]: pgmap v384: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-05-20T17:07:44.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:43 smithi006 ceph-mon[32486]: pgmap v384: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-05-20T17:07:44.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:43 smithi062 ceph-mon[35425]: pgmap v384: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-05-20T17:07:46.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:45 smithi171 ceph-mon[35901]: pgmap v385: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-05-20T17:07:46.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:45 smithi006 ceph-mon[32486]: pgmap v385: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-05-20T17:07:46.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:45 smithi062 ceph-mon[35425]: pgmap v385: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-05-20T17:07:48.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:47 smithi171 ceph-mon[35901]: pgmap v386: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-05-20T17:07:48.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:47 smithi006 ceph-mon[32486]: pgmap v386: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-05-20T17:07:48.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:47 smithi062 ceph-mon[35425]: pgmap v386: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-05-20T17:07:49.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:48 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:07:49.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:48 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:07:49.224 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:48 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:07:50.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:49 smithi171 ceph-mon[35901]: pgmap v387: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-05-20T17:07:50.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:49 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:50.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:49 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:50.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:49 smithi006 ceph-mon[32486]: pgmap v387: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-05-20T17:07:50.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:49 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:50.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:49 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:50.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:49 smithi062 ceph-mon[35425]: pgmap v387: 129 pgs: 129 active+clean; 658 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-05-20T17:07:50.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:49 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:50.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:49 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:51.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:51 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:51.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:51 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:51.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:51 smithi171 ceph-mon[35901]: pgmap v388: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-05-20T17:07:51.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:51 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:51.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:51 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:51.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:51 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:51.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:51 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:51.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:51 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:51.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:51 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:51.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:51 smithi006 ceph-mon[32486]: pgmap v388: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-05-20T17:07:51.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:51 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:51.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:51 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:51.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:51 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:51.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:51 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:51.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:51 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:51.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:51 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:51.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:51 smithi062 ceph-mon[35425]: pgmap v388: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-05-20T17:07:51.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:51 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:51.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:51 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:51.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:51 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:51.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:51 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:52.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:52 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:07:52.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:52 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:07:52.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:52 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:52.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:52 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:07:52.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:52 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:07:52.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:52 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:52.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:52 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:07:52.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:52 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:07:52.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:52 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:07:53.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:53 smithi171 ceph-mon[35901]: pgmap v389: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 682 B/s wr, 10 op/s 2024-05-20T17:07:53.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:53 smithi006 ceph-mon[32486]: pgmap v389: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 682 B/s wr, 10 op/s 2024-05-20T17:07:53.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:53 smithi062 ceph-mon[35425]: pgmap v389: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 682 B/s wr, 10 op/s 2024-05-20T17:07:55.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:55 smithi062 ceph-mon[35425]: pgmap v390: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-20T17:07:55.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:55 smithi171 ceph-mon[35901]: pgmap v390: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-20T17:07:55.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:55 smithi006 ceph-mon[32486]: pgmap v390: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-20T17:07:57.452 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:57 smithi006 ceph-mon[32486]: pgmap v391: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-05-20T17:07:57.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:57 smithi062 ceph-mon[35425]: pgmap v391: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-05-20T17:07:57.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:57 smithi171 ceph-mon[35901]: pgmap v391: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-05-20T17:07:59.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:07:59 smithi062 ceph-mon[35425]: pgmap v392: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-20T17:07:59.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:07:59 smithi171 ceph-mon[35901]: pgmap v392: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-20T17:07:59.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:07:59 smithi006 ceph-mon[32486]: pgmap v392: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-20T17:08:01.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:01 smithi062 ceph-mon[35425]: pgmap v393: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-20T17:08:01.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:01 smithi171 ceph-mon[35901]: pgmap v393: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-20T17:08:01.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:01 smithi006 ceph-mon[32486]: pgmap v393: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-20T17:08:03.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:03 smithi062 ceph-mon[35425]: pgmap v394: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:08:03.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:03 smithi171 ceph-mon[35901]: pgmap v394: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:08:03.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:03 smithi006 ceph-mon[32486]: pgmap v394: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:08:05.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:05 smithi062 ceph-mon[35425]: pgmap v395: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:08:05.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:05 smithi171 ceph-mon[35901]: pgmap v395: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:08:05.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:05 smithi006 ceph-mon[32486]: pgmap v395: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:08:07.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:07 smithi062 ceph-mon[35425]: pgmap v396: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:08:07.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:07 smithi171 ceph-mon[35901]: pgmap v396: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:08:07.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:07 smithi006 ceph-mon[32486]: pgmap v396: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:08:09.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:09 smithi062 ceph-mon[35425]: pgmap v397: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:08:09.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:09 smithi171 ceph-mon[35901]: pgmap v397: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:08:09.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:09 smithi006 ceph-mon[32486]: pgmap v397: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:08:11.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:11 smithi062 ceph-mon[35425]: pgmap v398: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:08:11.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:11 smithi171 ceph-mon[35901]: pgmap v398: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:08:11.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:11 smithi006 ceph-mon[32486]: pgmap v398: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:08:13.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:13 smithi062 ceph-mon[35425]: pgmap v399: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:08:13.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:13 smithi171 ceph-mon[35901]: pgmap v399: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:08:13.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:13 smithi006 ceph-mon[32486]: pgmap v399: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:08:15.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:15 smithi062 ceph-mon[35425]: pgmap v400: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:08:15.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:15 smithi171 ceph-mon[35901]: pgmap v400: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:08:15.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:15 smithi006 ceph-mon[32486]: pgmap v400: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:08:17.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:17 smithi062 ceph-mon[35425]: pgmap v401: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:08:17.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:17 smithi171 ceph-mon[35901]: pgmap v401: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:08:17.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:17 smithi006 ceph-mon[32486]: pgmap v401: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:08:19.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:19 smithi062 ceph-mon[35425]: pgmap v402: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:08:19.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:19 smithi171 ceph-mon[35901]: pgmap v402: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:08:19.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:19 smithi006 ceph-mon[32486]: pgmap v402: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:08:21.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:21 smithi062 ceph-mon[35425]: pgmap v403: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:08:21.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:21 smithi171 ceph-mon[35901]: pgmap v403: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:08:21.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:21 smithi006 ceph-mon[32486]: pgmap v403: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:08:23.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:23 smithi062 ceph-mon[35425]: pgmap v404: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:08:23.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:23 smithi171 ceph-mon[35901]: pgmap v404: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:08:23.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:23 smithi006 ceph-mon[32486]: pgmap v404: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:08:25.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:25 smithi062 ceph-mon[35425]: pgmap v405: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:08:25.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:25 smithi171 ceph-mon[35901]: pgmap v405: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:08:25.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:25 smithi006 ceph-mon[32486]: pgmap v405: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:08:27.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:27 smithi062 ceph-mon[35425]: pgmap v406: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:08:27.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:27 smithi171 ceph-mon[35901]: pgmap v406: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:08:27.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:27 smithi006 ceph-mon[32486]: pgmap v406: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:08:29.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:29 smithi062 ceph-mon[35425]: pgmap v407: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:08:29.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:29 smithi171 ceph-mon[35901]: pgmap v407: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:08:29.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:29 smithi006 ceph-mon[32486]: pgmap v407: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:08:31.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:31 smithi062 ceph-mon[35425]: pgmap v408: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:08:31.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:31 smithi171 ceph-mon[35901]: pgmap v408: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:08:31.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:31 smithi006 ceph-mon[32486]: pgmap v408: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:08:33.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:33 smithi062 ceph-mon[35425]: pgmap v409: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:08:33.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:33 smithi171 ceph-mon[35901]: pgmap v409: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:08:33.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:33 smithi006 ceph-mon[32486]: pgmap v409: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:08:35.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:35 smithi062 ceph-mon[35425]: pgmap v410: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:08:35.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:35 smithi171 ceph-mon[35901]: pgmap v410: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:08:35.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:35 smithi006 ceph-mon[32486]: pgmap v410: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:08:37.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:37 smithi062 ceph-mon[35425]: pgmap v411: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:08:37.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:37 smithi171 ceph-mon[35901]: pgmap v411: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:08:37.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:37 smithi006 ceph-mon[32486]: pgmap v411: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:08:39.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:39 smithi062 ceph-mon[35425]: pgmap v412: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:08:39.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:39 smithi171 ceph-mon[35901]: pgmap v412: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:08:39.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:39 smithi006 ceph-mon[32486]: pgmap v412: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:08:41.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:41 smithi062 ceph-mon[35425]: pgmap v413: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:08:41.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:41 smithi171 ceph-mon[35901]: pgmap v413: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:08:41.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:41 smithi006 ceph-mon[32486]: pgmap v413: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:08:43.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:43 smithi062 ceph-mon[35425]: pgmap v414: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:08:43.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:43 smithi171 ceph-mon[35901]: pgmap v414: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:08:43.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:43 smithi006 ceph-mon[32486]: pgmap v414: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:08:45.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:45 smithi062 ceph-mon[35425]: pgmap v415: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:08:45.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:45 smithi171 ceph-mon[35901]: pgmap v415: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:08:45.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:45 smithi006 ceph-mon[32486]: pgmap v415: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:08:47.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:47 smithi062 ceph-mon[35425]: pgmap v416: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:08:47.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:47 smithi171 ceph-mon[35901]: pgmap v416: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:08:47.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:47 smithi006 ceph-mon[32486]: pgmap v416: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:08:49.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:49 smithi171 ceph-mon[35901]: pgmap v417: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:08:49.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:49 smithi006 ceph-mon[32486]: pgmap v417: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:08:50.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:49 smithi062 ceph-mon[35425]: pgmap v417: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:08:51.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:51 smithi171 ceph-mon[35901]: pgmap v418: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:08:51.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:51 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:08:51.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:51 smithi006 ceph-mon[32486]: pgmap v418: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:08:51.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:51 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:08:52.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:51 smithi062 ceph-mon[35425]: pgmap v418: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:08:52.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:51 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:08:53.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:53 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:08:53.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:53 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:08:53.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:53 smithi171 ceph-mon[35901]: pgmap v419: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:08:53.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:53 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:08:53.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:53 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:08:53.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:53 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:08:53.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:53 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:08:53.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:53 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:08:53.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:53 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:08:53.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:53 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:08:53.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:53 smithi006 ceph-mon[32486]: pgmap v419: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:08:53.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:53 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:08:53.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:53 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:08:53.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:53 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:08:53.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:53 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:08:53.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:53 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:08:53.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:53 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:08:53.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:53 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:08:53.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:53 smithi062 ceph-mon[35425]: pgmap v419: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:08:53.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:53 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:08:53.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:53 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:08:53.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:53 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:08:53.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:53 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:08:53.523 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:53 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:08:55.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:55 smithi062 ceph-mon[35425]: pgmap v420: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:08:55.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:55 smithi171 ceph-mon[35901]: pgmap v420: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:08:55.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:55 smithi006 ceph-mon[32486]: pgmap v420: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:08:57.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:57 smithi062 ceph-mon[35425]: pgmap v421: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:08:57.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:57 smithi171 ceph-mon[35901]: pgmap v421: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:08:57.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:57 smithi006 ceph-mon[32486]: pgmap v421: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:08:59.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:08:59 smithi062 ceph-mon[35425]: pgmap v422: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:08:59.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:08:59 smithi171 ceph-mon[35901]: pgmap v422: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:08:59.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:08:59 smithi006 ceph-mon[32486]: pgmap v422: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-20T17:09:01.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:01 smithi062 ceph-mon[35425]: pgmap v423: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:09:01.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:01 smithi171 ceph-mon[35901]: pgmap v423: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:09:01.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:01 smithi006 ceph-mon[32486]: pgmap v423: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-20T17:09:02.165 INFO:tasks.workunit.client.0.smithi006.stderr:Updating files: 94% (11611/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-20T17:09:02.536 INFO:tasks.workunit.client.0.smithi006.stderr:Note: switching to 'd2b507c724ef6c8295ee0a35d185cdab167fd61d'. 2024-05-20T17:09:02.537 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-05-20T17:09:02.537 INFO:tasks.workunit.client.0.smithi006.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-20T17:09:02.537 INFO:tasks.workunit.client.0.smithi006.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-20T17:09:02.537 INFO:tasks.workunit.client.0.smithi006.stderr:state without impacting any branches by switching back to a branch. 2024-05-20T17:09:02.537 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-05-20T17:09:02.537 INFO:tasks.workunit.client.0.smithi006.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-20T17:09:02.537 INFO:tasks.workunit.client.0.smithi006.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-20T17:09:02.537 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-05-20T17:09:02.537 INFO:tasks.workunit.client.0.smithi006.stderr: git switch -c 2024-05-20T17:09:02.537 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-05-20T17:09:02.537 INFO:tasks.workunit.client.0.smithi006.stderr:Or undo this operation with: 2024-05-20T17:09:02.537 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-05-20T17:09:02.538 INFO:tasks.workunit.client.0.smithi006.stderr: git switch - 2024-05-20T17:09:02.538 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-05-20T17:09:02.538 INFO:tasks.workunit.client.0.smithi006.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-20T17:09:02.538 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-05-20T17:09:02.538 INFO:tasks.workunit.client.0.smithi006.stderr:HEAD is now at d2b507c724e Merge PR #56984 into wip-pdonnell-testing-20240517.203521-squid-debug 2024-05-20T17:09:02.544 DEBUG:teuthology.orchestra.run.smithi006:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-20T17:09:02.608 INFO:tasks.workunit.client.0.smithi006.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-20T17:09:02.610 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-20T17:09:02.610 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-20T17:09:03.340 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-20T17:09:03.396 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-20T17:09:03.437 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-20T17:09:03.438 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-20T17:09:03.438 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-20T17:09:03.479 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-20T17:09:03.483 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:09:03.483 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-20T17:09:03.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:03 smithi062 ceph-mon[35425]: pgmap v424: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:09:03.540 INFO:tasks.workunit:Running workunits matching suites/iogen.sh on client.0... 2024-05-20T17:09:03.542 INFO:tasks.workunit:Running workunit suites/iogen.sh... 2024-05-20T17:09:03.543 DEBUG:teuthology.orchestra.run.smithi006:workunit test suites/iogen.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2b507c724ef6c8295ee0a35d185cdab167fd61d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iogen.sh 2024-05-20T17:09:03.606 INFO:tasks.workunit.client.0.smithi006.stdout:getting iogen 2024-05-20T17:09:03.607 INFO:tasks.workunit.client.0.smithi006.stderr:+ echo 'getting iogen' 2024-05-20T17:09:03.607 INFO:tasks.workunit.client.0.smithi006.stderr:+ wget http://download.ceph.com/qa/iogen_3.1p0.tar 2024-05-20T17:09:03.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:03 smithi171 ceph-mon[35901]: pgmap v424: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:09:03.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:03 smithi006 ceph-mon[32486]: pgmap v424: 129 pgs: 129 active+clean; 663 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:09:03.641 INFO:tasks.workunit.client.0.smithi006.stderr:--2024-05-20 17:09:03-- http://download.ceph.com/qa/iogen_3.1p0.tar 2024-05-20T17:09:03.641 INFO:tasks.workunit.client.0.smithi006.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-05-20T17:09:03.678 INFO:tasks.workunit.client.0.smithi006.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-05-20T17:09:03.714 INFO:tasks.workunit.client.0.smithi006.stderr:HTTP request sent, awaiting response... 200 OK 2024-05-20T17:09:03.714 INFO:tasks.workunit.client.0.smithi006.stderr:Length: 8071 (7.9K) [application/octet-stream] 2024-05-20T17:09:03.716 INFO:tasks.workunit.client.0.smithi006.stderr:Saving to: ‘iogen_3.1p0.tar’ 2024-05-20T17:09:03.720 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-05-20T17:09:03.720 INFO:tasks.workunit.client.0.smithi006.stderr: 0K ....... 100% 1.22G=0s 2024-05-20T17:09:03.720 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-05-20T17:09:03.720 INFO:tasks.workunit.client.0.smithi006.stderr:2024-05-20 17:09:03 (1.22 GB/s) - ‘iogen_3.1p0.tar’ saved [8071/8071] 2024-05-20T17:09:03.720 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-05-20T17:09:03.720 INFO:tasks.workunit.client.0.smithi006.stderr:+ tar -xvzf iogen_3.1p0.tar 2024-05-20T17:09:03.737 INFO:tasks.workunit.client.0.smithi006.stdout:iogen_3.1p0 2024-05-20T17:09:03.739 INFO:tasks.workunit.client.0.smithi006.stdout:iogen_3.1p0/src 2024-05-20T17:09:03.740 INFO:tasks.workunit.client.0.smithi006.stdout:iogen_3.1p0/src/iogen.8 2024-05-20T17:09:03.742 INFO:tasks.workunit.client.0.smithi006.stdout:iogen_3.1p0/src/iogen.c 2024-05-20T17:09:03.746 INFO:tasks.workunit.client.0.smithi006.stdout:iogen_3.1p0/README 2024-05-20T17:09:03.748 INFO:tasks.workunit.client.0.smithi006.stdout:iogen_3.1p0/Makefile.bsd 2024-05-20T17:09:03.750 INFO:tasks.workunit.client.0.smithi006.stdout:iogen_3.1p0/Makefile 2024-05-20T17:09:03.753 INFO:tasks.workunit.client.0.smithi006.stderr:+ cd iogen_3.1p0 2024-05-20T17:09:03.755 INFO:tasks.workunit.client.0.smithi006.stdout:making iogen 2024-05-20T17:09:03.755 INFO:tasks.workunit.client.0.smithi006.stderr:+ echo 'making iogen' 2024-05-20T17:09:03.755 INFO:tasks.workunit.client.0.smithi006.stderr:+ make 2024-05-20T17:09:03.768 INFO:tasks.workunit.client.0.smithi006.stdout:gcc -D_FILE_OFFSET_BITS=64 -DVERSION=\"3.1p0\" -Dstrlcpy=strncpy -Darc4random=rand -O2 src/iogen.c -o iogen 2024-05-20T17:09:04.004 INFO:tasks.workunit.client.0.smithi006.stdout:nroff -mandoc -Tascii src/iogen.8 > iogen.cat8 2024-05-20T17:09:04.114 INFO:tasks.workunit.client.0.smithi006.stdout:running iogen 2024-05-20T17:09:04.114 INFO:tasks.workunit.client.0.smithi006.stderr:+ echo 'running iogen' 2024-05-20T17:09:04.114 INFO:tasks.workunit.client.0.smithi006.stderr:+ ./iogen -n 5 -s 2g 2024-05-20T17:09:04.115 INFO:tasks.workunit.client.0.smithi006.stderr:child spawned 87396 2024-05-20T17:09:04.115 INFO:tasks.workunit.client.0.smithi006.stderr:child spawned 87397 2024-05-20T17:09:04.115 INFO:tasks.workunit.client.0.smithi006.stderr:child spawned 87398 2024-05-20T17:09:04.118 INFO:tasks.workunit.client.0.smithi006.stderr:child spawned 87399 2024-05-20T17:09:04.118 INFO:tasks.workunit.client.0.smithi006.stderr:child spawned 87400 2024-05-20T17:09:04.118 INFO:tasks.workunit.client.0.smithi006.stderr:+ echo 'sleep for 10 min' 2024-05-20T17:09:04.118 INFO:tasks.workunit.client.0.smithi006.stdout:sleep for 10 min 2024-05-20T17:09:04.119 INFO:tasks.workunit.client.0.smithi006.stderr:+ sleep 600 2024-05-20T17:09:05.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:05 smithi062 ceph-mon[35425]: pgmap v425: 129 pgs: 129 active+clean; 681 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-05-20T17:09:05.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:05 smithi171 ceph-mon[35901]: pgmap v425: 129 pgs: 129 active+clean; 681 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-05-20T17:09:05.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:05 smithi006 ceph-mon[32486]: pgmap v425: 129 pgs: 129 active+clean; 681 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-05-20T17:09:07.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:07 smithi062 ceph-mon[35425]: pgmap v426: 129 pgs: 129 active+clean; 98 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8.1 MiB/s wr, 13 op/s 2024-05-20T17:09:07.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:07 smithi171 ceph-mon[35901]: pgmap v426: 129 pgs: 129 active+clean; 98 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8.1 MiB/s wr, 13 op/s 2024-05-20T17:09:07.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:07 smithi006 ceph-mon[32486]: pgmap v426: 129 pgs: 129 active+clean; 98 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8.1 MiB/s wr, 13 op/s 2024-05-20T17:09:09.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:09 smithi062 ceph-mon[35425]: pgmap v427: 129 pgs: 129 active+clean; 378 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 31 MiB/s wr, 28 op/s 2024-05-20T17:09:09.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:09 smithi171 ceph-mon[35901]: pgmap v427: 129 pgs: 129 active+clean; 378 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 31 MiB/s wr, 28 op/s 2024-05-20T17:09:09.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:09 smithi006 ceph-mon[32486]: pgmap v427: 129 pgs: 129 active+clean; 378 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 31 MiB/s wr, 28 op/s 2024-05-20T17:09:11.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:11 smithi062 ceph-mon[35425]: pgmap v428: 129 pgs: 129 active+clean; 457 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 38 MiB/s wr, 36 op/s 2024-05-20T17:09:11.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:11 smithi171 ceph-mon[35901]: pgmap v428: 129 pgs: 129 active+clean; 457 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 38 MiB/s wr, 36 op/s 2024-05-20T17:09:11.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:11 smithi006 ceph-mon[32486]: pgmap v428: 129 pgs: 129 active+clean; 457 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 38 MiB/s wr, 36 op/s 2024-05-20T17:09:13.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:13 smithi062 ceph-mon[35425]: pgmap v429: 129 pgs: 129 active+clean; 898 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 75 MiB/s wr, 53 op/s 2024-05-20T17:09:13.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:13 smithi171 ceph-mon[35901]: pgmap v429: 129 pgs: 129 active+clean; 898 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 75 MiB/s wr, 53 op/s 2024-05-20T17:09:13.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:13 smithi006 ceph-mon[32486]: pgmap v429: 129 pgs: 129 active+clean; 898 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 75 MiB/s wr, 53 op/s 2024-05-20T17:09:15.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:15 smithi062 ceph-mon[35425]: pgmap v430: 129 pgs: 129 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 97 MiB/s wr, 67 op/s 2024-05-20T17:09:15.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:15 smithi062 ceph-mon[35425]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:09:15.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:15 smithi171 ceph-mon[35901]: pgmap v430: 129 pgs: 129 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 97 MiB/s wr, 67 op/s 2024-05-20T17:09:15.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:15 smithi171 ceph-mon[35901]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:09:15.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:15 smithi006 ceph-mon[32486]: pgmap v430: 129 pgs: 129 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 97 MiB/s wr, 67 op/s 2024-05-20T17:09:15.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:15 smithi006 ceph-mon[32486]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:09:17.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:17 smithi062 ceph-mon[35425]: pgmap v431: 129 pgs: 129 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 117 MiB/s wr, 75 op/s 2024-05-20T17:09:17.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:17 smithi171 ceph-mon[35901]: pgmap v431: 129 pgs: 129 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 117 MiB/s wr, 75 op/s 2024-05-20T17:09:17.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:17 smithi006 ceph-mon[32486]: pgmap v431: 129 pgs: 129 active+clean; 1.4 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 117 MiB/s wr, 75 op/s 2024-05-20T17:09:19.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:19 smithi062 ceph-mon[35425]: pgmap v432: 129 pgs: 129 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 151 MiB/s wr, 93 op/s 2024-05-20T17:09:19.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:19 smithi171 ceph-mon[35901]: pgmap v432: 129 pgs: 129 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 151 MiB/s wr, 93 op/s 2024-05-20T17:09:19.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:19 smithi006 ceph-mon[32486]: pgmap v432: 129 pgs: 129 active+clean; 1.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 151 MiB/s wr, 93 op/s 2024-05-20T17:09:20.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:20 smithi062 ceph-mon[35425]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:09:20.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:20 smithi171 ceph-mon[35901]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:09:20.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:20 smithi006 ceph-mon[32486]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:09:21.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:21 smithi062 ceph-mon[35425]: pgmap v433: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 133 MiB/s wr, 84 op/s 2024-05-20T17:09:21.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:21 smithi171 ceph-mon[35901]: pgmap v433: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 133 MiB/s wr, 84 op/s 2024-05-20T17:09:21.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:21 smithi006 ceph-mon[32486]: pgmap v433: 129 pgs: 129 active+clean; 1.9 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 133 MiB/s wr, 84 op/s 2024-05-20T17:09:23.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:23 smithi062 ceph-mon[35425]: pgmap v434: 129 pgs: 129 active+clean; 2.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 164 MiB/s wr, 94 op/s 2024-05-20T17:09:23.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:23 smithi171 ceph-mon[35901]: pgmap v434: 129 pgs: 129 active+clean; 2.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 164 MiB/s wr, 94 op/s 2024-05-20T17:09:23.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:23 smithi006 ceph-mon[32486]: pgmap v434: 129 pgs: 129 active+clean; 2.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 164 MiB/s wr, 94 op/s 2024-05-20T17:09:25.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:25 smithi171 ceph-mon[35901]: pgmap v435: 129 pgs: 129 active+clean; 2.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 149 MiB/s wr, 89 op/s 2024-05-20T17:09:25.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:25 smithi006 ceph-mon[32486]: pgmap v435: 129 pgs: 129 active+clean; 2.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 149 MiB/s wr, 89 op/s 2024-05-20T17:09:25.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:25 smithi062 ceph-mon[35425]: pgmap v435: 129 pgs: 129 active+clean; 2.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 149 MiB/s wr, 89 op/s 2024-05-20T17:09:27.573 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:27 smithi062 ceph-mon[35425]: pgmap v436: 129 pgs: 129 active+clean; 2.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 147 MiB/s wr, 84 op/s 2024-05-20T17:09:27.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:27 smithi171 ceph-mon[35901]: pgmap v436: 129 pgs: 129 active+clean; 2.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 147 MiB/s wr, 84 op/s 2024-05-20T17:09:27.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:27 smithi006 ceph-mon[32486]: pgmap v436: 129 pgs: 129 active+clean; 2.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 147 MiB/s wr, 84 op/s 2024-05-20T17:09:29.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:29 smithi171 ceph-mon[35901]: pgmap v437: 129 pgs: 129 active+clean; 3.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 173 MiB/s wr, 97 op/s 2024-05-20T17:09:29.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:29 smithi006 ceph-mon[32486]: pgmap v437: 129 pgs: 129 active+clean; 3.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 173 MiB/s wr, 97 op/s 2024-05-20T17:09:29.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:29 smithi062 ceph-mon[35425]: pgmap v437: 129 pgs: 129 active+clean; 3.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 173 MiB/s wr, 97 op/s 2024-05-20T17:09:31.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:31 smithi171 ceph-mon[35901]: pgmap v438: 129 pgs: 129 active+clean; 3.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 136 MiB/s wr, 80 op/s 2024-05-20T17:09:31.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:31 smithi006 ceph-mon[32486]: pgmap v438: 129 pgs: 129 active+clean; 3.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 136 MiB/s wr, 80 op/s 2024-05-20T17:09:31.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:31 smithi062 ceph-mon[35425]: pgmap v438: 129 pgs: 129 active+clean; 3.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 136 MiB/s wr, 80 op/s 2024-05-20T17:09:33.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:33 smithi171 ceph-mon[35901]: pgmap v439: 129 pgs: 129 active+clean; 3.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 166 MiB/s wr, 93 op/s 2024-05-20T17:09:33.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:33 smithi006 ceph-mon[32486]: pgmap v439: 129 pgs: 129 active+clean; 3.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 166 MiB/s wr, 93 op/s 2024-05-20T17:09:33.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:33 smithi062 ceph-mon[35425]: pgmap v439: 129 pgs: 129 active+clean; 3.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 166 MiB/s wr, 93 op/s 2024-05-20T17:09:35.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:35 smithi171 ceph-mon[35901]: pgmap v440: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 151 MiB/s wr, 87 op/s 2024-05-20T17:09:35.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:35 smithi006 ceph-mon[32486]: pgmap v440: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 151 MiB/s wr, 87 op/s 2024-05-20T17:09:35.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:35 smithi062 ceph-mon[35425]: pgmap v440: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 151 MiB/s wr, 87 op/s 2024-05-20T17:09:37.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:37 smithi171 ceph-mon[35901]: pgmap v441: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 148 MiB/s wr, 83 op/s 2024-05-20T17:09:37.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:37 smithi006 ceph-mon[32486]: pgmap v441: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 148 MiB/s wr, 83 op/s 2024-05-20T17:09:37.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:37 smithi062 ceph-mon[35425]: pgmap v441: 129 pgs: 129 active+clean; 4.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 148 MiB/s wr, 83 op/s 2024-05-20T17:09:39.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:39 smithi171 ceph-mon[35901]: pgmap v442: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 174 MiB/s wr, 97 op/s 2024-05-20T17:09:39.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:39 smithi006 ceph-mon[32486]: pgmap v442: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 174 MiB/s wr, 97 op/s 2024-05-20T17:09:39.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:39 smithi062 ceph-mon[35425]: pgmap v442: 129 pgs: 129 active+clean; 4.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 174 MiB/s wr, 97 op/s 2024-05-20T17:09:41.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:41 smithi171 ceph-mon[35901]: pgmap v443: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 134 MiB/s wr, 78 op/s 2024-05-20T17:09:41.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:41 smithi006 ceph-mon[32486]: pgmap v443: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 134 MiB/s wr, 78 op/s 2024-05-20T17:09:41.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:41 smithi062 ceph-mon[35425]: pgmap v443: 129 pgs: 129 active+clean; 5.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 134 MiB/s wr, 78 op/s 2024-05-20T17:09:43.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:43 smithi171 ceph-mon[35901]: pgmap v444: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 165 MiB/s wr, 93 op/s 2024-05-20T17:09:43.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:43 smithi006 ceph-mon[32486]: pgmap v444: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 165 MiB/s wr, 93 op/s 2024-05-20T17:09:43.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:43 smithi062 ceph-mon[35425]: pgmap v444: 129 pgs: 129 active+clean; 5.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 165 MiB/s wr, 93 op/s 2024-05-20T17:09:45.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:45 smithi171 ceph-mon[35901]: pgmap v445: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 152 MiB/s wr, 88 op/s 2024-05-20T17:09:45.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:45 smithi006 ceph-mon[32486]: pgmap v445: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 152 MiB/s wr, 88 op/s 2024-05-20T17:09:45.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:45 smithi062 ceph-mon[35425]: pgmap v445: 129 pgs: 129 active+clean; 5.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 152 MiB/s wr, 88 op/s 2024-05-20T17:09:47.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:47 smithi171 ceph-mon[35901]: pgmap v446: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 150 MiB/s wr, 84 op/s 2024-05-20T17:09:47.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:47 smithi006 ceph-mon[32486]: pgmap v446: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 150 MiB/s wr, 84 op/s 2024-05-20T17:09:47.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:47 smithi062 ceph-mon[35425]: pgmap v446: 129 pgs: 129 active+clean; 5.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 150 MiB/s wr, 84 op/s 2024-05-20T17:09:49.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:49 smithi171 ceph-mon[35901]: pgmap v447: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 176 MiB/s wr, 98 op/s 2024-05-20T17:09:49.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:49 smithi006 ceph-mon[32486]: pgmap v447: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 176 MiB/s wr, 98 op/s 2024-05-20T17:09:49.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:49 smithi062 ceph-mon[35425]: pgmap v447: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 176 MiB/s wr, 98 op/s 2024-05-20T17:09:51.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:51 smithi171 ceph-mon[35901]: pgmap v448: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 135 MiB/s wr, 79 op/s 2024-05-20T17:09:51.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:51 smithi006 ceph-mon[32486]: pgmap v448: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 135 MiB/s wr, 79 op/s 2024-05-20T17:09:51.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:51 smithi062 ceph-mon[35425]: pgmap v448: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 135 MiB/s wr, 79 op/s 2024-05-20T17:09:53.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:53 smithi171 ceph-mon[35901]: pgmap v449: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 169 MiB/s wr, 94 op/s 2024-05-20T17:09:53.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:53 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:09:53.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:53 smithi006 ceph-mon[32486]: pgmap v449: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 169 MiB/s wr, 94 op/s 2024-05-20T17:09:53.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:53 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:09:53.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:53 smithi062 ceph-mon[35425]: pgmap v449: 129 pgs: 129 active+clean; 7.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 169 MiB/s wr, 94 op/s 2024-05-20T17:09:53.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:53 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:09:54.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:54 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:09:54.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:54 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:09:54.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:54 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:09:54.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:54 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:09:54.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:54 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:09:54.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:54 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:09:54.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:54 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:09:54.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:54 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:09:54.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:54 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:09:55.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:55 smithi171 ceph-mon[35901]: pgmap v450: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 153 MiB/s wr, 88 op/s 2024-05-20T17:09:55.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:55 smithi006 ceph-mon[32486]: pgmap v450: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 153 MiB/s wr, 88 op/s 2024-05-20T17:09:55.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:55 smithi062 ceph-mon[35425]: pgmap v450: 129 pgs: 129 active+clean; 7.2 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 153 MiB/s wr, 88 op/s 2024-05-20T17:09:57.574 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:57 smithi062 ceph-mon[35425]: pgmap v451: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 151 MiB/s wr, 85 op/s 2024-05-20T17:09:57.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:57 smithi171 ceph-mon[35901]: pgmap v451: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 151 MiB/s wr, 85 op/s 2024-05-20T17:09:57.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:57 smithi006 ceph-mon[32486]: pgmap v451: 129 pgs: 129 active+clean; 7.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 151 MiB/s wr, 85 op/s 2024-05-20T17:09:59.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:09:59 smithi171 ceph-mon[35901]: pgmap v452: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 172 MiB/s wr, 96 op/s 2024-05-20T17:09:59.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:09:59 smithi006 ceph-mon[32486]: pgmap v452: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 172 MiB/s wr, 96 op/s 2024-05-20T17:09:59.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:09:59 smithi062 ceph-mon[35425]: pgmap v452: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 172 MiB/s wr, 96 op/s 2024-05-20T17:10:00.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:00 smithi171 ceph-mon[35901]: overall HEALTH_OK 2024-05-20T17:10:00.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:00 smithi006 ceph-mon[32486]: overall HEALTH_OK 2024-05-20T17:10:00.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:00 smithi062 ceph-mon[35425]: overall HEALTH_OK 2024-05-20T17:10:01.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:01 smithi171 ceph-mon[35901]: pgmap v453: 129 pgs: 129 active+clean; 8.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 132 MiB/s wr, 77 op/s 2024-05-20T17:10:01.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:01 smithi006 ceph-mon[32486]: pgmap v453: 129 pgs: 129 active+clean; 8.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 132 MiB/s wr, 77 op/s 2024-05-20T17:10:01.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:01 smithi062 ceph-mon[35425]: pgmap v453: 129 pgs: 129 active+clean; 8.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 132 MiB/s wr, 77 op/s 2024-05-20T17:10:03.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:03 smithi171 ceph-mon[35901]: pgmap v454: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 165 MiB/s wr, 93 op/s 2024-05-20T17:10:03.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:03 smithi006 ceph-mon[32486]: pgmap v454: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 165 MiB/s wr, 93 op/s 2024-05-20T17:10:03.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:03 smithi062 ceph-mon[35425]: pgmap v454: 129 pgs: 129 active+clean; 8.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 165 MiB/s wr, 93 op/s 2024-05-20T17:10:05.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:05 smithi171 ceph-mon[35901]: pgmap v455: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 149 MiB/s wr, 86 op/s 2024-05-20T17:10:05.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:05 smithi006 ceph-mon[32486]: pgmap v455: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 149 MiB/s wr, 86 op/s 2024-05-20T17:10:05.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:05 smithi062 ceph-mon[35425]: pgmap v455: 129 pgs: 129 active+clean; 8.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 149 MiB/s wr, 86 op/s 2024-05-20T17:10:07.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:07 smithi171 ceph-mon[35901]: pgmap v456: 129 pgs: 129 active+clean; 9.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 154 MiB/s wr, 86 op/s 2024-05-20T17:10:07.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:07 smithi006 ceph-mon[32486]: pgmap v456: 129 pgs: 129 active+clean; 9.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 154 MiB/s wr, 86 op/s 2024-05-20T17:10:07.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:07 smithi062 ceph-mon[35425]: pgmap v456: 129 pgs: 129 active+clean; 9.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 154 MiB/s wr, 86 op/s 2024-05-20T17:10:09.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:09 smithi171 ceph-mon[35901]: pgmap v457: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 171 MiB/s wr, 95 op/s 2024-05-20T17:10:09.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:09 smithi006 ceph-mon[32486]: pgmap v457: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 171 MiB/s wr, 95 op/s 2024-05-20T17:10:09.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:09 smithi062 ceph-mon[35425]: pgmap v457: 129 pgs: 129 active+clean; 9.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 171 MiB/s wr, 95 op/s 2024-05-20T17:10:11.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:11 smithi171 ceph-mon[35901]: pgmap v458: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 137 MiB/s wr, 79 op/s 2024-05-20T17:10:11.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:11 smithi006 ceph-mon[32486]: pgmap v458: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 137 MiB/s wr, 79 op/s 2024-05-20T17:10:11.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:11 smithi062 ceph-mon[35425]: pgmap v458: 129 pgs: 129 active+clean; 9.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 137 MiB/s wr, 79 op/s 2024-05-20T17:10:13.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:13 smithi171 ceph-mon[35901]: pgmap v459: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 161 MiB/s wr, 134 op/s 2024-05-20T17:10:13.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:13 smithi006 ceph-mon[32486]: pgmap v459: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 161 MiB/s wr, 134 op/s 2024-05-20T17:10:13.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:13 smithi062 ceph-mon[35425]: pgmap v459: 129 pgs: 129 active+clean; 9.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 161 MiB/s wr, 134 op/s 2024-05-20T17:10:15.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:15 smithi171 ceph-mon[35901]: pgmap v460: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 141 MiB/s wr, 184 op/s 2024-05-20T17:10:15.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:15 smithi006 ceph-mon[32486]: pgmap v460: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 141 MiB/s wr, 184 op/s 2024-05-20T17:10:15.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:15 smithi062 ceph-mon[35425]: pgmap v460: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 141 MiB/s wr, 184 op/s 2024-05-20T17:10:17.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:17 smithi171 ceph-mon[35901]: pgmap v461: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 125 MiB/s wr, 290 op/s 2024-05-20T17:10:17.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:17 smithi006 ceph-mon[32486]: pgmap v461: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 125 MiB/s wr, 290 op/s 2024-05-20T17:10:17.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:17 smithi062 ceph-mon[35425]: pgmap v461: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 125 MiB/s wr, 290 op/s 2024-05-20T17:10:19.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:19 smithi171 ceph-mon[35901]: pgmap v462: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 116 MiB/s wr, 525 op/s 2024-05-20T17:10:19.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:19 smithi006 ceph-mon[32486]: pgmap v462: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 116 MiB/s wr, 525 op/s 2024-05-20T17:10:19.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:19 smithi062 ceph-mon[35425]: pgmap v462: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 116 MiB/s wr, 525 op/s 2024-05-20T17:10:21.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:21 smithi171 ceph-mon[35901]: pgmap v463: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 81 MiB/s wr, 542 op/s 2024-05-20T17:10:21.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:21 smithi006 ceph-mon[32486]: pgmap v463: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 81 MiB/s wr, 542 op/s 2024-05-20T17:10:21.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:21 smithi062 ceph-mon[35425]: pgmap v463: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 81 MiB/s wr, 542 op/s 2024-05-20T17:10:23.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:23 smithi171 ceph-mon[35901]: pgmap v464: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 87 MiB/s wr, 747 op/s 2024-05-20T17:10:23.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:23 smithi006 ceph-mon[32486]: pgmap v464: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 87 MiB/s wr, 747 op/s 2024-05-20T17:10:23.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:23 smithi062 ceph-mon[35425]: pgmap v464: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 87 MiB/s wr, 747 op/s 2024-05-20T17:10:25.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:25 smithi006 ceph-mon[32486]: pgmap v465: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 65 MiB/s wr, 819 op/s 2024-05-20T17:10:25.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:25 smithi062 ceph-mon[35425]: pgmap v465: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 65 MiB/s wr, 819 op/s 2024-05-20T17:10:25.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:25 smithi171 ceph-mon[35901]: pgmap v465: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 65 MiB/s wr, 819 op/s 2024-05-20T17:10:27.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:27 smithi062 ceph-mon[35425]: pgmap v466: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 54 MiB/s wr, 873 op/s 2024-05-20T17:10:27.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:27 smithi006 ceph-mon[32486]: pgmap v466: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 54 MiB/s wr, 873 op/s 2024-05-20T17:10:27.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:27 smithi171 ceph-mon[35901]: pgmap v466: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 54 MiB/s wr, 873 op/s 2024-05-20T17:10:29.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:29 smithi006 ceph-mon[32486]: pgmap v467: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 61 MiB/s wr, 989 op/s 2024-05-20T17:10:29.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:29 smithi062 ceph-mon[35425]: pgmap v467: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 61 MiB/s wr, 989 op/s 2024-05-20T17:10:29.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:29 smithi171 ceph-mon[35901]: pgmap v467: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 61 MiB/s wr, 989 op/s 2024-05-20T17:10:31.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:31 smithi006 ceph-mon[32486]: pgmap v468: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 48 MiB/s wr, 775 op/s 2024-05-20T17:10:31.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:31 smithi062 ceph-mon[35425]: pgmap v468: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 48 MiB/s wr, 775 op/s 2024-05-20T17:10:31.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:31 smithi171 ceph-mon[35901]: pgmap v468: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 48 MiB/s wr, 775 op/s 2024-05-20T17:10:33.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:33 smithi006 ceph-mon[32486]: pgmap v469: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 59 MiB/s wr, 945 op/s 2024-05-20T17:10:33.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:33 smithi062 ceph-mon[35425]: pgmap v469: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 59 MiB/s wr, 945 op/s 2024-05-20T17:10:33.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:33 smithi171 ceph-mon[35901]: pgmap v469: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 59 MiB/s wr, 945 op/s 2024-05-20T17:10:35.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:35 smithi171 ceph-mon[35901]: pgmap v470: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 53 MiB/s wr, 861 op/s 2024-05-20T17:10:35.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:35 smithi062 ceph-mon[35425]: pgmap v470: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 53 MiB/s wr, 861 op/s 2024-05-20T17:10:35.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:35 smithi006 ceph-mon[32486]: pgmap v470: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 53 MiB/s wr, 861 op/s 2024-05-20T17:10:37.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:37 smithi062 ceph-mon[35425]: pgmap v471: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 53 MiB/s wr, 850 op/s 2024-05-20T17:10:37.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:37 smithi171 ceph-mon[35901]: pgmap v471: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 53 MiB/s wr, 850 op/s 2024-05-20T17:10:37.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:37 smithi006 ceph-mon[32486]: pgmap v471: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 53 MiB/s wr, 850 op/s 2024-05-20T17:10:39.657 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:39 smithi006 ceph-mon[32486]: pgmap v472: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 59 MiB/s wr, 956 op/s 2024-05-20T17:10:39.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:39 smithi062 ceph-mon[35425]: pgmap v472: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 59 MiB/s wr, 956 op/s 2024-05-20T17:10:39.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:39 smithi171 ceph-mon[35901]: pgmap v472: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 59 MiB/s wr, 956 op/s 2024-05-20T17:10:41.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:41 smithi062 ceph-mon[35425]: pgmap v473: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 46 MiB/s wr, 751 op/s 2024-05-20T17:10:41.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:41 smithi171 ceph-mon[35901]: pgmap v473: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 46 MiB/s wr, 751 op/s 2024-05-20T17:10:41.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:41 smithi006 ceph-mon[32486]: pgmap v473: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 46 MiB/s wr, 751 op/s 2024-05-20T17:10:43.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:43 smithi062 ceph-mon[35425]: pgmap v474: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 58 MiB/s wr, 928 op/s 2024-05-20T17:10:43.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:43 smithi171 ceph-mon[35901]: pgmap v474: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 58 MiB/s wr, 928 op/s 2024-05-20T17:10:43.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:43 smithi006 ceph-mon[32486]: pgmap v474: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 58 MiB/s wr, 928 op/s 2024-05-20T17:10:45.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:45 smithi062 ceph-mon[35425]: pgmap v475: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 53 MiB/s wr, 851 op/s 2024-05-20T17:10:45.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:45 smithi171 ceph-mon[35901]: pgmap v475: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 53 MiB/s wr, 851 op/s 2024-05-20T17:10:45.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:45 smithi006 ceph-mon[32486]: pgmap v475: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 53 MiB/s wr, 851 op/s 2024-05-20T17:10:47.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:47 smithi062 ceph-mon[35425]: pgmap v476: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 52 MiB/s wr, 842 op/s 2024-05-20T17:10:47.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:47 smithi171 ceph-mon[35901]: pgmap v476: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 52 MiB/s wr, 842 op/s 2024-05-20T17:10:47.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:47 smithi006 ceph-mon[32486]: pgmap v476: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 52 MiB/s wr, 842 op/s 2024-05-20T17:10:49.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:49 smithi062 ceph-mon[35425]: pgmap v477: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 59 MiB/s wr, 950 op/s 2024-05-20T17:10:49.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:49 smithi171 ceph-mon[35901]: pgmap v477: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 59 MiB/s wr, 950 op/s 2024-05-20T17:10:49.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:49 smithi006 ceph-mon[32486]: pgmap v477: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 59 MiB/s wr, 950 op/s 2024-05-20T17:10:51.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:51 smithi062 ceph-mon[35425]: pgmap v478: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 47 MiB/s wr, 753 op/s 2024-05-20T17:10:51.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:51 smithi171 ceph-mon[35901]: pgmap v478: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 47 MiB/s wr, 753 op/s 2024-05-20T17:10:51.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:51 smithi006 ceph-mon[32486]: pgmap v478: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 47 MiB/s wr, 753 op/s 2024-05-20T17:10:53.668 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:53 smithi171 ceph-mon[35901]: pgmap v479: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 58 MiB/s wr, 931 op/s 2024-05-20T17:10:53.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:53 smithi062 ceph-mon[35425]: pgmap v479: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 58 MiB/s wr, 931 op/s 2024-05-20T17:10:53.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:53 smithi006 ceph-mon[32486]: pgmap v479: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 58 MiB/s wr, 931 op/s 2024-05-20T17:10:54.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:54 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:10:54.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:54 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:10:54.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:54 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:10:55.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:55 smithi062 ceph-mon[35425]: pgmap v480: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 52 MiB/s wr, 844 op/s 2024-05-20T17:10:55.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:55 smithi171 ceph-mon[35901]: pgmap v480: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 52 MiB/s wr, 844 op/s 2024-05-20T17:10:55.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:55 smithi006 ceph-mon[32486]: pgmap v480: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 52 MiB/s wr, 844 op/s 2024-05-20T17:10:56.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:56 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:10:56.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:56 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:10:56.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:56 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:10:56.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:56 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:10:56.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:56 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:10:56.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:56 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:10:56.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:56 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:10:56.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:56 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:10:56.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:56 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:10:57.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:57 smithi062 ceph-mon[35425]: pgmap v481: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 51 MiB/s wr, 827 op/s 2024-05-20T17:10:57.782 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:57 smithi006 ceph-mon[32486]: pgmap v481: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 51 MiB/s wr, 827 op/s 2024-05-20T17:10:57.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:57 smithi171 ceph-mon[35901]: pgmap v481: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 51 MiB/s wr, 827 op/s 2024-05-20T17:10:59.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:10:59 smithi062 ceph-mon[35425]: pgmap v482: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 57 MiB/s wr, 925 op/s 2024-05-20T17:10:59.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:10:59 smithi171 ceph-mon[35901]: pgmap v482: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 57 MiB/s wr, 925 op/s 2024-05-20T17:10:59.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:10:59 smithi006 ceph-mon[32486]: pgmap v482: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 57 MiB/s wr, 925 op/s 2024-05-20T17:11:01.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:01 smithi062 ceph-mon[35425]: pgmap v483: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 45 MiB/s wr, 728 op/s 2024-05-20T17:11:01.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:01 smithi171 ceph-mon[35901]: pgmap v483: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 45 MiB/s wr, 728 op/s 2024-05-20T17:11:01.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:01 smithi006 ceph-mon[32486]: pgmap v483: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 45 MiB/s wr, 728 op/s 2024-05-20T17:11:03.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:03 smithi062 ceph-mon[35425]: pgmap v484: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 55 MiB/s wr, 890 op/s 2024-05-20T17:11:03.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:03 smithi171 ceph-mon[35901]: pgmap v484: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 55 MiB/s wr, 890 op/s 2024-05-20T17:11:03.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:03 smithi006 ceph-mon[32486]: pgmap v484: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 55 MiB/s wr, 890 op/s 2024-05-20T17:11:05.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:05 smithi062 ceph-mon[35425]: pgmap v485: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 50 MiB/s wr, 804 op/s 2024-05-20T17:11:05.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:05 smithi171 ceph-mon[35901]: pgmap v485: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 50 MiB/s wr, 804 op/s 2024-05-20T17:11:05.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:05 smithi006 ceph-mon[32486]: pgmap v485: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 50 MiB/s wr, 804 op/s 2024-05-20T17:11:07.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:07 smithi062 ceph-mon[35425]: pgmap v486: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 49 MiB/s wr, 792 op/s 2024-05-20T17:11:07.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:07 smithi171 ceph-mon[35901]: pgmap v486: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 49 MiB/s wr, 792 op/s 2024-05-20T17:11:07.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:07 smithi006 ceph-mon[32486]: pgmap v486: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 49 MiB/s wr, 792 op/s 2024-05-20T17:11:09.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:09 smithi062 ceph-mon[35425]: pgmap v487: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 55 MiB/s wr, 896 op/s 2024-05-20T17:11:09.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:09 smithi171 ceph-mon[35901]: pgmap v487: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 55 MiB/s wr, 896 op/s 2024-05-20T17:11:09.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:09 smithi006 ceph-mon[32486]: pgmap v487: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 55 MiB/s wr, 896 op/s 2024-05-20T17:11:10.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:10 smithi062 ceph-mon[35425]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:11:10.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:10 smithi171 ceph-mon[35901]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:11:10.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:10 smithi006 ceph-mon[32486]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:11:11.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:11 smithi062 ceph-mon[35425]: pgmap v488: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 44 MiB/s wr, 713 op/s 2024-05-20T17:11:11.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:11 smithi171 ceph-mon[35901]: pgmap v488: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 44 MiB/s wr, 713 op/s 2024-05-20T17:11:11.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:11 smithi006 ceph-mon[32486]: pgmap v488: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 44 MiB/s wr, 713 op/s 2024-05-20T17:11:13.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:13 smithi062 ceph-mon[35425]: pgmap v489: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 54 MiB/s wr, 879 op/s 2024-05-20T17:11:13.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:13 smithi171 ceph-mon[35901]: pgmap v489: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 54 MiB/s wr, 879 op/s 2024-05-20T17:11:13.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:13 smithi006 ceph-mon[32486]: pgmap v489: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 54 MiB/s wr, 879 op/s 2024-05-20T17:11:15.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:15 smithi062 ceph-mon[35425]: pgmap v490: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 50 MiB/s wr, 804 op/s 2024-05-20T17:11:15.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:15 smithi171 ceph-mon[35901]: pgmap v490: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 50 MiB/s wr, 804 op/s 2024-05-20T17:11:15.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:15 smithi006 ceph-mon[32486]: pgmap v490: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 50 MiB/s wr, 804 op/s 2024-05-20T17:11:17.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:17 smithi062 ceph-mon[35425]: pgmap v491: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 47 MiB/s wr, 758 op/s 2024-05-20T17:11:17.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:17 smithi171 ceph-mon[35901]: pgmap v491: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 47 MiB/s wr, 758 op/s 2024-05-20T17:11:17.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:17 smithi006 ceph-mon[32486]: pgmap v491: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 47 MiB/s wr, 758 op/s 2024-05-20T17:11:19.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:19 smithi062 ceph-mon[35425]: pgmap v492: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 55 MiB/s wr, 889 op/s 2024-05-20T17:11:19.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:19 smithi171 ceph-mon[35901]: pgmap v492: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 55 MiB/s wr, 889 op/s 2024-05-20T17:11:19.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:19 smithi006 ceph-mon[32486]: pgmap v492: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 55 MiB/s wr, 889 op/s 2024-05-20T17:11:20.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:20 smithi171 ceph-mon[35901]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:11:20.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:20 smithi006 ceph-mon[32486]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:11:21.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:20 smithi062 ceph-mon[35425]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:11:21.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:21 smithi171 ceph-mon[35901]: pgmap v493: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 44 MiB/s wr, 705 op/s 2024-05-20T17:11:21.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:21 smithi006 ceph-mon[32486]: pgmap v493: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 44 MiB/s wr, 705 op/s 2024-05-20T17:11:22.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:21 smithi062 ceph-mon[35425]: pgmap v493: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 44 MiB/s wr, 705 op/s 2024-05-20T17:11:23.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:23 smithi171 ceph-mon[35901]: pgmap v494: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 54 MiB/s wr, 866 op/s 2024-05-20T17:11:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:23 smithi006 ceph-mon[32486]: pgmap v494: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 54 MiB/s wr, 866 op/s 2024-05-20T17:11:24.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:23 smithi062 ceph-mon[35425]: pgmap v494: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 54 MiB/s wr, 866 op/s 2024-05-20T17:11:25.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:25 smithi171 ceph-mon[35901]: pgmap v495: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 49 MiB/s wr, 787 op/s 2024-05-20T17:11:25.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:25 smithi006 ceph-mon[32486]: pgmap v495: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 49 MiB/s wr, 787 op/s 2024-05-20T17:11:26.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:25 smithi062 ceph-mon[35425]: pgmap v495: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 49 MiB/s wr, 787 op/s 2024-05-20T17:11:27.823 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:27 smithi062 ceph-mon[35425]: pgmap v496: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 46 MiB/s wr, 740 op/s 2024-05-20T17:11:27.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:27 smithi171 ceph-mon[35901]: pgmap v496: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 46 MiB/s wr, 740 op/s 2024-05-20T17:11:27.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:27 smithi006 ceph-mon[32486]: pgmap v496: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 46 MiB/s wr, 740 op/s 2024-05-20T17:11:29.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:29 smithi171 ceph-mon[35901]: pgmap v497: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 56 MiB/s wr, 897 op/s 2024-05-20T17:11:29.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:29 smithi006 ceph-mon[32486]: pgmap v497: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 56 MiB/s wr, 897 op/s 2024-05-20T17:11:30.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:29 smithi062 ceph-mon[35425]: pgmap v497: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 56 MiB/s wr, 897 op/s 2024-05-20T17:11:31.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:31 smithi171 ceph-mon[35901]: pgmap v498: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 42 MiB/s wr, 686 op/s 2024-05-20T17:11:31.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:31 smithi006 ceph-mon[32486]: pgmap v498: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 42 MiB/s wr, 686 op/s 2024-05-20T17:11:32.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:31 smithi062 ceph-mon[35425]: pgmap v498: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 42 MiB/s wr, 686 op/s 2024-05-20T17:11:33.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:33 smithi171 ceph-mon[35901]: pgmap v499: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 52 MiB/s wr, 843 op/s 2024-05-20T17:11:33.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:33 smithi006 ceph-mon[32486]: pgmap v499: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 52 MiB/s wr, 843 op/s 2024-05-20T17:11:34.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:33 smithi062 ceph-mon[35425]: pgmap v499: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 52 MiB/s wr, 843 op/s 2024-05-20T17:11:35.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:35 smithi171 ceph-mon[35901]: pgmap v500: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 47 MiB/s wr, 767 op/s 2024-05-20T17:11:35.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:35 smithi006 ceph-mon[32486]: pgmap v500: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 47 MiB/s wr, 767 op/s 2024-05-20T17:11:36.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:35 smithi062 ceph-mon[35425]: pgmap v500: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 47 MiB/s wr, 767 op/s 2024-05-20T17:11:37.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:37 smithi171 ceph-mon[35901]: pgmap v501: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 44 MiB/s wr, 717 op/s 2024-05-20T17:11:37.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:37 smithi006 ceph-mon[32486]: pgmap v501: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 44 MiB/s wr, 717 op/s 2024-05-20T17:11:38.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:37 smithi062 ceph-mon[35425]: pgmap v501: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 44 MiB/s wr, 717 op/s 2024-05-20T17:11:39.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:39 smithi171 ceph-mon[35901]: pgmap v502: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 55 MiB/s wr, 883 op/s 2024-05-20T17:11:39.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:39 smithi006 ceph-mon[32486]: pgmap v502: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 55 MiB/s wr, 883 op/s 2024-05-20T17:11:40.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:39 smithi062 ceph-mon[35425]: pgmap v502: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 55 MiB/s wr, 883 op/s 2024-05-20T17:11:41.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:41 smithi171 ceph-mon[35901]: pgmap v503: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 42 MiB/s wr, 679 op/s 2024-05-20T17:11:41.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:41 smithi006 ceph-mon[32486]: pgmap v503: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 42 MiB/s wr, 679 op/s 2024-05-20T17:11:42.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:41 smithi062 ceph-mon[35425]: pgmap v503: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 42 MiB/s wr, 679 op/s 2024-05-20T17:11:43.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:43 smithi171 ceph-mon[35901]: pgmap v504: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 52 MiB/s wr, 832 op/s 2024-05-20T17:11:43.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:43 smithi006 ceph-mon[32486]: pgmap v504: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 52 MiB/s wr, 832 op/s 2024-05-20T17:11:44.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:43 smithi062 ceph-mon[35425]: pgmap v504: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 52 MiB/s wr, 832 op/s 2024-05-20T17:11:45.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:45 smithi171 ceph-mon[35901]: pgmap v505: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 47 MiB/s wr, 762 op/s 2024-05-20T17:11:45.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:45 smithi006 ceph-mon[32486]: pgmap v505: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 47 MiB/s wr, 762 op/s 2024-05-20T17:11:46.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:45 smithi062 ceph-mon[35425]: pgmap v505: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 47 MiB/s wr, 762 op/s 2024-05-20T17:11:47.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:47 smithi171 ceph-mon[35901]: pgmap v506: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 44 MiB/s wr, 717 op/s 2024-05-20T17:11:47.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:47 smithi006 ceph-mon[32486]: pgmap v506: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 44 MiB/s wr, 717 op/s 2024-05-20T17:11:48.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:47 smithi062 ceph-mon[35425]: pgmap v506: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 44 MiB/s wr, 717 op/s 2024-05-20T17:11:49.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:49 smithi171 ceph-mon[35901]: pgmap v507: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 55 MiB/s wr, 884 op/s 2024-05-20T17:11:49.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:49 smithi006 ceph-mon[32486]: pgmap v507: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 55 MiB/s wr, 884 op/s 2024-05-20T17:11:50.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:49 smithi062 ceph-mon[35425]: pgmap v507: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 55 MiB/s wr, 884 op/s 2024-05-20T17:11:51.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:51 smithi171 ceph-mon[35901]: pgmap v508: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 42 MiB/s wr, 676 op/s 2024-05-20T17:11:51.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:51 smithi006 ceph-mon[32486]: pgmap v508: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 42 MiB/s wr, 676 op/s 2024-05-20T17:11:52.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:51 smithi062 ceph-mon[35425]: pgmap v508: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 42 MiB/s wr, 676 op/s 2024-05-20T17:11:53.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:53 smithi006 ceph-mon[32486]: pgmap v509: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 51 MiB/s wr, 823 op/s 2024-05-20T17:11:54.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:53 smithi062 ceph-mon[35425]: pgmap v509: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 51 MiB/s wr, 823 op/s 2024-05-20T17:11:54.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:53 smithi171 ceph-mon[35901]: pgmap v509: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 51 MiB/s wr, 823 op/s 2024-05-20T17:11:55.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:55 smithi006 ceph-mon[32486]: pgmap v510: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 47 MiB/s wr, 755 op/s 2024-05-20T17:11:56.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:55 smithi062 ceph-mon[35425]: pgmap v510: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 47 MiB/s wr, 755 op/s 2024-05-20T17:11:56.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:55 smithi171 ceph-mon[35901]: pgmap v510: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 47 MiB/s wr, 755 op/s 2024-05-20T17:11:57.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:56 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:11:57.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:56 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:11:57.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:56 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:11:57.922 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:57 smithi062 ceph-mon[35425]: pgmap v511: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 44 MiB/s wr, 705 op/s 2024-05-20T17:11:57.923 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:57 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:11:57.923 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:57 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:11:57.923 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:57 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:11:58.032 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:57 smithi006 ceph-mon[32486]: pgmap v511: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 44 MiB/s wr, 705 op/s 2024-05-20T17:11:58.033 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:57 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:11:58.033 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:57 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:11:58.033 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:57 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:11:58.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:57 smithi171 ceph-mon[35901]: pgmap v511: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 44 MiB/s wr, 705 op/s 2024-05-20T17:11:58.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:57 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:11:58.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:57 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:11:58.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:57 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:12:00.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:11:59 smithi062 ceph-mon[35425]: pgmap v512: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 52 MiB/s wr, 846 op/s 2024-05-20T17:12:00.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:11:59 smithi171 ceph-mon[35901]: pgmap v512: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 52 MiB/s wr, 846 op/s 2024-05-20T17:12:00.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:11:59 smithi006 ceph-mon[32486]: pgmap v512: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 52 MiB/s wr, 846 op/s 2024-05-20T17:12:02.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:01 smithi062 ceph-mon[35425]: pgmap v513: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 39 MiB/s wr, 638 op/s 2024-05-20T17:12:02.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:01 smithi171 ceph-mon[35901]: pgmap v513: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 39 MiB/s wr, 638 op/s 2024-05-20T17:12:02.136 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:01 smithi006 ceph-mon[32486]: pgmap v513: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 39 MiB/s wr, 638 op/s 2024-05-20T17:12:04.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:03 smithi062 ceph-mon[35425]: pgmap v514: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 49 MiB/s wr, 784 op/s 2024-05-20T17:12:04.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:03 smithi171 ceph-mon[35901]: pgmap v514: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 49 MiB/s wr, 784 op/s 2024-05-20T17:12:04.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:03 smithi006 ceph-mon[32486]: pgmap v514: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 49 MiB/s wr, 784 op/s 2024-05-20T17:12:06.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:05 smithi062 ceph-mon[35425]: pgmap v515: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 MiB/s wr, 714 op/s 2024-05-20T17:12:06.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:05 smithi171 ceph-mon[35901]: pgmap v515: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 MiB/s wr, 714 op/s 2024-05-20T17:12:06.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:05 smithi006 ceph-mon[32486]: pgmap v515: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 44 MiB/s wr, 714 op/s 2024-05-20T17:12:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:07 smithi062 ceph-mon[35425]: pgmap v516: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 41 MiB/s wr, 669 op/s 2024-05-20T17:12:08.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:07 smithi171 ceph-mon[35901]: pgmap v516: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 41 MiB/s wr, 669 op/s 2024-05-20T17:12:08.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:07 smithi006 ceph-mon[32486]: pgmap v516: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 41 MiB/s wr, 669 op/s 2024-05-20T17:12:10.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:09 smithi062 ceph-mon[35425]: pgmap v517: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 51 MiB/s wr, 827 op/s 2024-05-20T17:12:10.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:09 smithi171 ceph-mon[35901]: pgmap v517: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 51 MiB/s wr, 827 op/s 2024-05-20T17:12:10.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:09 smithi006 ceph-mon[32486]: pgmap v517: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 51 MiB/s wr, 827 op/s 2024-05-20T17:12:12.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:11 smithi062 ceph-mon[35425]: pgmap v518: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 39 MiB/s wr, 640 op/s 2024-05-20T17:12:12.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:11 smithi171 ceph-mon[35901]: pgmap v518: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 39 MiB/s wr, 640 op/s 2024-05-20T17:12:12.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:11 smithi006 ceph-mon[32486]: pgmap v518: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 39 MiB/s wr, 640 op/s 2024-05-20T17:12:14.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:13 smithi062 ceph-mon[35425]: pgmap v519: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 49 MiB/s wr, 786 op/s 2024-05-20T17:12:14.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:13 smithi171 ceph-mon[35901]: pgmap v519: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 49 MiB/s wr, 786 op/s 2024-05-20T17:12:14.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:13 smithi006 ceph-mon[32486]: pgmap v519: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 49 MiB/s wr, 786 op/s 2024-05-20T17:12:16.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:15 smithi062 ceph-mon[35425]: pgmap v520: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 45 MiB/s wr, 724 op/s 2024-05-20T17:12:16.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:15 smithi171 ceph-mon[35901]: pgmap v520: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 45 MiB/s wr, 724 op/s 2024-05-20T17:12:16.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:15 smithi006 ceph-mon[32486]: pgmap v520: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 45 MiB/s wr, 724 op/s 2024-05-20T17:12:18.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:17 smithi062 ceph-mon[35425]: pgmap v521: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 42 MiB/s wr, 681 op/s 2024-05-20T17:12:18.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:17 smithi171 ceph-mon[35901]: pgmap v521: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 42 MiB/s wr, 681 op/s 2024-05-20T17:12:18.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:17 smithi006 ceph-mon[32486]: pgmap v521: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 42 MiB/s wr, 681 op/s 2024-05-20T17:12:20.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:19 smithi062 ceph-mon[35425]: pgmap v522: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 52 MiB/s wr, 835 op/s 2024-05-20T17:12:20.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:19 smithi171 ceph-mon[35901]: pgmap v522: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 52 MiB/s wr, 835 op/s 2024-05-20T17:12:20.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:19 smithi006 ceph-mon[32486]: pgmap v522: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 52 MiB/s wr, 835 op/s 2024-05-20T17:12:22.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:21 smithi062 ceph-mon[35425]: pgmap v523: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 39 MiB/s wr, 636 op/s 2024-05-20T17:12:22.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:21 smithi171 ceph-mon[35901]: pgmap v523: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 39 MiB/s wr, 636 op/s 2024-05-20T17:12:22.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:21 smithi006 ceph-mon[32486]: pgmap v523: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 39 MiB/s wr, 636 op/s 2024-05-20T17:12:24.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:23 smithi062 ceph-mon[35425]: pgmap v524: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 48 MiB/s wr, 780 op/s 2024-05-20T17:12:24.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:23 smithi171 ceph-mon[35901]: pgmap v524: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 48 MiB/s wr, 780 op/s 2024-05-20T17:12:24.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:23 smithi006 ceph-mon[32486]: pgmap v524: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 48 MiB/s wr, 780 op/s 2024-05-20T17:12:26.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:25 smithi062 ceph-mon[35425]: pgmap v525: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 44 MiB/s wr, 716 op/s 2024-05-20T17:12:26.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:25 smithi171 ceph-mon[35901]: pgmap v525: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 44 MiB/s wr, 716 op/s 2024-05-20T17:12:26.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:25 smithi006 ceph-mon[32486]: pgmap v525: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 44 MiB/s wr, 716 op/s 2024-05-20T17:12:28.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:27 smithi062 ceph-mon[35425]: pgmap v526: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 42 MiB/s wr, 672 op/s 2024-05-20T17:12:28.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:27 smithi171 ceph-mon[35901]: pgmap v526: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 42 MiB/s wr, 672 op/s 2024-05-20T17:12:28.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:27 smithi006 ceph-mon[32486]: pgmap v526: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 42 MiB/s wr, 672 op/s 2024-05-20T17:12:30.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:29 smithi062 ceph-mon[35425]: pgmap v527: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 51 MiB/s wr, 823 op/s 2024-05-20T17:12:30.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:29 smithi171 ceph-mon[35901]: pgmap v527: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 51 MiB/s wr, 823 op/s 2024-05-20T17:12:30.132 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:29 smithi006 ceph-mon[32486]: pgmap v527: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 51 MiB/s wr, 823 op/s 2024-05-20T17:12:32.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:31 smithi062 ceph-mon[35425]: pgmap v528: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 39 MiB/s wr, 628 op/s 2024-05-20T17:12:32.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:31 smithi171 ceph-mon[35901]: pgmap v528: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 39 MiB/s wr, 628 op/s 2024-05-20T17:12:32.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:31 smithi006 ceph-mon[32486]: pgmap v528: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 39 MiB/s wr, 628 op/s 2024-05-20T17:12:34.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:33 smithi062 ceph-mon[35425]: pgmap v529: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 48 MiB/s wr, 772 op/s 2024-05-20T17:12:34.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:33 smithi171 ceph-mon[35901]: pgmap v529: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 48 MiB/s wr, 772 op/s 2024-05-20T17:12:34.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:33 smithi006 ceph-mon[32486]: pgmap v529: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 48 MiB/s wr, 772 op/s 2024-05-20T17:12:36.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:35 smithi062 ceph-mon[35425]: pgmap v530: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 44 MiB/s wr, 709 op/s 2024-05-20T17:12:36.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:35 smithi171 ceph-mon[35901]: pgmap v530: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 44 MiB/s wr, 709 op/s 2024-05-20T17:12:36.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:35 smithi006 ceph-mon[32486]: pgmap v530: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 44 MiB/s wr, 709 op/s 2024-05-20T17:12:38.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:37 smithi062 ceph-mon[35425]: pgmap v531: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 41 MiB/s wr, 668 op/s 2024-05-20T17:12:38.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:37 smithi171 ceph-mon[35901]: pgmap v531: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 41 MiB/s wr, 668 op/s 2024-05-20T17:12:38.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:37 smithi006 ceph-mon[32486]: pgmap v531: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 41 MiB/s wr, 668 op/s 2024-05-20T17:12:40.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:39 smithi062 ceph-mon[35425]: pgmap v532: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 50 MiB/s wr, 814 op/s 2024-05-20T17:12:40.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:39 smithi171 ceph-mon[35901]: pgmap v532: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 50 MiB/s wr, 814 op/s 2024-05-20T17:12:40.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:39 smithi006 ceph-mon[32486]: pgmap v532: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 50 MiB/s wr, 814 op/s 2024-05-20T17:12:42.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:41 smithi062 ceph-mon[35425]: pgmap v533: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 38 MiB/s wr, 625 op/s 2024-05-20T17:12:42.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:41 smithi171 ceph-mon[35901]: pgmap v533: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 38 MiB/s wr, 625 op/s 2024-05-20T17:12:42.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:41 smithi006 ceph-mon[32486]: pgmap v533: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 38 MiB/s wr, 625 op/s 2024-05-20T17:12:44.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:43 smithi171 ceph-mon[35901]: pgmap v534: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 47 MiB/s wr, 758 op/s 2024-05-20T17:12:44.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:43 smithi006 ceph-mon[32486]: pgmap v534: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 47 MiB/s wr, 758 op/s 2024-05-20T17:12:44.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:43 smithi062 ceph-mon[35425]: pgmap v534: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 47 MiB/s wr, 758 op/s 2024-05-20T17:12:46.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:45 smithi171 ceph-mon[35901]: pgmap v535: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 43 MiB/s wr, 690 op/s 2024-05-20T17:12:46.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:45 smithi006 ceph-mon[32486]: pgmap v535: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 43 MiB/s wr, 690 op/s 2024-05-20T17:12:46.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:45 smithi062 ceph-mon[35425]: pgmap v535: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 43 MiB/s wr, 690 op/s 2024-05-20T17:12:48.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:47 smithi171 ceph-mon[35901]: pgmap v536: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 40 MiB/s wr, 647 op/s 2024-05-20T17:12:48.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:47 smithi006 ceph-mon[32486]: pgmap v536: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 40 MiB/s wr, 647 op/s 2024-05-20T17:12:48.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:47 smithi062 ceph-mon[35425]: pgmap v536: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 40 MiB/s wr, 647 op/s 2024-05-20T17:12:50.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:49 smithi171 ceph-mon[35901]: pgmap v537: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 49 MiB/s wr, 791 op/s 2024-05-20T17:12:50.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:49 smithi006 ceph-mon[32486]: pgmap v537: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 49 MiB/s wr, 791 op/s 2024-05-20T17:12:50.274 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:49 smithi062 ceph-mon[35425]: pgmap v537: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 49 MiB/s wr, 791 op/s 2024-05-20T17:12:52.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:51 smithi171 ceph-mon[35901]: pgmap v538: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 37 MiB/s wr, 603 op/s 2024-05-20T17:12:52.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:51 smithi006 ceph-mon[32486]: pgmap v538: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 37 MiB/s wr, 603 op/s 2024-05-20T17:12:52.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:51 smithi062 ceph-mon[35425]: pgmap v538: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 37 MiB/s wr, 603 op/s 2024-05-20T17:12:54.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:53 smithi171 ceph-mon[35901]: pgmap v539: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 46 MiB/s wr, 742 op/s 2024-05-20T17:12:54.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:53 smithi006 ceph-mon[32486]: pgmap v539: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 46 MiB/s wr, 742 op/s 2024-05-20T17:12:54.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:53 smithi062 ceph-mon[35425]: pgmap v539: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 46 MiB/s wr, 742 op/s 2024-05-20T17:12:56.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:55 smithi171 ceph-mon[35901]: pgmap v540: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 42 MiB/s wr, 684 op/s 2024-05-20T17:12:56.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:55 smithi006 ceph-mon[32486]: pgmap v540: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 42 MiB/s wr, 684 op/s 2024-05-20T17:12:56.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:55 smithi062 ceph-mon[35425]: pgmap v540: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 42 MiB/s wr, 684 op/s 2024-05-20T17:12:58.074 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:57 smithi062 ceph-mon[35425]: pgmap v541: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 40 MiB/s wr, 646 op/s 2024-05-20T17:12:58.074 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:57 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:12:58.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:57 smithi171 ceph-mon[35901]: pgmap v541: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 40 MiB/s wr, 646 op/s 2024-05-20T17:12:58.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:57 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:12:58.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:57 smithi006 ceph-mon[32486]: pgmap v541: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 40 MiB/s wr, 646 op/s 2024-05-20T17:12:58.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:57 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:13:00.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:12:59 smithi171 ceph-mon[35901]: pgmap v542: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 49 MiB/s wr, 791 op/s 2024-05-20T17:13:00.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:12:59 smithi006 ceph-mon[32486]: pgmap v542: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 49 MiB/s wr, 791 op/s 2024-05-20T17:13:00.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:12:59 smithi062 ceph-mon[35425]: pgmap v542: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 49 MiB/s wr, 791 op/s 2024-05-20T17:13:02.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:01 smithi171 ceph-mon[35901]: pgmap v543: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 38 MiB/s wr, 610 op/s 2024-05-20T17:13:02.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:01 smithi006 ceph-mon[32486]: pgmap v543: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 38 MiB/s wr, 610 op/s 2024-05-20T17:13:02.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:01 smithi062 ceph-mon[35425]: pgmap v543: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 38 MiB/s wr, 610 op/s 2024-05-20T17:13:04.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:03 smithi171 ceph-mon[35901]: pgmap v544: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 45 MiB/s wr, 732 op/s 2024-05-20T17:13:04.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:03 smithi006 ceph-mon[32486]: pgmap v544: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 45 MiB/s wr, 732 op/s 2024-05-20T17:13:04.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:03 smithi062 ceph-mon[35425]: pgmap v544: 129 pgs: 129 active+clean; 10 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 45 MiB/s wr, 732 op/s 2024-05-20T17:13:05.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:04 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:13:05.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:04 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:13:05.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:04 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:13:05.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:04 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:13:05.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:04 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:13:05.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:04 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:13:05.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:04 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:13:05.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:04 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:13:05.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:04 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:13:06.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:05 smithi171 ceph-mon[35901]: pgmap v545: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 40 MiB/s wr, 653 op/s 2024-05-20T17:13:06.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:05 smithi006 ceph-mon[32486]: pgmap v545: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 40 MiB/s wr, 653 op/s 2024-05-20T17:13:06.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:05 smithi062 ceph-mon[35425]: pgmap v545: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 40 MiB/s wr, 653 op/s 2024-05-20T17:13:08.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:07 smithi171 ceph-mon[35901]: pgmap v546: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 38 MiB/s wr, 610 op/s 2024-05-20T17:13:08.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:07 smithi006 ceph-mon[32486]: pgmap v546: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 38 MiB/s wr, 610 op/s 2024-05-20T17:13:08.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:07 smithi062 ceph-mon[35425]: pgmap v546: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 38 MiB/s wr, 610 op/s 2024-05-20T17:13:10.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:09 smithi171 ceph-mon[35901]: pgmap v547: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 46 MiB/s wr, 745 op/s 2024-05-20T17:13:10.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:09 smithi006 ceph-mon[32486]: pgmap v547: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 46 MiB/s wr, 745 op/s 2024-05-20T17:13:10.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:09 smithi062 ceph-mon[35425]: pgmap v547: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 46 MiB/s wr, 745 op/s 2024-05-20T17:13:12.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:11 smithi171 ceph-mon[35901]: pgmap v548: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 35 MiB/s wr, 564 op/s 2024-05-20T17:13:12.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:11 smithi006 ceph-mon[32486]: pgmap v548: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 35 MiB/s wr, 564 op/s 2024-05-20T17:13:12.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:11 smithi062 ceph-mon[35425]: pgmap v548: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 35 MiB/s wr, 564 op/s 2024-05-20T17:13:14.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:13 smithi171 ceph-mon[35901]: pgmap v549: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 43 MiB/s wr, 689 op/s 2024-05-20T17:13:14.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:13 smithi006 ceph-mon[32486]: pgmap v549: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 43 MiB/s wr, 689 op/s 2024-05-20T17:13:14.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:13 smithi062 ceph-mon[35425]: pgmap v549: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 43 MiB/s wr, 689 op/s 2024-05-20T17:13:16.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:15 smithi006 ceph-mon[32486]: pgmap v550: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 40 MiB/s wr, 643 op/s 2024-05-20T17:13:16.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:15 smithi062 ceph-mon[35425]: pgmap v550: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 40 MiB/s wr, 643 op/s 2024-05-20T17:13:16.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:15 smithi171 ceph-mon[35901]: pgmap v550: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 40 MiB/s wr, 643 op/s 2024-05-20T17:13:18.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:17 smithi006 ceph-mon[32486]: pgmap v551: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 38 MiB/s wr, 617 op/s 2024-05-20T17:13:18.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:17 smithi062 ceph-mon[35425]: pgmap v551: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 38 MiB/s wr, 617 op/s 2024-05-20T17:13:18.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:17 smithi171 ceph-mon[35901]: pgmap v551: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 38 MiB/s wr, 617 op/s 2024-05-20T17:13:20.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:19 smithi062 ceph-mon[35425]: pgmap v552: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 47 MiB/s wr, 760 op/s 2024-05-20T17:13:20.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:19 smithi171 ceph-mon[35901]: pgmap v552: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 47 MiB/s wr, 760 op/s 2024-05-20T17:13:20.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:19 smithi006 ceph-mon[32486]: pgmap v552: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 47 MiB/s wr, 760 op/s 2024-05-20T17:13:22.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:21 smithi062 ceph-mon[35425]: pgmap v553: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 36 MiB/s wr, 583 op/s 2024-05-20T17:13:22.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:21 smithi171 ceph-mon[35901]: pgmap v553: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 36 MiB/s wr, 583 op/s 2024-05-20T17:13:22.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:21 smithi006 ceph-mon[32486]: pgmap v553: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 36 MiB/s wr, 583 op/s 2024-05-20T17:13:24.168 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:23 smithi171 ceph-mon[35901]: pgmap v554: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 44 MiB/s wr, 712 op/s 2024-05-20T17:13:24.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:23 smithi062 ceph-mon[35425]: pgmap v554: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 44 MiB/s wr, 712 op/s 2024-05-20T17:13:24.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:23 smithi006 ceph-mon[32486]: pgmap v554: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 44 MiB/s wr, 712 op/s 2024-05-20T17:13:26.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:25 smithi062 ceph-mon[35425]: pgmap v555: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 40 MiB/s wr, 654 op/s 2024-05-20T17:13:26.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:25 smithi171 ceph-mon[35901]: pgmap v555: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 40 MiB/s wr, 654 op/s 2024-05-20T17:13:26.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:25 smithi006 ceph-mon[32486]: pgmap v555: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 40 MiB/s wr, 654 op/s 2024-05-20T17:13:28.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:27 smithi062 ceph-mon[35425]: pgmap v556: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 38 MiB/s wr, 611 op/s 2024-05-20T17:13:28.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:27 smithi171 ceph-mon[35901]: pgmap v556: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 38 MiB/s wr, 611 op/s 2024-05-20T17:13:28.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:27 smithi006 ceph-mon[32486]: pgmap v556: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 38 MiB/s wr, 611 op/s 2024-05-20T17:13:30.184 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:29 smithi006 ceph-mon[32486]: pgmap v557: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 47 MiB/s wr, 762 op/s 2024-05-20T17:13:30.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:29 smithi062 ceph-mon[35425]: pgmap v557: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 47 MiB/s wr, 762 op/s 2024-05-20T17:13:30.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:29 smithi171 ceph-mon[35901]: pgmap v557: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 47 MiB/s wr, 762 op/s 2024-05-20T17:13:31.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:30 smithi062 ceph-mon[35425]: pgmap v558: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 36 MiB/s wr, 583 op/s 2024-05-20T17:13:31.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:30 smithi171 ceph-mon[35901]: pgmap v558: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 36 MiB/s wr, 583 op/s 2024-05-20T17:13:31.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:30 smithi006 ceph-mon[32486]: pgmap v558: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 36 MiB/s wr, 583 op/s 2024-05-20T17:13:33.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:33 smithi171 ceph-mon[35901]: pgmap v559: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 44 MiB/s wr, 721 op/s 2024-05-20T17:13:33.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:33 smithi006 ceph-mon[32486]: pgmap v559: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 44 MiB/s wr, 721 op/s 2024-05-20T17:13:33.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:33 smithi062 ceph-mon[35425]: pgmap v559: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 44 MiB/s wr, 721 op/s 2024-05-20T17:13:35.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:35 smithi171 ceph-mon[35901]: pgmap v560: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 40 MiB/s wr, 666 op/s 2024-05-20T17:13:35.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:35 smithi006 ceph-mon[32486]: pgmap v560: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 40 MiB/s wr, 666 op/s 2024-05-20T17:13:35.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:35 smithi062 ceph-mon[35425]: pgmap v560: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 40 MiB/s wr, 666 op/s 2024-05-20T17:13:37.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:37 smithi171 ceph-mon[35901]: pgmap v561: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 38 MiB/s wr, 631 op/s 2024-05-20T17:13:37.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:37 smithi006 ceph-mon[32486]: pgmap v561: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 38 MiB/s wr, 631 op/s 2024-05-20T17:13:37.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:37 smithi062 ceph-mon[35425]: pgmap v561: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 38 MiB/s wr, 631 op/s 2024-05-20T17:13:39.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:39 smithi171 ceph-mon[35901]: pgmap v562: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 47 MiB/s wr, 776 op/s 2024-05-20T17:13:39.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:39 smithi006 ceph-mon[32486]: pgmap v562: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 47 MiB/s wr, 776 op/s 2024-05-20T17:13:39.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:39 smithi062 ceph-mon[35425]: pgmap v562: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 47 MiB/s wr, 776 op/s 2024-05-20T17:13:41.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:41 smithi171 ceph-mon[35901]: pgmap v563: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 35 MiB/s wr, 587 op/s 2024-05-20T17:13:41.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:41 smithi006 ceph-mon[32486]: pgmap v563: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 35 MiB/s wr, 587 op/s 2024-05-20T17:13:41.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:41 smithi062 ceph-mon[35425]: pgmap v563: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 35 MiB/s wr, 587 op/s 2024-05-20T17:13:43.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:43 smithi171 ceph-mon[35901]: pgmap v564: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 44 MiB/s wr, 723 op/s 2024-05-20T17:13:43.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:43 smithi006 ceph-mon[32486]: pgmap v564: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 44 MiB/s wr, 723 op/s 2024-05-20T17:13:43.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:43 smithi062 ceph-mon[35425]: pgmap v564: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 44 MiB/s wr, 723 op/s 2024-05-20T17:13:45.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:45 smithi171 ceph-mon[35901]: pgmap v565: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 40 MiB/s wr, 660 op/s 2024-05-20T17:13:45.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:45 smithi006 ceph-mon[32486]: pgmap v565: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 40 MiB/s wr, 660 op/s 2024-05-20T17:13:45.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:45 smithi062 ceph-mon[35425]: pgmap v565: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 40 MiB/s wr, 660 op/s 2024-05-20T17:13:47.630 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:47 smithi006 ceph-mon[32486]: pgmap v566: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 37 MiB/s wr, 621 op/s 2024-05-20T17:13:47.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:47 smithi062 ceph-mon[35425]: pgmap v566: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 37 MiB/s wr, 621 op/s 2024-05-20T17:13:47.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:47 smithi171 ceph-mon[35901]: pgmap v566: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 37 MiB/s wr, 621 op/s 2024-05-20T17:13:49.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:49 smithi006 ceph-mon[32486]: pgmap v567: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 45 MiB/s wr, 762 op/s 2024-05-20T17:13:49.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:49 smithi062 ceph-mon[35425]: pgmap v567: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 45 MiB/s wr, 762 op/s 2024-05-20T17:13:49.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:49 smithi171 ceph-mon[35901]: pgmap v567: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 45 MiB/s wr, 762 op/s 2024-05-20T17:13:51.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:51 smithi062 ceph-mon[35425]: pgmap v568: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 34 MiB/s wr, 581 op/s 2024-05-20T17:13:51.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:51 smithi171 ceph-mon[35901]: pgmap v568: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 34 MiB/s wr, 581 op/s 2024-05-20T17:13:51.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:51 smithi006 ceph-mon[32486]: pgmap v568: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 34 MiB/s wr, 581 op/s 2024-05-20T17:13:53.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:53 smithi062 ceph-mon[35425]: pgmap v569: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 42 MiB/s wr, 713 op/s 2024-05-20T17:13:53.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:53 smithi171 ceph-mon[35901]: pgmap v569: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 42 MiB/s wr, 713 op/s 2024-05-20T17:13:53.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:53 smithi006 ceph-mon[32486]: pgmap v569: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 42 MiB/s wr, 713 op/s 2024-05-20T17:13:55.668 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:55 smithi171 ceph-mon[35901]: pgmap v570: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 38 MiB/s wr, 656 op/s 2024-05-20T17:13:55.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:55 smithi062 ceph-mon[35425]: pgmap v570: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 38 MiB/s wr, 656 op/s 2024-05-20T17:13:55.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:55 smithi006 ceph-mon[32486]: pgmap v570: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 38 MiB/s wr, 656 op/s 2024-05-20T17:13:57.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:57 smithi062 ceph-mon[35425]: pgmap v571: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 36 MiB/s wr, 621 op/s 2024-05-20T17:13:57.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:57 smithi171 ceph-mon[35901]: pgmap v571: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 36 MiB/s wr, 621 op/s 2024-05-20T17:13:57.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:57 smithi006 ceph-mon[32486]: pgmap v571: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 36 MiB/s wr, 621 op/s 2024-05-20T17:13:59.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:13:59 smithi062 ceph-mon[35425]: pgmap v572: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 44 MiB/s wr, 759 op/s 2024-05-20T17:13:59.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:13:59 smithi171 ceph-mon[35901]: pgmap v572: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 44 MiB/s wr, 759 op/s 2024-05-20T17:13:59.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:13:59 smithi006 ceph-mon[32486]: pgmap v572: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 44 MiB/s wr, 759 op/s 2024-05-20T17:14:01.682 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:01 smithi006 ceph-mon[32486]: pgmap v573: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 34 MiB/s wr, 581 op/s 2024-05-20T17:14:01.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:01 smithi062 ceph-mon[35425]: pgmap v573: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 34 MiB/s wr, 581 op/s 2024-05-20T17:14:01.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:01 smithi171 ceph-mon[35901]: pgmap v573: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 34 MiB/s wr, 581 op/s 2024-05-20T17:14:03.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:03 smithi062 ceph-mon[35425]: pgmap v574: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 41 MiB/s wr, 715 op/s 2024-05-20T17:14:03.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:03 smithi171 ceph-mon[35901]: pgmap v574: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 41 MiB/s wr, 715 op/s 2024-05-20T17:14:03.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:03 smithi006 ceph-mon[32486]: pgmap v574: 129 pgs: 129 active+clean; 10 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 41 MiB/s wr, 715 op/s 2024-05-20T17:14:05.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:05 smithi062 ceph-mon[35425]: pgmap v575: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 38 MiB/s wr, 658 op/s 2024-05-20T17:14:05.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:05 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:14:05.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:05 smithi171 ceph-mon[35901]: pgmap v575: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 38 MiB/s wr, 658 op/s 2024-05-20T17:14:05.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:05 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:14:05.888 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:05 smithi006 ceph-mon[32486]: pgmap v575: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 38 MiB/s wr, 658 op/s 2024-05-20T17:14:05.888 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:05 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:14:06.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:06 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:06.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:06 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:06.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:06 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:06.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:06 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:06.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:06 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:06.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:06 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:06.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:06 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:06.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:06 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:06.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:06 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:06.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:06 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:06.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:06 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:06.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:06 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:07.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:07 smithi062 ceph-mon[35425]: Adjusting osd_memory_target on smithi062 to 176.2M 2024-05-20T17:14:07.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:07 smithi062 ceph-mon[35425]: Unable to set osd_memory_target on smithi062 to 184775270: error parsing value: Value '184775270' is below minimum 939524096 2024-05-20T17:14:07.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:07 smithi062 ceph-mon[35425]: pgmap v576: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 36 MiB/s wr, 612 op/s 2024-05-20T17:14:07.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:07.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:07.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:07.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:07.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:07 smithi062 ceph-mon[35425]: Adjusting osd_memory_target on smithi006 to 177.2M 2024-05-20T17:14:07.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:07 smithi062 ceph-mon[35425]: Unable to set osd_memory_target on smithi006 to 185879142: error parsing value: Value '185879142' is below minimum 939524096 2024-05-20T17:14:07.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:14:07.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:14:07.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:14:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:07 smithi171 ceph-mon[35901]: Adjusting osd_memory_target on smithi062 to 176.2M 2024-05-20T17:14:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:07 smithi171 ceph-mon[35901]: Unable to set osd_memory_target on smithi062 to 184775270: error parsing value: Value '184775270' is below minimum 939524096 2024-05-20T17:14:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:07 smithi171 ceph-mon[35901]: pgmap v576: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 36 MiB/s wr, 612 op/s 2024-05-20T17:14:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:07 smithi171 ceph-mon[35901]: Adjusting osd_memory_target on smithi006 to 177.2M 2024-05-20T17:14:07.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:07 smithi171 ceph-mon[35901]: Unable to set osd_memory_target on smithi006 to 185879142: error parsing value: Value '185879142' is below minimum 939524096 2024-05-20T17:14:07.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:14:07.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:14:07.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:14:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:07 smithi006 ceph-mon[32486]: Adjusting osd_memory_target on smithi062 to 176.2M 2024-05-20T17:14:07.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:07 smithi006 ceph-mon[32486]: Unable to set osd_memory_target on smithi062 to 184775270: error parsing value: Value '184775270' is below minimum 939524096 2024-05-20T17:14:07.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:07 smithi006 ceph-mon[32486]: pgmap v576: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 36 MiB/s wr, 612 op/s 2024-05-20T17:14:07.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:07.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:07.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:07.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:14:07.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:07 smithi006 ceph-mon[32486]: Adjusting osd_memory_target on smithi006 to 177.2M 2024-05-20T17:14:07.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:07 smithi006 ceph-mon[32486]: Unable to set osd_memory_target on smithi006 to 185879142: error parsing value: Value '185879142' is below minimum 939524096 2024-05-20T17:14:07.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:14:07.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:14:07.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:14:09.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:09 smithi062 ceph-mon[35425]: pgmap v577: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 44 MiB/s wr, 753 op/s 2024-05-20T17:14:09.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:09 smithi171 ceph-mon[35901]: pgmap v577: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 44 MiB/s wr, 753 op/s 2024-05-20T17:14:09.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:09 smithi006 ceph-mon[32486]: pgmap v577: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 44 MiB/s wr, 753 op/s 2024-05-20T17:14:11.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:11 smithi062 ceph-mon[35425]: pgmap v578: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 33 MiB/s wr, 576 op/s 2024-05-20T17:14:11.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:11 smithi171 ceph-mon[35901]: pgmap v578: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 33 MiB/s wr, 576 op/s 2024-05-20T17:14:11.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:11 smithi006 ceph-mon[32486]: pgmap v578: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 33 MiB/s wr, 576 op/s 2024-05-20T17:14:13.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:13 smithi062 ceph-mon[35425]: pgmap v579: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 41 MiB/s wr, 707 op/s 2024-05-20T17:14:13.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:13 smithi171 ceph-mon[35901]: pgmap v579: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 41 MiB/s wr, 707 op/s 2024-05-20T17:14:13.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:13 smithi006 ceph-mon[32486]: pgmap v579: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 41 MiB/s wr, 707 op/s 2024-05-20T17:14:15.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:15 smithi062 ceph-mon[35425]: pgmap v580: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 38 MiB/s wr, 650 op/s 2024-05-20T17:14:15.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:15 smithi171 ceph-mon[35901]: pgmap v580: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 38 MiB/s wr, 650 op/s 2024-05-20T17:14:15.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:15 smithi006 ceph-mon[32486]: pgmap v580: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 38 MiB/s wr, 650 op/s 2024-05-20T17:14:17.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:17 smithi062 ceph-mon[35425]: pgmap v581: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 35 MiB/s wr, 611 op/s 2024-05-20T17:14:17.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:17 smithi171 ceph-mon[35901]: pgmap v581: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 35 MiB/s wr, 611 op/s 2024-05-20T17:14:17.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:17 smithi006 ceph-mon[32486]: pgmap v581: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 35 MiB/s wr, 611 op/s 2024-05-20T17:14:19.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:19 smithi062 ceph-mon[35425]: pgmap v582: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 43 MiB/s wr, 751 op/s 2024-05-20T17:14:19.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:19 smithi171 ceph-mon[35901]: pgmap v582: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 43 MiB/s wr, 751 op/s 2024-05-20T17:14:19.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:19 smithi006 ceph-mon[32486]: pgmap v582: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 43 MiB/s wr, 751 op/s 2024-05-20T17:14:21.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:21 smithi062 ceph-mon[35425]: pgmap v583: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 33 MiB/s wr, 570 op/s 2024-05-20T17:14:21.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:21 smithi171 ceph-mon[35901]: pgmap v583: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 33 MiB/s wr, 570 op/s 2024-05-20T17:14:21.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:21 smithi006 ceph-mon[32486]: pgmap v583: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 33 MiB/s wr, 570 op/s 2024-05-20T17:14:23.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:23 smithi062 ceph-mon[35425]: pgmap v584: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 41 MiB/s wr, 704 op/s 2024-05-20T17:14:23.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:23 smithi171 ceph-mon[35901]: pgmap v584: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 41 MiB/s wr, 704 op/s 2024-05-20T17:14:23.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:23 smithi006 ceph-mon[32486]: pgmap v584: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 41 MiB/s wr, 704 op/s 2024-05-20T17:14:25.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:25 smithi062 ceph-mon[35425]: pgmap v585: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 37 MiB/s wr, 647 op/s 2024-05-20T17:14:25.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:25 smithi171 ceph-mon[35901]: pgmap v585: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 37 MiB/s wr, 647 op/s 2024-05-20T17:14:25.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:25 smithi006 ceph-mon[32486]: pgmap v585: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 37 MiB/s wr, 647 op/s 2024-05-20T17:14:27.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:27 smithi062 ceph-mon[35425]: pgmap v586: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 35 MiB/s wr, 613 op/s 2024-05-20T17:14:27.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:27 smithi171 ceph-mon[35901]: pgmap v586: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 35 MiB/s wr, 613 op/s 2024-05-20T17:14:27.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:27 smithi006 ceph-mon[32486]: pgmap v586: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 35 MiB/s wr, 613 op/s 2024-05-20T17:14:29.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:29 smithi062 ceph-mon[35425]: pgmap v587: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 43 MiB/s wr, 752 op/s 2024-05-20T17:14:29.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:29 smithi171 ceph-mon[35901]: pgmap v587: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 43 MiB/s wr, 752 op/s 2024-05-20T17:14:29.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:29 smithi006 ceph-mon[32486]: pgmap v587: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 43 MiB/s wr, 752 op/s 2024-05-20T17:14:31.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:31 smithi062 ceph-mon[35425]: pgmap v588: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 33 MiB/s wr, 584 op/s 2024-05-20T17:14:31.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:31 smithi171 ceph-mon[35901]: pgmap v588: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 33 MiB/s wr, 584 op/s 2024-05-20T17:14:31.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:31 smithi006 ceph-mon[32486]: pgmap v588: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 33 MiB/s wr, 584 op/s 2024-05-20T17:14:33.774 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:33 smithi062 ceph-mon[35425]: pgmap v589: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 40 MiB/s wr, 713 op/s 2024-05-20T17:14:33.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:33 smithi171 ceph-mon[35901]: pgmap v589: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 40 MiB/s wr, 713 op/s 2024-05-20T17:14:33.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:33 smithi006 ceph-mon[32486]: pgmap v589: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 40 MiB/s wr, 713 op/s 2024-05-20T17:14:35.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:35 smithi171 ceph-mon[35901]: pgmap v590: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 37 MiB/s wr, 655 op/s 2024-05-20T17:14:35.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:35 smithi006 ceph-mon[32486]: pgmap v590: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 37 MiB/s wr, 655 op/s 2024-05-20T17:14:36.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:35 smithi062 ceph-mon[35425]: pgmap v590: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 37 MiB/s wr, 655 op/s 2024-05-20T17:14:37.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:37 smithi171 ceph-mon[35901]: pgmap v591: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 34 MiB/s wr, 610 op/s 2024-05-20T17:14:37.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:37 smithi006 ceph-mon[32486]: pgmap v591: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 34 MiB/s wr, 610 op/s 2024-05-20T17:14:38.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:37 smithi062 ceph-mon[35425]: pgmap v591: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 34 MiB/s wr, 610 op/s 2024-05-20T17:14:39.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:39 smithi171 ceph-mon[35901]: pgmap v592: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 42 MiB/s wr, 742 op/s 2024-05-20T17:14:39.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:39 smithi006 ceph-mon[32486]: pgmap v592: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 42 MiB/s wr, 742 op/s 2024-05-20T17:14:40.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:39 smithi062 ceph-mon[35425]: pgmap v592: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 42 MiB/s wr, 742 op/s 2024-05-20T17:14:41.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:41 smithi171 ceph-mon[35901]: pgmap v593: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 32 MiB/s wr, 565 op/s 2024-05-20T17:14:41.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:41 smithi006 ceph-mon[32486]: pgmap v593: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 32 MiB/s wr, 565 op/s 2024-05-20T17:14:42.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:41 smithi062 ceph-mon[35425]: pgmap v593: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 32 MiB/s wr, 565 op/s 2024-05-20T17:14:43.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:43 smithi171 ceph-mon[35901]: pgmap v594: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 39 MiB/s wr, 692 op/s 2024-05-20T17:14:43.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:43 smithi006 ceph-mon[32486]: pgmap v594: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 39 MiB/s wr, 692 op/s 2024-05-20T17:14:44.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:43 smithi062 ceph-mon[35425]: pgmap v594: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 39 MiB/s wr, 692 op/s 2024-05-20T17:14:45.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:45 smithi171 ceph-mon[35901]: pgmap v595: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 36 MiB/s wr, 637 op/s 2024-05-20T17:14:45.886 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:45 smithi006 ceph-mon[32486]: pgmap v595: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 36 MiB/s wr, 637 op/s 2024-05-20T17:14:46.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:45 smithi062 ceph-mon[35425]: pgmap v595: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 36 MiB/s wr, 637 op/s 2024-05-20T17:14:47.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:47 smithi171 ceph-mon[35901]: pgmap v596: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 34 MiB/s wr, 596 op/s 2024-05-20T17:14:47.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:47 smithi006 ceph-mon[32486]: pgmap v596: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 34 MiB/s wr, 596 op/s 2024-05-20T17:14:48.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:47 smithi062 ceph-mon[35425]: pgmap v596: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 34 MiB/s wr, 596 op/s 2024-05-20T17:14:49.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:49 smithi171 ceph-mon[35901]: pgmap v597: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 40 MiB/s wr, 709 op/s 2024-05-20T17:14:49.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:49 smithi006 ceph-mon[32486]: pgmap v597: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 40 MiB/s wr, 709 op/s 2024-05-20T17:14:50.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:49 smithi062 ceph-mon[35425]: pgmap v597: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 40 MiB/s wr, 709 op/s 2024-05-20T17:14:51.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:51 smithi171 ceph-mon[35901]: pgmap v598: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 32 MiB/s wr, 571 op/s 2024-05-20T17:14:51.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:51 smithi006 ceph-mon[32486]: pgmap v598: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 32 MiB/s wr, 571 op/s 2024-05-20T17:14:52.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:51 smithi062 ceph-mon[35425]: pgmap v598: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 32 MiB/s wr, 571 op/s 2024-05-20T17:14:53.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:53 smithi171 ceph-mon[35901]: pgmap v599: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 39 MiB/s wr, 702 op/s 2024-05-20T17:14:53.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:53 smithi006 ceph-mon[32486]: pgmap v599: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 39 MiB/s wr, 702 op/s 2024-05-20T17:14:54.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:53 smithi062 ceph-mon[35425]: pgmap v599: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 39 MiB/s wr, 702 op/s 2024-05-20T17:14:55.870 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:55 smithi171 ceph-mon[35901]: pgmap v600: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 36 MiB/s wr, 645 op/s 2024-05-20T17:14:55.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:55 smithi006 ceph-mon[32486]: pgmap v600: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 36 MiB/s wr, 645 op/s 2024-05-20T17:14:56.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:55 smithi062 ceph-mon[35425]: pgmap v600: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 36 MiB/s wr, 645 op/s 2024-05-20T17:14:57.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:57 smithi171 ceph-mon[35901]: pgmap v601: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 34 MiB/s wr, 606 op/s 2024-05-20T17:14:57.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:57 smithi006 ceph-mon[32486]: pgmap v601: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 34 MiB/s wr, 606 op/s 2024-05-20T17:14:58.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:57 smithi062 ceph-mon[35425]: pgmap v601: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 34 MiB/s wr, 606 op/s 2024-05-20T17:14:59.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:14:59 smithi171 ceph-mon[35901]: pgmap v602: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 39 MiB/s wr, 704 op/s 2024-05-20T17:14:59.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:14:59 smithi006 ceph-mon[32486]: pgmap v602: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 39 MiB/s wr, 704 op/s 2024-05-20T17:15:00.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:14:59 smithi062 ceph-mon[35425]: pgmap v602: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 39 MiB/s wr, 704 op/s 2024-05-20T17:15:01.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:01 smithi171 ceph-mon[35901]: pgmap v603: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 33 MiB/s wr, 596 op/s 2024-05-20T17:15:01.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:01 smithi006 ceph-mon[32486]: pgmap v603: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 33 MiB/s wr, 596 op/s 2024-05-20T17:15:02.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:01 smithi062 ceph-mon[35425]: pgmap v603: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 33 MiB/s wr, 596 op/s 2024-05-20T17:15:04.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:03 smithi062 ceph-mon[35425]: pgmap v604: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 38 MiB/s wr, 683 op/s 2024-05-20T17:15:04.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:03 smithi171 ceph-mon[35901]: pgmap v604: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 38 MiB/s wr, 683 op/s 2024-05-20T17:15:04.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:03 smithi006 ceph-mon[32486]: pgmap v604: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 38 MiB/s wr, 683 op/s 2024-05-20T17:15:06.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:05 smithi062 ceph-mon[35425]: pgmap v605: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 35 MiB/s wr, 627 op/s 2024-05-20T17:15:06.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:05 smithi171 ceph-mon[35901]: pgmap v605: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 35 MiB/s wr, 627 op/s 2024-05-20T17:15:06.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:05 smithi006 ceph-mon[32486]: pgmap v605: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 35 MiB/s wr, 627 op/s 2024-05-20T17:15:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:07 smithi062 ceph-mon[35425]: pgmap v606: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 33 MiB/s wr, 585 op/s 2024-05-20T17:15:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:07 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:15:08.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:07 smithi171 ceph-mon[35901]: pgmap v606: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 33 MiB/s wr, 585 op/s 2024-05-20T17:15:08.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:07 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:15:08.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:07 smithi006 ceph-mon[32486]: pgmap v606: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 33 MiB/s wr, 585 op/s 2024-05-20T17:15:08.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:07 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:15:09.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:15:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:15:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:15:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:15:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:15:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:15:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:15:09.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:15:09.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:15:09.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:15:09.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:15:09.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:15:09.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:15:09.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:15:09.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:15:09.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:15:09.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:15:09.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-20T17:15:09.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:15:09.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:15:09.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:15:10.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:09 smithi062 ceph-mon[35425]: Adjusting osd_memory_target on smithi171 to 176.2M 2024-05-20T17:15:10.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:09 smithi062 ceph-mon[35425]: Unable to set osd_memory_target on smithi171 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-05-20T17:15:10.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:09 smithi062 ceph-mon[35425]: pgmap v607: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 38 MiB/s wr, 686 op/s 2024-05-20T17:15:10.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:09 smithi171 ceph-mon[35901]: Adjusting osd_memory_target on smithi171 to 176.2M 2024-05-20T17:15:10.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:09 smithi171 ceph-mon[35901]: Unable to set osd_memory_target on smithi171 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-05-20T17:15:10.118 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:09 smithi171 ceph-mon[35901]: pgmap v607: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 38 MiB/s wr, 686 op/s 2024-05-20T17:15:10.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:09 smithi006 ceph-mon[32486]: Adjusting osd_memory_target on smithi171 to 176.2M 2024-05-20T17:15:10.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:09 smithi006 ceph-mon[32486]: Unable to set osd_memory_target on smithi171 to 184769536: error parsing value: Value '184769536' is below minimum 939524096 2024-05-20T17:15:10.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:09 smithi006 ceph-mon[32486]: pgmap v607: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 38 MiB/s wr, 686 op/s 2024-05-20T17:15:12.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:11 smithi171 ceph-mon[35901]: pgmap v608: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 32 MiB/s wr, 584 op/s 2024-05-20T17:15:12.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:11 smithi006 ceph-mon[32486]: pgmap v608: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 32 MiB/s wr, 584 op/s 2024-05-20T17:15:12.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:11 smithi062 ceph-mon[35425]: pgmap v608: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 32 MiB/s wr, 584 op/s 2024-05-20T17:15:14.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:13 smithi171 ceph-mon[35901]: pgmap v609: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 36 MiB/s wr, 674 op/s 2024-05-20T17:15:14.143 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:13 smithi006 ceph-mon[32486]: pgmap v609: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 36 MiB/s wr, 674 op/s 2024-05-20T17:15:14.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:13 smithi062 ceph-mon[35425]: pgmap v609: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 36 MiB/s wr, 674 op/s 2024-05-20T17:15:16.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:15 smithi171 ceph-mon[35901]: pgmap v610: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 33 MiB/s wr, 625 op/s 2024-05-20T17:15:16.132 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:15 smithi006 ceph-mon[32486]: pgmap v610: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 33 MiB/s wr, 625 op/s 2024-05-20T17:15:16.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:15 smithi062 ceph-mon[35425]: pgmap v610: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 33 MiB/s wr, 625 op/s 2024-05-20T17:15:18.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:17 smithi171 ceph-mon[35901]: pgmap v611: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 32 MiB/s wr, 589 op/s 2024-05-20T17:15:18.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:17 smithi006 ceph-mon[32486]: pgmap v611: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 32 MiB/s wr, 589 op/s 2024-05-20T17:15:18.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:17 smithi062 ceph-mon[35425]: pgmap v611: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 32 MiB/s wr, 589 op/s 2024-05-20T17:15:20.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:19 smithi171 ceph-mon[35901]: pgmap v612: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 35 MiB/s wr, 661 op/s 2024-05-20T17:15:20.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:19 smithi006 ceph-mon[32486]: pgmap v612: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 35 MiB/s wr, 661 op/s 2024-05-20T17:15:20.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:19 smithi062 ceph-mon[35425]: pgmap v612: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 35 MiB/s wr, 661 op/s 2024-05-20T17:15:22.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:21 smithi171 ceph-mon[35901]: pgmap v613: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 31 MiB/s wr, 586 op/s 2024-05-20T17:15:22.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:21 smithi006 ceph-mon[32486]: pgmap v613: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 31 MiB/s wr, 586 op/s 2024-05-20T17:15:22.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:21 smithi062 ceph-mon[35425]: pgmap v613: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 31 MiB/s wr, 586 op/s 2024-05-20T17:15:24.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:23 smithi171 ceph-mon[35901]: pgmap v614: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 37 MiB/s wr, 685 op/s 2024-05-20T17:15:24.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:23 smithi006 ceph-mon[32486]: pgmap v614: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 37 MiB/s wr, 685 op/s 2024-05-20T17:15:24.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:23 smithi062 ceph-mon[35425]: pgmap v614: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 37 MiB/s wr, 685 op/s 2024-05-20T17:15:26.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:25 smithi171 ceph-mon[35901]: pgmap v615: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 34 MiB/s wr, 631 op/s 2024-05-20T17:15:26.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:25 smithi006 ceph-mon[32486]: pgmap v615: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 34 MiB/s wr, 631 op/s 2024-05-20T17:15:26.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:25 smithi062 ceph-mon[35425]: pgmap v615: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 34 MiB/s wr, 631 op/s 2024-05-20T17:15:28.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:27 smithi171 ceph-mon[35901]: pgmap v616: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 32 MiB/s wr, 593 op/s 2024-05-20T17:15:28.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:27 smithi006 ceph-mon[32486]: pgmap v616: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 32 MiB/s wr, 593 op/s 2024-05-20T17:15:28.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:27 smithi062 ceph-mon[35425]: pgmap v616: 129 pgs: 129 active+clean; 10 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 32 MiB/s wr, 593 op/s 2024-05-20T17:15:30.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:29 smithi171 ceph-mon[35901]: pgmap v617: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 36 MiB/s wr, 666 op/s 2024-05-20T17:15:30.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:29 smithi006 ceph-mon[32486]: pgmap v617: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 36 MiB/s wr, 666 op/s 2024-05-20T17:15:30.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:29 smithi062 ceph-mon[35425]: pgmap v617: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 36 MiB/s wr, 666 op/s 2024-05-20T17:15:32.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:31 smithi171 ceph-mon[35901]: pgmap v618: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 33 MiB/s wr, 623 op/s 2024-05-20T17:15:32.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:31 smithi006 ceph-mon[32486]: pgmap v618: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 33 MiB/s wr, 623 op/s 2024-05-20T17:15:32.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:31 smithi062 ceph-mon[35425]: pgmap v618: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 33 MiB/s wr, 623 op/s 2024-05-20T17:15:34.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:33 smithi171 ceph-mon[35901]: pgmap v619: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 36 MiB/s wr, 686 op/s 2024-05-20T17:15:34.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:33 smithi006 ceph-mon[32486]: pgmap v619: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 36 MiB/s wr, 686 op/s 2024-05-20T17:15:34.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:33 smithi062 ceph-mon[35425]: pgmap v619: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 36 MiB/s wr, 686 op/s 2024-05-20T17:15:36.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:35 smithi171 ceph-mon[35901]: pgmap v620: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 33 MiB/s wr, 627 op/s 2024-05-20T17:15:36.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:35 smithi006 ceph-mon[32486]: pgmap v620: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 33 MiB/s wr, 627 op/s 2024-05-20T17:15:36.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:35 smithi062 ceph-mon[35425]: pgmap v620: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 33 MiB/s wr, 627 op/s 2024-05-20T17:15:38.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:37 smithi171 ceph-mon[35901]: pgmap v621: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 31 MiB/s wr, 589 op/s 2024-05-20T17:15:38.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:37 smithi006 ceph-mon[32486]: pgmap v621: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 31 MiB/s wr, 589 op/s 2024-05-20T17:15:38.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:37 smithi062 ceph-mon[35425]: pgmap v621: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 31 MiB/s wr, 589 op/s 2024-05-20T17:15:40.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:39 smithi171 ceph-mon[35901]: pgmap v622: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 34 MiB/s wr, 660 op/s 2024-05-20T17:15:40.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:39 smithi006 ceph-mon[32486]: pgmap v622: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 34 MiB/s wr, 660 op/s 2024-05-20T17:15:40.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:39 smithi062 ceph-mon[35425]: pgmap v622: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 34 MiB/s wr, 660 op/s 2024-05-20T17:15:42.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:41 smithi006 ceph-mon[32486]: pgmap v623: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 32 MiB/s wr, 613 op/s 2024-05-20T17:15:42.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:41 smithi062 ceph-mon[35425]: pgmap v623: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 32 MiB/s wr, 613 op/s 2024-05-20T17:15:42.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:41 smithi171 ceph-mon[35901]: pgmap v623: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 32 MiB/s wr, 613 op/s 2024-05-20T17:15:44.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:43 smithi006 ceph-mon[32486]: pgmap v624: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 35 MiB/s wr, 680 op/s 2024-05-20T17:15:44.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:43 smithi062 ceph-mon[35425]: pgmap v624: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 35 MiB/s wr, 680 op/s 2024-05-20T17:15:44.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:43 smithi171 ceph-mon[35901]: pgmap v624: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 35 MiB/s wr, 680 op/s 2024-05-20T17:15:46.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:45 smithi006 ceph-mon[32486]: pgmap v625: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 32 MiB/s wr, 631 op/s 2024-05-20T17:15:46.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:45 smithi062 ceph-mon[35425]: pgmap v625: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 32 MiB/s wr, 631 op/s 2024-05-20T17:15:46.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:45 smithi171 ceph-mon[35901]: pgmap v625: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 32 MiB/s wr, 631 op/s 2024-05-20T17:15:48.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:47 smithi062 ceph-mon[35425]: pgmap v626: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 31 MiB/s wr, 596 op/s 2024-05-20T17:15:48.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:47 smithi171 ceph-mon[35901]: pgmap v626: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 31 MiB/s wr, 596 op/s 2024-05-20T17:15:48.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:47 smithi006 ceph-mon[32486]: pgmap v626: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 31 MiB/s wr, 596 op/s 2024-05-20T17:15:50.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:49 smithi062 ceph-mon[35425]: pgmap v627: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 35 MiB/s wr, 666 op/s 2024-05-20T17:15:50.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:49 smithi171 ceph-mon[35901]: pgmap v627: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 35 MiB/s wr, 666 op/s 2024-05-20T17:15:50.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:49 smithi006 ceph-mon[32486]: pgmap v627: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 35 MiB/s wr, 666 op/s 2024-05-20T17:15:52.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:51 smithi062 ceph-mon[35425]: pgmap v628: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 32 MiB/s wr, 628 op/s 2024-05-20T17:15:52.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:51 smithi171 ceph-mon[35901]: pgmap v628: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 32 MiB/s wr, 628 op/s 2024-05-20T17:15:52.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:51 smithi006 ceph-mon[32486]: pgmap v628: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 32 MiB/s wr, 628 op/s 2024-05-20T17:15:54.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:53 smithi062 ceph-mon[35425]: pgmap v629: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 35 MiB/s wr, 690 op/s 2024-05-20T17:15:54.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:53 smithi171 ceph-mon[35901]: pgmap v629: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 35 MiB/s wr, 690 op/s 2024-05-20T17:15:54.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:53 smithi006 ceph-mon[32486]: pgmap v629: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 35 MiB/s wr, 690 op/s 2024-05-20T17:15:56.168 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:55 smithi171 ceph-mon[35901]: pgmap v630: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 32 MiB/s wr, 635 op/s 2024-05-20T17:15:56.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:55 smithi062 ceph-mon[35425]: pgmap v630: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 32 MiB/s wr, 635 op/s 2024-05-20T17:15:56.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:55 smithi006 ceph-mon[32486]: pgmap v630: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 32 MiB/s wr, 635 op/s 2024-05-20T17:15:58.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:57 smithi062 ceph-mon[35425]: pgmap v631: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 30 MiB/s wr, 595 op/s 2024-05-20T17:15:58.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:57 smithi171 ceph-mon[35901]: pgmap v631: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 30 MiB/s wr, 595 op/s 2024-05-20T17:15:58.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:57 smithi006 ceph-mon[32486]: pgmap v631: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 30 MiB/s wr, 595 op/s 2024-05-20T17:16:00.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:15:59 smithi062 ceph-mon[35425]: pgmap v632: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 34 MiB/s wr, 666 op/s 2024-05-20T17:16:00.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:15:59 smithi171 ceph-mon[35901]: pgmap v632: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 34 MiB/s wr, 666 op/s 2024-05-20T17:16:00.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:15:59 smithi006 ceph-mon[32486]: pgmap v632: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 34 MiB/s wr, 666 op/s 2024-05-20T17:16:02.183 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:01 smithi006 ceph-mon[32486]: pgmap v633: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 31 MiB/s wr, 624 op/s 2024-05-20T17:16:02.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:01 smithi062 ceph-mon[35425]: pgmap v633: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 31 MiB/s wr, 624 op/s 2024-05-20T17:16:02.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:01 smithi171 ceph-mon[35901]: pgmap v633: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 31 MiB/s wr, 624 op/s 2024-05-20T17:16:04.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:03 smithi062 ceph-mon[35425]: pgmap v634: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 34 MiB/s wr, 688 op/s 2024-05-20T17:16:04.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:03 smithi171 ceph-mon[35901]: pgmap v634: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 34 MiB/s wr, 688 op/s 2024-05-20T17:16:04.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:03 smithi006 ceph-mon[32486]: pgmap v634: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 34 MiB/s wr, 688 op/s 2024-05-20T17:16:06.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:05 smithi062 ceph-mon[35425]: pgmap v635: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 32 MiB/s wr, 634 op/s 2024-05-20T17:16:06.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:05 smithi171 ceph-mon[35901]: pgmap v635: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 32 MiB/s wr, 634 op/s 2024-05-20T17:16:06.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:05 smithi006 ceph-mon[32486]: pgmap v635: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 32 MiB/s wr, 634 op/s 2024-05-20T17:16:08.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:07 smithi062 ceph-mon[35425]: pgmap v636: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 30 MiB/s wr, 588 op/s 2024-05-20T17:16:08.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:07 smithi171 ceph-mon[35901]: pgmap v636: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 30 MiB/s wr, 588 op/s 2024-05-20T17:16:08.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:07 smithi006 ceph-mon[32486]: pgmap v636: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 30 MiB/s wr, 588 op/s 2024-05-20T17:16:09.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:16:09.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:16:09.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:16:10.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:09 smithi062 ceph-mon[35425]: pgmap v637: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 33 MiB/s wr, 659 op/s 2024-05-20T17:16:10.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:09 smithi171 ceph-mon[35901]: pgmap v637: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 33 MiB/s wr, 659 op/s 2024-05-20T17:16:10.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:09 smithi006 ceph-mon[32486]: pgmap v637: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 33 MiB/s wr, 659 op/s 2024-05-20T17:16:11.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:10 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:16:11.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:10 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:16:11.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:10 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:16:11.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:10 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:16:11.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:10 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:16:11.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:10 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:16:11.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:10 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:16:11.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:10 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:16:11.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:10 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:16:12.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:11 smithi062 ceph-mon[35425]: pgmap v638: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 31 MiB/s wr, 614 op/s 2024-05-20T17:16:12.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:11 smithi171 ceph-mon[35901]: pgmap v638: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 31 MiB/s wr, 614 op/s 2024-05-20T17:16:12.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:11 smithi006 ceph-mon[32486]: pgmap v638: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 31 MiB/s wr, 614 op/s 2024-05-20T17:16:14.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:13 smithi062 ceph-mon[35425]: pgmap v639: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 34 MiB/s wr, 670 op/s 2024-05-20T17:16:14.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:13 smithi171 ceph-mon[35901]: pgmap v639: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 34 MiB/s wr, 670 op/s 2024-05-20T17:16:14.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:13 smithi006 ceph-mon[32486]: pgmap v639: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 34 MiB/s wr, 670 op/s 2024-05-20T17:16:15.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:14 smithi062 ceph-mon[35425]: pgmap v640: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 31 MiB/s wr, 608 op/s 2024-05-20T17:16:15.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:14 smithi171 ceph-mon[35901]: pgmap v640: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 31 MiB/s wr, 608 op/s 2024-05-20T17:16:15.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:14 smithi006 ceph-mon[32486]: pgmap v640: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 31 MiB/s wr, 608 op/s 2024-05-20T17:16:17.774 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:17 smithi062 ceph-mon[35425]: pgmap v641: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 29 MiB/s wr, 572 op/s 2024-05-20T17:16:17.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:17 smithi171 ceph-mon[35901]: pgmap v641: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 29 MiB/s wr, 572 op/s 2024-05-20T17:16:17.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:17 smithi006 ceph-mon[32486]: pgmap v641: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 29 MiB/s wr, 572 op/s 2024-05-20T17:16:19.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:19 smithi062 ceph-mon[35425]: pgmap v642: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 33 MiB/s wr, 650 op/s 2024-05-20T17:16:19.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:19 smithi171 ceph-mon[35901]: pgmap v642: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 33 MiB/s wr, 650 op/s 2024-05-20T17:16:19.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:19 smithi006 ceph-mon[32486]: pgmap v642: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 33 MiB/s wr, 650 op/s 2024-05-20T17:16:21.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:21 smithi062 ceph-mon[35425]: pgmap v643: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 30 MiB/s wr, 605 op/s 2024-05-20T17:16:21.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:21 smithi171 ceph-mon[35901]: pgmap v643: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 30 MiB/s wr, 605 op/s 2024-05-20T17:16:21.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:21 smithi006 ceph-mon[32486]: pgmap v643: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 30 MiB/s wr, 605 op/s 2024-05-20T17:16:23.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:23 smithi062 ceph-mon[35425]: pgmap v644: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 33 MiB/s wr, 668 op/s 2024-05-20T17:16:23.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:23 smithi171 ceph-mon[35901]: pgmap v644: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 33 MiB/s wr, 668 op/s 2024-05-20T17:16:23.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:23 smithi006 ceph-mon[32486]: pgmap v644: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 33 MiB/s wr, 668 op/s 2024-05-20T17:16:25.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:25 smithi062 ceph-mon[35425]: pgmap v645: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 31 MiB/s wr, 626 op/s 2024-05-20T17:16:25.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:25 smithi171 ceph-mon[35901]: pgmap v645: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 31 MiB/s wr, 626 op/s 2024-05-20T17:16:25.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:25 smithi006 ceph-mon[32486]: pgmap v645: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 31 MiB/s wr, 626 op/s 2024-05-20T17:16:27.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:27 smithi062 ceph-mon[35425]: pgmap v646: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 29 MiB/s wr, 588 op/s 2024-05-20T17:16:27.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:27 smithi171 ceph-mon[35901]: pgmap v646: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 29 MiB/s wr, 588 op/s 2024-05-20T17:16:27.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:27 smithi006 ceph-mon[32486]: pgmap v646: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 29 MiB/s wr, 588 op/s 2024-05-20T17:16:29.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:29 smithi062 ceph-mon[35425]: pgmap v647: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 33 MiB/s wr, 667 op/s 2024-05-20T17:16:29.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:29 smithi171 ceph-mon[35901]: pgmap v647: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 33 MiB/s wr, 667 op/s 2024-05-20T17:16:29.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:29 smithi006 ceph-mon[32486]: pgmap v647: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 33 MiB/s wr, 667 op/s 2024-05-20T17:16:31.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:31 smithi062 ceph-mon[35425]: pgmap v648: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 31 MiB/s wr, 621 op/s 2024-05-20T17:16:31.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:31 smithi171 ceph-mon[35901]: pgmap v648: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 31 MiB/s wr, 621 op/s 2024-05-20T17:16:31.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:31 smithi006 ceph-mon[32486]: pgmap v648: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 31 MiB/s wr, 621 op/s 2024-05-20T17:16:33.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:33 smithi062 ceph-mon[35425]: pgmap v649: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 34 MiB/s wr, 684 op/s 2024-05-20T17:16:33.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:33 smithi171 ceph-mon[35901]: pgmap v649: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 34 MiB/s wr, 684 op/s 2024-05-20T17:16:33.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:33 smithi006 ceph-mon[32486]: pgmap v649: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 34 MiB/s wr, 684 op/s 2024-05-20T17:16:35.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:35 smithi062 ceph-mon[35425]: pgmap v650: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 31 MiB/s wr, 628 op/s 2024-05-20T17:16:35.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:35 smithi171 ceph-mon[35901]: pgmap v650: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 31 MiB/s wr, 628 op/s 2024-05-20T17:16:35.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:35 smithi006 ceph-mon[32486]: pgmap v650: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 31 MiB/s wr, 628 op/s 2024-05-20T17:16:37.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:37 smithi062 ceph-mon[35425]: pgmap v651: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 30 MiB/s wr, 612 op/s 2024-05-20T17:16:37.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:37 smithi171 ceph-mon[35901]: pgmap v651: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 30 MiB/s wr, 612 op/s 2024-05-20T17:16:37.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:37 smithi006 ceph-mon[32486]: pgmap v651: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 30 MiB/s wr, 612 op/s 2024-05-20T17:16:39.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:39 smithi062 ceph-mon[35425]: pgmap v652: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 32 MiB/s wr, 660 op/s 2024-05-20T17:16:39.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:39 smithi171 ceph-mon[35901]: pgmap v652: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 32 MiB/s wr, 660 op/s 2024-05-20T17:16:39.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:39 smithi006 ceph-mon[32486]: pgmap v652: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 32 MiB/s wr, 660 op/s 2024-05-20T17:16:41.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:41 smithi062 ceph-mon[35425]: pgmap v653: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 30 MiB/s wr, 609 op/s 2024-05-20T17:16:41.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:41 smithi171 ceph-mon[35901]: pgmap v653: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 30 MiB/s wr, 609 op/s 2024-05-20T17:16:41.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:41 smithi006 ceph-mon[32486]: pgmap v653: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 30 MiB/s wr, 609 op/s 2024-05-20T17:16:43.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:43 smithi062 ceph-mon[35425]: pgmap v654: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 33 MiB/s wr, 670 op/s 2024-05-20T17:16:43.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:43 smithi171 ceph-mon[35901]: pgmap v654: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 33 MiB/s wr, 670 op/s 2024-05-20T17:16:43.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:43 smithi006 ceph-mon[32486]: pgmap v654: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 33 MiB/s wr, 670 op/s 2024-05-20T17:16:45.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:45 smithi062 ceph-mon[35425]: pgmap v655: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 30 MiB/s wr, 617 op/s 2024-05-20T17:16:45.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:45 smithi171 ceph-mon[35901]: pgmap v655: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 30 MiB/s wr, 617 op/s 2024-05-20T17:16:45.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:45 smithi006 ceph-mon[32486]: pgmap v655: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 30 MiB/s wr, 617 op/s 2024-05-20T17:16:47.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:47 smithi062 ceph-mon[35425]: pgmap v656: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 30 MiB/s wr, 610 op/s 2024-05-20T17:16:47.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:47 smithi171 ceph-mon[35901]: pgmap v656: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 30 MiB/s wr, 610 op/s 2024-05-20T17:16:47.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:47 smithi006 ceph-mon[32486]: pgmap v656: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 30 MiB/s wr, 610 op/s 2024-05-20T17:16:50.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:49 smithi062 ceph-mon[35425]: pgmap v657: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 31 MiB/s wr, 628 op/s 2024-05-20T17:16:50.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:49 smithi171 ceph-mon[35901]: pgmap v657: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 31 MiB/s wr, 628 op/s 2024-05-20T17:16:50.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:49 smithi006 ceph-mon[32486]: pgmap v657: 129 pgs: 129 active+clean; 10 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 31 MiB/s wr, 628 op/s 2024-05-20T17:16:52.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:51 smithi062 ceph-mon[35425]: pgmap v658: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 30 MiB/s wr, 603 op/s 2024-05-20T17:16:52.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:51 smithi171 ceph-mon[35901]: pgmap v658: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 30 MiB/s wr, 603 op/s 2024-05-20T17:16:52.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:51 smithi006 ceph-mon[32486]: pgmap v658: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 30 MiB/s wr, 603 op/s 2024-05-20T17:16:54.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:53 smithi062 ceph-mon[35425]: pgmap v659: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 33 MiB/s wr, 665 op/s 2024-05-20T17:16:54.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:53 smithi171 ceph-mon[35901]: pgmap v659: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 33 MiB/s wr, 665 op/s 2024-05-20T17:16:54.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:53 smithi006 ceph-mon[32486]: pgmap v659: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 33 MiB/s wr, 665 op/s 2024-05-20T17:16:56.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:55 smithi171 ceph-mon[35901]: pgmap v660: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 30 MiB/s wr, 610 op/s 2024-05-20T17:16:56.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:55 smithi006 ceph-mon[32486]: pgmap v660: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 30 MiB/s wr, 610 op/s 2024-05-20T17:16:56.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:55 smithi062 ceph-mon[35425]: pgmap v660: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 30 MiB/s wr, 610 op/s 2024-05-20T17:16:58.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:57 smithi171 ceph-mon[35901]: pgmap v661: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 30 MiB/s wr, 597 op/s 2024-05-20T17:16:58.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:57 smithi006 ceph-mon[32486]: pgmap v661: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 30 MiB/s wr, 597 op/s 2024-05-20T17:16:58.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:57 smithi062 ceph-mon[35425]: pgmap v661: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 30 MiB/s wr, 597 op/s 2024-05-20T17:17:00.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:16:59 smithi171 ceph-mon[35901]: pgmap v662: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 30 MiB/s wr, 598 op/s 2024-05-20T17:17:00.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:16:59 smithi006 ceph-mon[32486]: pgmap v662: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 30 MiB/s wr, 598 op/s 2024-05-20T17:17:00.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:16:59 smithi062 ceph-mon[35425]: pgmap v662: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 30 MiB/s wr, 598 op/s 2024-05-20T17:17:02.074 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:01 smithi062 ceph-mon[35425]: pgmap v663: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 29 MiB/s wr, 595 op/s 2024-05-20T17:17:02.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:01 smithi171 ceph-mon[35901]: pgmap v663: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 29 MiB/s wr, 595 op/s 2024-05-20T17:17:02.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:01 smithi006 ceph-mon[32486]: pgmap v663: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 29 MiB/s wr, 595 op/s 2024-05-20T17:17:04.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:03 smithi171 ceph-mon[35901]: pgmap v664: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 33 MiB/s wr, 667 op/s 2024-05-20T17:17:04.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:03 smithi006 ceph-mon[32486]: pgmap v664: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 33 MiB/s wr, 667 op/s 2024-05-20T17:17:04.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:03 smithi062 ceph-mon[35425]: pgmap v664: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 33 MiB/s wr, 667 op/s 2024-05-20T17:17:06.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:05 smithi171 ceph-mon[35901]: pgmap v665: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 28 MiB/s wr, 577 op/s 2024-05-20T17:17:06.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:05 smithi006 ceph-mon[32486]: pgmap v665: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 28 MiB/s wr, 577 op/s 2024-05-20T17:17:06.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:05 smithi062 ceph-mon[35425]: pgmap v665: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 28 MiB/s wr, 577 op/s 2024-05-20T17:17:08.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:07 smithi171 ceph-mon[35901]: pgmap v666: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 29 MiB/s wr, 601 op/s 2024-05-20T17:17:08.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:07 smithi006 ceph-mon[32486]: pgmap v666: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 29 MiB/s wr, 601 op/s 2024-05-20T17:17:08.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:07 smithi062 ceph-mon[35425]: pgmap v666: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 29 MiB/s wr, 601 op/s 2024-05-20T17:17:10.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:09 smithi171 ceph-mon[35901]: pgmap v667: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 30 MiB/s wr, 605 op/s 2024-05-20T17:17:10.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:09 smithi006 ceph-mon[32486]: pgmap v667: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 30 MiB/s wr, 605 op/s 2024-05-20T17:17:10.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:09 smithi062 ceph-mon[35425]: pgmap v667: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 30 MiB/s wr, 605 op/s 2024-05-20T17:17:11.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:10 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:17:11.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:10 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:17:11.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:10 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:17:12.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:11 smithi062 ceph-mon[35425]: pgmap v668: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 30 MiB/s wr, 612 op/s 2024-05-20T17:17:12.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:11 smithi171 ceph-mon[35901]: pgmap v668: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 30 MiB/s wr, 612 op/s 2024-05-20T17:17:12.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:11 smithi006 ceph-mon[32486]: pgmap v668: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 30 MiB/s wr, 612 op/s 2024-05-20T17:17:13.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:12 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:17:13.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:12 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:17:13.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:12 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:17:13.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:12 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:17:13.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:12 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:17:13.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:12 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:17:13.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:12 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:17:13.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:12 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:17:13.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:12 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:17:14.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:13 smithi062 ceph-mon[35425]: pgmap v669: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 32 MiB/s wr, 662 op/s 2024-05-20T17:17:14.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:13 smithi171 ceph-mon[35901]: pgmap v669: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 32 MiB/s wr, 662 op/s 2024-05-20T17:17:14.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:13 smithi006 ceph-mon[32486]: pgmap v669: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 32 MiB/s wr, 662 op/s 2024-05-20T17:17:16.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:15 smithi062 ceph-mon[35425]: pgmap v670: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 28 MiB/s wr, 569 op/s 2024-05-20T17:17:16.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:15 smithi171 ceph-mon[35901]: pgmap v670: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 28 MiB/s wr, 569 op/s 2024-05-20T17:17:16.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:15 smithi006 ceph-mon[32486]: pgmap v670: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 28 MiB/s wr, 569 op/s 2024-05-20T17:17:18.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:17 smithi062 ceph-mon[35425]: pgmap v671: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 30 MiB/s wr, 621 op/s 2024-05-20T17:17:18.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:17 smithi171 ceph-mon[35901]: pgmap v671: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 30 MiB/s wr, 621 op/s 2024-05-20T17:17:18.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:17 smithi006 ceph-mon[32486]: pgmap v671: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 30 MiB/s wr, 621 op/s 2024-05-20T17:17:20.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:19 smithi062 ceph-mon[35425]: pgmap v672: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 29 MiB/s wr, 593 op/s 2024-05-20T17:17:20.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:19 smithi171 ceph-mon[35901]: pgmap v672: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 29 MiB/s wr, 593 op/s 2024-05-20T17:17:20.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:19 smithi006 ceph-mon[32486]: pgmap v672: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 29 MiB/s wr, 593 op/s 2024-05-20T17:17:22.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:21 smithi062 ceph-mon[35425]: pgmap v673: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 29 MiB/s wr, 603 op/s 2024-05-20T17:17:22.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:21 smithi171 ceph-mon[35901]: pgmap v673: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 29 MiB/s wr, 603 op/s 2024-05-20T17:17:22.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:21 smithi006 ceph-mon[32486]: pgmap v673: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 29 MiB/s wr, 603 op/s 2024-05-20T17:17:24.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:23 smithi062 ceph-mon[35425]: pgmap v674: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 32 MiB/s wr, 651 op/s 2024-05-20T17:17:24.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:23 smithi171 ceph-mon[35901]: pgmap v674: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 32 MiB/s wr, 651 op/s 2024-05-20T17:17:24.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:23 smithi006 ceph-mon[32486]: pgmap v674: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 32 MiB/s wr, 651 op/s 2024-05-20T17:17:26.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:25 smithi062 ceph-mon[35425]: pgmap v675: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 27 MiB/s wr, 560 op/s 2024-05-20T17:17:26.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:25 smithi171 ceph-mon[35901]: pgmap v675: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 27 MiB/s wr, 560 op/s 2024-05-20T17:17:26.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:25 smithi006 ceph-mon[32486]: pgmap v675: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 27 MiB/s wr, 560 op/s 2024-05-20T17:17:28.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:27 smithi062 ceph-mon[35425]: pgmap v676: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 30 MiB/s wr, 616 op/s 2024-05-20T17:17:28.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:27 smithi171 ceph-mon[35901]: pgmap v676: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 30 MiB/s wr, 616 op/s 2024-05-20T17:17:28.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:27 smithi006 ceph-mon[32486]: pgmap v676: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 30 MiB/s wr, 616 op/s 2024-05-20T17:17:30.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:29 smithi062 ceph-mon[35425]: pgmap v677: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 29 MiB/s wr, 595 op/s 2024-05-20T17:17:30.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:29 smithi171 ceph-mon[35901]: pgmap v677: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 29 MiB/s wr, 595 op/s 2024-05-20T17:17:30.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:29 smithi006 ceph-mon[32486]: pgmap v677: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 29 MiB/s wr, 595 op/s 2024-05-20T17:17:32.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:31 smithi062 ceph-mon[35425]: pgmap v678: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 29 MiB/s wr, 604 op/s 2024-05-20T17:17:32.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:31 smithi171 ceph-mon[35901]: pgmap v678: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 29 MiB/s wr, 604 op/s 2024-05-20T17:17:32.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:31 smithi006 ceph-mon[32486]: pgmap v678: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 29 MiB/s wr, 604 op/s 2024-05-20T17:17:34.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:33 smithi062 ceph-mon[35425]: pgmap v679: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 32 MiB/s wr, 655 op/s 2024-05-20T17:17:34.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:33 smithi171 ceph-mon[35901]: pgmap v679: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 32 MiB/s wr, 655 op/s 2024-05-20T17:17:34.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:33 smithi006 ceph-mon[32486]: pgmap v679: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 32 MiB/s wr, 655 op/s 2024-05-20T17:17:36.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:35 smithi062 ceph-mon[35425]: pgmap v680: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 27 MiB/s wr, 570 op/s 2024-05-20T17:17:36.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:35 smithi171 ceph-mon[35901]: pgmap v680: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 27 MiB/s wr, 570 op/s 2024-05-20T17:17:36.383 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:35 smithi006 ceph-mon[32486]: pgmap v680: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 27 MiB/s wr, 570 op/s 2024-05-20T17:17:38.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:37 smithi062 ceph-mon[35425]: pgmap v681: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 30 MiB/s wr, 631 op/s 2024-05-20T17:17:38.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:37 smithi171 ceph-mon[35901]: pgmap v681: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 30 MiB/s wr, 631 op/s 2024-05-20T17:17:38.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:37 smithi006 ceph-mon[32486]: pgmap v681: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 30 MiB/s wr, 631 op/s 2024-05-20T17:17:40.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:39 smithi062 ceph-mon[35425]: pgmap v682: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 29 MiB/s wr, 600 op/s 2024-05-20T17:17:40.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:39 smithi171 ceph-mon[35901]: pgmap v682: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 29 MiB/s wr, 600 op/s 2024-05-20T17:17:40.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:39 smithi006 ceph-mon[32486]: pgmap v682: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 29 MiB/s wr, 600 op/s 2024-05-20T17:17:42.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:41 smithi062 ceph-mon[35425]: pgmap v683: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 29 MiB/s wr, 610 op/s 2024-05-20T17:17:42.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:41 smithi171 ceph-mon[35901]: pgmap v683: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 29 MiB/s wr, 610 op/s 2024-05-20T17:17:42.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:41 smithi006 ceph-mon[32486]: pgmap v683: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 29 MiB/s wr, 610 op/s 2024-05-20T17:17:44.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:43 smithi062 ceph-mon[35425]: pgmap v684: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 31 MiB/s wr, 657 op/s 2024-05-20T17:17:44.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:43 smithi171 ceph-mon[35901]: pgmap v684: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 31 MiB/s wr, 657 op/s 2024-05-20T17:17:44.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:43 smithi006 ceph-mon[32486]: pgmap v684: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 31 MiB/s wr, 657 op/s 2024-05-20T17:17:45.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:45 smithi062 ceph-mon[35425]: pgmap v685: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 26 MiB/s wr, 544 op/s 2024-05-20T17:17:45.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:45 smithi171 ceph-mon[35901]: pgmap v685: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 26 MiB/s wr, 544 op/s 2024-05-20T17:17:45.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:45 smithi006 ceph-mon[32486]: pgmap v685: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 26 MiB/s wr, 544 op/s 2024-05-20T17:17:47.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:47 smithi062 ceph-mon[35425]: pgmap v686: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 30 MiB/s wr, 628 op/s 2024-05-20T17:17:47.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:47 smithi171 ceph-mon[35901]: pgmap v686: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 30 MiB/s wr, 628 op/s 2024-05-20T17:17:47.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:47 smithi006 ceph-mon[32486]: pgmap v686: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 30 MiB/s wr, 628 op/s 2024-05-20T17:17:49.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:49 smithi062 ceph-mon[35425]: pgmap v687: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 29 MiB/s wr, 593 op/s 2024-05-20T17:17:49.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:49 smithi171 ceph-mon[35901]: pgmap v687: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 29 MiB/s wr, 593 op/s 2024-05-20T17:17:49.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:49 smithi006 ceph-mon[32486]: pgmap v687: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 29 MiB/s wr, 593 op/s 2024-05-20T17:17:51.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:51 smithi062 ceph-mon[35425]: pgmap v688: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 29 MiB/s wr, 605 op/s 2024-05-20T17:17:51.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:51 smithi171 ceph-mon[35901]: pgmap v688: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 29 MiB/s wr, 605 op/s 2024-05-20T17:17:51.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:51 smithi006 ceph-mon[32486]: pgmap v688: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 29 MiB/s wr, 605 op/s 2024-05-20T17:17:53.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:53 smithi062 ceph-mon[35425]: pgmap v689: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 31 MiB/s wr, 646 op/s 2024-05-20T17:17:53.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:53 smithi171 ceph-mon[35901]: pgmap v689: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 31 MiB/s wr, 646 op/s 2024-05-20T17:17:53.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:53 smithi006 ceph-mon[32486]: pgmap v689: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 31 MiB/s wr, 646 op/s 2024-05-20T17:17:55.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:55 smithi062 ceph-mon[35425]: pgmap v690: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 26 MiB/s wr, 535 op/s 2024-05-20T17:17:55.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:55 smithi171 ceph-mon[35901]: pgmap v690: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 26 MiB/s wr, 535 op/s 2024-05-20T17:17:55.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:55 smithi006 ceph-mon[32486]: pgmap v690: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 26 MiB/s wr, 535 op/s 2024-05-20T17:17:57.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:57 smithi062 ceph-mon[35425]: pgmap v691: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 31 MiB/s wr, 638 op/s 2024-05-20T17:17:57.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:57 smithi171 ceph-mon[35901]: pgmap v691: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 31 MiB/s wr, 638 op/s 2024-05-20T17:17:57.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:57 smithi006 ceph-mon[32486]: pgmap v691: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 31 MiB/s wr, 638 op/s 2024-05-20T17:17:59.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:17:59 smithi062 ceph-mon[35425]: pgmap v692: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 29 MiB/s wr, 584 op/s 2024-05-20T17:17:59.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:17:59 smithi171 ceph-mon[35901]: pgmap v692: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 29 MiB/s wr, 584 op/s 2024-05-20T17:17:59.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:17:59 smithi006 ceph-mon[32486]: pgmap v692: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 29 MiB/s wr, 584 op/s 2024-05-20T17:18:01.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:01 smithi062 ceph-mon[35425]: pgmap v693: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 29 MiB/s wr, 597 op/s 2024-05-20T17:18:01.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:01 smithi171 ceph-mon[35901]: pgmap v693: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 29 MiB/s wr, 597 op/s 2024-05-20T17:18:01.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:01 smithi006 ceph-mon[32486]: pgmap v693: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 29 MiB/s wr, 597 op/s 2024-05-20T17:18:03.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:03 smithi062 ceph-mon[35425]: pgmap v694: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 32 MiB/s wr, 639 op/s 2024-05-20T17:18:03.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:03 smithi171 ceph-mon[35901]: pgmap v694: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 32 MiB/s wr, 639 op/s 2024-05-20T17:18:03.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:03 smithi006 ceph-mon[32486]: pgmap v694: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 32 MiB/s wr, 639 op/s 2024-05-20T17:18:05.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:05 smithi062 ceph-mon[35425]: pgmap v695: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 26 MiB/s wr, 530 op/s 2024-05-20T17:18:05.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:05 smithi171 ceph-mon[35901]: pgmap v695: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 26 MiB/s wr, 530 op/s 2024-05-20T17:18:05.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:05 smithi006 ceph-mon[32486]: pgmap v695: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 26 MiB/s wr, 530 op/s 2024-05-20T17:18:07.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:07 smithi171 ceph-mon[35901]: pgmap v696: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 31 MiB/s wr, 635 op/s 2024-05-20T17:18:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:07 smithi006 ceph-mon[32486]: pgmap v696: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 31 MiB/s wr, 635 op/s 2024-05-20T17:18:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:07 smithi062 ceph-mon[35425]: pgmap v696: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 31 MiB/s wr, 635 op/s 2024-05-20T17:18:09.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:09 smithi171 ceph-mon[35901]: pgmap v697: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 29 MiB/s wr, 581 op/s 2024-05-20T17:18:09.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:09 smithi006 ceph-mon[32486]: pgmap v697: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 29 MiB/s wr, 581 op/s 2024-05-20T17:18:10.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:09 smithi062 ceph-mon[35425]: pgmap v697: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 29 MiB/s wr, 581 op/s 2024-05-20T17:18:11.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:11 smithi171 ceph-mon[35901]: pgmap v698: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 29 MiB/s wr, 594 op/s 2024-05-20T17:18:11.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:11 smithi006 ceph-mon[32486]: pgmap v698: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 29 MiB/s wr, 594 op/s 2024-05-20T17:18:12.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:11 smithi062 ceph-mon[35425]: pgmap v698: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 29 MiB/s wr, 594 op/s 2024-05-20T17:18:13.818 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:13 smithi171 ceph-mon[35901]: pgmap v699: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 31 MiB/s wr, 636 op/s 2024-05-20T17:18:13.818 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:13 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:18:13.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:13 smithi006 ceph-mon[32486]: pgmap v699: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 31 MiB/s wr, 636 op/s 2024-05-20T17:18:13.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:13 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:18:14.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:13 smithi062 ceph-mon[35425]: pgmap v699: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 31 MiB/s wr, 636 op/s 2024-05-20T17:18:14.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:13 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:18:15.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:14 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:15.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:14 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:15.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:14 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:15.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:14 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:15.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:14 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:15.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:14 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:16.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:15 smithi062 ceph-mon[35425]: pgmap v700: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 26 MiB/s wr, 529 op/s 2024-05-20T17:18:16.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:15 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:16.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:15 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:16.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:15 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:16.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:15 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:16.276 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:15 smithi006 ceph-mon[32486]: pgmap v700: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 26 MiB/s wr, 529 op/s 2024-05-20T17:18:16.277 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:15 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:16.277 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:15 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:16.277 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:15 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:16.277 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:15 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:16.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:15 smithi171 ceph-mon[35901]: pgmap v700: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 26 MiB/s wr, 529 op/s 2024-05-20T17:18:16.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:15 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:16.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:15 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:16.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:15 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:16.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:15 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:18.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:17 smithi062 ceph-mon[35425]: pgmap v701: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 31 MiB/s wr, 628 op/s 2024-05-20T17:18:18.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:17 smithi171 ceph-mon[35901]: pgmap v701: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 31 MiB/s wr, 628 op/s 2024-05-20T17:18:18.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:17 smithi006 ceph-mon[32486]: pgmap v701: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 31 MiB/s wr, 628 op/s 2024-05-20T17:18:20.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:19 smithi062 ceph-mon[35425]: pgmap v702: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 29 MiB/s wr, 583 op/s 2024-05-20T17:18:20.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:19 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:20.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:19 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:20.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:19 smithi171 ceph-mon[35901]: pgmap v702: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 29 MiB/s wr, 583 op/s 2024-05-20T17:18:20.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:19 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:20.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:19 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:20.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:19 smithi006 ceph-mon[32486]: pgmap v702: 129 pgs: 129 active+clean; 10 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 29 MiB/s wr, 583 op/s 2024-05-20T17:18:20.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:19 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:20.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:19 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:22.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:21 smithi062 ceph-mon[35425]: pgmap v703: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 28 MiB/s wr, 557 op/s 2024-05-20T17:18:22.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:21 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:18:22.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:21 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:18:22.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:21 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:22.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:21 smithi171 ceph-mon[35901]: pgmap v703: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 28 MiB/s wr, 557 op/s 2024-05-20T17:18:22.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:21 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:18:22.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:21 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:18:22.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:21 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:22.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:21 smithi006 ceph-mon[32486]: pgmap v703: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 28 MiB/s wr, 557 op/s 2024-05-20T17:18:22.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:21 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:18:22.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:21 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:18:22.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:21 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:18:24.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:23 smithi062 ceph-mon[35425]: pgmap v704: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 30 MiB/s wr, 592 op/s 2024-05-20T17:18:24.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:23 smithi171 ceph-mon[35901]: pgmap v704: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 30 MiB/s wr, 592 op/s 2024-05-20T17:18:24.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:23 smithi006 ceph-mon[32486]: pgmap v704: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 30 MiB/s wr, 592 op/s 2024-05-20T17:18:26.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:25 smithi062 ceph-mon[35425]: pgmap v705: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 26 MiB/s wr, 516 op/s 2024-05-20T17:18:26.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:25 smithi171 ceph-mon[35901]: pgmap v705: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 26 MiB/s wr, 516 op/s 2024-05-20T17:18:26.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:25 smithi006 ceph-mon[32486]: pgmap v705: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 26 MiB/s wr, 516 op/s 2024-05-20T17:18:28.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:27 smithi062 ceph-mon[35425]: pgmap v706: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 29 MiB/s wr, 587 op/s 2024-05-20T17:18:28.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:27 smithi171 ceph-mon[35901]: pgmap v706: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 29 MiB/s wr, 587 op/s 2024-05-20T17:18:28.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:27 smithi006 ceph-mon[32486]: pgmap v706: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 29 MiB/s wr, 587 op/s 2024-05-20T17:18:30.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:30 smithi062 ceph-mon[35425]: pgmap v707: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 29 MiB/s wr, 568 op/s 2024-05-20T17:18:30.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:30 smithi171 ceph-mon[35901]: pgmap v707: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 29 MiB/s wr, 568 op/s 2024-05-20T17:18:30.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:30 smithi006 ceph-mon[32486]: pgmap v707: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 29 MiB/s wr, 568 op/s 2024-05-20T17:18:32.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:32 smithi062 ceph-mon[35425]: pgmap v708: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 27 MiB/s wr, 539 op/s 2024-05-20T17:18:32.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:32 smithi171 ceph-mon[35901]: pgmap v708: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 27 MiB/s wr, 539 op/s 2024-05-20T17:18:32.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:32 smithi006 ceph-mon[32486]: pgmap v708: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 27 MiB/s wr, 539 op/s 2024-05-20T17:18:34.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:34 smithi062 ceph-mon[35425]: pgmap v709: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 31 MiB/s wr, 619 op/s 2024-05-20T17:18:34.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:34 smithi171 ceph-mon[35901]: pgmap v709: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 31 MiB/s wr, 619 op/s 2024-05-20T17:18:34.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:34 smithi006 ceph-mon[32486]: pgmap v709: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 31 MiB/s wr, 619 op/s 2024-05-20T17:18:36.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:36 smithi062 ceph-mon[35425]: pgmap v710: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 27 MiB/s wr, 546 op/s 2024-05-20T17:18:36.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:36 smithi171 ceph-mon[35901]: pgmap v710: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 27 MiB/s wr, 546 op/s 2024-05-20T17:18:36.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:36 smithi006 ceph-mon[32486]: pgmap v710: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 27 MiB/s wr, 546 op/s 2024-05-20T17:18:38.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:38 smithi062 ceph-mon[35425]: pgmap v711: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 30 MiB/s wr, 589 op/s 2024-05-20T17:18:38.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:38 smithi171 ceph-mon[35901]: pgmap v711: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 30 MiB/s wr, 589 op/s 2024-05-20T17:18:38.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:38 smithi006 ceph-mon[32486]: pgmap v711: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 30 MiB/s wr, 589 op/s 2024-05-20T17:18:39.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:39 smithi171 ceph-mon[35901]: pgmap v712: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 31 MiB/s wr, 605 op/s 2024-05-20T17:18:39.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:39 smithi006 ceph-mon[32486]: pgmap v712: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 31 MiB/s wr, 605 op/s 2024-05-20T17:18:39.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:39 smithi062 ceph-mon[35425]: pgmap v712: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 31 MiB/s wr, 605 op/s 2024-05-20T17:18:41.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:41 smithi062 ceph-mon[35425]: pgmap v713: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 27 MiB/s wr, 539 op/s 2024-05-20T17:18:41.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:41 smithi171 ceph-mon[35901]: pgmap v713: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 27 MiB/s wr, 539 op/s 2024-05-20T17:18:41.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:41 smithi006 ceph-mon[32486]: pgmap v713: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 27 MiB/s wr, 539 op/s 2024-05-20T17:18:43.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:43 smithi062 ceph-mon[35425]: pgmap v714: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 32 MiB/s wr, 624 op/s 2024-05-20T17:18:43.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:43 smithi171 ceph-mon[35901]: pgmap v714: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 32 MiB/s wr, 624 op/s 2024-05-20T17:18:43.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:43 smithi006 ceph-mon[32486]: pgmap v714: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 32 MiB/s wr, 624 op/s 2024-05-20T17:18:45.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:45 smithi062 ceph-mon[35425]: pgmap v715: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 28 MiB/s wr, 544 op/s 2024-05-20T17:18:45.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:45 smithi171 ceph-mon[35901]: pgmap v715: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 28 MiB/s wr, 544 op/s 2024-05-20T17:18:45.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:45 smithi006 ceph-mon[32486]: pgmap v715: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 28 MiB/s wr, 544 op/s 2024-05-20T17:18:47.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:47 smithi062 ceph-mon[35425]: pgmap v716: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 30 MiB/s wr, 584 op/s 2024-05-20T17:18:47.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:47 smithi171 ceph-mon[35901]: pgmap v716: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 30 MiB/s wr, 584 op/s 2024-05-20T17:18:47.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:47 smithi006 ceph-mon[32486]: pgmap v716: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 30 MiB/s wr, 584 op/s 2024-05-20T17:18:50.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:49 smithi171 ceph-mon[35901]: pgmap v717: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 30 MiB/s wr, 590 op/s 2024-05-20T17:18:50.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:49 smithi006 ceph-mon[32486]: pgmap v717: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 30 MiB/s wr, 590 op/s 2024-05-20T17:18:50.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:49 smithi062 ceph-mon[35425]: pgmap v717: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 30 MiB/s wr, 590 op/s 2024-05-20T17:18:52.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:51 smithi171 ceph-mon[35901]: pgmap v718: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 27 MiB/s wr, 521 op/s 2024-05-20T17:18:52.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:51 smithi006 ceph-mon[32486]: pgmap v718: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 27 MiB/s wr, 521 op/s 2024-05-20T17:18:52.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:51 smithi062 ceph-mon[35425]: pgmap v718: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 27 MiB/s wr, 521 op/s 2024-05-20T17:18:54.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:53 smithi171 ceph-mon[35901]: pgmap v719: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 32 MiB/s wr, 628 op/s 2024-05-20T17:18:54.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:53 smithi006 ceph-mon[32486]: pgmap v719: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 32 MiB/s wr, 628 op/s 2024-05-20T17:18:54.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:53 smithi062 ceph-mon[35425]: pgmap v719: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 32 MiB/s wr, 628 op/s 2024-05-20T17:18:56.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:55 smithi171 ceph-mon[35901]: pgmap v720: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 28 MiB/s wr, 539 op/s 2024-05-20T17:18:56.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:55 smithi006 ceph-mon[32486]: pgmap v720: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 28 MiB/s wr, 539 op/s 2024-05-20T17:18:56.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:55 smithi062 ceph-mon[35425]: pgmap v720: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 28 MiB/s wr, 539 op/s 2024-05-20T17:18:58.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:57 smithi171 ceph-mon[35901]: pgmap v721: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 30 MiB/s wr, 581 op/s 2024-05-20T17:18:58.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:57 smithi006 ceph-mon[32486]: pgmap v721: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 30 MiB/s wr, 581 op/s 2024-05-20T17:18:58.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:57 smithi062 ceph-mon[35425]: pgmap v721: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 30 MiB/s wr, 581 op/s 2024-05-20T17:19:00.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:18:59 smithi171 ceph-mon[35901]: pgmap v722: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 31 MiB/s wr, 593 op/s 2024-05-20T17:19:00.134 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:18:59 smithi006 ceph-mon[32486]: pgmap v722: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 31 MiB/s wr, 593 op/s 2024-05-20T17:19:00.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:18:59 smithi062 ceph-mon[35425]: pgmap v722: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 31 MiB/s wr, 593 op/s 2024-05-20T17:19:02.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:01 smithi171 ceph-mon[35901]: pgmap v723: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 27 MiB/s wr, 528 op/s 2024-05-20T17:19:02.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:01 smithi006 ceph-mon[32486]: pgmap v723: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 27 MiB/s wr, 528 op/s 2024-05-20T17:19:02.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:01 smithi062 ceph-mon[35425]: pgmap v723: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 27 MiB/s wr, 528 op/s 2024-05-20T17:19:04.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:03 smithi171 ceph-mon[35901]: pgmap v724: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 33 MiB/s wr, 631 op/s 2024-05-20T17:19:04.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:03 smithi006 ceph-mon[32486]: pgmap v724: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 33 MiB/s wr, 631 op/s 2024-05-20T17:19:04.131 INFO:tasks.workunit.client.0.smithi006.stdout:stopping iogen 2024-05-20T17:19:04.132 INFO:tasks.workunit.client.0.smithi006.stderr:+ echo 'stopping iogen' 2024-05-20T17:19:04.132 INFO:tasks.workunit.client.0.smithi006.stderr:+ ./iogen -k 2024-05-20T17:19:04.137 INFO:tasks.workunit.client.0.smithi006.stdout:OK 2024-05-20T17:19:04.137 INFO:tasks.workunit.client.0.smithi006.stderr:+ echo OK 2024-05-20T17:19:04.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:03 smithi062 ceph-mon[35425]: pgmap v724: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 33 MiB/s wr, 631 op/s 2024-05-20T17:19:06.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:05 smithi171 ceph-mon[35901]: pgmap v725: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 28 MiB/s wr, 537 op/s 2024-05-20T17:19:06.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:05 smithi006 ceph-mon[32486]: pgmap v725: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 28 MiB/s wr, 537 op/s 2024-05-20T17:19:06.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:05 smithi062 ceph-mon[35425]: pgmap v725: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 28 MiB/s wr, 537 op/s 2024-05-20T17:19:06.454 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-20T17:19:06.455 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-20T17:19:07.315 INFO:tasks.workunit:Stopping ['suites/iogen.sh'] on client.0... 2024-05-20T17:19:07.316 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-20T17:19:07.645 DEBUG:teuthology.parallel:result is None 2024-05-20T17:19:07.645 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-20T17:19:07.688 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-20T17:19:07.688 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-05-20T17:19:07.699 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:19:07.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.938+0000 7f17f64f7640 1 -- 172.21.15.6:0/3137315031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f01078f0 msgr2=0x7f17f0109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:07.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.938+0000 7f17f64f7640 1 --2- 172.21.15.6:0/3137315031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f01078f0 0x7f17f0109d10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009ca0 tx=0x7f17e802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:19:07.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.938+0000 7f17f64f7640 1 -- 172.21.15.6:0/3137315031 shutdown_connections 2024-05-20T17:19:07.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.938+0000 7f17f64f7640 1 --2- 172.21.15.6:0/3137315031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f01078f0 0x7f17f0109d10 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:07.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.938+0000 7f17f64f7640 1 --2- 172.21.15.6:0/3137315031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f0102bf0 0x7f17f0103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:07.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.938+0000 7f17f64f7640 1 --2- 172.21.15.6:0/3137315031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17f01019b0 0x7f17f01026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:07.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.938+0000 7f17f64f7640 1 -- 172.21.15.6:0/3137315031 >> 172.21.15.6:0/3137315031 conn(0x7f17f00fcba0 msgr2=0x7f17f00ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:07.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.938+0000 7f17f64f7640 1 -- 172.21.15.6:0/3137315031 shutdown_connections 2024-05-20T17:19:07.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.938+0000 7f17f64f7640 1 -- 172.21.15.6:0/3137315031 wait complete. 2024-05-20T17:19:07.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.939+0000 7f17f64f7640 1 Processor -- start 2024-05-20T17:19:07.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.939+0000 7f17f64f7640 1 -- start start 2024-05-20T17:19:07.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.939+0000 7f17f64f7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f01019b0 0x7f17f00747f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:07.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.939+0000 7f17f64f7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17f0102bf0 0x7f17f019de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:07.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.939+0000 7f17f64f7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f01078f0 0x7f17f01a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:07.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.939+0000 7f17f64f7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f17f010d4e0 con 0x7f17f01019b0 2024-05-20T17:19:07.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.939+0000 7f17f64f7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f17f010d360 con 0x7f17f01078f0 2024-05-20T17:19:07.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.939+0000 7f17f64f7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f17f010d660 con 0x7f17f0102bf0 2024-05-20T17:19:07.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.940+0000 7f17effff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f01019b0 0x7f17f00747f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:07.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.940+0000 7f17effff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f01019b0 0x7f17f00747f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55378/0 (socket says 172.21.15.6:55378) 2024-05-20T17:19:07.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.940+0000 7f17effff640 1 -- 172.21.15.6:0/2823651124 learned_addr learned my addr 172.21.15.6:0/2823651124 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:19:07.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.940+0000 7f17f4a94640 1 --2- 172.21.15.6:0/2823651124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f01078f0 0x7f17f01a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:07.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.940+0000 7f17ef7fe640 1 --2- 172.21.15.6:0/2823651124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17f0102bf0 0x7f17f019de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:07.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.940+0000 7f17effff640 1 -- 172.21.15.6:0/2823651124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17f0102bf0 msgr2=0x7f17f019de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:07.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.940+0000 7f17effff640 1 --2- 172.21.15.6:0/2823651124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17f0102bf0 0x7f17f019de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:07.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.940+0000 7f17effff640 1 -- 172.21.15.6:0/2823651124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f01078f0 msgr2=0x7f17f01a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:07.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.940+0000 7f17effff640 1 --2- 172.21.15.6:0/2823651124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f01078f0 0x7f17f01a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:07.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.940+0000 7f17effff640 1 -- 172.21.15.6:0/2823651124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f01a0bf0 con 0x7f17f01019b0 2024-05-20T17:19:07.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.940+0000 7f17ef7fe640 1 --2- 172.21.15.6:0/2823651124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17f0102bf0 0x7f17f019de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:19:07.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.940+0000 7f17effff640 1 --2- 172.21.15.6:0/2823651124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f01019b0 0x7f17f00747f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f17e000e9f0 tx=0x7f17e000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:07.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.940+0000 7f17ed7fa640 1 -- 172.21.15.6:0/2823651124 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e000ccc0 con 0x7f17f01019b0 2024-05-20T17:19:07.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.940+0000 7f17ed7fa640 1 -- 172.21.15.6:0/2823651124 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f17e00035f0 con 0x7f17f01019b0 2024-05-20T17:19:07.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.940+0000 7f17f64f7640 1 -- 172.21.15.6:0/2823651124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f01a0ee0 con 0x7f17f01019b0 2024-05-20T17:19:07.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.940+0000 7f17ed7fa640 1 -- 172.21.15.6:0/2823651124 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e000ce60 con 0x7f17f01019b0 2024-05-20T17:19:07.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.940+0000 7f17f64f7640 1 -- 172.21.15.6:0/2823651124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f01a1340 con 0x7f17f01019b0 2024-05-20T17:19:07.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.941+0000 7f17f64f7640 1 -- 172.21.15.6:0/2823651124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f00691c0 con 0x7f17f01019b0 2024-05-20T17:19:07.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.943+0000 7f17ed7fa640 1 -- 172.21.15.6:0/2823651124 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f17e0004000 con 0x7f17f01019b0 2024-05-20T17:19:07.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.943+0000 7f17ed7fa640 1 --2- 172.21.15.6:0/2823651124 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f17d80a2cb0 0x7f17d80a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:07.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.944+0000 7f17ef7fe640 1 --2- 172.21.15.6:0/2823651124 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f17d80a2cb0 0x7f17d80a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:07.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.944+0000 7f17ed7fa640 1 -- 172.21.15.6:0/2823651124 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f17e00cf7f0 con 0x7f17f01019b0 2024-05-20T17:19:07.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.944+0000 7f17ef7fe640 1 --2- 172.21.15.6:0/2823651124 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f17d80a2cb0 0x7f17d80a51c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f17e4005fd0 tx=0x7f17e4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:07.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:07.947+0000 7f17ed7fa640 1 -- 172.21.15.6:0/2823651124 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f17e009c3a0 con 0x7f17f01019b0 2024-05-20T17:19:08.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:07 smithi171 ceph-mon[35901]: pgmap v726: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 30 MiB/s wr, 573 op/s 2024-05-20T17:19:08.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:07 smithi006 ceph-mon[32486]: pgmap v726: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 30 MiB/s wr, 573 op/s 2024-05-20T17:19:08.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.139+0000 7f17f64f7640 1 -- 172.21.15.6:0/2823651124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17f0106750 con 0x7f17f01019b0 2024-05-20T17:19:08.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.140+0000 7f17ed7fa640 1 -- 172.21.15.6:0/2823651124 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+24584 (secure 0 0 0) 0x7f17f0106750 con 0x7f17f01019b0 2024-05-20T17:19:08.142 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:19:08.142 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":94,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:06:44.581646+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:05:02.947896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:05:03.842231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:05:07.551471+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:19:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.143+0000 7f17f64f7640 1 -- 172.21.15.6:0/2823651124 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f17d80a2cb0 msgr2=0x7f17d80a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:08.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.143+0000 7f17f64f7640 1 --2- 172.21.15.6:0/2823651124 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f17d80a2cb0 0x7f17d80a51c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f17e4005fd0 tx=0x7f17e4005850 comp rx=0 tx=0).stop 2024-05-20T17:19:08.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.143+0000 7f17f64f7640 1 -- 172.21.15.6:0/2823651124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f01019b0 msgr2=0x7f17f00747f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:08.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.143+0000 7f17f64f7640 1 --2- 172.21.15.6:0/2823651124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f01019b0 0x7f17f00747f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f17e000e9f0 tx=0x7f17e000eeb0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.143+0000 7f17f64f7640 1 -- 172.21.15.6:0/2823651124 shutdown_connections 2024-05-20T17:19:08.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.143+0000 7f17f64f7640 1 --2- 172.21.15.6:0/2823651124 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f17d80a2cb0 0x7f17d80a51c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.143+0000 7f17f64f7640 1 --2- 172.21.15.6:0/2823651124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17f01078f0 0x7f17f01a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.143+0000 7f17f64f7640 1 --2- 172.21.15.6:0/2823651124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17f0102bf0 0x7f17f019de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.143+0000 7f17f64f7640 1 --2- 172.21.15.6:0/2823651124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f01019b0 0x7f17f00747f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.143+0000 7f17f64f7640 1 -- 172.21.15.6:0/2823651124 >> 172.21.15.6:0/2823651124 conn(0x7f17f00fcba0 msgr2=0x7f17f01038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:08.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.143+0000 7f17f64f7640 1 -- 172.21.15.6:0/2823651124 shutdown_connections 2024-05-20T17:19:08.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.143+0000 7f17f64f7640 1 -- 172.21.15.6:0/2823651124 wait complete. 2024-05-20T17:19:08.157 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:00:12.516679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:05:02.947896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:05:03.842231+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:05:07.551471+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:19:08.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:19:08.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:07 smithi062 ceph-mon[35425]: pgmap v726: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 30 MiB/s wr, 573 op/s 2024-05-20T17:19:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.276+0000 7f4cd7f65640 1 -- 172.21.15.6:0/2205695400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cd0102950 msgr2=0x7f4cd0102da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.276+0000 7f4cd7f65640 1 --2- 172.21.15.6:0/2205695400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cd0102950 0x7f4cd0102da0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0009900 tx=0x7f4cc002a410 comp rx=0 tx=0).stop 2024-05-20T17:19:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.276+0000 7f4cd7f65640 1 -- 172.21.15.6:0/2205695400 shutdown_connections 2024-05-20T17:19:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.276+0000 7f4cd7f65640 1 --2- 172.21.15.6:0/2205695400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cd0103430 0x7f4cd0109b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.276+0000 7f4cd7f65640 1 --2- 172.21.15.6:0/2205695400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cd0102950 0x7f4cd0102da0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.276+0000 7f4cd7f65640 1 --2- 172.21.15.6:0/2205695400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd0101f70 0x7f4cd0102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.276+0000 7f4cd7f65640 1 -- 172.21.15.6:0/2205695400 >> 172.21.15.6:0/2205695400 conn(0x7f4cd00fc330 msgr2=0x7f4cd00fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.276+0000 7f4cd7f65640 1 -- 172.21.15.6:0/2205695400 shutdown_connections 2024-05-20T17:19:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.276+0000 7f4cd7f65640 1 -- 172.21.15.6:0/2205695400 wait complete. 2024-05-20T17:19:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.276+0000 7f4cd7f65640 1 Processor -- start 2024-05-20T17:19:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.277+0000 7f4cd7f65640 1 -- start start 2024-05-20T17:19:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.277+0000 7f4cd7f65640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cd0101f70 0x7f4cd0199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.277+0000 7f4cd7f65640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cd0102950 0x7f4cd0199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.277+0000 7f4cd7f65640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd0103430 0x7f4cd01a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.277+0000 7f4cd7f65640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd010d4f0 con 0x7f4cd0101f70 2024-05-20T17:19:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.277+0000 7f4cd7f65640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd010d370 con 0x7f4cd0102950 2024-05-20T17:19:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.277+0000 7f4cd7f65640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd010d670 con 0x7f4cd0103430 2024-05-20T17:19:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.277+0000 7f4cd5d01640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cd0101f70 0x7f4cd0199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.277+0000 7f4cd5d01640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cd0101f70 0x7f4cd0199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55398/0 (socket says 172.21.15.6:55398) 2024-05-20T17:19:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.277+0000 7f4cd5d01640 1 -- 172.21.15.6:0/2083681791 learned_addr learned my addr 172.21.15.6:0/2083681791 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:19:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.277+0000 7f4cd6502640 1 --2- 172.21.15.6:0/2083681791 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd0103430 0x7f4cd01a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.277+0000 7f4cd5500640 1 --2- 172.21.15.6:0/2083681791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cd0102950 0x7f4cd0199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.277+0000 7f4cd5d01640 1 -- 172.21.15.6:0/2083681791 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd0103430 msgr2=0x7f4cd01a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.277+0000 7f4cd5d01640 1 --2- 172.21.15.6:0/2083681791 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd0103430 0x7f4cd01a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.277+0000 7f4cd5d01640 1 -- 172.21.15.6:0/2083681791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cd0102950 msgr2=0x7f4cd0199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:08.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.277+0000 7f4cd5d01640 1 --2- 172.21.15.6:0/2083681791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cd0102950 0x7f4cd0199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.277+0000 7f4cd5d01640 1 -- 172.21.15.6:0/2083681791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd01a0d00 con 0x7f4cd0101f70 2024-05-20T17:19:08.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.277+0000 7f4cd5500640 1 --2- 172.21.15.6:0/2083681791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cd0102950 0x7f4cd0199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:19:08.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.277+0000 7f4cd5d01640 1 --2- 172.21.15.6:0/2083681791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cd0101f70 0x7f4cd0199210 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00e9f0 tx=0x7f4ccc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:08.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.278+0000 7f4cc6ffd640 1 -- 172.21.15.6:0/2083681791 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc00ccc0 con 0x7f4cd0101f70 2024-05-20T17:19:08.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.278+0000 7f4cc6ffd640 1 -- 172.21.15.6:0/2083681791 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ccc0035f0 con 0x7f4cd0101f70 2024-05-20T17:19:08.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.278+0000 7f4cd7f65640 1 -- 172.21.15.6:0/2083681791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd01a0ff0 con 0x7f4cd0101f70 2024-05-20T17:19:08.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.278+0000 7f4cc6ffd640 1 -- 172.21.15.6:0/2083681791 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc00ce60 con 0x7f4cd0101f70 2024-05-20T17:19:08.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.278+0000 7f4cd7f65640 1 -- 172.21.15.6:0/2083681791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd01a1450 con 0x7f4cd0101f70 2024-05-20T17:19:08.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.279+0000 7f4cd7f65640 1 -- 172.21.15.6:0/2083681791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd01a16e0 con 0x7f4cd0101f70 2024-05-20T17:19:08.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.280+0000 7f4cc6ffd640 1 -- 172.21.15.6:0/2083681791 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f4ccc004000 con 0x7f4cd0101f70 2024-05-20T17:19:08.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.281+0000 7f4cc6ffd640 1 --2- 172.21.15.6:0/2083681791 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4cbc0a2b90 0x7f4cbc0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:08.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.282+0000 7f4cd5500640 1 --2- 172.21.15.6:0/2083681791 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4cbc0a2b90 0x7f4cbc0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:08.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.282+0000 7f4cc6ffd640 1 -- 172.21.15.6:0/2083681791 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f4ccc0cf880 con 0x7f4cd0101f70 2024-05-20T17:19:08.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.282+0000 7f4cd5500640 1 --2- 172.21.15.6:0/2083681791 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4cbc0a2b90 0x7f4cbc0a50a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0006010 tx=0x7f4cc0000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:08.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.285+0000 7f4cc6ffd640 1 -- 172.21.15.6:0/2083681791 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4ccc09c430 con 0x7f4cd0101f70 2024-05-20T17:19:08.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.473+0000 7f4cd7f65640 1 -- 172.21.15.6:0/2083681791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4cd01a1a20 con 0x7f4cd0101f70 2024-05-20T17:19:08.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.473+0000 7f4cc6ffd640 1 -- 172.21.15.6:0/2083681791 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) ==== 93+0+10 (secure 0 0 0) 0x7f4ccc09bd30 con 0x7f4cd0101f70 2024-05-20T17:19:08.474 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:19:08.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.475+0000 7f4cd7f65640 1 -- 172.21.15.6:0/2083681791 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4cbc0a2b90 msgr2=0x7f4cbc0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.475+0000 7f4cd7f65640 1 --2- 172.21.15.6:0/2083681791 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4cbc0a2b90 0x7f4cbc0a50a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0006010 tx=0x7f4cc0000bc0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.475+0000 7f4cd7f65640 1 -- 172.21.15.6:0/2083681791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cd0101f70 msgr2=0x7f4cd0199210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.475+0000 7f4cd7f65640 1 --2- 172.21.15.6:0/2083681791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cd0101f70 0x7f4cd0199210 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00e9f0 tx=0x7f4ccc00eeb0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.475+0000 7f4cd7f65640 1 -- 172.21.15.6:0/2083681791 shutdown_connections 2024-05-20T17:19:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.475+0000 7f4cd7f65640 1 --2- 172.21.15.6:0/2083681791 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f4cbc0a2b90 0x7f4cbc0a50a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.475+0000 7f4cd7f65640 1 --2- 172.21.15.6:0/2083681791 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd0103430 0x7f4cd01a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.475+0000 7f4cd7f65640 1 --2- 172.21.15.6:0/2083681791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cd0102950 0x7f4cd0199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.475+0000 7f4cd7f65640 1 --2- 172.21.15.6:0/2083681791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cd0101f70 0x7f4cd0199210 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.475+0000 7f4cd7f65640 1 -- 172.21.15.6:0/2083681791 >> 172.21.15.6:0/2083681791 conn(0x7f4cd00fc330 msgr2=0x7f4cd0108c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.475+0000 7f4cd7f65640 1 -- 172.21.15.6:0/2083681791 shutdown_connections 2024-05-20T17:19:08.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.475+0000 7f4cd7f65640 1 -- 172.21.15.6:0/2083681791 wait complete. 2024-05-20T17:19:08.489 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:19:08.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.605+0000 7f2f25b10640 1 -- 172.21.15.6:0/149954230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f20101990 msgr2=0x7f2f20102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:08.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.605+0000 7f2f25b10640 1 --2- 172.21.15.6:0/149954230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f20101990 0x7f2f20102690 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2f10009900 tx=0x7f2f1002a410 comp rx=0 tx=0).stop 2024-05-20T17:19:08.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.606+0000 7f2f25b10640 1 -- 172.21.15.6:0/149954230 shutdown_connections 2024-05-20T17:19:08.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.606+0000 7f2f25b10640 1 --2- 172.21.15.6:0/149954230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f201078d0 0x7f2f20109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.606+0000 7f2f25b10640 1 --2- 172.21.15.6:0/149954230 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f20102bd0 0x7f2f20102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.606+0000 7f2f25b10640 1 --2- 172.21.15.6:0/149954230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f20101990 0x7f2f20102690 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.606+0000 7f2f25b10640 1 -- 172.21.15.6:0/149954230 >> 172.21.15.6:0/149954230 conn(0x7f2f200fcb80 msgr2=0x7f2f200ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:08.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.606+0000 7f2f25b10640 1 -- 172.21.15.6:0/149954230 shutdown_connections 2024-05-20T17:19:08.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.606+0000 7f2f25b10640 1 -- 172.21.15.6:0/149954230 wait complete. 2024-05-20T17:19:08.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.606+0000 7f2f25b10640 1 Processor -- start 2024-05-20T17:19:08.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.606+0000 7f2f25b10640 1 -- start start 2024-05-20T17:19:08.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.606+0000 7f2f25b10640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f20101990 0x7f2f200fea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:08.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.606+0000 7f2f25b10640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f20102bd0 0x7f2f200fd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:08.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.606+0000 7f2f25b10640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f201078d0 0x7f2f200fd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:08.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.607+0000 7f2f25b10640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2010d4e0 con 0x7f2f20102bd0 2024-05-20T17:19:08.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.607+0000 7f2f25b10640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2010d360 con 0x7f2f201078d0 2024-05-20T17:19:08.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.607+0000 7f2f25b10640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2010d660 con 0x7f2f20101990 2024-05-20T17:19:08.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.607+0000 7f2f17fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f20102bd0 0x7f2f200fd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:08.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.607+0000 7f2f17fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f20102bd0 0x7f2f200fd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55412/0 (socket says 172.21.15.6:55412) 2024-05-20T17:19:08.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.607+0000 7f2f17fff640 1 -- 172.21.15.6:0/1541044783 learned_addr learned my addr 172.21.15.6:0/1541044783 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:19:08.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.607+0000 7f2f1ffff640 1 --2- 172.21.15.6:0/1541044783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f201078d0 0x7f2f200fd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:08.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.607+0000 7f2f1f7fe640 1 --2- 172.21.15.6:0/1541044783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f20101990 0x7f2f200fea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:08.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.607+0000 7f2f17fff640 1 -- 172.21.15.6:0/1541044783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f20101990 msgr2=0x7f2f200fea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:08.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.607+0000 7f2f17fff640 1 --2- 172.21.15.6:0/1541044783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f20101990 0x7f2f200fea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.607+0000 7f2f17fff640 1 -- 172.21.15.6:0/1541044783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f201078d0 msgr2=0x7f2f200fd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:08.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.607+0000 7f2f17fff640 1 --2- 172.21.15.6:0/1541044783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f201078d0 0x7f2f200fd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.607+0000 7f2f17fff640 1 -- 172.21.15.6:0/1541044783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f200fdd20 con 0x7f2f20102bd0 2024-05-20T17:19:08.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.607+0000 7f2f1f7fe640 1 --2- 172.21.15.6:0/1541044783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f20101990 0x7f2f200fea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:19:08.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.607+0000 7f2f17fff640 1 --2- 172.21.15.6:0/1541044783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f20102bd0 0x7f2f200fd0b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800c970 tx=0x7f2f0800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:08.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.607+0000 7f2f1d7fa640 1 -- 172.21.15.6:0/1541044783 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08007bb0 con 0x7f2f20102bd0 2024-05-20T17:19:08.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.607+0000 7f2f1d7fa640 1 -- 172.21.15.6:0/1541044783 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2f08007d50 con 0x7f2f20102bd0 2024-05-20T17:19:08.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.607+0000 7f2f25b10640 1 -- 172.21.15.6:0/1541044783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f201a32d0 con 0x7f2f20102bd0 2024-05-20T17:19:08.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.607+0000 7f2f1d7fa640 1 -- 172.21.15.6:0/1541044783 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0800f450 con 0x7f2f20102bd0 2024-05-20T17:19:08.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.607+0000 7f2f25b10640 1 -- 172.21.15.6:0/1541044783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f201a3740 con 0x7f2f20102bd0 2024-05-20T17:19:08.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.608+0000 7f2f25b10640 1 -- 172.21.15.6:0/1541044783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f201a3a00 con 0x7f2f20102bd0 2024-05-20T17:19:08.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.610+0000 7f2f1d7fa640 1 -- 172.21.15.6:0/1541044783 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f2f08004f00 con 0x7f2f20102bd0 2024-05-20T17:19:08.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.610+0000 7f2f1d7fa640 1 --2- 172.21.15.6:0/1541044783 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2f0c0a2b90 0x7f2f0c0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:08.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.611+0000 7f2f1d7fa640 1 -- 172.21.15.6:0/1541044783 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f2f080cf5f0 con 0x7f2f20102bd0 2024-05-20T17:19:08.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.611+0000 7f2f1f7fe640 1 --2- 172.21.15.6:0/1541044783 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2f0c0a2b90 0x7f2f0c0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:08.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.611+0000 7f2f1f7fe640 1 --2- 172.21.15.6:0/1541044783 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2f0c0a2b90 0x7f2f0c0a50a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2f10005ab0 tx=0x7f2f10005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:08.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.614+0000 7f2f1d7fa640 1 -- 172.21.15.6:0/1541044783 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2f08014030 con 0x7f2f20102bd0 2024-05-20T17:19:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.799+0000 7f2f25b10640 1 -- 172.21.15.6:0/1541044783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2f201a3bd0 con 0x7f2f20102bd0 2024-05-20T17:19:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.799+0000 7f2f1d7fa640 1 -- 172.21.15.6:0/1541044783 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) ==== 104+0+11 (secure 0 0 0) 0x7f2f0809c1a0 con 0x7f2f20102bd0 2024-05-20T17:19:08.801 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:19:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.801+0000 7f2f25b10640 1 -- 172.21.15.6:0/1541044783 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2f0c0a2b90 msgr2=0x7f2f0c0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.801+0000 7f2f25b10640 1 --2- 172.21.15.6:0/1541044783 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2f0c0a2b90 0x7f2f0c0a50a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2f10005ab0 tx=0x7f2f10005fd0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.801+0000 7f2f25b10640 1 -- 172.21.15.6:0/1541044783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f20102bd0 msgr2=0x7f2f200fd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.801+0000 7f2f25b10640 1 --2- 172.21.15.6:0/1541044783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f20102bd0 0x7f2f200fd0b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800c970 tx=0x7f2f0800ce30 comp rx=0 tx=0).stop 2024-05-20T17:19:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.801+0000 7f2f25b10640 1 -- 172.21.15.6:0/1541044783 shutdown_connections 2024-05-20T17:19:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.801+0000 7f2f25b10640 1 --2- 172.21.15.6:0/1541044783 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f2f0c0a2b90 0x7f2f0c0a50a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.801+0000 7f2f25b10640 1 --2- 172.21.15.6:0/1541044783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f201078d0 0x7f2f200fd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.801+0000 7f2f25b10640 1 --2- 172.21.15.6:0/1541044783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f20102bd0 0x7f2f200fd0b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.801+0000 7f2f25b10640 1 --2- 172.21.15.6:0/1541044783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f20101990 0x7f2f200fea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.801+0000 7f2f25b10640 1 -- 172.21.15.6:0/1541044783 >> 172.21.15.6:0/1541044783 conn(0x7f2f200fcb80 msgr2=0x7f2f20108e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.801+0000 7f2f25b10640 1 -- 172.21.15.6:0/1541044783 shutdown_connections 2024-05-20T17:19:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.801+0000 7f2f25b10640 1 -- 172.21.15.6:0/1541044783 wait complete. 2024-05-20T17:19:08.815 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:19:08.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.933+0000 7ff349777640 1 -- 172.21.15.6:0/1110404467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff344101990 msgr2=0x7ff344102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:08.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.933+0000 7ff349777640 1 --2- 172.21.15.6:0/1110404467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff344101990 0x7ff344102690 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff334009900 tx=0x7ff33402a410 comp rx=0 tx=0).stop 2024-05-20T17:19:08.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.933+0000 7ff349777640 1 -- 172.21.15.6:0/1110404467 shutdown_connections 2024-05-20T17:19:08.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.933+0000 7ff349777640 1 --2- 172.21.15.6:0/1110404467 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3441078d0 0x7ff344109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.933+0000 7ff349777640 1 --2- 172.21.15.6:0/1110404467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff344102bd0 0x7ff344102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.933+0000 7ff349777640 1 --2- 172.21.15.6:0/1110404467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff344101990 0x7ff344102690 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.933+0000 7ff349777640 1 -- 172.21.15.6:0/1110404467 >> 172.21.15.6:0/1110404467 conn(0x7ff3440fcb80 msgr2=0x7ff3440ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:08.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.933+0000 7ff349777640 1 -- 172.21.15.6:0/1110404467 shutdown_connections 2024-05-20T17:19:08.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.933+0000 7ff349777640 1 -- 172.21.15.6:0/1110404467 wait complete. 2024-05-20T17:19:08.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.933+0000 7ff349777640 1 Processor -- start 2024-05-20T17:19:08.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.933+0000 7ff349777640 1 -- start start 2024-05-20T17:19:08.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.934+0000 7ff349777640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff344101990 0x7ff34410c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:08.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.934+0000 7ff349777640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff344102bd0 0x7ff34410a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:08.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.934+0000 7ff349777640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3441078d0 0x7ff34410ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:08.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.934+0000 7ff349777640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff34410e580 con 0x7ff3441078d0 2024-05-20T17:19:08.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.934+0000 7ff349777640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff34410e400 con 0x7ff344102bd0 2024-05-20T17:19:08.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.934+0000 7ff349777640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff34410e700 con 0x7ff344101990 2024-05-20T17:19:08.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.934+0000 7ff3437fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3441078d0 0x7ff34410ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:08.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.934+0000 7ff3437fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3441078d0 0x7ff34410ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55442/0 (socket says 172.21.15.6:55442) 2024-05-20T17:19:08.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.934+0000 7ff3437fe640 1 -- 172.21.15.6:0/1118210223 learned_addr learned my addr 172.21.15.6:0/1118210223 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:19:08.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.934+0000 7ff342ffd640 1 --2- 172.21.15.6:0/1118210223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff344101990 0x7ff34410c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:08.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.934+0000 7ff33bfff640 1 --2- 172.21.15.6:0/1118210223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff344102bd0 0x7ff34410a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:08.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.934+0000 7ff3437fe640 1 -- 172.21.15.6:0/1118210223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff344101990 msgr2=0x7ff34410c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:08.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.934+0000 7ff3437fe640 1 --2- 172.21.15.6:0/1118210223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff344101990 0x7ff34410c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.934+0000 7ff3437fe640 1 -- 172.21.15.6:0/1118210223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff344102bd0 msgr2=0x7ff34410a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:08.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.934+0000 7ff3437fe640 1 --2- 172.21.15.6:0/1118210223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff344102bd0 0x7ff34410a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:08.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.934+0000 7ff3437fe640 1 -- 172.21.15.6:0/1118210223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff34410b570 con 0x7ff3441078d0 2024-05-20T17:19:08.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.934+0000 7ff3437fe640 1 --2- 172.21.15.6:0/1118210223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3441078d0 0x7ff34410ae40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff33c00eaa0 tx=0x7ff33c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:08.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.934+0000 7ff340ff9640 1 -- 172.21.15.6:0/1118210223 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33c00cdb0 con 0x7ff3441078d0 2024-05-20T17:19:08.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.935+0000 7ff340ff9640 1 -- 172.21.15.6:0/1118210223 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff33c005020 con 0x7ff3441078d0 2024-05-20T17:19:08.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.935+0000 7ff349777640 1 -- 172.21.15.6:0/1118210223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3441a32b0 con 0x7ff3441078d0 2024-05-20T17:19:08.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.935+0000 7ff340ff9640 1 -- 172.21.15.6:0/1118210223 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0116d0 con 0x7ff3441078d0 2024-05-20T17:19:08.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.935+0000 7ff349777640 1 -- 172.21.15.6:0/1118210223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3441a3770 con 0x7ff3441078d0 2024-05-20T17:19:08.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.936+0000 7ff349777640 1 -- 172.21.15.6:0/1118210223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3441066e0 con 0x7ff3441078d0 2024-05-20T17:19:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.937+0000 7ff340ff9640 1 -- 172.21.15.6:0/1118210223 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7ff33c0051d0 con 0x7ff3441078d0 2024-05-20T17:19:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.938+0000 7ff340ff9640 1 --2- 172.21.15.6:0/1118210223 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff3300a2c10 0x7ff3300a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.938+0000 7ff342ffd640 1 --2- 172.21.15.6:0/1118210223 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff3300a2c10 0x7ff3300a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.938+0000 7ff340ff9640 1 -- 172.21.15.6:0/1118210223 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7ff33c0cf910 con 0x7ff3441078d0 2024-05-20T17:19:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.938+0000 7ff342ffd640 1 --2- 172.21.15.6:0/1118210223 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff3300a2c10 0x7ff3300a5120 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff3340314e0 tx=0x7ff334031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:08.942+0000 7ff340ff9640 1 -- 172.21.15.6:0/1118210223 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff33c016030 con 0x7ff3441078d0 2024-05-20T17:19:09.116 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:08 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2823651124' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:19:09.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:08 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2083681791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:19:09.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:08 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1541044783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:19:09.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:08 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2823651124' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:19:09.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:08 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2083681791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:19:09.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:08 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1541044783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:19:09.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.132+0000 7ff349777640 1 -- 172.21.15.6:0/1118210223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff34402d430 con 0x7ff3441078d0 2024-05-20T17:19:09.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.133+0000 7ff340ff9640 1 -- 172.21.15.6:0/1118210223 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) ==== 100+0+11 (secure 0 0 0) 0x7ff33c09be90 con 0x7ff3441078d0 2024-05-20T17:19:09.134 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:19:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.135+0000 7ff349777640 1 -- 172.21.15.6:0/1118210223 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff3300a2c10 msgr2=0x7ff3300a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.135+0000 7ff349777640 1 --2- 172.21.15.6:0/1118210223 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff3300a2c10 0x7ff3300a5120 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff3340314e0 tx=0x7ff334031400 comp rx=0 tx=0).stop 2024-05-20T17:19:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.135+0000 7ff349777640 1 -- 172.21.15.6:0/1118210223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3441078d0 msgr2=0x7ff34410ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.135+0000 7ff349777640 1 --2- 172.21.15.6:0/1118210223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3441078d0 0x7ff34410ae40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff33c00eaa0 tx=0x7ff33c00ef60 comp rx=0 tx=0).stop 2024-05-20T17:19:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.135+0000 7ff349777640 1 -- 172.21.15.6:0/1118210223 shutdown_connections 2024-05-20T17:19:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.135+0000 7ff349777640 1 --2- 172.21.15.6:0/1118210223 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff3300a2c10 0x7ff3300a5120 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.135+0000 7ff349777640 1 --2- 172.21.15.6:0/1118210223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3441078d0 0x7ff34410ae40 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.135+0000 7ff349777640 1 --2- 172.21.15.6:0/1118210223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff344102bd0 0x7ff34410a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:09.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.135+0000 7ff349777640 1 --2- 172.21.15.6:0/1118210223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff344101990 0x7ff34410c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:09.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.135+0000 7ff349777640 1 -- 172.21.15.6:0/1118210223 >> 172.21.15.6:0/1118210223 conn(0x7ff3440fcb80 msgr2=0x7ff3441038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:09.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.135+0000 7ff349777640 1 -- 172.21.15.6:0/1118210223 shutdown_connections 2024-05-20T17:19:09.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.135+0000 7ff349777640 1 -- 172.21.15.6:0/1118210223 wait complete. 2024-05-20T17:19:09.148 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:19:09.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.267+0000 7fad90073640 1 -- 172.21.15.6:0/864277307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad88105be0 msgr2=0x7fad88108080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:09.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.267+0000 7fad90073640 1 --2- 172.21.15.6:0/864277307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad88105be0 0x7fad88108080 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fad7c009900 tx=0x7fad7c02a410 comp rx=0 tx=0).stop 2024-05-20T17:19:09.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.267+0000 7fad90073640 1 -- 172.21.15.6:0/864277307 shutdown_connections 2024-05-20T17:19:09.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.267+0000 7fad90073640 1 --2- 172.21.15.6:0/864277307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad88108710 0x7fad8810ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:09.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.267+0000 7fad90073640 1 --2- 172.21.15.6:0/864277307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad88105be0 0x7fad88108080 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:09.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.267+0000 7fad90073640 1 --2- 172.21.15.6:0/864277307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad881031f0 0x7fad88105610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:09.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.267+0000 7fad90073640 1 -- 172.21.15.6:0/864277307 >> 172.21.15.6:0/864277307 conn(0x7fad880fcb70 msgr2=0x7fad880ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:09.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.267+0000 7fad90073640 1 -- 172.21.15.6:0/864277307 shutdown_connections 2024-05-20T17:19:09.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.267+0000 7fad90073640 1 -- 172.21.15.6:0/864277307 wait complete. 2024-05-20T17:19:09.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.268+0000 7fad90073640 1 Processor -- start 2024-05-20T17:19:09.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.268+0000 7fad90073640 1 -- start start 2024-05-20T17:19:09.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.268+0000 7fad90073640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad881031f0 0x7fad881991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:09.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.268+0000 7fad90073640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad88105be0 0x7fad88199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:09.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.268+0000 7fad90073640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad88108710 0x7fad881a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:09.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.268+0000 7fad90073640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fad8810e580 con 0x7fad88105be0 2024-05-20T17:19:09.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.268+0000 7fad90073640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fad8810e400 con 0x7fad88108710 2024-05-20T17:19:09.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.268+0000 7fad90073640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fad8810e700 con 0x7fad881031f0 2024-05-20T17:19:09.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.268+0000 7fad8d60e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad88105be0 0x7fad88199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:09.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.268+0000 7fad8d60e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad88105be0 0x7fad88199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55454/0 (socket says 172.21.15.6:55454) 2024-05-20T17:19:09.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.268+0000 7fad8d60e640 1 -- 172.21.15.6:0/474900445 learned_addr learned my addr 172.21.15.6:0/474900445 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:19:09.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.268+0000 7fad8de0f640 1 --2- 172.21.15.6:0/474900445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad881031f0 0x7fad881991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:09.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.268+0000 7fad8e610640 1 --2- 172.21.15.6:0/474900445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad88108710 0x7fad881a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:09.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.269+0000 7fad8d60e640 1 -- 172.21.15.6:0/474900445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad881031f0 msgr2=0x7fad881991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:09.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.269+0000 7fad8d60e640 1 --2- 172.21.15.6:0/474900445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad881031f0 0x7fad881991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:09.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.269+0000 7fad8d60e640 1 -- 172.21.15.6:0/474900445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad88108710 msgr2=0x7fad881a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:09.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.269+0000 7fad8d60e640 1 --2- 172.21.15.6:0/474900445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad88108710 0x7fad881a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:09.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.269+0000 7fad8d60e640 1 -- 172.21.15.6:0/474900445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad881a0d20 con 0x7fad88105be0 2024-05-20T17:19:09.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.269+0000 7fad8d60e640 1 --2- 172.21.15.6:0/474900445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad88105be0 0x7fad88199720 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fad7c031440 tx=0x7fad7c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:09.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.269+0000 7fad7affd640 1 -- 172.21.15.6:0/474900445 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c03f030 con 0x7fad88105be0 2024-05-20T17:19:09.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.269+0000 7fad7affd640 1 -- 172.21.15.6:0/474900445 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad7c003cb0 con 0x7fad88105be0 2024-05-20T17:19:09.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.269+0000 7fad90073640 1 -- 172.21.15.6:0/474900445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad881a0fb0 con 0x7fad88105be0 2024-05-20T17:19:09.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.269+0000 7fad7affd640 1 -- 172.21.15.6:0/474900445 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c035070 con 0x7fad88105be0 2024-05-20T17:19:09.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.269+0000 7fad90073640 1 -- 172.21.15.6:0/474900445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad881a13b0 con 0x7fad88105be0 2024-05-20T17:19:09.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.270+0000 7fad90073640 1 -- 172.21.15.6:0/474900445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad880fe690 con 0x7fad88105be0 2024-05-20T17:19:09.275 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:08 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2823651124' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:19:09.275 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:08 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2083681791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:19:09.275 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:08 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1541044783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:19:09.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.272+0000 7fad7affd640 1 -- 172.21.15.6:0/474900445 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fad7c042030 con 0x7fad88105be0 2024-05-20T17:19:09.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.272+0000 7fad7affd640 1 --2- 172.21.15.6:0/474900445 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fad740a2b90 0x7fad740a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:09.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.273+0000 7fad8de0f640 1 --2- 172.21.15.6:0/474900445 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fad740a2b90 0x7fad740a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:09.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.273+0000 7fad7affd640 1 -- 172.21.15.6:0/474900445 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fad7c0efff0 con 0x7fad88105be0 2024-05-20T17:19:09.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.273+0000 7fad8de0f640 1 --2- 172.21.15.6:0/474900445 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fad740a2b90 0x7fad740a50a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fad88069930 tx=0x7fad84009760 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:09.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.276+0000 7fad7affd640 1 -- 172.21.15.6:0/474900445 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fad7c0bc550 con 0x7fad88105be0 2024-05-20T17:19:09.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.461+0000 7fad90073640 1 -- 172.21.15.6:0/474900445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fad88062780 con 0x7fad88105be0 2024-05-20T17:19:09.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.462+0000 7fad7affd640 1 -- 172.21.15.6:0/474900445 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) ==== 103+0+11 (secure 0 0 0) 0x7fad7c0c0850 con 0x7fad88105be0 2024-05-20T17:19:09.463 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:19:09.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.464+0000 7fad90073640 1 -- 172.21.15.6:0/474900445 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fad740a2b90 msgr2=0x7fad740a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:09.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.464+0000 7fad90073640 1 --2- 172.21.15.6:0/474900445 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fad740a2b90 0x7fad740a50a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fad88069930 tx=0x7fad84009760 comp rx=0 tx=0).stop 2024-05-20T17:19:09.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.464+0000 7fad90073640 1 -- 172.21.15.6:0/474900445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad88105be0 msgr2=0x7fad88199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:09.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.464+0000 7fad90073640 1 --2- 172.21.15.6:0/474900445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad88105be0 0x7fad88199720 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fad7c031440 tx=0x7fad7c0043b0 comp rx=0 tx=0).stop 2024-05-20T17:19:09.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.464+0000 7fad90073640 1 -- 172.21.15.6:0/474900445 shutdown_connections 2024-05-20T17:19:09.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.464+0000 7fad90073640 1 --2- 172.21.15.6:0/474900445 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fad740a2b90 0x7fad740a50a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:09.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.464+0000 7fad90073640 1 --2- 172.21.15.6:0/474900445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad88108710 0x7fad881a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:09.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.464+0000 7fad90073640 1 --2- 172.21.15.6:0/474900445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad88105be0 0x7fad88199720 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:09.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.464+0000 7fad90073640 1 --2- 172.21.15.6:0/474900445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad881031f0 0x7fad881991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:09.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.464+0000 7fad90073640 1 -- 172.21.15.6:0/474900445 >> 172.21.15.6:0/474900445 conn(0x7fad880fcb70 msgr2=0x7fad88103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:09.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.464+0000 7fad90073640 1 -- 172.21.15.6:0/474900445 shutdown_connections 2024-05-20T17:19:09.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.464+0000 7fad90073640 1 -- 172.21.15.6:0/474900445 wait complete. 2024-05-20T17:19:09.477 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-05-20T17:19:09.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.670+0000 7fa224d37640 1 -- 172.21.15.6:0/1726272961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa22010a300 msgr2=0x7fa22010a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:09.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.670+0000 7fa224d37640 1 --2- 172.21.15.6:0/1726272961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa22010a300 0x7fa22010a710 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa218009ca0 tx=0x7fa21802a8f0 comp rx=0 tx=0).stop 2024-05-20T17:19:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.675+0000 7fa224d37640 1 -- 172.21.15.6:0/1726272961 shutdown_connections 2024-05-20T17:19:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.675+0000 7fa224d37640 1 --2- 172.21.15.6:0/1726272961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22010f020 0x7fa22010f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:09.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.675+0000 7fa224d37640 1 --2- 172.21.15.6:0/1726272961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa22010a300 0x7fa22010a710 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:09.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.675+0000 7fa224d37640 1 --2- 172.21.15.6:0/1726272961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2201093d0 0x7fa220109dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:09.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.675+0000 7fa224d37640 1 -- 172.21.15.6:0/1726272961 >> 172.21.15.6:0/1726272961 conn(0x7fa22006f4e0 msgr2=0x7fa220071970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:09.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.680+0000 7fa224d37640 1 -- 172.21.15.6:0/1726272961 shutdown_connections 2024-05-20T17:19:09.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.681+0000 7fa224d37640 1 -- 172.21.15.6:0/1726272961 wait complete. 2024-05-20T17:19:09.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.682+0000 7fa224d37640 1 Processor -- start 2024-05-20T17:19:09.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.685+0000 7fa224d37640 1 -- start start 2024-05-20T17:19:09.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.685+0000 7fa224d37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2201093d0 0x7fa2201a7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:09.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.685+0000 7fa224d37640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa22010a300 0x7fa2201a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:09.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.685+0000 7fa224d37640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22010f020 0x7fa2201af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:09.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.685+0000 7fa224d37640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa22011d4d0 con 0x7fa2201093d0 2024-05-20T17:19:09.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.685+0000 7fa224d37640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa22011d350 con 0x7fa22010a300 2024-05-20T17:19:09.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.686+0000 7fa224d37640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa22011d650 con 0x7fa22010f020 2024-05-20T17:19:09.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.686+0000 7fa21e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2201093d0 0x7fa2201a7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:09.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.686+0000 7fa21e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2201093d0 0x7fa2201a7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55466/0 (socket says 172.21.15.6:55466) 2024-05-20T17:19:09.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.686+0000 7fa21e59c640 1 -- 172.21.15.6:0/2967325021 learned_addr learned my addr 172.21.15.6:0/2967325021 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:19:09.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.686+0000 7fa21e59c640 1 -- 172.21.15.6:0/2967325021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22010f020 msgr2=0x7fa2201af480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:19:09.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.686+0000 7fa21e59c640 1 --2- 172.21.15.6:0/2967325021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22010f020 0x7fa2201af480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:09.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.686+0000 7fa21e59c640 1 -- 172.21.15.6:0/2967325021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa22010a300 msgr2=0x7fa2201a84f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-20T17:19:09.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.686+0000 7fa21e59c640 1 --2- 172.21.15.6:0/2967325021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa22010a300 0x7fa2201a84f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:09.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.686+0000 7fa21e59c640 1 -- 172.21.15.6:0/2967325021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2201afaf0 con 0x7fa2201093d0 2024-05-20T17:19:09.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.687+0000 7fa21e59c640 1 --2- 172.21.15.6:0/2967325021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2201093d0 0x7fa2201a7fb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa21400c970 tx=0x7fa21400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:09.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.688+0000 7fa20f7fe640 1 -- 172.21.15.6:0/2967325021 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa214007bb0 con 0x7fa2201093d0 2024-05-20T17:19:09.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.688+0000 7fa224d37640 1 -- 172.21.15.6:0/2967325021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2201afde0 con 0x7fa2201093d0 2024-05-20T17:19:09.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.688+0000 7fa224d37640 1 -- 172.21.15.6:0/2967325021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2201b01f0 con 0x7fa2201093d0 2024-05-20T17:19:09.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.689+0000 7fa20f7fe640 1 -- 172.21.15.6:0/2967325021 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa214007d50 con 0x7fa2201093d0 2024-05-20T17:19:09.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.689+0000 7fa20f7fe640 1 -- 172.21.15.6:0/2967325021 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21400f450 con 0x7fa2201093d0 2024-05-20T17:19:09.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.694+0000 7fa20f7fe640 1 -- 172.21.15.6:0/2967325021 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fa21400f5f0 con 0x7fa2201093d0 2024-05-20T17:19:09.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.695+0000 7fa20f7fe640 1 --2- 172.21.15.6:0/2967325021 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa2080a2e70 0x7fa2080a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:09.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.695+0000 7fa20f7fe640 1 -- 172.21.15.6:0/2967325021 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fa2140cf0f0 con 0x7fa2201093d0 2024-05-20T17:19:09.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.695+0000 7fa224d37640 1 -- 172.21.15.6:0/2967325021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2000052c0 con 0x7fa2201093d0 2024-05-20T17:19:09.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.697+0000 7fa21dd9b640 1 --2- 172.21.15.6:0/2967325021 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa2080a2e70 0x7fa2080a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:09.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.702+0000 7fa21dd9b640 1 --2- 172.21.15.6:0/2967325021 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa2080a2e70 0x7fa2080a5380 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa218004af0 tx=0x7fa218000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:09.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:09.707+0000 7fa20f7fe640 1 -- 172.21.15.6:0/2967325021 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa214014030 con 0x7fa2201093d0 2024-05-20T17:19:10.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:09 smithi006 ceph-mon[32486]: pgmap v727: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 28 MiB/s wr, 542 op/s 2024-05-20T17:19:10.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:09 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1118210223' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:19:10.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:09 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/474900445' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:19:10.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:10.156+0000 7fa224d37640 1 -- 172.21.15.6:0/2967325021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fa2000055b0 con 0x7fa2201093d0 2024-05-20T17:19:10.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:10.170+0000 7fa20f7fe640 1 -- 172.21.15.6:0/2967325021 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+740362 (secure 0 0 0) 0x7fa21409bc40 con 0x7fa2201093d0 2024-05-20T17:19:10.182 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:19:10.182 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:19:10.182 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 18, 2024-05-20T17:19:10.182 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: "active_gid": 14152, 2024-05-20T17:19:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: "active_name": "x", 2024-05-20T17:19:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: "active_addrs": { 2024-05-20T17:19:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-05-20T17:19:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-05-20T17:19:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2024-05-20T17:19:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3244338052 2024-05-20T17:19:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-05-20T17:19:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2024-05-20T17:19:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3244338052 2024-05-20T17:19:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T17:19:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: "active_addr": "172.21.15.6:6801/3244338052", 2024-05-20T17:19:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: "active_change": "2024-05-20T16:57:41.985885+0000", 2024-05-20T17:19:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: "active_mgr_features": 4540701547738038271, 2024-05-20T17:19:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: "available": true, 2024-05-20T17:19:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: "standbys": [ 2024-05-20T17:19:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: "gid": 24107, 2024-05-20T17:19:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "y", 2024-05-20T17:19:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_features": 4540701547738038271, 2024-05-20T17:19:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: "available_modules": [ 2024-05-20T17:19:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "alerts", 2024-05-20T17:19:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-05-20T17:19:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-05-20T17:19:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-05-20T17:19:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How frequently to reexamine health status", 2024-05-20T17:19:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_destination": { 2024-05-20T17:19:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_destination", 2024-05-20T17:19:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email address to send alerts to", 2024-05-20T17:19:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_from_name": { 2024-05-20T17:19:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_from_name", 2024-05-20T17:19:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "Ceph", 2024-05-20T17:19:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email From: name", 2024-05-20T17:19:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_host": { 2024-05-20T17:19:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_host", 2024-05-20T17:19:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP server", 2024-05-20T17:19:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_password": { 2024-05-20T17:19:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_password", 2024-05-20T17:19:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Password to authenticate with", 2024-05-20T17:19:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_port": { 2024-05-20T17:19:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_port", 2024-05-20T17:19:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "465", 2024-05-20T17:19:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP port", 2024-05-20T17:19:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_sender": { 2024-05-20T17:19:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_sender", 2024-05-20T17:19:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP envelope sender", 2024-05-20T17:19:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_ssl": { 2024-05-20T17:19:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_ssl", 2024-05-20T17:19:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-20T17:19:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_user": { 2024-05-20T17:19:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_user", 2024-05-20T17:19:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "User to authenticate as", 2024-05-20T17:19:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "balancer", 2024-05-20T17:19:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "active": { 2024-05-20T17:19:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "active", 2024-05-20T17:19:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically balance PGs across cluster", 2024-05-20T17:19:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_time": { 2024-05-20T17:19:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_time", 2024-05-20T17:19:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0000", 2024-05-20T17:19:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "beginning time of day to automatically balance", 2024-05-20T17:19:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-20T17:19:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_weekday": { 2024-05-20T17:19:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_weekday", 2024-05-20T17:19:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-05-20T17:19:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-05-20T17:19:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2024-05-20T17:19:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2024-05-20T17:19:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-20T17:19:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-20T17:19:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_max_iterations": { 2024-05-20T17:19:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_max_iterations", 2024-05-20T17:19:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-05-20T17:19:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "25", 2024-05-20T17:19:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-05-20T17:19:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "250", 2024-05-20T17:19:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-20T17:19:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_metrics": { 2024-05-20T17:19:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_metrics", 2024-05-20T17:19:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "pgs,objects,bytes", 2024-05-20T17:19:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-20T17:19:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-20T17:19:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_step": { 2024-05-20T17:19:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_step", 2024-05-20T17:19:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.5", 2024-05-20T17:19:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0.001", 2024-05-20T17:19:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "0.999", 2024-05-20T17:19:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "aggressiveness of optimization", 2024-05-20T17:19:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-20T17:19:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: "end_time": { 2024-05-20T17:19:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_time", 2024-05-20T17:19:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2359", 2024-05-20T17:19:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ending time of day to automatically balance", 2024-05-20T17:19:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-20T17:19:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "end_weekday": { 2024-05-20T17:19:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_weekday", 2024-05-20T17:19:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-05-20T17:19:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-05-20T17:19:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2024-05-20T17:19:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2024-05-20T17:19:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-20T17:19:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-20T17:19:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.212 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.212 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.212 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.212 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.212 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.212 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.212 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.212 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "min_score": { 2024-05-20T17:19:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_score", 2024-05-20T17:19:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-05-20T17:19:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-20T17:19:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2024-05-20T17:19:10.216 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2024-05-20T17:19:10.216 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.216 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.216 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.216 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "upmap", 2024-05-20T17:19:10.216 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.216 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.216 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.216 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-compat", 2024-05-20T17:19:10.216 INFO:teuthology.orchestra.run.smithi006.stdout: "none", 2024-05-20T17:19:10.216 INFO:teuthology.orchestra.run.smithi006.stdout: "read", 2024-05-20T17:19:10.216 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap", 2024-05-20T17:19:10.216 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap-read" 2024-05-20T17:19:10.217 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.217 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Balancer mode", 2024-05-20T17:19:10.217 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.217 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.217 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.217 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_ids": { 2024-05-20T17:19:10.217 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_ids", 2024-05-20T17:19:10.217 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.217 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.217 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.217 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.217 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.217 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.218 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.218 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-20T17:19:10.218 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.218 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.218 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.218 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-05-20T17:19:10.218 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-05-20T17:19:10.218 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.218 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.218 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.218 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-05-20T17:19:10.218 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.218 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.219 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.219 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-20T17:19:10.219 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.219 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.219 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.219 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_deviation": { 2024-05-20T17:19:10.219 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_deviation", 2024-05-20T17:19:10.219 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.219 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.219 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.219 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-05-20T17:19:10.219 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-05-20T17:19:10.219 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.220 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.220 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-20T17:19:10.220 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-20T17:19:10.220 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.220 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.220 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_optimizations": { 2024-05-20T17:19:10.220 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_optimizations", 2024-05-20T17:19:10.220 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-05-20T17:19:10.220 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.220 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.220 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:10.220 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.221 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.221 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.221 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-20T17:19:10.221 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.221 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.221 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.221 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.221 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.221 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm", 2024-05-20T17:19:10.221 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.222 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.222 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.222 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_down_multiplier": { 2024-05-20T17:19:10.222 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_down_multiplier", 2024-05-20T17:19:10.222 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:10.222 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.222 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.222 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2024-05-20T17:19:10.222 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.222 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.222 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.222 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-20T17:19:10.222 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.223 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.223 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.223 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_refresh_rate": { 2024-05-20T17:19:10.223 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_refresh_rate", 2024-05-20T17:19:10.223 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.223 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.223 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.223 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "20", 2024-05-20T17:19:10.223 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.223 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.223 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.223 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-20T17:19:10.223 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.224 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.224 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.224 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_starting_port": { 2024-05-20T17:19:10.224 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_starting_port", 2024-05-20T17:19:10.224 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.224 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.224 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.224 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4721", 2024-05-20T17:19:10.224 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.224 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.224 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.224 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-20T17:19:10.225 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.225 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.225 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.225 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_ptrace": { 2024-05-20T17:19:10.225 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_ptrace", 2024-05-20T17:19:10.225 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.225 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.225 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.225 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.225 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.225 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.225 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.226 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-20T17:19:10.226 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-20T17:19:10.226 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.226 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.226 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_interval": { 2024-05-20T17:19:10.226 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_interval", 2024-05-20T17:19:10.226 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.226 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.226 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.226 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-05-20T17:19:10.226 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.226 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.226 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.227 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-20T17:19:10.227 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.227 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.227 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.227 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_memory_target_ratio": { 2024-05-20T17:19:10.227 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_memory_target_ratio", 2024-05-20T17:19:10.227 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:10.227 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.227 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.227 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.7", 2024-05-20T17:19:10.227 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.227 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.228 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.228 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-20T17:19:10.228 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.228 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.228 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.228 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm_log_destination": { 2024-05-20T17:19:10.228 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm_log_destination", 2024-05-20T17:19:10.228 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.228 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.228 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.228 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.228 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.228 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.229 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.229 INFO:teuthology.orchestra.run.smithi006.stdout: "file", 2024-05-20T17:19:10.229 INFO:teuthology.orchestra.run.smithi006.stdout: "file,syslog", 2024-05-20T17:19:10.229 INFO:teuthology.orchestra.run.smithi006.stdout: "syslog" 2024-05-20T17:19:10.229 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.229 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-20T17:19:10.229 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.229 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.229 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.229 INFO:teuthology.orchestra.run.smithi006.stdout: "cgroups_split": { 2024-05-20T17:19:10.229 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cgroups_split", 2024-05-20T17:19:10.229 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.229 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.230 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.230 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.230 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.230 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.230 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.230 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-20T17:19:10.230 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.230 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.230 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.230 INFO:teuthology.orchestra.run.smithi006.stdout: "config_checks_enabled": { 2024-05-20T17:19:10.230 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_checks_enabled", 2024-05-20T17:19:10.230 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.231 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.231 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.231 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.231 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.231 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.231 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.231 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-20T17:19:10.231 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.231 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.231 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.231 INFO:teuthology.orchestra.run.smithi006.stdout: "config_dashboard": { 2024-05-20T17:19:10.231 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_dashboard", 2024-05-20T17:19:10.231 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.232 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.232 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.232 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.232 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.232 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.232 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.232 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-20T17:19:10.232 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.232 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.232 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.232 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_alertmanager": { 2024-05-20T17:19:10.232 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_alertmanager", 2024-05-20T17:19:10.232 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.233 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.233 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.233 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-20T17:19:10.233 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.233 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.233 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.233 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-05-20T17:19:10.233 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.233 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.233 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.233 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_base": { 2024-05-20T17:19:10.233 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_base", 2024-05-20T17:19:10.233 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.234 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.234 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.234 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-20T17:19:10.234 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.234 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.234 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.234 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Container image name, without the tag", 2024-05-20T17:19:10.234 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.234 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.234 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.234 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_elasticsearch": { 2024-05-20T17:19:10.234 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_elasticsearch", 2024-05-20T17:19:10.235 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.235 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.235 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.235 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-20T17:19:10.235 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.235 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.235 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.235 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "elasticsearch container image", 2024-05-20T17:19:10.235 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.235 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.235 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.235 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_grafana": { 2024-05-20T17:19:10.235 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_grafana", 2024-05-20T17:19:10.236 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.236 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.236 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.236 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-20T17:19:10.236 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.236 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.236 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.236 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-05-20T17:19:10.236 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.236 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.236 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.236 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.236 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_haproxy": { 2024-05-20T17:19:10.236 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_haproxy", 2024-05-20T17:19:10.237 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.237 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.237 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.237 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-20T17:19:10.237 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.237 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.237 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.237 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "HAproxy container image", 2024-05-20T17:19:10.237 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.237 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.237 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.238 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_agent": { 2024-05-20T17:19:10.238 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_agent", 2024-05-20T17:19:10.238 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.238 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.238 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.238 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-20T17:19:10.238 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.238 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.238 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.238 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger agent container image", 2024-05-20T17:19:10.238 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.238 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.238 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.239 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_collector": { 2024-05-20T17:19:10.239 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_collector", 2024-05-20T17:19:10.239 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.239 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.239 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.239 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-20T17:19:10.239 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.239 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.239 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.239 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger collector container image", 2024-05-20T17:19:10.239 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.239 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.239 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.241 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_query": { 2024-05-20T17:19:10.241 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_query", 2024-05-20T17:19:10.241 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.241 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.241 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.241 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-20T17:19:10.241 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.242 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.242 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.242 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger query container image", 2024-05-20T17:19:10.242 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.242 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.242 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.242 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_keepalived": { 2024-05-20T17:19:10.242 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_keepalived", 2024-05-20T17:19:10.242 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.242 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.242 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.243 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-20T17:19:10.243 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.243 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.243 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.243 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Keepalived container image", 2024-05-20T17:19:10.243 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.243 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.243 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.243 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_loki": { 2024-05-20T17:19:10.243 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_loki", 2024-05-20T17:19:10.243 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.244 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.244 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.244 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-20T17:19:10.244 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.244 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.244 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.244 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Loki container image", 2024-05-20T17:19:10.244 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.244 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.244 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.244 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_node_exporter": { 2024-05-20T17:19:10.244 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_node_exporter", 2024-05-20T17:19:10.244 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.245 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.245 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.245 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-20T17:19:10.245 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.245 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.245 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.245 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-05-20T17:19:10.245 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.245 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.245 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.245 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_nvmeof": { 2024-05-20T17:19:10.245 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_nvmeof", 2024-05-20T17:19:10.245 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.246 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.246 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.246 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-20T17:19:10.246 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.246 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.246 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.246 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Nvme-of container image", 2024-05-20T17:19:10.246 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.246 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.246 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.246 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_prometheus": { 2024-05-20T17:19:10.246 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_prometheus", 2024-05-20T17:19:10.246 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.247 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.247 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.247 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-20T17:19:10.247 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.247 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.247 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.247 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-05-20T17:19:10.247 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.247 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.247 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.247 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_promtail": { 2024-05-20T17:19:10.247 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_promtail", 2024-05-20T17:19:10.248 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.248 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.248 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.248 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-20T17:19:10.248 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.248 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.248 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.248 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Promtail container image", 2024-05-20T17:19:10.248 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.248 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.248 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.248 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_samba": { 2024-05-20T17:19:10.248 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_samba", 2024-05-20T17:19:10.248 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.249 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.249 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.249 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-20T17:19:10.249 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.249 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.249 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.249 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Samba/SMB container image", 2024-05-20T17:19:10.249 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.249 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.249 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.249 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_snmp_gateway": { 2024-05-20T17:19:10.249 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_snmp_gateway", 2024-05-20T17:19:10.250 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.250 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.250 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.250 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-20T17:19:10.250 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.250 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.250 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.250 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SNMP Gateway container image", 2024-05-20T17:19:10.250 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.250 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.250 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.250 INFO:teuthology.orchestra.run.smithi006.stdout: "container_init": { 2024-05-20T17:19:10.250 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_init", 2024-05-20T17:19:10.251 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.251 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.251 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.251 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.251 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.251 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.251 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.251 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Run podman/docker with `--init`", 2024-05-20T17:19:10.251 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.251 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.251 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.251 INFO:teuthology.orchestra.run.smithi006.stdout: "daemon_cache_timeout": { 2024-05-20T17:19:10.252 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "daemon_cache_timeout", 2024-05-20T17:19:10.252 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.252 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.252 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.252 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-05-20T17:19:10.252 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.252 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.252 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.252 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-20T17:19:10.252 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.252 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.252 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.253 INFO:teuthology.orchestra.run.smithi006.stdout: "default_cephadm_command_timeout": { 2024-05-20T17:19:10.253 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_cephadm_command_timeout", 2024-05-20T17:19:10.253 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.253 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.253 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.253 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "900", 2024-05-20T17:19:10.253 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.253 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.253 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.253 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-20T17:19:10.253 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.253 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.253 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.254 INFO:teuthology.orchestra.run.smithi006.stdout: "default_registry": { 2024-05-20T17:19:10.254 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_registry", 2024-05-20T17:19:10.254 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.254 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.254 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.254 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io", 2024-05-20T17:19:10.254 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.254 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.254 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.254 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-20T17:19:10.254 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.254 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.254 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.255 INFO:teuthology.orchestra.run.smithi006.stdout: "device_cache_timeout": { 2024-05-20T17:19:10.255 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_cache_timeout", 2024-05-20T17:19:10.255 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.255 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.255 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.255 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1800", 2024-05-20T17:19:10.255 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.255 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.255 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.255 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache device inventory", 2024-05-20T17:19:10.255 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.255 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.255 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.256 INFO:teuthology.orchestra.run.smithi006.stdout: "device_enhanced_scan": { 2024-05-20T17:19:10.256 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_enhanced_scan", 2024-05-20T17:19:10.256 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.256 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.256 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.256 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.256 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.256 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.256 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.256 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-20T17:19:10.256 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.256 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.256 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.257 INFO:teuthology.orchestra.run.smithi006.stdout: "facts_cache_timeout": { 2024-05-20T17:19:10.257 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "facts_cache_timeout", 2024-05-20T17:19:10.257 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.257 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.257 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.257 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-05-20T17:19:10.257 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.257 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.257 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.257 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache host facts data", 2024-05-20T17:19:10.257 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.257 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.257 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.258 INFO:teuthology.orchestra.run.smithi006.stdout: "grafana_dashboards_path": { 2024-05-20T17:19:10.258 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "grafana_dashboards_path", 2024-05-20T17:19:10.258 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.258 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.258 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.258 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-20T17:19:10.258 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.258 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.258 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.258 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-20T17:19:10.258 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.258 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.258 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.259 INFO:teuthology.orchestra.run.smithi006.stdout: "host_check_interval": { 2024-05-20T17:19:10.259 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "host_check_interval", 2024-05-20T17:19:10.259 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.259 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.259 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.259 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-05-20T17:19:10.259 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.259 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.259 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.259 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to perform a host check", 2024-05-20T17:19:10.259 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.259 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.259 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.260 INFO:teuthology.orchestra.run.smithi006.stdout: "hw_monitoring": { 2024-05-20T17:19:10.260 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hw_monitoring", 2024-05-20T17:19:10.260 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.260 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.260 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.260 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.260 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.260 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.260 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.260 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-20T17:19:10.260 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.260 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.260 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.261 INFO:teuthology.orchestra.run.smithi006.stdout: "inventory_list_all": { 2024-05-20T17:19:10.261 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "inventory_list_all", 2024-05-20T17:19:10.261 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.261 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.261 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.261 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.261 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.261 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.261 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.261 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-20T17:19:10.261 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.261 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.261 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.262 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.262 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.262 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.262 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.262 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.262 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.262 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.262 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.262 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.262 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.262 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.262 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.262 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.263 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.263 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.263 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.263 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.263 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.263 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.263 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.263 INFO:teuthology.orchestra.run.smithi006.stdout: "log_refresh_metadata": { 2024-05-20T17:19:10.263 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_refresh_metadata", 2024-05-20T17:19:10.263 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.263 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.263 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.264 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.264 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.264 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.264 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.264 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-20T17:19:10.264 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.264 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.264 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.264 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.264 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.264 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.264 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.265 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.265 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.265 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.265 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.265 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.265 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-20T17:19:10.265 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.265 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.265 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.265 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.266 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.266 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.266 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.266 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.266 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.266 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.266 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.266 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.266 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.266 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.266 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.266 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.267 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.267 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.267 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.267 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.267 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.267 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.267 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.267 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.267 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.267 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.267 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.267 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.268 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.268 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.268 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.268 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.268 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.268 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.268 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.268 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.268 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-20T17:19:10.268 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-20T17:19:10.268 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.268 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.268 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.269 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.269 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.269 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.269 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.269 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-20T17:19:10.269 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.269 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.269 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.269 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-20T17:19:10.269 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-20T17:19:10.269 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.269 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.269 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.270 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "*", 2024-05-20T17:19:10.270 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.270 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.270 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.270 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-20T17:19:10.270 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.270 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.270 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.270 INFO:teuthology.orchestra.run.smithi006.stdout: "max_count_per_host": { 2024-05-20T17:19:10.270 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_count_per_host", 2024-05-20T17:19:10.270 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.270 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.271 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.271 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:10.271 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.271 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.271 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.271 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of daemons per service per host", 2024-05-20T17:19:10.271 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.271 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.271 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.271 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd_draining_count": { 2024-05-20T17:19:10.271 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_osd_draining_count", 2024-05-20T17:19:10.271 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.271 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.272 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.272 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:10.272 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.272 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.272 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.272 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-20T17:19:10.272 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.272 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.272 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.272 INFO:teuthology.orchestra.run.smithi006.stdout: "migration_current": { 2024-05-20T17:19:10.272 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "migration_current", 2024-05-20T17:19:10.272 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.273 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.273 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.273 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.273 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.273 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.273 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.273 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "internal - do not modify", 2024-05-20T17:19:10.273 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.273 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.273 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.273 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2024-05-20T17:19:10.273 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2024-05-20T17:19:10.273 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.274 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.274 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.274 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "root", 2024-05-20T17:19:10.274 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.274 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.274 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.274 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm-package", 2024-05-20T17:19:10.274 INFO:teuthology.orchestra.run.smithi006.stdout: "root" 2024-05-20T17:19:10.274 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.274 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "mode for remote execution of cephadm", 2024-05-20T17:19:10.274 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.274 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.274 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.275 INFO:teuthology.orchestra.run.smithi006.stdout: "oob_default_addr": { 2024-05-20T17:19:10.275 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "oob_default_addr", 2024-05-20T17:19:10.275 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.275 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.275 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.275 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "169.254.1.1", 2024-05-20T17:19:10.275 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.275 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.275 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.275 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-20T17:19:10.275 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.275 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.275 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.276 INFO:teuthology.orchestra.run.smithi006.stdout: "prometheus_alerts_path": { 2024-05-20T17:19:10.276 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus_alerts_path", 2024-05-20T17:19:10.276 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.276 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.276 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.276 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-20T17:19:10.276 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.276 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.276 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.276 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-20T17:19:10.276 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.276 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.276 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.276 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_insecure": { 2024-05-20T17:19:10.277 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_insecure", 2024-05-20T17:19:10.277 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.277 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.277 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.277 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.277 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.277 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.277 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.277 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-20T17:19:10.277 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.277 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.277 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.278 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_password": { 2024-05-20T17:19:10.278 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_password", 2024-05-20T17:19:10.278 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.278 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.278 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.278 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.278 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.278 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.278 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.278 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-20T17:19:10.278 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.278 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.279 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.279 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_url": { 2024-05-20T17:19:10.279 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_url", 2024-05-20T17:19:10.279 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.279 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.279 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.279 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.279 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.279 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.279 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.279 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-20T17:19:10.279 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.279 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.279 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.280 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_username": { 2024-05-20T17:19:10.280 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_username", 2024-05-20T17:19:10.280 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.280 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.280 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.280 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.280 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.280 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.280 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.280 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-20T17:19:10.280 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.280 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.281 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.281 INFO:teuthology.orchestra.run.smithi006.stdout: "secure_monitoring_stack": { 2024-05-20T17:19:10.281 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "secure_monitoring_stack", 2024-05-20T17:19:10.281 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.281 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.281 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.281 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.281 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.281 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.281 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.281 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-20T17:19:10.281 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.281 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.282 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.282 INFO:teuthology.orchestra.run.smithi006.stdout: "service_discovery_port": { 2024-05-20T17:19:10.282 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "service_discovery_port", 2024-05-20T17:19:10.282 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.282 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.282 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.282 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8765", 2024-05-20T17:19:10.282 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.282 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.282 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.282 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "cephadm service discovery port", 2024-05-20T17:19:10.282 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.282 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.283 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.283 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_config_file": { 2024-05-20T17:19:10.283 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_config_file", 2024-05-20T17:19:10.283 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.283 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.283 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.283 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.283 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.283 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.283 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.283 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-20T17:19:10.284 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.284 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.284 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.284 INFO:teuthology.orchestra.run.smithi006.stdout: "use_agent": { 2024-05-20T17:19:10.284 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_agent", 2024-05-20T17:19:10.284 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.284 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.284 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.284 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.284 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.284 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.285 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.285 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-20T17:19:10.285 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.285 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.285 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.285 INFO:teuthology.orchestra.run.smithi006.stdout: "use_repo_digest": { 2024-05-20T17:19:10.285 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_repo_digest", 2024-05-20T17:19:10.285 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.285 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.285 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.285 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.285 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.286 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.286 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.286 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-20T17:19:10.286 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.286 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.286 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.286 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_failed_host_check": { 2024-05-20T17:19:10.286 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_failed_host_check", 2024-05-20T17:19:10.286 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.286 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.286 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.286 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.287 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.287 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.287 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.287 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if the host check fails", 2024-05-20T17:19:10.287 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.287 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.287 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.287 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_daemons": { 2024-05-20T17:19:10.287 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_daemons", 2024-05-20T17:19:10.287 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.287 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.287 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.287 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.288 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.288 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.288 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.288 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-20T17:19:10.288 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.288 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.288 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.288 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_hosts": { 2024-05-20T17:19:10.288 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_hosts", 2024-05-20T17:19:10.288 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.288 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.288 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.288 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.289 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.289 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.289 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.289 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-20T17:19:10.289 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.289 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.289 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.289 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.289 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.289 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crash", 2024-05-20T17:19:10.289 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.290 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.290 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.290 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.290 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.290 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.290 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.290 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.290 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.290 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.290 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.290 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.290 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.290 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.291 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.291 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.291 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.291 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.291 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.291 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.291 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.291 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.291 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.291 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.291 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.291 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.291 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.292 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.292 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.292 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.292 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.292 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.292 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.292 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.292 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.292 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.292 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.292 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.292 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.293 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.293 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.293 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.293 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.293 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.293 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.293 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.293 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.293 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.293 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.293 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.293 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.293 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.293 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.294 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.294 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.294 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.294 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.294 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.294 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.294 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.294 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.294 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.294 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.294 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.294 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.295 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.295 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.295 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.295 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.295 INFO:teuthology.orchestra.run.smithi006.stdout: "retain_interval": { 2024-05-20T17:19:10.295 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retain_interval", 2024-05-20T17:19:10.295 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.295 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.295 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.295 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "31536000", 2024-05-20T17:19:10.295 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.295 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.295 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.296 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-20T17:19:10.296 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.296 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.296 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.296 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_recent_interval": { 2024-05-20T17:19:10.296 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_recent_interval", 2024-05-20T17:19:10.296 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.296 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.296 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.296 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1209600", 2024-05-20T17:19:10.296 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.296 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.297 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.297 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-20T17:19:10.297 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.297 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.297 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.297 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.297 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.297 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dashboard", 2024-05-20T17:19:10.297 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.297 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.297 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.297 INFO:teuthology.orchestra.run.smithi006.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-20T17:19:10.298 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-20T17:19:10.298 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.298 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.298 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.298 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:10.298 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.298 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.298 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.298 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.298 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.298 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.298 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.299 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_HOST": { 2024-05-20T17:19:10.299 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-20T17:19:10.299 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.299 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.299 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.299 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.299 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.299 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.299 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.299 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.299 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.299 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.299 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.300 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-20T17:19:10.300 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-20T17:19:10.300 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.300 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.300 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.300 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.300 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.300 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.300 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.300 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.300 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.300 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.300 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.301 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_ENABLED": { 2024-05-20T17:19:10.301 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_ENABLED", 2024-05-20T17:19:10.301 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.301 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.301 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.301 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.301 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.301 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.301 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.301 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.301 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.301 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.301 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.302 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-20T17:19:10.302 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-20T17:19:10.302 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.302 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.302 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.302 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.302 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.302 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.302 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.302 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.302 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.302 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.302 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.303 INFO:teuthology.orchestra.run.smithi006.stdout: "ENABLE_BROWSABLE_API": { 2024-05-20T17:19:10.303 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-20T17:19:10.303 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.303 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.303 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.303 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.303 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.303 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.303 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.303 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.303 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.304 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.304 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.304 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-20T17:19:10.304 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-20T17:19:10.304 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.304 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.304 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.304 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.304 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.304 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.304 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.305 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.305 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.305 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.305 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.305 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-20T17:19:10.305 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-20T17:19:10.305 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.305 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.305 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.305 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.305 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.305 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.306 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.306 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.306 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.306 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.306 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.306 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-20T17:19:10.306 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-20T17:19:10.306 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.306 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.306 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.306 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.306 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.307 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.307 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.307 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.307 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.307 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.307 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.307 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-20T17:19:10.307 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-20T17:19:10.307 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.307 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.307 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.307 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.307 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.308 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.308 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.308 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.308 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.308 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.308 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.308 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-20T17:19:10.308 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-20T17:19:10.308 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.308 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.308 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.308 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.308 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.309 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.309 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.309 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.309 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.309 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.309 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.309 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-20T17:19:10.309 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-20T17:19:10.309 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.309 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.309 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.309 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.310 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.310 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.310 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.310 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.310 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.310 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.310 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.310 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-20T17:19:10.310 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-20T17:19:10.310 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.310 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.310 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.311 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.311 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.311 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.311 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.311 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.311 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.311 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.311 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.311 INFO:teuthology.orchestra.run.smithi006.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-20T17:19:10.311 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-20T17:19:10.311 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.311 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.311 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.312 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.312 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.312 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.312 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.312 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.312 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.312 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.312 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.312 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_PASSWORD": { 2024-05-20T17:19:10.312 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-20T17:19:10.312 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.312 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.312 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.313 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-05-20T17:19:10.313 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.313 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.313 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.313 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.313 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.313 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.313 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.313 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-20T17:19:10.313 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-20T17:19:10.313 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.313 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.313 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.314 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.314 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.314 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.314 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.314 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.314 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.314 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.314 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.314 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_URL": { 2024-05-20T17:19:10.314 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_URL", 2024-05-20T17:19:10.314 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.314 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.315 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.315 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.315 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.315 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.315 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.315 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.315 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.315 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.315 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.315 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_USERNAME": { 2024-05-20T17:19:10.315 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-20T17:19:10.315 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.315 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.315 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-05-20T17:19:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-20T17:19:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-20T17:19:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.317 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.317 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.317 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.317 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.317 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.317 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.317 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.317 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.317 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-20T17:19:10.317 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-20T17:19:10.317 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-20T17:19:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-20T17:19:10.319 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.319 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.319 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.319 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.319 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.319 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.319 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.319 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.319 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.319 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.319 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.319 INFO:teuthology.orchestra.run.smithi006.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-20T17:19:10.319 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-20T17:19:10.320 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.320 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.320 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.320 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.320 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.320 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.320 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.320 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.320 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.320 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.320 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.320 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_HOST": { 2024-05-20T17:19:10.320 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-20T17:19:10.321 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.321 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.321 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.321 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.321 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.321 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.321 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.321 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.321 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.321 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.321 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.321 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-20T17:19:10.321 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-20T17:19:10.322 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.322 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.322 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.322 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.322 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.322 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.322 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.322 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.322 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.322 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.322 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.322 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-20T17:19:10.323 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-20T17:19:10.323 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.323 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.323 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.323 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.323 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.323 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.323 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.323 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.323 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.323 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.323 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.323 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-20T17:19:10.324 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-20T17:19:10.324 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.324 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.324 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.324 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.324 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.324 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.324 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.324 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.324 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.324 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.324 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.325 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-20T17:19:10.325 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-20T17:19:10.325 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.325 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.325 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.325 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.325 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.325 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.325 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.325 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.325 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.326 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.326 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.326 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-20T17:19:10.326 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-20T17:19:10.326 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.326 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.326 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.326 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.326 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.326 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.326 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.326 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.326 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.327 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.327 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.327 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-20T17:19:10.327 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-20T17:19:10.327 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.327 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.327 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.327 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.327 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.327 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.327 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.327 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.327 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.328 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.328 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.328 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-20T17:19:10.328 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-20T17:19:10.328 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.328 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.328 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.328 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.328 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.328 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.328 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.328 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.328 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.329 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.329 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.329 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-20T17:19:10.329 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-20T17:19:10.329 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.329 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.329 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.329 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.329 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.329 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.329 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.329 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.329 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.330 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.330 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.330 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_ENABLED": { 2024-05-20T17:19:10.330 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-20T17:19:10.330 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.330 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.330 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.330 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.330 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.330 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.330 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.330 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.330 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.331 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.331 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.331 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-20T17:19:10.331 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-20T17:19:10.331 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.331 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.331 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.331 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-20T17:19:10.331 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.331 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.331 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.331 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.332 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.332 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.332 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.332 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-20T17:19:10.332 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-20T17:19:10.332 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.332 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.332 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.332 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:10.332 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.332 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.332 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.332 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.333 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.333 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.333 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.333 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-20T17:19:10.333 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-20T17:19:10.333 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.333 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.333 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.333 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8", 2024-05-20T17:19:10.333 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.333 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.333 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.333 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.334 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.334 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.334 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.334 INFO:teuthology.orchestra.run.smithi006.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-20T17:19:10.334 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-20T17:19:10.334 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.334 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.334 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.334 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "45", 2024-05-20T17:19:10.334 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.334 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.334 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.335 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.335 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.335 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.335 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.335 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ACCESS_KEY": { 2024-05-20T17:19:10.335 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-20T17:19:10.335 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.335 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.335 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.335 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.335 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.335 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.336 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.336 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.336 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.336 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.336 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.336 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-20T17:19:10.336 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-20T17:19:10.336 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.336 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.336 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.336 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-05-20T17:19:10.336 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.336 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.337 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.337 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.337 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.337 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.337 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.337 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SECRET_KEY": { 2024-05-20T17:19:10.337 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-20T17:19:10.337 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.337 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.337 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.337 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.337 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.337 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.338 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.338 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.338 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.338 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.338 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.338 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SSL_VERIFY": { 2024-05-20T17:19:10.338 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-20T17:19:10.338 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.338 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.338 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.338 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.338 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.339 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.339 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.339 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.339 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.339 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.339 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.339 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-20T17:19:10.339 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-20T17:19:10.339 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.339 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.339 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.339 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-05-20T17:19:10.339 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.339 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.340 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.340 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.340 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.340 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.340 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.340 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-20T17:19:10.340 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-20T17:19:10.340 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.340 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.340 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.340 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:10.340 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.341 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.341 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.341 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.341 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.341 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.341 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.341 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-20T17:19:10.341 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-20T17:19:10.341 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.341 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.341 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.341 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-05-20T17:19:10.341 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.342 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.342 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.342 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.342 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.342 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.342 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.342 INFO:teuthology.orchestra.run.smithi006.stdout: "cross_origin_url": { 2024-05-20T17:19:10.342 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cross_origin_url", 2024-05-20T17:19:10.342 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.342 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.342 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.342 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.342 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.343 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.343 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.343 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.343 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.343 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.343 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.343 INFO:teuthology.orchestra.run.smithi006.stdout: "crt_file": { 2024-05-20T17:19:10.343 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crt_file", 2024-05-20T17:19:10.343 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.343 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.343 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.343 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.343 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.344 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.344 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.344 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.344 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.344 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.344 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.344 INFO:teuthology.orchestra.run.smithi006.stdout: "debug": { 2024-05-20T17:19:10.344 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "debug", 2024-05-20T17:19:10.344 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.344 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.344 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.344 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.345 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.345 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.345 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.345 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable/disable debug options", 2024-05-20T17:19:10.345 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.345 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.345 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.345 INFO:teuthology.orchestra.run.smithi006.stdout: "jwt_token_ttl": { 2024-05-20T17:19:10.345 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "jwt_token_ttl", 2024-05-20T17:19:10.345 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.345 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.345 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.346 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "28800", 2024-05-20T17:19:10.346 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.346 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.346 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.346 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.346 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.346 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.346 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.346 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2024-05-20T17:19:10.346 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2024-05-20T17:19:10.346 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.347 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.347 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.347 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.347 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.347 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.347 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.347 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.347 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.347 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.347 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.347 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.347 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.348 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.348 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.348 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.348 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.348 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.348 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.348 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.348 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.348 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.348 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.348 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.348 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.348 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.348 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.349 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.349 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.349 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.349 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.349 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.349 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.349 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.349 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.349 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.349 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.349 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.349 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.349 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.350 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.350 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.350 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.350 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.350 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.350 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.350 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.350 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.350 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.350 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.350 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.350 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.351 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.351 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.351 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.351 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.351 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.351 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.351 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.351 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.351 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.351 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.351 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.351 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.351 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.352 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.352 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.352 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.352 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.352 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.352 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.352 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.352 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.352 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.352 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.352 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.352 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.352 INFO:teuthology.orchestra.run.smithi006.stdout: "motd": { 2024-05-20T17:19:10.352 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "motd", 2024-05-20T17:19:10.353 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.353 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.353 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.353 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.353 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.353 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.353 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.353 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "The message of the day", 2024-05-20T17:19:10.353 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.353 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.353 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.353 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect_resolve_ip_addr": { 2024-05-20T17:19:10.353 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "redirect_resolve_ip_addr", 2024-05-20T17:19:10.354 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.354 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.354 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.354 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.354 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.354 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.354 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.354 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.354 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.354 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.354 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.354 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-05-20T17:19:10.355 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-05-20T17:19:10.355 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.355 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.355 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.355 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2024-05-20T17:19:10.355 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.355 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.355 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.355 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.355 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.355 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.355 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.355 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-05-20T17:19:10.355 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-05-20T17:19:10.356 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.356 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.356 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.356 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8080", 2024-05-20T17:19:10.356 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.356 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.356 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.356 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.356 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.356 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.356 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.356 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2024-05-20T17:19:10.356 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2024-05-20T17:19:10.357 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.357 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.357 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.357 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.357 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.357 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.357 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.357 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.357 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.357 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.357 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.357 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl_server_port": { 2024-05-20T17:19:10.357 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl_server_port", 2024-05-20T17:19:10.358 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.358 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.358 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.358 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8443", 2024-05-20T17:19:10.358 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.358 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.358 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.358 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.358 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.358 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.358 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.359 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2024-05-20T17:19:10.359 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2024-05-20T17:19:10.359 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.359 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.359 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.359 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "redirect", 2024-05-20T17:19:10.359 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.359 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.359 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.359 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.359 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect" 2024-05-20T17:19:10.359 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.359 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.359 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.360 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.360 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.360 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2024-05-20T17:19:10.360 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2024-05-20T17:19:10.360 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.360 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.360 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.360 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-05-20T17:19:10.360 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2024-05-20T17:19:10.360 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2024-05-20T17:19:10.360 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.360 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.360 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.361 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.361 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.361 INFO:teuthology.orchestra.run.smithi006.stdout: "url_prefix": { 2024-05-20T17:19:10.361 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url_prefix", 2024-05-20T17:19:10.361 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.361 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.361 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.361 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.361 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.361 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.361 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.361 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.361 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.362 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.362 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.362 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.362 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.362 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "devicehealth", 2024-05-20T17:19:10.362 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.362 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.362 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.362 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_monitoring": { 2024-05-20T17:19:10.362 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_monitoring", 2024-05-20T17:19:10.362 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.363 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.363 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.363 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.363 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.363 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.363 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.363 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "monitor device health metrics", 2024-05-20T17:19:10.363 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.363 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.363 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.363 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.363 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.363 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.364 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.364 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.364 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.364 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.364 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.364 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.364 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.364 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.364 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.364 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.364 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.364 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.365 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.365 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.365 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.365 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.365 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.365 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.365 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.365 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.365 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.365 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.365 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.366 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.366 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.366 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.366 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.366 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.366 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.366 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.366 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.366 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.366 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.366 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.366 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.367 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.367 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.367 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.367 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.367 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.367 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.367 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.367 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.367 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.367 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.367 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.367 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.367 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.367 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.368 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.368 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.368 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.368 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.368 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.368 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.368 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.368 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.368 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.368 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.368 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.368 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.368 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.368 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.369 INFO:teuthology.orchestra.run.smithi006.stdout: "mark_out_threshold": { 2024-05-20T17:19:10.369 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mark_out_threshold", 2024-05-20T17:19:10.369 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.369 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.369 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.369 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2419200", 2024-05-20T17:19:10.369 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.369 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.369 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.369 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-20T17:19:10.369 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.369 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": { 2024-05-20T17:19:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_name", 2024-05-20T17:19:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "device_health_metrics", 2024-05-20T17:19:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-20T17:19:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "retention_period": { 2024-05-20T17:19:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retention_period", 2024-05-20T17:19:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15552000", 2024-05-20T17:19:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain device health metrics", 2024-05-20T17:19:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_frequency": { 2024-05-20T17:19:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_frequency", 2024-05-20T17:19:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2024-05-20T17:19:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-20T17:19:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "self_heal": { 2024-05-20T17:19:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "self_heal", 2024-05-20T17:19:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-20T17:19:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.374 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.374 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.374 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-05-20T17:19:10.374 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-05-20T17:19:10.374 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.374 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.374 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.374 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-05-20T17:19:10.374 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.374 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.374 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.374 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and check device health", 2024-05-20T17:19:10.375 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.375 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.375 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.375 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_threshold": { 2024-05-20T17:19:10.375 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_threshold", 2024-05-20T17:19:10.375 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.375 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.375 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.375 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7257600", 2024-05-20T17:19:10.375 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.375 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.375 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.375 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-20T17:19:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "diskprediction_local", 2024-05-20T17:19:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "predict_interval": { 2024-05-20T17:19:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predict_interval", 2024-05-20T17:19:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2024-05-20T17:19:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "predictor_model": { 2024-05-20T17:19:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predictor_model", 2024-05-20T17:19:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "prophetstor", 2024-05-20T17:19:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-05-20T17:19:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-05-20T17:19:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-05-20T17:19:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "influx", 2024-05-20T17:19:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": false, 2024-05-20T17:19:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "influxdb python module not found", 2024-05-20T17:19:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "batch_size": { 2024-05-20T17:19:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "batch_size", 2024-05-20T17:19:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5000", 2024-05-20T17:19:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-20T17:19:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: "database": { 2024-05-20T17:19:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "database", 2024-05-20T17:19:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "ceph", 2024-05-20T17:19:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-20T17:19:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": { 2024-05-20T17:19:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hostname", 2024-05-20T17:19:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server hostname", 2024-05-20T17:19:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-05-20T17:19:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-05-20T17:19:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "30", 2024-05-20T17:19:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "5", 2024-05-20T17:19:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-20T17:19:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "password": { 2024-05-20T17:19:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "password", 2024-05-20T17:19:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "password of InfluxDB server user", 2024-05-20T17:19:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "port": { 2024-05-20T17:19:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "port", 2024-05-20T17:19:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8086", 2024-05-20T17:19:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server port", 2024-05-20T17:19:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2024-05-20T17:19:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2024-05-20T17:19:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "false", 2024-05-20T17:19:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-20T17:19:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "threads": { 2024-05-20T17:19:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threads", 2024-05-20T17:19:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-05-20T17:19:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-05-20T17:19:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "32", 2024-05-20T17:19:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-20T17:19:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "username": { 2024-05-20T17:19:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "username", 2024-05-20T17:19:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "username of InfluxDB server user", 2024-05-20T17:19:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: "verify_ssl": { 2024-05-20T17:19:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "verify_ssl", 2024-05-20T17:19:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "true", 2024-05-20T17:19:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-20T17:19:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "insights", 2024-05-20T17:19:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "iostat", 2024-05-20T17:19:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "k8sevents", 2024-05-20T17:19:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_event_retention_days": { 2024-05-20T17:19:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ceph_event_retention_days", 2024-05-20T17:19:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7", 2024-05-20T17:19:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-20T17:19:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "config_check_secs": { 2024-05-20T17:19:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_check_secs", 2024-05-20T17:19:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "10", 2024-05-20T17:19:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-20T17:19:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "localpool", 2024-05-20T17:19:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: "failure_domain": { 2024-05-20T17:19:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "failure_domain", 2024-05-20T17:19:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "host", 2024-05-20T17:19:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "failure domain for any created local pool", 2024-05-20T17:19:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-20T17:19:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": { 2024-05-20T17:19:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_size", 2024-05-20T17:19:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default min_size for any created local pool", 2024-05-20T17:19:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-20T17:19:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "num_rep": { 2024-05-20T17:19:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "num_rep", 2024-05-20T17:19:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3", 2024-05-20T17:19:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default replica count for any created local pool", 2024-05-20T17:19:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": { 2024-05-20T17:19:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_num", 2024-05-20T17:19:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "128", 2024-05-20T17:19:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default pg_num for any created local pool", 2024-05-20T17:19:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "prefix": { 2024-05-20T17:19:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prefix", 2024-05-20T17:19:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name prefix for any created local pool", 2024-05-20T17:19:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: "subtree": { 2024-05-20T17:19:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "subtree", 2024-05-20T17:19:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "rack", 2024-05-20T17:19:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-20T17:19:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-20T17:19:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mds_autoscaler", 2024-05-20T17:19:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirroring", 2024-05-20T17:19:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "nfs", 2024-05-20T17:19:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2024-05-20T17:19:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: "fail_fs": { 2024-05-20T17:19:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "fail_fs", 2024-05-20T17:19:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-20T17:19:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator": { 2024-05-20T17:19:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2024-05-20T17:19:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm", 2024-05-20T17:19:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: "rook", 2024-05-20T17:19:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: "test_orchestrator" 2024-05-20T17:19:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Orchestrator backend", 2024-05-20T17:19:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_perf_query", 2024-05-20T17:19:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_support", 2024-05-20T17:19:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_autoscaler", 2024-05-20T17:19:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.471 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.471 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.471 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.471 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.471 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.471 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.471 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.471 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.471 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.471 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.471 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.472 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.472 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.472 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.472 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.472 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.472 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.472 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.472 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.472 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.472 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.472 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.472 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.472 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.472 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.473 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.473 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.473 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.473 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.473 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.473 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.473 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.473 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.473 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.473 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-05-20T17:19:10.473 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-05-20T17:19:10.473 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.473 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.474 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.474 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-05-20T17:19:10.474 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.474 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.474 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.474 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.474 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.474 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.474 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.474 INFO:teuthology.orchestra.run.smithi006.stdout: "threshold": { 2024-05-20T17:19:10.474 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threshold", 2024-05-20T17:19:10.474 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:10.475 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.475 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.475 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2024-05-20T17:19:10.475 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1.0", 2024-05-20T17:19:10.475 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.475 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.475 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "scaling threshold", 2024-05-20T17:19:10.475 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-20T17:19:10.475 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.475 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.475 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.475 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.476 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "progress", 2024-05-20T17:19:10.476 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.476 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.476 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.476 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_pg_recovery_event": { 2024-05-20T17:19:10.476 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_pg_recovery_event", 2024-05-20T17:19:10.476 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.476 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.476 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.476 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.476 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.476 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.476 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.476 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-20T17:19:10.477 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.477 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.477 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.477 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.477 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2024-05-20T17:19:10.477 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2024-05-20T17:19:10.477 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.477 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.477 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.477 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.477 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.477 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.477 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.477 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.478 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.478 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.478 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.478 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.478 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.478 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.478 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.478 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.478 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.478 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.478 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.478 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.478 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.479 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.479 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.479 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.479 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.479 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.479 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.479 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.479 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.479 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.479 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.479 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.480 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.480 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.480 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.480 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.480 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.480 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.480 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.480 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.480 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.480 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.480 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.480 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.480 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.480 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.481 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.481 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.481 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.481 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.481 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.481 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.481 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.481 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.481 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.481 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.481 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.481 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.481 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.481 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.482 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.482 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.482 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.482 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.482 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.482 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.482 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.482 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.482 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.482 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.482 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.482 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.482 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.482 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.483 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.483 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.483 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.483 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.483 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.483 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.483 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.483 INFO:teuthology.orchestra.run.smithi006.stdout: "max_completed_events": { 2024-05-20T17:19:10.483 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_completed_events", 2024-05-20T17:19:10.483 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.483 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.483 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.483 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "50", 2024-05-20T17:19:10.483 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "number of past completed events to remember", 2024-05-20T17:19:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-05-20T17:19:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-05-20T17:19:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-05-20T17:19:10.484 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.485 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.485 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.485 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long the module is going to sleep", 2024-05-20T17:19:10.485 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.485 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.485 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.485 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.485 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.485 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.485 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.485 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus", 2024-05-20T17:19:10.485 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.485 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.486 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.486 INFO:teuthology.orchestra.run.smithi006.stdout: "cache": { 2024-05-20T17:19:10.486 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cache", 2024-05-20T17:19:10.486 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.486 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.486 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.486 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.486 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.486 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.486 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.486 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.486 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.486 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.487 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.487 INFO:teuthology.orchestra.run.smithi006.stdout: "exclude_perf_counters": { 2024-05-20T17:19:10.487 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "exclude_perf_counters", 2024-05-20T17:19:10.487 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.487 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.487 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.487 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.487 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.487 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.487 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.487 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-20T17:19:10.487 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-20T17:19:10.487 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.488 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.488 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.488 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.488 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.488 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.488 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.488 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.488 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.488 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.488 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.488 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.488 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.488 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.489 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.489 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.489 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.489 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.489 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.489 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.489 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.489 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.489 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.489 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.489 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.489 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.489 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.490 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.490 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.490 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.490 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.490 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.490 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.490 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.490 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.490 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.490 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.490 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.490 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.491 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.491 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.491 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.491 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.491 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.491 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.491 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.491 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.491 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.491 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.491 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.491 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.491 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.491 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.492 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.492 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.492 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.492 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.492 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.492 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.492 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.492 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.492 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.492 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.492 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.492 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.492 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.492 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.493 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.493 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.493 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools": { 2024-05-20T17:19:10.493 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools", 2024-05-20T17:19:10.493 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.493 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.493 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.493 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.493 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.493 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.493 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.493 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.493 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.493 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.494 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.494 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-20T17:19:10.494 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-20T17:19:10.494 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.494 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.494 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.494 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300", 2024-05-20T17:19:10.494 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.494 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.494 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.494 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.494 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.494 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.495 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.495 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_interval": { 2024-05-20T17:19:10.495 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_interval", 2024-05-20T17:19:10.495 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:10.495 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.495 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.495 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15.0", 2024-05-20T17:19:10.495 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.495 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.495 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.495 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.495 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.495 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.496 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.496 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-05-20T17:19:10.496 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-05-20T17:19:10.496 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.496 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.496 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.496 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2024-05-20T17:19:10.496 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.496 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.496 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.496 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-20T17:19:10.496 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.496 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.497 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.497 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.497 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-05-20T17:19:10.497 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-05-20T17:19:10.497 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.497 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.497 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.497 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "9283", 2024-05-20T17:19:10.497 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.497 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.497 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.497 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-20T17:19:10.497 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.497 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.498 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.498 INFO:teuthology.orchestra.run.smithi006.stdout: "stale_cache_strategy": { 2024-05-20T17:19:10.498 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stale_cache_strategy", 2024-05-20T17:19:10.498 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.498 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.498 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.498 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "log", 2024-05-20T17:19:10.498 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.498 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.498 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.498 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.498 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.499 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.499 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.499 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2024-05-20T17:19:10.499 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2024-05-20T17:19:10.499 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.499 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.499 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.499 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "default", 2024-05-20T17:19:10.499 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.499 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.499 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.499 INFO:teuthology.orchestra.run.smithi006.stdout: "default", 2024-05-20T17:19:10.500 INFO:teuthology.orchestra.run.smithi006.stdout: "error" 2024-05-20T17:19:10.500 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.500 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.500 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.500 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.500 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.500 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2024-05-20T17:19:10.500 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2024-05-20T17:19:10.500 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.500 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.500 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.501 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-05-20T17:19:10.501 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2024-05-20T17:19:10.501 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2024-05-20T17:19:10.501 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.501 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.501 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.501 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.501 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.501 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.501 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.501 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_support", 2024-05-20T17:19:10.501 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.502 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.502 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.502 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.502 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.502 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.502 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.502 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.502 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.502 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.502 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.502 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.502 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.502 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.502 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.503 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.503 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.503 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.503 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.503 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.503 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.503 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.503 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.503 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.503 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.503 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.503 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.504 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.504 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.504 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.504 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.504 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.504 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.504 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.504 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.504 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.504 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.504 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.504 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.504 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.505 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.505 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.505 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.505 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.505 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.505 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.505 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.505 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.505 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.505 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.505 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.505 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.505 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.505 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.506 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.506 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.506 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.506 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.506 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.506 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.506 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.506 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.506 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.506 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.506 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.506 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.507 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.507 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.507 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.507 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_snap_create": { 2024-05-20T17:19:10.507 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_snap_create", 2024-05-20T17:19:10.507 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.507 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.507 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.507 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:10.507 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.507 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.507 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.507 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.508 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.508 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.508 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.508 INFO:teuthology.orchestra.run.smithi006.stdout: "mirror_snapshot_schedule": { 2024-05-20T17:19:10.508 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirror_snapshot_schedule", 2024-05-20T17:19:10.508 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.508 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.508 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.508 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.508 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.508 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.508 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.508 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.509 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.509 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.509 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.509 INFO:teuthology.orchestra.run.smithi006.stdout: "trash_purge_schedule": { 2024-05-20T17:19:10.509 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "trash_purge_schedule", 2024-05-20T17:19:10.509 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.509 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.509 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.509 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.509 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.509 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.509 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.509 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.510 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.510 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.510 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.510 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.510 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.510 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.510 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "restful", 2024-05-20T17:19:10.510 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.510 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.510 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.510 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_auth": { 2024-05-20T17:19:10.510 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_auth", 2024-05-20T17:19:10.510 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.511 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.511 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.511 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.511 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.511 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.511 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.511 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.511 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.511 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.511 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.511 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2024-05-20T17:19:10.511 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2024-05-20T17:19:10.511 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.512 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.512 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.512 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.512 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.512 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.512 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.512 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.512 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.512 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.512 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.513 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.513 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.513 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.513 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.513 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.513 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.513 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.513 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.513 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.513 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.513 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.513 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.513 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.514 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.514 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.514 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.514 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.514 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.514 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.514 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.514 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.514 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.514 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.514 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.514 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.514 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.515 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.515 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.515 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.515 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.515 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.515 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.515 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.515 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.515 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.515 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.515 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.515 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.516 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.516 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.516 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.516 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.516 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.516 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.516 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.516 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.516 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.516 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.516 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.516 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.516 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.516 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.517 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.517 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.517 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.517 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.517 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.517 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.517 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.517 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.517 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.517 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.517 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.517 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.517 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.518 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.518 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-05-20T17:19:10.518 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-05-20T17:19:10.518 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.518 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.518 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.518 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.518 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.518 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.518 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.518 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.518 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.518 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.519 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.519 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-05-20T17:19:10.519 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-05-20T17:19:10.519 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.519 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.519 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.519 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.519 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.519 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.519 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.519 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.519 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.520 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.520 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.520 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.520 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.520 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rgw", 2024-05-20T17:19:10.520 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.520 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.520 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.520 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.520 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.521 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.521 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.521 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.521 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.521 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.521 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.521 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.521 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.521 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.521 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.521 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.521 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.521 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.521 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.522 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.522 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.522 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.522 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.522 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.522 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.522 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.522 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.522 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.522 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.522 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.522 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.522 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.523 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.523 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.523 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.523 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.523 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.523 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.523 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.523 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.523 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.523 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.523 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.523 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.523 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.524 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.524 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.524 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.524 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.524 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.524 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.524 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.524 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.524 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.524 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.524 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.524 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.524 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.525 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.525 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.525 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.525 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.525 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.525 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.525 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.525 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.525 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.525 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.525 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.525 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.525 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.526 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.526 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rook", 2024-05-20T17:19:10.526 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.526 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.526 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.526 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.526 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.526 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.526 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.526 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.526 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.526 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.526 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.526 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.527 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.527 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.527 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.527 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.527 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.527 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.527 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.527 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.527 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.527 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.527 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.527 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.528 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.528 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.528 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.528 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.528 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.528 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.528 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.528 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.528 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.528 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.528 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.528 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.529 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.529 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.529 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.529 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.529 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.529 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.529 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.529 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.529 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.529 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.529 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.529 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.529 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.529 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.530 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.530 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.530 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.530 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.530 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.530 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.530 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.530 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.530 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.530 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.530 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.530 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.531 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.531 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.531 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.531 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.531 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.531 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.531 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.531 INFO:teuthology.orchestra.run.smithi006.stdout: "storage_class": { 2024-05-20T17:19:10.531 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "storage_class", 2024-05-20T17:19:10.531 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.531 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.531 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.531 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "local", 2024-05-20T17:19:10.532 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.532 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.532 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.532 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-20T17:19:10.532 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.532 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.532 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.532 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.532 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.532 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "selftest", 2024-05-20T17:19:10.532 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.532 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.533 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.533 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.533 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.533 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.533 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.533 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.533 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.533 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.533 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.533 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.533 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.533 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.533 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.533 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.534 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.534 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.534 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.534 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.534 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.534 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.534 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.534 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.534 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.534 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.534 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.534 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.534 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.535 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.535 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.535 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.535 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.535 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.535 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.535 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.535 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.535 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.535 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.535 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.535 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.535 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.536 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.536 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.536 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.536 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.536 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.536 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.536 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.536 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.536 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.536 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.536 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.536 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.536 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.536 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.537 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.537 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.537 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.537 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.537 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.537 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.537 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.537 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.537 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.537 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.537 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.537 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.537 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.538 INFO:teuthology.orchestra.run.smithi006.stdout: "roption1": { 2024-05-20T17:19:10.538 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption1", 2024-05-20T17:19:10.538 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.538 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.538 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.538 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.538 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.538 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.538 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.538 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.538 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.538 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.538 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.539 INFO:teuthology.orchestra.run.smithi006.stdout: "roption2": { 2024-05-20T17:19:10.539 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption2", 2024-05-20T17:19:10.539 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.539 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.539 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.539 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "xyz", 2024-05-20T17:19:10.539 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.539 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.539 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.539 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.539 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.539 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.539 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.540 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption1": { 2024-05-20T17:19:10.540 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption1", 2024-05-20T17:19:10.540 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.540 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.540 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.540 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.540 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.540 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.540 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.540 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.540 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.540 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.540 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.541 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption2": { 2024-05-20T17:19:10.541 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption2", 2024-05-20T17:19:10.541 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.541 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.541 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.541 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.541 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.541 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.541 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.541 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.542 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.542 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.542 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.542 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption3": { 2024-05-20T17:19:10.542 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption3", 2024-05-20T17:19:10.542 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:10.542 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.542 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.542 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.542 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.543 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.543 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.543 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.543 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.543 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.543 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.543 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption4": { 2024-05-20T17:19:10.543 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption4", 2024-05-20T17:19:10.543 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.543 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.543 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.543 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.544 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.544 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.544 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.544 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.544 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.544 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.544 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.544 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption5": { 2024-05-20T17:19:10.544 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption5", 2024-05-20T17:19:10.544 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.544 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.544 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.544 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.545 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.545 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.545 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.545 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.545 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.545 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.545 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.545 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption6": { 2024-05-20T17:19:10.545 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption6", 2024-05-20T17:19:10.545 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.545 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.545 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.546 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.546 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.546 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.546 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.546 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.546 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.546 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.546 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.546 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption7": { 2024-05-20T17:19:10.546 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption7", 2024-05-20T17:19:10.546 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.546 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.546 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.547 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.547 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-05-20T17:19:10.547 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "42", 2024-05-20T17:19:10.547 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.547 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.547 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.547 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.547 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.547 INFO:teuthology.orchestra.run.smithi006.stdout: "testkey": { 2024-05-20T17:19:10.547 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testkey", 2024-05-20T17:19:10.547 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.547 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.547 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.548 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.548 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.548 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.548 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.548 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.548 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.548 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.548 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.548 INFO:teuthology.orchestra.run.smithi006.stdout: "testlkey": { 2024-05-20T17:19:10.548 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testlkey", 2024-05-20T17:19:10.548 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.548 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.548 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.549 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.549 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.549 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.549 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.549 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.549 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.549 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.549 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.549 INFO:teuthology.orchestra.run.smithi006.stdout: "testnewline": { 2024-05-20T17:19:10.549 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testnewline", 2024-05-20T17:19:10.549 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.549 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.549 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.550 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.550 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.550 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.550 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.550 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.550 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.550 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.550 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.550 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.550 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.550 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snap_schedule", 2024-05-20T17:19:10.551 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.551 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.551 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.551 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_m_granularity": { 2024-05-20T17:19:10.551 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_m_granularity", 2024-05-20T17:19:10.551 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.551 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.551 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.551 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.551 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.551 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.551 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.551 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow minute scheduled snapshots", 2024-05-20T17:19:10.551 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.552 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.552 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.552 INFO:teuthology.orchestra.run.smithi006.stdout: "dump_on_update": { 2024-05-20T17:19:10.552 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dump_on_update", 2024-05-20T17:19:10.552 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.552 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.552 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.552 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.552 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.552 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.552 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.552 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "dump database to debug log on update", 2024-05-20T17:19:10.552 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.553 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.553 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.553 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.553 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.553 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.553 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.553 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.553 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.553 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.553 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.553 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.553 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.553 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.554 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.554 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.554 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.554 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.554 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.554 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.554 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.554 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.554 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.554 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.554 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.554 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.554 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.555 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.555 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.555 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.555 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.555 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.555 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.555 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.555 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.555 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.555 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.555 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.555 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.556 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.556 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.556 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.556 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.556 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.556 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.556 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.556 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.556 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.556 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.556 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.556 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.556 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.556 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.557 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.557 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.557 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.557 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.557 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.557 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.557 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.557 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.557 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.557 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.557 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.557 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stats", 2024-05-20T17:19:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.558 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.559 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.559 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.559 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.559 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.559 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.559 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.559 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.559 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.559 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.559 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.559 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.559 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.559 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.560 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.561 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.561 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.561 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.561 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.561 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.561 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.561 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.561 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.561 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.561 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.561 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.562 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.562 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.562 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.562 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.562 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.562 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.562 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.562 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.562 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.562 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.562 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.562 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.562 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.562 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.563 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.563 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.563 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.563 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.563 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.563 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.563 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.563 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.563 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.563 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.563 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.563 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.563 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.564 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.564 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.564 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.564 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.564 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "status", 2024-05-20T17:19:10.564 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.564 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.564 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.564 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.564 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.564 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.564 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.565 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.565 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.565 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.565 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.565 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.565 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.565 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.565 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.565 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.565 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.565 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.565 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.565 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.565 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.566 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.566 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.566 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.566 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.566 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.566 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.566 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.566 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.566 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.566 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.566 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.566 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.567 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.567 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.567 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.567 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.567 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.567 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.567 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.567 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.567 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.567 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.567 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.567 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.567 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.567 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.568 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.568 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.568 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.568 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.568 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.568 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.568 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.568 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.568 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.568 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.568 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.568 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.568 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.569 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.569 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.569 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.569 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.569 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.569 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.569 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.569 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.569 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.569 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.569 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.569 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telegraf", 2024-05-20T17:19:10.570 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.570 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.570 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.570 INFO:teuthology.orchestra.run.smithi006.stdout: "address": { 2024-05-20T17:19:10.570 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "address", 2024-05-20T17:19:10.570 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.570 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.570 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.570 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-20T17:19:10.570 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.570 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.570 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.571 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.571 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.571 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.571 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.571 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-05-20T17:19:10.571 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-05-20T17:19:10.571 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.571 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.571 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.571 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15", 2024-05-20T17:19:10.571 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.571 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.572 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.572 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.572 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.572 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.572 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.572 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.572 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.572 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.572 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.572 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.572 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.572 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.572 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.573 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.573 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.573 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.573 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.573 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.573 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.573 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.573 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.573 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.573 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.573 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.573 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.573 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.574 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.574 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.574 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.574 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.574 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.574 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.574 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.574 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.574 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.574 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.574 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.574 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.574 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.575 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.575 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.575 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.575 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.575 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.575 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.575 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.575 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.575 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.575 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.575 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.575 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.575 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.576 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.576 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.576 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.576 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.576 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.576 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.576 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.576 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.576 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.576 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.576 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.576 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.576 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.577 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.577 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.577 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.577 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.577 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.577 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.577 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.577 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.577 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.577 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telemetry", 2024-05-20T17:19:10.577 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.577 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.577 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.578 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_basic": { 2024-05-20T17:19:10.578 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_basic", 2024-05-20T17:19:10.578 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.578 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.578 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.578 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.578 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.578 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.578 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.578 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-20T17:19:10.578 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.578 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.578 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.579 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_crash": { 2024-05-20T17:19:10.579 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_crash", 2024-05-20T17:19:10.579 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.579 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.579 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.579 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.579 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.579 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.579 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.579 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-20T17:19:10.579 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.579 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.579 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.579 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.580 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_device": { 2024-05-20T17:19:10.580 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_device", 2024-05-20T17:19:10.580 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.580 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.580 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.580 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.580 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.580 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.580 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.580 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-20T17:19:10.580 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.580 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.580 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.581 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_ident": { 2024-05-20T17:19:10.581 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_ident", 2024-05-20T17:19:10.581 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.581 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.581 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.581 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.581 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.581 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.581 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.581 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-20T17:19:10.581 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.581 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.582 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.582 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.582 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_perf": { 2024-05-20T17:19:10.582 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_perf", 2024-05-20T17:19:10.582 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.582 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.582 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.582 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.582 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.582 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.582 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.582 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-20T17:19:10.582 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.583 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.583 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.583 INFO:teuthology.orchestra.run.smithi006.stdout: "contact": { 2024-05-20T17:19:10.583 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "contact", 2024-05-20T17:19:10.583 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.583 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.583 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.583 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.583 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.583 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.583 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.583 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.583 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.584 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.584 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.584 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.584 INFO:teuthology.orchestra.run.smithi006.stdout: "description": { 2024-05-20T17:19:10.584 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "description", 2024-05-20T17:19:10.584 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.584 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.584 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.584 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.584 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.584 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.584 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.584 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.585 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.585 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.585 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.585 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.585 INFO:teuthology.orchestra.run.smithi006.stdout: "device_url": { 2024-05-20T17:19:10.585 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_url", 2024-05-20T17:19:10.585 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.585 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.585 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.585 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-20T17:19:10.585 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.585 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.585 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.585 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.586 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.586 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.586 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.586 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2024-05-20T17:19:10.586 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2024-05-20T17:19:10.586 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.586 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.586 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.586 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.586 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.586 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.586 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.587 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.587 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.587 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.587 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.587 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.587 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-05-20T17:19:10.587 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-05-20T17:19:10.587 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.587 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.587 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.587 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "24", 2024-05-20T17:19:10.587 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "8", 2024-05-20T17:19:10.587 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.588 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.588 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.588 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.588 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.588 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.588 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.588 INFO:teuthology.orchestra.run.smithi006.stdout: "last_opt_revision": { 2024-05-20T17:19:10.588 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "last_opt_revision", 2024-05-20T17:19:10.588 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.588 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.588 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.588 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1", 2024-05-20T17:19:10.588 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.588 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.589 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.589 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.589 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.589 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.589 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.589 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.589 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard": { 2024-05-20T17:19:10.589 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard", 2024-05-20T17:19:10.589 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.589 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.589 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.589 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.589 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.589 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.590 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.590 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.590 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.590 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.590 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.590 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard_description": { 2024-05-20T17:19:10.590 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard_description", 2024-05-20T17:19:10.590 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.590 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.590 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.590 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.590 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.591 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.591 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.591 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.591 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.591 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.591 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.591 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.591 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.591 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.591 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.591 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.591 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.591 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.591 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.592 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.592 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.592 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.592 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.592 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.592 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.592 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.592 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.592 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.592 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.592 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.592 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.592 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.593 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.593 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.593 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.593 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.593 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.593 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.593 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.593 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.593 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.593 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.593 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.593 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.593 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.594 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.594 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.594 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.594 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.594 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.594 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.594 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.594 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.594 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.594 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.594 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.594 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.594 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.594 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.595 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.595 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.595 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.595 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.595 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.595 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.595 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.595 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.595 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.595 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.595 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.595 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.595 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.596 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.596 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.596 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.596 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.596 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.596 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.596 INFO:teuthology.orchestra.run.smithi006.stdout: "organization": { 2024-05-20T17:19:10.596 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "organization", 2024-05-20T17:19:10.596 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.596 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.596 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.596 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.596 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.597 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.597 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.597 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.597 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.597 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.597 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.597 INFO:teuthology.orchestra.run.smithi006.stdout: "proxy": { 2024-05-20T17:19:10.597 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "proxy", 2024-05-20T17:19:10.597 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.597 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.597 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.597 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.597 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.598 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.598 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.598 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.598 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.598 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.598 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.598 INFO:teuthology.orchestra.run.smithi006.stdout: "url": { 2024-05-20T17:19:10.598 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url", 2024-05-20T17:19:10.598 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.598 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.598 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.598 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-20T17:19:10.599 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.599 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.599 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.599 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.599 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.599 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.599 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.599 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.599 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.599 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.599 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "test_orchestrator", 2024-05-20T17:19:10.599 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.599 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.600 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.600 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.600 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.600 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.600 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.600 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.600 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.600 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.600 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.600 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.600 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.600 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.600 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.601 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.601 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.601 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.601 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.601 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.601 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.601 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.601 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.601 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.601 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.601 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.602 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.602 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.602 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.602 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.602 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.602 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.602 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.602 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.602 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.602 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.602 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.602 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.603 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.603 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.603 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.603 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.603 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.603 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.603 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.603 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.603 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.603 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.603 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.603 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.603 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.603 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.604 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.604 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.604 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.604 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.604 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.604 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.604 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.604 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.604 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.604 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.604 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.604 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.604 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.605 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.605 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.605 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.605 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.605 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.605 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.605 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volumes", 2024-05-20T17:19:10.605 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.605 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.605 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.605 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.605 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.606 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.606 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.606 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.606 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.606 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.606 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.606 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.606 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.606 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.606 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.606 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.606 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.606 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.607 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.607 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.607 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.607 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.607 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.607 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.607 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.607 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.607 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.607 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.607 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.607 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.607 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.608 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.608 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.608 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.608 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.608 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.608 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.608 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.608 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.608 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.608 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.608 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.608 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.608 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.609 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.609 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.609 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.609 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.609 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.609 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.609 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.609 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.609 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.609 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.609 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.609 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.609 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.610 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.610 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.610 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.610 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.610 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.610 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.610 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.610 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.610 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.610 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.610 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.610 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.610 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_clones": { 2024-05-20T17:19:10.611 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_clones", 2024-05-20T17:19:10.611 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.611 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.611 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.611 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4", 2024-05-20T17:19:10.611 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.611 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.611 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.611 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-20T17:19:10.611 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.611 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.611 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.611 INFO:teuthology.orchestra.run.smithi006.stdout: "periodic_async_work": { 2024-05-20T17:19:10.612 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "periodic_async_work", 2024-05-20T17:19:10.612 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.612 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.612 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.612 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.612 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.612 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.612 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.612 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Periodically check for async work", 2024-05-20T17:19:10.612 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.612 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.612 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.613 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_delay": { 2024-05-20T17:19:10.613 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_delay", 2024-05-20T17:19:10.613 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.613 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.613 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.613 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-05-20T17:19:10.613 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.613 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.613 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.613 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-20T17:19:10.613 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.613 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.613 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.614 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_no_wait": { 2024-05-20T17:19:10.614 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_no_wait", 2024-05-20T17:19:10.614 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.614 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.614 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.614 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.614 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.614 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.614 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.614 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-20T17:19:10.614 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.614 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.615 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.615 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.615 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.615 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix", 2024-05-20T17:19:10.615 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.615 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.615 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.615 INFO:teuthology.orchestra.run.smithi006.stdout: "discovery_interval": { 2024-05-20T17:19:10.615 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "discovery_interval", 2024-05-20T17:19:10.615 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-05-20T17:19:10.615 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.615 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.615 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "100", 2024-05-20T17:19:10.616 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.616 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.616 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.616 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.616 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.616 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.616 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.616 INFO:teuthology.orchestra.run.smithi006.stdout: "identifier": { 2024-05-20T17:19:10.616 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "identifier", 2024-05-20T17:19:10.616 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.616 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.616 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.617 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.617 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.617 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.617 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.617 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.617 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.617 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.617 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.617 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-05-20T17:19:10.617 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-05-20T17:19:10.617 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.617 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.617 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.618 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-05-20T17:19:10.618 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.618 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.618 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.618 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.618 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.618 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.618 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.618 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.618 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.618 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.618 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.618 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.619 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.619 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.619 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.619 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.619 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.619 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.619 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.619 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.619 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.619 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.619 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.619 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.619 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.620 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.620 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.620 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.620 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.620 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.620 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.620 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.620 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.620 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.620 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.621 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.621 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.621 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.621 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.621 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.621 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.621 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.621 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.621 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.621 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.621 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.621 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.622 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.622 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.622 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.622 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.622 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.622 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.622 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.622 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.622 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.622 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.622 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.622 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.622 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.623 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.623 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.623 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.623 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.623 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.623 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.623 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.623 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.623 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.623 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.623 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.623 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.623 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.624 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_host": { 2024-05-20T17:19:10.624 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_host", 2024-05-20T17:19:10.624 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.624 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.624 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.624 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.624 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.624 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.624 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.624 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.624 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.624 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.624 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.625 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_port": { 2024-05-20T17:19:10.625 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_port", 2024-05-20T17:19:10.625 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.625 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.625 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.625 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10051", 2024-05-20T17:19:10.625 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.625 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.625 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.625 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.625 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.625 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.625 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.626 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_sender": { 2024-05-20T17:19:10.626 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_sender", 2024-05-20T17:19:10.626 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.626 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.626 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.626 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-20T17:19:10.626 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.626 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.626 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.626 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.626 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.626 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.627 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.627 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.627 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.627 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.627 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T17:19:10.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.627 INFO:teuthology.orchestra.run.smithi006.stdout: "gid": 24112, 2024-05-20T17:19:10.627 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "z", 2024-05-20T17:19:10.627 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_features": 4540701547738038271, 2024-05-20T17:19:10.627 INFO:teuthology.orchestra.run.smithi006.stdout: "available_modules": [ 2024-05-20T17:19:10.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.627 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "alerts", 2024-05-20T17:19:10.627 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.628 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.628 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.628 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-05-20T17:19:10.628 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-05-20T17:19:10.628 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.628 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.628 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.628 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-05-20T17:19:10.628 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.628 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.628 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.628 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How frequently to reexamine health status", 2024-05-20T17:19:10.628 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.628 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.629 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.629 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.629 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.629 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.629 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.629 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.629 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.629 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.629 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.629 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.629 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.629 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.629 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.630 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.630 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.630 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.630 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.630 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.630 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.630 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.630 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.630 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.630 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.630 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.630 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.631 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.631 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.631 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.631 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.631 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.631 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.631 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.631 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.631 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.631 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.631 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.631 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.631 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.632 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.632 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.632 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.632 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.632 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.632 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.632 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.632 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.632 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.632 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.632 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.632 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.632 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.632 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.633 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.633 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.633 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.633 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.633 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.633 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.633 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.633 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.633 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.633 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.633 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.633 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.634 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.634 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.634 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.634 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_destination": { 2024-05-20T17:19:10.634 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_destination", 2024-05-20T17:19:10.634 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.634 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.634 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.634 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.634 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.634 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.634 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.634 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email address to send alerts to", 2024-05-20T17:19:10.635 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.635 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.635 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.635 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_from_name": { 2024-05-20T17:19:10.635 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_from_name", 2024-05-20T17:19:10.635 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.635 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.635 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.635 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "Ceph", 2024-05-20T17:19:10.635 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.635 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.635 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.635 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email From: name", 2024-05-20T17:19:10.636 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.636 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.636 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.636 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_host": { 2024-05-20T17:19:10.636 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_host", 2024-05-20T17:19:10.636 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.636 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.636 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.636 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.636 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.636 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.636 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.636 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP server", 2024-05-20T17:19:10.637 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.637 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.637 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.637 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_password": { 2024-05-20T17:19:10.637 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_password", 2024-05-20T17:19:10.637 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.637 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.637 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.637 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.637 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.637 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.637 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.637 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Password to authenticate with", 2024-05-20T17:19:10.638 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.638 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.638 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.638 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_port": { 2024-05-20T17:19:10.638 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_port", 2024-05-20T17:19:10.638 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.638 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.638 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.638 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "465", 2024-05-20T17:19:10.638 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.638 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.638 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.638 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP port", 2024-05-20T17:19:10.639 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.639 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.639 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.639 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_sender": { 2024-05-20T17:19:10.639 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_sender", 2024-05-20T17:19:10.639 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.639 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.639 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.639 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.639 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.639 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.640 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.640 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP envelope sender", 2024-05-20T17:19:10.640 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.640 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.640 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.640 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_ssl": { 2024-05-20T17:19:10.640 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_ssl", 2024-05-20T17:19:10.640 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.640 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.640 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.640 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.641 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.641 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.641 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.641 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-20T17:19:10.641 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.641 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.641 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.641 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_user": { 2024-05-20T17:19:10.641 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_user", 2024-05-20T17:19:10.641 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.641 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.642 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.642 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.642 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.642 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.642 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.642 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "User to authenticate as", 2024-05-20T17:19:10.642 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.642 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.642 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.642 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.642 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.642 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "balancer", 2024-05-20T17:19:10.643 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.643 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.643 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.643 INFO:teuthology.orchestra.run.smithi006.stdout: "active": { 2024-05-20T17:19:10.643 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "active", 2024-05-20T17:19:10.643 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.643 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.643 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.643 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.643 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.643 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.643 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.643 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically balance PGs across cluster", 2024-05-20T17:19:10.644 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.644 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.644 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.644 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_time": { 2024-05-20T17:19:10.644 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_time", 2024-05-20T17:19:10.644 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.644 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.644 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.644 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0000", 2024-05-20T17:19:10.644 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.644 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.644 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.644 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "beginning time of day to automatically balance", 2024-05-20T17:19:10.645 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-20T17:19:10.645 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.645 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.645 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_weekday": { 2024-05-20T17:19:10.645 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_weekday", 2024-05-20T17:19:10.645 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-05-20T17:19:10.645 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.645 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.645 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-05-20T17:19:10.645 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2024-05-20T17:19:10.645 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2024-05-20T17:19:10.645 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.646 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-20T17:19:10.646 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-20T17:19:10.646 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.646 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.646 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_max_iterations": { 2024-05-20T17:19:10.646 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_max_iterations", 2024-05-20T17:19:10.646 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-05-20T17:19:10.646 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.646 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.646 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "25", 2024-05-20T17:19:10.646 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-05-20T17:19:10.646 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "250", 2024-05-20T17:19:10.646 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.647 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-20T17:19:10.647 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.647 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.647 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.647 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_metrics": { 2024-05-20T17:19:10.647 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_metrics", 2024-05-20T17:19:10.647 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.647 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.647 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.647 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "pgs,objects,bytes", 2024-05-20T17:19:10.647 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.647 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.647 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.648 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-20T17:19:10.648 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-20T17:19:10.648 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.648 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.648 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_step": { 2024-05-20T17:19:10.648 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_step", 2024-05-20T17:19:10.648 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:10.648 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.648 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.648 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.5", 2024-05-20T17:19:10.648 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0.001", 2024-05-20T17:19:10.649 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "0.999", 2024-05-20T17:19:10.649 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.649 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "aggressiveness of optimization", 2024-05-20T17:19:10.649 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-20T17:19:10.649 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.649 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.649 INFO:teuthology.orchestra.run.smithi006.stdout: "end_time": { 2024-05-20T17:19:10.649 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_time", 2024-05-20T17:19:10.649 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.649 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.649 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.649 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2359", 2024-05-20T17:19:10.649 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.649 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.650 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.650 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ending time of day to automatically balance", 2024-05-20T17:19:10.650 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-20T17:19:10.650 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.650 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.650 INFO:teuthology.orchestra.run.smithi006.stdout: "end_weekday": { 2024-05-20T17:19:10.650 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_weekday", 2024-05-20T17:19:10.650 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-05-20T17:19:10.650 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.650 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.650 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-05-20T17:19:10.650 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2024-05-20T17:19:10.651 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2024-05-20T17:19:10.651 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.651 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-20T17:19:10.651 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-20T17:19:10.651 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.651 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.651 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.651 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.651 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.651 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.651 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.651 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.651 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.652 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.652 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.652 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.652 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.652 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.652 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.652 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.652 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.652 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.652 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.652 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.652 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.652 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.653 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.653 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.653 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.653 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.653 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.653 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.653 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.653 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.653 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.653 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.653 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.653 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.653 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.654 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.654 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.654 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.654 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.654 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.654 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.654 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.654 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.654 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.654 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.654 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.654 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.654 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.655 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.655 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.655 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.655 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.655 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.655 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.655 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.655 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.655 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.655 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.655 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.655 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.656 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.656 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.656 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.656 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.656 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.656 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.656 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.656 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.656 INFO:teuthology.orchestra.run.smithi006.stdout: "min_score": { 2024-05-20T17:19:10.656 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_score", 2024-05-20T17:19:10.656 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:10.656 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.656 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.657 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-05-20T17:19:10.657 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.657 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.657 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.657 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-20T17:19:10.657 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.657 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.657 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.657 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2024-05-20T17:19:10.657 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2024-05-20T17:19:10.657 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.657 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.657 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.658 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "upmap", 2024-05-20T17:19:10.658 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.658 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.658 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.658 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-compat", 2024-05-20T17:19:10.658 INFO:teuthology.orchestra.run.smithi006.stdout: "none", 2024-05-20T17:19:10.658 INFO:teuthology.orchestra.run.smithi006.stdout: "read", 2024-05-20T17:19:10.658 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap", 2024-05-20T17:19:10.658 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap-read" 2024-05-20T17:19:10.658 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.658 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Balancer mode", 2024-05-20T17:19:10.658 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.658 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.658 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.659 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_ids": { 2024-05-20T17:19:10.659 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_ids", 2024-05-20T17:19:10.659 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.659 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.659 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.659 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.659 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.659 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.659 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.659 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-20T17:19:10.659 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.659 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.660 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.660 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-05-20T17:19:10.660 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-05-20T17:19:10.660 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.660 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.660 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.660 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-05-20T17:19:10.660 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.660 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.660 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.660 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-20T17:19:10.660 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.660 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.661 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.661 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_deviation": { 2024-05-20T17:19:10.661 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_deviation", 2024-05-20T17:19:10.661 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.661 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.661 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.661 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-05-20T17:19:10.661 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-05-20T17:19:10.661 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.661 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.662 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-20T17:19:10.662 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-20T17:19:10.662 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.662 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.662 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_optimizations": { 2024-05-20T17:19:10.662 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_optimizations", 2024-05-20T17:19:10.662 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-05-20T17:19:10.662 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.662 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.662 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:10.663 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.663 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.663 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.663 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-20T17:19:10.663 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.663 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.663 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.663 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.663 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.663 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm", 2024-05-20T17:19:10.663 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.663 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.664 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.664 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_down_multiplier": { 2024-05-20T17:19:10.664 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_down_multiplier", 2024-05-20T17:19:10.664 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:10.664 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.664 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.664 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2024-05-20T17:19:10.664 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.664 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.664 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.664 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-20T17:19:10.664 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.664 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.664 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.665 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_refresh_rate": { 2024-05-20T17:19:10.665 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_refresh_rate", 2024-05-20T17:19:10.665 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.665 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.665 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.665 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "20", 2024-05-20T17:19:10.665 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.665 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.665 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.665 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-20T17:19:10.665 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.665 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.665 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.666 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_starting_port": { 2024-05-20T17:19:10.666 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_starting_port", 2024-05-20T17:19:10.666 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.666 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.666 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.666 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4721", 2024-05-20T17:19:10.666 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.666 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.666 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.666 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-20T17:19:10.666 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.666 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.666 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.667 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_ptrace": { 2024-05-20T17:19:10.667 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_ptrace", 2024-05-20T17:19:10.667 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.667 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.667 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.667 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.667 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.667 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.667 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.667 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-20T17:19:10.667 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-20T17:19:10.668 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.668 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.668 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_interval": { 2024-05-20T17:19:10.668 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_interval", 2024-05-20T17:19:10.668 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.668 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.668 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.668 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-05-20T17:19:10.668 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.668 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.668 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.668 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-20T17:19:10.668 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.669 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.669 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.669 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_memory_target_ratio": { 2024-05-20T17:19:10.669 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_memory_target_ratio", 2024-05-20T17:19:10.669 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:10.669 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.669 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.669 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.7", 2024-05-20T17:19:10.669 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.669 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.669 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.669 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-20T17:19:10.669 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.670 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.670 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.670 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm_log_destination": { 2024-05-20T17:19:10.670 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm_log_destination", 2024-05-20T17:19:10.670 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.670 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.670 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.670 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.670 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.670 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.670 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.670 INFO:teuthology.orchestra.run.smithi006.stdout: "file", 2024-05-20T17:19:10.671 INFO:teuthology.orchestra.run.smithi006.stdout: "file,syslog", 2024-05-20T17:19:10.671 INFO:teuthology.orchestra.run.smithi006.stdout: "syslog" 2024-05-20T17:19:10.671 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.671 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-20T17:19:10.671 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.671 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.671 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.671 INFO:teuthology.orchestra.run.smithi006.stdout: "cgroups_split": { 2024-05-20T17:19:10.671 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cgroups_split", 2024-05-20T17:19:10.671 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.671 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.671 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.671 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.672 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.672 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.672 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.672 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-20T17:19:10.672 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.672 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.672 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.672 INFO:teuthology.orchestra.run.smithi006.stdout: "config_checks_enabled": { 2024-05-20T17:19:10.672 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_checks_enabled", 2024-05-20T17:19:10.672 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.672 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.672 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.672 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.673 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.673 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.673 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.673 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-20T17:19:10.673 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.673 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.673 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.673 INFO:teuthology.orchestra.run.smithi006.stdout: "config_dashboard": { 2024-05-20T17:19:10.673 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_dashboard", 2024-05-20T17:19:10.673 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.673 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.673 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.674 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.674 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.674 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.674 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.674 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-20T17:19:10.674 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.674 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.674 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.674 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_alertmanager": { 2024-05-20T17:19:10.674 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_alertmanager", 2024-05-20T17:19:10.674 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.674 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.675 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.675 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-20T17:19:10.675 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.675 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.675 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.675 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-05-20T17:19:10.675 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.675 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.675 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.675 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_base": { 2024-05-20T17:19:10.675 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_base", 2024-05-20T17:19:10.675 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.675 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.676 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.676 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-20T17:19:10.676 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.676 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.676 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.676 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Container image name, without the tag", 2024-05-20T17:19:10.676 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.676 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.676 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.676 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_elasticsearch": { 2024-05-20T17:19:10.676 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_elasticsearch", 2024-05-20T17:19:10.676 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.676 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.677 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.677 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-20T17:19:10.677 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.677 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.677 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.677 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "elasticsearch container image", 2024-05-20T17:19:10.677 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.677 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.677 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.677 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_grafana": { 2024-05-20T17:19:10.677 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_grafana", 2024-05-20T17:19:10.677 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.677 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.678 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.678 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-20T17:19:10.678 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.678 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.678 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.678 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-05-20T17:19:10.678 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.678 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.678 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.678 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_haproxy": { 2024-05-20T17:19:10.678 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_haproxy", 2024-05-20T17:19:10.678 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.678 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.679 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.679 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-20T17:19:10.679 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.679 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.679 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.679 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "HAproxy container image", 2024-05-20T17:19:10.679 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.679 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.679 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.679 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.679 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_agent": { 2024-05-20T17:19:10.679 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_agent", 2024-05-20T17:19:10.679 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.680 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.680 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.680 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-20T17:19:10.680 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.680 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.680 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.680 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger agent container image", 2024-05-20T17:19:10.680 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.680 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.680 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.680 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.680 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_collector": { 2024-05-20T17:19:10.680 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_collector", 2024-05-20T17:19:10.681 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.681 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.681 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.681 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-20T17:19:10.681 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.681 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.681 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.681 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger collector container image", 2024-05-20T17:19:10.681 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.681 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.681 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.681 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_query": { 2024-05-20T17:19:10.681 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_query", 2024-05-20T17:19:10.682 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.682 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.682 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.682 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-20T17:19:10.682 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.682 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.682 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.682 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger query container image", 2024-05-20T17:19:10.682 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.682 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.682 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.682 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_keepalived": { 2024-05-20T17:19:10.683 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_keepalived", 2024-05-20T17:19:10.683 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.683 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.683 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.683 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-20T17:19:10.683 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.683 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.683 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.683 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Keepalived container image", 2024-05-20T17:19:10.683 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.683 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.683 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.683 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_loki": { 2024-05-20T17:19:10.684 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_loki", 2024-05-20T17:19:10.684 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.684 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.684 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.684 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-20T17:19:10.684 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.684 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.684 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.684 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Loki container image", 2024-05-20T17:19:10.684 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.684 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.684 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.684 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_node_exporter": { 2024-05-20T17:19:10.685 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_node_exporter", 2024-05-20T17:19:10.685 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.685 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.685 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.685 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-20T17:19:10.685 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.685 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.685 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.685 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-05-20T17:19:10.685 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.685 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.685 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.686 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.686 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_nvmeof": { 2024-05-20T17:19:10.686 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_nvmeof", 2024-05-20T17:19:10.686 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.686 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.686 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.686 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-20T17:19:10.686 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.686 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.686 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.686 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Nvme-of container image", 2024-05-20T17:19:10.686 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.687 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.687 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.687 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_prometheus": { 2024-05-20T17:19:10.687 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_prometheus", 2024-05-20T17:19:10.687 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.687 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.687 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.687 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-20T17:19:10.687 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.687 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.687 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.687 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-05-20T17:19:10.688 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.688 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.688 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.688 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_promtail": { 2024-05-20T17:19:10.688 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_promtail", 2024-05-20T17:19:10.688 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.688 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.688 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.688 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-20T17:19:10.688 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.688 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.688 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.688 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Promtail container image", 2024-05-20T17:19:10.689 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.689 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.689 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.689 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_samba": { 2024-05-20T17:19:10.689 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_samba", 2024-05-20T17:19:10.689 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.689 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.689 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.689 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-20T17:19:10.689 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.689 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.689 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.689 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Samba/SMB container image", 2024-05-20T17:19:10.690 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.690 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.690 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.690 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_snmp_gateway": { 2024-05-20T17:19:10.690 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_snmp_gateway", 2024-05-20T17:19:10.690 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.690 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.690 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.690 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-20T17:19:10.690 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.690 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.690 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.690 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SNMP Gateway container image", 2024-05-20T17:19:10.691 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.691 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.691 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.691 INFO:teuthology.orchestra.run.smithi006.stdout: "container_init": { 2024-05-20T17:19:10.691 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_init", 2024-05-20T17:19:10.691 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.691 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.691 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.691 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.691 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.691 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.691 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.691 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Run podman/docker with `--init`", 2024-05-20T17:19:10.692 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.692 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.692 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.692 INFO:teuthology.orchestra.run.smithi006.stdout: "daemon_cache_timeout": { 2024-05-20T17:19:10.692 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "daemon_cache_timeout", 2024-05-20T17:19:10.692 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.692 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.692 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.692 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-05-20T17:19:10.692 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.692 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.692 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.693 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-20T17:19:10.693 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.693 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.693 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.693 INFO:teuthology.orchestra.run.smithi006.stdout: "default_cephadm_command_timeout": { 2024-05-20T17:19:10.693 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_cephadm_command_timeout", 2024-05-20T17:19:10.693 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.693 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.693 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.693 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "900", 2024-05-20T17:19:10.693 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.693 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.693 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.694 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-20T17:19:10.694 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.694 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.694 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.694 INFO:teuthology.orchestra.run.smithi006.stdout: "default_registry": { 2024-05-20T17:19:10.694 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_registry", 2024-05-20T17:19:10.694 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.694 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.694 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.694 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io", 2024-05-20T17:19:10.694 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.694 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.695 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.695 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-20T17:19:10.695 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.695 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.695 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.695 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.695 INFO:teuthology.orchestra.run.smithi006.stdout: "device_cache_timeout": { 2024-05-20T17:19:10.695 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_cache_timeout", 2024-05-20T17:19:10.695 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.695 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.695 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.695 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1800", 2024-05-20T17:19:10.695 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.695 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.696 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.696 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache device inventory", 2024-05-20T17:19:10.696 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.696 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.696 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.696 INFO:teuthology.orchestra.run.smithi006.stdout: "device_enhanced_scan": { 2024-05-20T17:19:10.696 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_enhanced_scan", 2024-05-20T17:19:10.696 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.696 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.696 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.696 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.696 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.696 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.697 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.697 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-20T17:19:10.697 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.697 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.697 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.697 INFO:teuthology.orchestra.run.smithi006.stdout: "facts_cache_timeout": { 2024-05-20T17:19:10.697 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "facts_cache_timeout", 2024-05-20T17:19:10.697 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.697 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.697 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.697 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-05-20T17:19:10.697 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.697 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.698 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.698 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache host facts data", 2024-05-20T17:19:10.698 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.698 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.698 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.698 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.698 INFO:teuthology.orchestra.run.smithi006.stdout: "grafana_dashboards_path": { 2024-05-20T17:19:10.698 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "grafana_dashboards_path", 2024-05-20T17:19:10.698 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.698 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.698 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.698 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-20T17:19:10.698 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.699 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.699 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.699 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-20T17:19:10.699 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.699 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.699 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.699 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.699 INFO:teuthology.orchestra.run.smithi006.stdout: "host_check_interval": { 2024-05-20T17:19:10.699 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "host_check_interval", 2024-05-20T17:19:10.699 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.699 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.699 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.699 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-05-20T17:19:10.699 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.700 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.700 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.700 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to perform a host check", 2024-05-20T17:19:10.700 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.700 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.700 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.700 INFO:teuthology.orchestra.run.smithi006.stdout: "hw_monitoring": { 2024-05-20T17:19:10.700 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hw_monitoring", 2024-05-20T17:19:10.700 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.700 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.700 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.700 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.700 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.701 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.701 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.701 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-20T17:19:10.701 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.701 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.701 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.701 INFO:teuthology.orchestra.run.smithi006.stdout: "inventory_list_all": { 2024-05-20T17:19:10.701 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "inventory_list_all", 2024-05-20T17:19:10.701 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.701 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.701 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.701 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.701 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.702 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.702 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.702 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-20T17:19:10.702 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.702 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.702 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.702 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.702 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.702 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.702 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.702 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.702 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.702 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.702 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.703 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.703 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.703 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.703 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.703 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.703 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.703 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.703 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.703 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.703 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.703 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.703 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.703 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.704 INFO:teuthology.orchestra.run.smithi006.stdout: "log_refresh_metadata": { 2024-05-20T17:19:10.704 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_refresh_metadata", 2024-05-20T17:19:10.704 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.704 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.704 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.704 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.704 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.704 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.704 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.704 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-20T17:19:10.704 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.704 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.704 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.704 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.705 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.705 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.705 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.705 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.705 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.705 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.705 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.705 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.705 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.705 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-20T17:19:10.705 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.706 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.706 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.706 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.706 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.706 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.706 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.706 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.706 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.706 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.706 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.706 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.706 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.707 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.707 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.707 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.707 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.707 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.707 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.707 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.707 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.707 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.707 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.707 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.707 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.707 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.708 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.708 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.708 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.708 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.708 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.708 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.708 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.708 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.708 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.708 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.708 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-20T17:19:10.708 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-20T17:19:10.708 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.709 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.709 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.709 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.709 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.709 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.709 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.709 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-20T17:19:10.709 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.709 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.709 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.709 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-20T17:19:10.709 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-20T17:19:10.709 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.710 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.710 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.710 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "*", 2024-05-20T17:19:10.710 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.710 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.710 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.710 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-20T17:19:10.710 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.710 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.710 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.710 INFO:teuthology.orchestra.run.smithi006.stdout: "max_count_per_host": { 2024-05-20T17:19:10.710 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_count_per_host", 2024-05-20T17:19:10.711 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.711 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.711 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.711 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:10.711 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.711 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.711 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.711 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of daemons per service per host", 2024-05-20T17:19:10.711 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.711 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.711 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.711 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd_draining_count": { 2024-05-20T17:19:10.711 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_osd_draining_count", 2024-05-20T17:19:10.712 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.712 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.712 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.712 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:10.712 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.712 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.712 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.712 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-20T17:19:10.712 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.712 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.712 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.712 INFO:teuthology.orchestra.run.smithi006.stdout: "migration_current": { 2024-05-20T17:19:10.712 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "migration_current", 2024-05-20T17:19:10.713 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.713 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.713 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.713 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.713 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.713 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.713 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.713 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "internal - do not modify", 2024-05-20T17:19:10.713 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.713 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.713 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.713 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2024-05-20T17:19:10.713 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2024-05-20T17:19:10.714 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.714 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.714 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.714 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "root", 2024-05-20T17:19:10.714 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.714 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.714 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.714 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm-package", 2024-05-20T17:19:10.714 INFO:teuthology.orchestra.run.smithi006.stdout: "root" 2024-05-20T17:19:10.714 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.714 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "mode for remote execution of cephadm", 2024-05-20T17:19:10.714 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.714 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.714 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.715 INFO:teuthology.orchestra.run.smithi006.stdout: "oob_default_addr": { 2024-05-20T17:19:10.715 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "oob_default_addr", 2024-05-20T17:19:10.715 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.715 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.715 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.715 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "169.254.1.1", 2024-05-20T17:19:10.715 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.715 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.715 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.715 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-20T17:19:10.715 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.715 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.715 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.716 INFO:teuthology.orchestra.run.smithi006.stdout: "prometheus_alerts_path": { 2024-05-20T17:19:10.716 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus_alerts_path", 2024-05-20T17:19:10.716 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.716 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.716 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.716 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-20T17:19:10.716 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.716 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.716 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.716 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-20T17:19:10.716 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.716 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.716 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.717 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_insecure": { 2024-05-20T17:19:10.717 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_insecure", 2024-05-20T17:19:10.717 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.717 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.717 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.717 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.717 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.717 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.717 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.717 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-20T17:19:10.717 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.717 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.717 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.718 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_password": { 2024-05-20T17:19:10.718 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_password", 2024-05-20T17:19:10.718 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.718 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.718 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.718 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.718 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.718 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.718 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.718 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-20T17:19:10.718 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.718 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.718 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.719 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_url": { 2024-05-20T17:19:10.719 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_url", 2024-05-20T17:19:10.719 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.719 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.719 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.719 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.719 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.719 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.719 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.719 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-20T17:19:10.719 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.719 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.720 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.720 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.720 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_username": { 2024-05-20T17:19:10.720 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_username", 2024-05-20T17:19:10.720 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.720 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.720 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.720 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.720 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.720 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.720 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.720 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-20T17:19:10.720 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.720 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.721 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.721 INFO:teuthology.orchestra.run.smithi006.stdout: "secure_monitoring_stack": { 2024-05-20T17:19:10.721 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "secure_monitoring_stack", 2024-05-20T17:19:10.721 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.721 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.721 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.721 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.721 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.721 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.721 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.721 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-20T17:19:10.721 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.722 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.722 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.722 INFO:teuthology.orchestra.run.smithi006.stdout: "service_discovery_port": { 2024-05-20T17:19:10.722 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "service_discovery_port", 2024-05-20T17:19:10.722 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.722 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.722 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.722 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8765", 2024-05-20T17:19:10.722 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.722 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.722 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.722 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "cephadm service discovery port", 2024-05-20T17:19:10.723 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.723 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.723 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.723 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_config_file": { 2024-05-20T17:19:10.723 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_config_file", 2024-05-20T17:19:10.723 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.723 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.723 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.723 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.723 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.723 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.723 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.723 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-20T17:19:10.724 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.724 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.724 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.724 INFO:teuthology.orchestra.run.smithi006.stdout: "use_agent": { 2024-05-20T17:19:10.724 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_agent", 2024-05-20T17:19:10.724 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.724 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.724 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.724 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.724 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.724 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.724 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.725 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-20T17:19:10.725 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.725 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.725 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.725 INFO:teuthology.orchestra.run.smithi006.stdout: "use_repo_digest": { 2024-05-20T17:19:10.725 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_repo_digest", 2024-05-20T17:19:10.725 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.725 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.725 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.725 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.725 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.725 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.725 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.726 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-20T17:19:10.726 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.726 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.726 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.726 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_failed_host_check": { 2024-05-20T17:19:10.726 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_failed_host_check", 2024-05-20T17:19:10.726 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.726 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.726 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.726 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.726 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.726 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.726 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.727 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if the host check fails", 2024-05-20T17:19:10.727 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.727 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.727 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.727 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_daemons": { 2024-05-20T17:19:10.727 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_daemons", 2024-05-20T17:19:10.727 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.727 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.727 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.727 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.727 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.727 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.728 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.728 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-20T17:19:10.728 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.728 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.728 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.728 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.728 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_hosts": { 2024-05-20T17:19:10.728 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_hosts", 2024-05-20T17:19:10.728 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.728 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.728 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.728 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.728 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.728 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.729 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.729 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-20T17:19:10.729 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.729 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.729 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.729 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.729 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.729 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crash", 2024-05-20T17:19:10.729 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.729 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.730 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.730 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.730 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.730 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.730 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.730 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.730 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.730 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.730 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.730 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.730 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.731 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.731 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.731 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.731 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.731 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.731 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.731 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.731 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.731 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.731 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.731 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.732 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.732 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.732 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.732 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.732 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.732 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.732 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.732 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.732 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.732 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.732 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.732 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.732 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.733 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.733 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.733 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.733 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.733 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.733 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.733 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.733 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.733 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.733 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.733 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.733 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.733 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.733 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.734 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.734 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.734 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.734 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.734 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.734 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.734 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.734 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.734 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.734 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.734 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.734 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.735 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.735 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.735 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.735 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.735 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.735 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.735 INFO:teuthology.orchestra.run.smithi006.stdout: "retain_interval": { 2024-05-20T17:19:10.735 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retain_interval", 2024-05-20T17:19:10.735 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.735 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.735 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.735 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "31536000", 2024-05-20T17:19:10.735 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.736 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.736 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.736 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-20T17:19:10.736 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.736 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.736 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.736 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_recent_interval": { 2024-05-20T17:19:10.736 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_recent_interval", 2024-05-20T17:19:10.736 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.736 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.736 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.736 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1209600", 2024-05-20T17:19:10.737 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.737 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.737 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.737 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-20T17:19:10.737 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.737 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.737 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.737 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.737 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.737 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.737 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dashboard", 2024-05-20T17:19:10.737 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.737 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.738 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.738 INFO:teuthology.orchestra.run.smithi006.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-20T17:19:10.738 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-20T17:19:10.738 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.738 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.738 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.738 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:10.738 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.738 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.738 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.738 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.738 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.738 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.739 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.739 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_HOST": { 2024-05-20T17:19:10.739 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-20T17:19:10.739 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.739 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.739 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.739 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.739 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.739 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.739 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.739 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.739 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.739 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.740 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.740 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-20T17:19:10.740 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-20T17:19:10.740 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.740 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.740 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.740 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.740 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.740 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.740 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.740 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.740 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.740 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.741 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.741 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_ENABLED": { 2024-05-20T17:19:10.741 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_ENABLED", 2024-05-20T17:19:10.741 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.741 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.741 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.741 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.741 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.741 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.741 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.741 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.741 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.741 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.742 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.742 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-20T17:19:10.742 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-20T17:19:10.742 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.742 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.742 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.742 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.742 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.742 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.742 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.742 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.742 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.742 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.743 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.743 INFO:teuthology.orchestra.run.smithi006.stdout: "ENABLE_BROWSABLE_API": { 2024-05-20T17:19:10.743 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-20T17:19:10.743 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.743 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.743 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.743 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.743 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.743 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.743 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.743 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.743 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.743 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.744 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.744 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-20T17:19:10.744 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-20T17:19:10.744 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.744 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.744 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.744 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.744 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.744 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.744 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.744 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.744 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.745 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.745 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.745 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-20T17:19:10.745 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-20T17:19:10.745 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.745 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.745 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.745 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.745 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.745 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.745 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.745 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.745 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.746 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.746 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.746 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-20T17:19:10.746 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-20T17:19:10.746 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.746 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.746 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.746 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.746 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.746 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.746 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.746 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.746 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.747 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.747 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.747 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-20T17:19:10.747 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-20T17:19:10.747 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.747 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.747 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.747 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.747 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.747 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.747 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.747 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.748 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.748 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.748 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.748 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-20T17:19:10.748 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-20T17:19:10.748 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.748 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.748 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.748 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.748 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.748 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.749 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.749 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.749 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.749 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.749 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.749 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-20T17:19:10.749 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-20T17:19:10.749 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.749 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.749 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.749 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.750 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.750 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.750 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.750 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.750 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.750 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.750 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.750 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-20T17:19:10.750 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-20T17:19:10.750 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.750 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.750 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.750 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.751 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.751 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.751 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.751 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.751 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.751 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.751 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.751 INFO:teuthology.orchestra.run.smithi006.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-20T17:19:10.751 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-20T17:19:10.751 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.751 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.751 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.752 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.752 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.752 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.752 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.752 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.752 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.752 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.752 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.752 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_PASSWORD": { 2024-05-20T17:19:10.752 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-20T17:19:10.752 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.752 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.752 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.753 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-05-20T17:19:10.753 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.753 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.753 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.753 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.753 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.753 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.753 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.753 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-20T17:19:10.753 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-20T17:19:10.753 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.753 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.753 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.753 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.754 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.754 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.754 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.754 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.754 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.754 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.754 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.754 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_URL": { 2024-05-20T17:19:10.754 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_URL", 2024-05-20T17:19:10.754 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.754 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.754 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.755 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.755 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.755 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.755 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.755 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.755 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.755 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.755 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.755 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_USERNAME": { 2024-05-20T17:19:10.755 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-20T17:19:10.755 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.755 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.755 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.756 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-05-20T17:19:10.756 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.756 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.756 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.756 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.756 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.756 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.756 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.756 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-20T17:19:10.756 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-20T17:19:10.756 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.756 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.756 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.757 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.757 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.757 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.757 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.757 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.757 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.757 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.757 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.757 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-20T17:19:10.757 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-20T17:19:10.757 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.757 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.757 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.758 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.758 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.758 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.758 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.758 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.758 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.758 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.758 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.758 INFO:teuthology.orchestra.run.smithi006.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-20T17:19:10.758 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-20T17:19:10.758 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.759 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.759 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.759 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.759 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.759 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.759 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.759 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.759 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.759 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.759 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.759 INFO:teuthology.orchestra.run.smithi006.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-20T17:19:10.759 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-20T17:19:10.759 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.760 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.760 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.760 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.760 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.760 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.760 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.760 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.760 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.760 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.760 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.760 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_HOST": { 2024-05-20T17:19:10.760 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-20T17:19:10.760 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.761 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.761 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.761 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.761 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.761 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.761 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.761 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.761 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.761 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.761 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.761 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-20T17:19:10.761 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-20T17:19:10.762 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.762 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.762 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.762 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.762 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.762 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.762 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.762 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.762 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.762 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.762 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.762 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-20T17:19:10.762 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-20T17:19:10.763 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.763 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.763 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.763 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.763 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.763 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.763 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.763 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.763 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.763 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.763 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.763 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-20T17:19:10.764 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-20T17:19:10.764 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.764 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.764 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.764 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.764 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.764 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.764 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.764 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.764 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.764 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.764 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.764 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-20T17:19:10.765 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-20T17:19:10.765 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.765 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.765 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.765 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.765 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.765 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.765 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.765 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.765 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.765 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.765 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.765 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-20T17:19:10.766 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-20T17:19:10.766 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.766 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.766 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.766 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.766 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.766 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.766 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.766 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.766 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.766 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.766 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.766 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-20T17:19:10.767 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-20T17:19:10.767 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.767 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.767 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.767 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.767 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.767 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.767 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.767 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.767 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.767 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.767 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.768 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-20T17:19:10.768 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-20T17:19:10.768 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.768 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.768 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.768 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.768 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.768 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.768 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.768 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.768 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.768 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.768 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.769 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-20T17:19:10.769 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-20T17:19:10.769 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.769 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.769 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.769 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.769 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.769 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.769 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.769 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.769 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.770 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.770 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.770 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_ENABLED": { 2024-05-20T17:19:10.770 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-20T17:19:10.770 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.770 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.770 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.770 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.770 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.770 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.770 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.770 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.771 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.771 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.771 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.771 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-20T17:19:10.771 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-20T17:19:10.771 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.771 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.771 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.771 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-20T17:19:10.771 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.771 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.771 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.772 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.772 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.772 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.772 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.772 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-20T17:19:10.772 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-20T17:19:10.772 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.772 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.772 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.772 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:10.772 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.772 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.772 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.773 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.773 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.773 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.773 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.773 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-20T17:19:10.773 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-20T17:19:10.773 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.773 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.773 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.773 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8", 2024-05-20T17:19:10.773 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.773 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.773 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.774 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.774 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.774 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.774 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.774 INFO:teuthology.orchestra.run.smithi006.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-20T17:19:10.774 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-20T17:19:10.774 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.774 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.774 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.774 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "45", 2024-05-20T17:19:10.774 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.774 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.775 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.775 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.775 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.775 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.775 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.775 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ACCESS_KEY": { 2024-05-20T17:19:10.775 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-20T17:19:10.775 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.775 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.775 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.775 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.775 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.775 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.776 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.776 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.776 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.776 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.776 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.776 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-20T17:19:10.776 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-20T17:19:10.776 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.776 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.776 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.776 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-05-20T17:19:10.776 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.776 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.777 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.777 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.777 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.777 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.777 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.777 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SECRET_KEY": { 2024-05-20T17:19:10.777 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-20T17:19:10.777 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.777 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.777 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.777 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.777 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.778 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.778 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.778 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.778 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.778 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.778 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.778 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SSL_VERIFY": { 2024-05-20T17:19:10.778 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-20T17:19:10.778 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.778 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.778 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.778 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.778 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.779 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.779 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.779 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.779 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.779 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.779 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.779 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-20T17:19:10.779 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-20T17:19:10.779 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.779 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.779 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.779 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-05-20T17:19:10.779 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.780 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.780 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.780 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.780 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.780 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.780 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.780 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-20T17:19:10.780 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-20T17:19:10.780 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.780 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.780 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.780 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:10.781 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.781 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.781 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.781 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.781 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.781 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.781 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.781 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-20T17:19:10.781 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-20T17:19:10.781 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.781 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.781 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.781 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-05-20T17:19:10.781 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.782 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.782 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.782 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.782 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.782 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.782 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.782 INFO:teuthology.orchestra.run.smithi006.stdout: "cross_origin_url": { 2024-05-20T17:19:10.782 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cross_origin_url", 2024-05-20T17:19:10.782 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.782 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.782 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.782 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.783 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.783 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.783 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.783 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.783 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.783 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.783 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.783 INFO:teuthology.orchestra.run.smithi006.stdout: "crt_file": { 2024-05-20T17:19:10.783 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crt_file", 2024-05-20T17:19:10.783 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.783 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.783 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.783 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.784 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.784 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.784 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.784 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.784 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.784 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.784 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.784 INFO:teuthology.orchestra.run.smithi006.stdout: "debug": { 2024-05-20T17:19:10.784 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "debug", 2024-05-20T17:19:10.784 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.784 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.784 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.784 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.785 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.785 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.785 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.785 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable/disable debug options", 2024-05-20T17:19:10.785 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.785 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.785 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.785 INFO:teuthology.orchestra.run.smithi006.stdout: "jwt_token_ttl": { 2024-05-20T17:19:10.785 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "jwt_token_ttl", 2024-05-20T17:19:10.785 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.785 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.785 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.786 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "28800", 2024-05-20T17:19:10.786 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.786 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.786 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.786 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.786 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.786 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.786 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.786 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2024-05-20T17:19:10.786 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2024-05-20T17:19:10.786 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.786 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.786 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.787 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.787 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.787 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.787 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.787 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.787 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.787 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.787 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.787 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.787 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.787 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.787 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.788 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.788 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.788 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.788 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.788 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.788 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.788 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.788 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.788 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.788 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.788 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.788 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.788 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.789 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.789 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.789 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.789 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.789 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.789 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.789 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.789 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.789 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.789 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.789 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.790 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.790 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.790 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.790 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.790 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.790 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.790 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.790 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.790 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.790 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.790 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.790 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.790 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.791 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.791 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.791 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.791 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.791 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.791 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.791 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.791 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.791 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.791 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.791 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.791 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.791 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.792 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.792 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.792 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.792 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.792 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.792 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.792 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.792 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.792 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.792 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.792 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.792 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.792 INFO:teuthology.orchestra.run.smithi006.stdout: "motd": { 2024-05-20T17:19:10.793 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "motd", 2024-05-20T17:19:10.793 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.793 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.793 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.793 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.793 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.793 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.793 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.793 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "The message of the day", 2024-05-20T17:19:10.793 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.793 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.793 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.794 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect_resolve_ip_addr": { 2024-05-20T17:19:10.794 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "redirect_resolve_ip_addr", 2024-05-20T17:19:10.794 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.794 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.794 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.794 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.794 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.794 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.794 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.794 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.794 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.794 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.794 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.795 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-05-20T17:19:10.795 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-05-20T17:19:10.795 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.795 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.795 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.795 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2024-05-20T17:19:10.795 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.795 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.795 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.795 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.795 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.795 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.795 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.796 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-05-20T17:19:10.796 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-05-20T17:19:10.796 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.796 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.796 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.796 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8080", 2024-05-20T17:19:10.796 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.796 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.796 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.796 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.796 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.796 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.796 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.797 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2024-05-20T17:19:10.797 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2024-05-20T17:19:10.797 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.797 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.797 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.797 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.797 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.797 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.797 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.797 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.797 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.797 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.797 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.798 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl_server_port": { 2024-05-20T17:19:10.798 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl_server_port", 2024-05-20T17:19:10.798 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.798 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.798 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.798 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8443", 2024-05-20T17:19:10.798 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.798 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.798 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.798 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.798 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.798 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.798 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.799 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2024-05-20T17:19:10.799 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2024-05-20T17:19:10.799 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.799 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.799 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.799 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "redirect", 2024-05-20T17:19:10.799 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.799 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.799 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.799 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.799 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect" 2024-05-20T17:19:10.799 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.799 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.800 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.800 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.800 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.800 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2024-05-20T17:19:10.800 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2024-05-20T17:19:10.800 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.800 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.800 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.800 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-05-20T17:19:10.800 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2024-05-20T17:19:10.800 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2024-05-20T17:19:10.800 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.800 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.801 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.801 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.801 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.801 INFO:teuthology.orchestra.run.smithi006.stdout: "url_prefix": { 2024-05-20T17:19:10.801 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url_prefix", 2024-05-20T17:19:10.801 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.801 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.801 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.801 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.801 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.801 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.801 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.802 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.802 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.802 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.802 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.802 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.802 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.802 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "devicehealth", 2024-05-20T17:19:10.802 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.802 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.802 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.802 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_monitoring": { 2024-05-20T17:19:10.802 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_monitoring", 2024-05-20T17:19:10.803 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.803 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.803 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.803 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.803 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.803 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.803 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.803 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "monitor device health metrics", 2024-05-20T17:19:10.803 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.803 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.803 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.803 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.804 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.804 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.804 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.804 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.804 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.804 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.804 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.804 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.804 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.804 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.804 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.804 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.804 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.804 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.805 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.805 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.805 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.805 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.805 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.805 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.805 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.805 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.805 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.805 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.805 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.805 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.806 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.806 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.806 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.806 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.806 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.806 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.806 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.806 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.806 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.806 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.806 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.806 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.807 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.807 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.807 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.807 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.807 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.807 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.807 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.807 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.807 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.807 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.807 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.807 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.807 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.807 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.808 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.808 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.808 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.808 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.808 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.808 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.808 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.808 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.808 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.808 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.808 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.809 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.809 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.809 INFO:teuthology.orchestra.run.smithi006.stdout: "mark_out_threshold": { 2024-05-20T17:19:10.809 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mark_out_threshold", 2024-05-20T17:19:10.809 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.809 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.809 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.809 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2419200", 2024-05-20T17:19:10.809 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.809 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.809 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.809 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-20T17:19:10.810 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.810 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.810 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.810 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": { 2024-05-20T17:19:10.810 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_name", 2024-05-20T17:19:10.810 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.810 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.810 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.810 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "device_health_metrics", 2024-05-20T17:19:10.810 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.810 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.810 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.810 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-20T17:19:10.811 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.811 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.811 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.811 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.811 INFO:teuthology.orchestra.run.smithi006.stdout: "retention_period": { 2024-05-20T17:19:10.811 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retention_period", 2024-05-20T17:19:10.811 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.811 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.811 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.811 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15552000", 2024-05-20T17:19:10.811 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.811 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.811 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.811 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain device health metrics", 2024-05-20T17:19:10.812 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.812 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.812 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.812 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_frequency": { 2024-05-20T17:19:10.812 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_frequency", 2024-05-20T17:19:10.812 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.812 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.812 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.812 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2024-05-20T17:19:10.812 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.812 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.812 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.812 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-20T17:19:10.813 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.813 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.813 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.813 INFO:teuthology.orchestra.run.smithi006.stdout: "self_heal": { 2024-05-20T17:19:10.813 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "self_heal", 2024-05-20T17:19:10.813 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.813 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.813 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.813 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.813 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.813 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.813 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.814 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-20T17:19:10.814 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.814 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.814 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.814 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-05-20T17:19:10.814 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-05-20T17:19:10.814 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.814 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.814 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.814 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-05-20T17:19:10.814 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.814 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.815 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.815 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and check device health", 2024-05-20T17:19:10.815 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.815 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.815 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.815 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_threshold": { 2024-05-20T17:19:10.815 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_threshold", 2024-05-20T17:19:10.815 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.815 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.815 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.815 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7257600", 2024-05-20T17:19:10.815 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.815 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.816 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.816 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-20T17:19:10.816 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.816 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.816 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.816 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.816 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.816 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.816 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "diskprediction_local", 2024-05-20T17:19:10.816 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.816 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.816 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.816 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.817 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.817 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.817 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.817 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.817 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.817 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.817 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.817 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.817 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.817 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.817 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.817 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.817 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.817 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.818 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.818 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.818 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.818 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.818 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.818 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.818 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.818 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.818 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.818 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.818 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.818 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.819 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.819 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.819 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.819 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.819 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.819 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.819 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.819 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.819 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.819 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.819 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.819 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.820 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.820 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.820 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.820 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.820 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.820 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.820 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.820 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.820 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.820 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.820 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.820 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.820 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.820 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.821 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.821 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.821 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.821 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.821 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.821 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.821 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.821 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.821 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.821 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.821 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.821 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.821 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.822 INFO:teuthology.orchestra.run.smithi006.stdout: "predict_interval": { 2024-05-20T17:19:10.822 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predict_interval", 2024-05-20T17:19:10.822 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.822 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.822 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.822 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2024-05-20T17:19:10.822 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.822 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.822 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.822 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.822 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.822 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.822 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.823 INFO:teuthology.orchestra.run.smithi006.stdout: "predictor_model": { 2024-05-20T17:19:10.823 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predictor_model", 2024-05-20T17:19:10.823 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.823 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.823 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.823 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "prophetstor", 2024-05-20T17:19:10.823 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.823 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.823 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.823 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.823 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.823 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.823 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.824 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-05-20T17:19:10.824 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-05-20T17:19:10.824 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.824 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.824 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.824 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-05-20T17:19:10.824 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.824 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.824 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.824 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.824 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.824 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.824 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.825 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.825 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.825 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.825 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "influx", 2024-05-20T17:19:10.825 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": false, 2024-05-20T17:19:10.825 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "influxdb python module not found", 2024-05-20T17:19:10.825 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.825 INFO:teuthology.orchestra.run.smithi006.stdout: "batch_size": { 2024-05-20T17:19:10.825 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "batch_size", 2024-05-20T17:19:10.825 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.825 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.825 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.825 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5000", 2024-05-20T17:19:10.826 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.826 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.826 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.826 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-20T17:19:10.826 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.826 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.826 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.826 INFO:teuthology.orchestra.run.smithi006.stdout: "database": { 2024-05-20T17:19:10.826 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "database", 2024-05-20T17:19:10.826 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.826 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.826 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.826 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "ceph", 2024-05-20T17:19:10.827 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.827 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.827 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.827 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-20T17:19:10.827 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.827 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.827 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.827 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": { 2024-05-20T17:19:10.827 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hostname", 2024-05-20T17:19:10.827 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.827 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.827 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.828 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.828 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.828 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.828 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.828 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server hostname", 2024-05-20T17:19:10.828 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.828 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.828 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.828 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-05-20T17:19:10.828 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-05-20T17:19:10.828 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.828 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.828 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.829 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "30", 2024-05-20T17:19:10.829 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "5", 2024-05-20T17:19:10.829 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.829 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.829 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-20T17:19:10.829 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.829 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.829 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.829 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.829 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.829 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.829 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.830 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.830 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.830 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.830 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.830 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.830 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.830 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.830 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.830 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.830 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.830 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.830 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.831 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.831 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.831 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.831 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.831 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.831 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.831 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.831 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.831 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.831 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.831 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.831 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.831 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.832 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.832 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.832 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.832 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.832 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.832 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.832 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.832 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.832 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.832 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.832 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.832 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.832 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.833 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.833 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.833 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.833 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.833 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.833 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.833 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.833 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.833 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.833 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.833 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.833 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.833 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.834 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.834 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.834 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.834 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.834 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.834 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.834 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.834 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.834 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.834 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.834 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.834 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.834 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.835 INFO:teuthology.orchestra.run.smithi006.stdout: "password": { 2024-05-20T17:19:10.835 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "password", 2024-05-20T17:19:10.835 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.835 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.835 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.835 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.835 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.835 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.835 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.835 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "password of InfluxDB server user", 2024-05-20T17:19:10.835 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.835 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.835 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.835 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.836 INFO:teuthology.orchestra.run.smithi006.stdout: "port": { 2024-05-20T17:19:10.836 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "port", 2024-05-20T17:19:10.836 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.836 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.836 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.836 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8086", 2024-05-20T17:19:10.836 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.836 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.836 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.836 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server port", 2024-05-20T17:19:10.836 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.836 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.836 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.837 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2024-05-20T17:19:10.837 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2024-05-20T17:19:10.837 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.837 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.837 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.837 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "false", 2024-05-20T17:19:10.837 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.837 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.837 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.837 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-20T17:19:10.837 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.837 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.837 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.838 INFO:teuthology.orchestra.run.smithi006.stdout: "threads": { 2024-05-20T17:19:10.838 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threads", 2024-05-20T17:19:10.838 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.838 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.838 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.838 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-05-20T17:19:10.838 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-05-20T17:19:10.838 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "32", 2024-05-20T17:19:10.838 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.838 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-20T17:19:10.838 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.838 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.838 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.838 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.839 INFO:teuthology.orchestra.run.smithi006.stdout: "username": { 2024-05-20T17:19:10.839 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "username", 2024-05-20T17:19:10.839 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.839 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.839 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.839 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.839 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.839 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.839 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.839 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "username of InfluxDB server user", 2024-05-20T17:19:10.839 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.839 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.839 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.840 INFO:teuthology.orchestra.run.smithi006.stdout: "verify_ssl": { 2024-05-20T17:19:10.840 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "verify_ssl", 2024-05-20T17:19:10.840 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.840 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.840 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.840 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "true", 2024-05-20T17:19:10.840 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.840 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.840 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.840 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-20T17:19:10.840 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.840 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.840 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.841 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.841 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.841 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.841 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "insights", 2024-05-20T17:19:10.841 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.841 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.841 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.841 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.841 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.841 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.841 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.841 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.841 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.842 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.842 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.842 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.842 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.842 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.842 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.842 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.842 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.842 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.842 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.842 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.842 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.842 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.843 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.843 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.843 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.843 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.843 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.843 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.843 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.843 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.843 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.843 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.843 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.843 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.844 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.844 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.844 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.844 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.844 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.844 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.844 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.844 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.844 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.844 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.844 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.844 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.844 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.845 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.845 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.845 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.845 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.845 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.845 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.845 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.845 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.845 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.845 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.845 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.845 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.845 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.846 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.846 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.846 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.846 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.846 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.846 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.846 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.846 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.846 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.846 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.846 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.846 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "iostat", 2024-05-20T17:19:10.847 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.847 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.847 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.847 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.847 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.847 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.847 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.847 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.847 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.847 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.847 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.847 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.847 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.848 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.848 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.848 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.848 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.848 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.848 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.848 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.848 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.848 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.848 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.848 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.848 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.848 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.849 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.849 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.849 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.849 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.849 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.849 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.849 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.849 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.849 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.849 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.849 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.849 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.849 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.850 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.850 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.850 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.850 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.850 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.850 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.850 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.850 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.850 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.850 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.850 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.850 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.850 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.851 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.851 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.851 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.851 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.851 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.851 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.851 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.851 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.851 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.851 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.851 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.852 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.852 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.852 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.852 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.852 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.852 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.852 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.852 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.852 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.852 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "k8sevents", 2024-05-20T17:19:10.852 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.852 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.852 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.853 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_event_retention_days": { 2024-05-20T17:19:10.853 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ceph_event_retention_days", 2024-05-20T17:19:10.853 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.853 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.853 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.853 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7", 2024-05-20T17:19:10.853 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.853 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.853 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.853 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-20T17:19:10.853 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.853 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.853 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.853 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.854 INFO:teuthology.orchestra.run.smithi006.stdout: "config_check_secs": { 2024-05-20T17:19:10.854 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_check_secs", 2024-05-20T17:19:10.854 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.854 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.854 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.854 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:10.854 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "10", 2024-05-20T17:19:10.854 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.854 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.854 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-20T17:19:10.854 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.854 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.854 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.855 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.855 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.855 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.855 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.855 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.855 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.855 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.855 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.855 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.855 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.855 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.855 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.856 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.856 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.856 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.856 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.856 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.856 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.856 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.856 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.856 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.856 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.856 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.856 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.856 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.857 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.857 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.857 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.857 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.857 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.857 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.857 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.857 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.857 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.857 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.857 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.857 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.857 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.858 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.858 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.858 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.858 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.858 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.858 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.858 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.858 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.858 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.858 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.858 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.858 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.858 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.858 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.859 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.859 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.859 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.859 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.859 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.859 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.859 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.859 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.859 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.859 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.859 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.859 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.860 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.860 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.860 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.860 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.860 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.860 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "localpool", 2024-05-20T17:19:10.860 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.860 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.860 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.860 INFO:teuthology.orchestra.run.smithi006.stdout: "failure_domain": { 2024-05-20T17:19:10.860 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "failure_domain", 2024-05-20T17:19:10.860 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.861 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.861 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.861 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "host", 2024-05-20T17:19:10.861 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.861 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.861 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.861 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "failure domain for any created local pool", 2024-05-20T17:19:10.861 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-20T17:19:10.861 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.861 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.861 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.861 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.861 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.862 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.862 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.862 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.862 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.862 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.862 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.862 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.862 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.862 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.862 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.862 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.862 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.862 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.863 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.863 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.863 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.863 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.863 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.863 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.863 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.863 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.863 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.863 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.863 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.863 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.863 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.864 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.864 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.864 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.864 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.864 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.864 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.864 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.864 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.864 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.864 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.864 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.864 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.864 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.864 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.865 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.865 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.865 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.865 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.865 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.865 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.865 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.865 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.865 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.865 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.865 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.865 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.865 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.866 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.866 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.866 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.866 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.866 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.866 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.866 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.866 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.866 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.866 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.866 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": { 2024-05-20T17:19:10.866 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_size", 2024-05-20T17:19:10.866 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.867 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.867 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.867 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.867 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.867 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.867 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.867 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default min_size for any created local pool", 2024-05-20T17:19:10.867 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-20T17:19:10.867 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.867 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.867 INFO:teuthology.orchestra.run.smithi006.stdout: "num_rep": { 2024-05-20T17:19:10.867 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "num_rep", 2024-05-20T17:19:10.868 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.868 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.868 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.868 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3", 2024-05-20T17:19:10.868 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.868 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.868 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.868 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default replica count for any created local pool", 2024-05-20T17:19:10.868 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.868 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.868 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.868 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": { 2024-05-20T17:19:10.868 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_num", 2024-05-20T17:19:10.869 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.869 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.869 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.869 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "128", 2024-05-20T17:19:10.869 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.869 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.869 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.869 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default pg_num for any created local pool", 2024-05-20T17:19:10.869 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.869 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.869 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.870 INFO:teuthology.orchestra.run.smithi006.stdout: "prefix": { 2024-05-20T17:19:10.870 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prefix", 2024-05-20T17:19:10.870 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.870 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.870 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.870 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.870 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.870 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.870 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.870 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name prefix for any created local pool", 2024-05-20T17:19:10.870 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.871 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.871 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.871 INFO:teuthology.orchestra.run.smithi006.stdout: "subtree": { 2024-05-20T17:19:10.871 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "subtree", 2024-05-20T17:19:10.871 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.871 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.871 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.871 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "rack", 2024-05-20T17:19:10.871 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.871 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.871 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.871 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-20T17:19:10.872 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-20T17:19:10.872 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.872 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.872 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.872 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.872 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mds_autoscaler", 2024-05-20T17:19:10.872 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.872 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.872 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.872 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.873 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.873 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.873 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.873 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.873 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.873 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.873 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.873 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.873 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.873 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.873 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.873 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.873 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.873 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.874 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.874 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.874 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.874 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.874 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.874 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.874 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.874 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.874 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.874 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.874 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.874 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.875 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.875 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.875 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.875 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.875 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.875 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.875 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.875 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.875 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.875 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.875 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.875 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.875 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.876 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.876 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.876 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.876 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.876 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.876 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.876 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.876 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.876 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.876 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.876 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.876 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.876 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.877 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.877 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.877 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.877 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.877 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.877 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.877 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.877 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.877 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.877 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.877 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.877 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.877 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.878 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.878 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.878 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.878 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirroring", 2024-05-20T17:19:10.878 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.878 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.878 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.878 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.878 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.878 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.878 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.878 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.878 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.879 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.879 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.879 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.879 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.879 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.879 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.879 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.879 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.879 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.879 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.879 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.879 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.879 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.879 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.880 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.880 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.880 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.880 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.880 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.880 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.880 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.880 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.880 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.880 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.880 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.880 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.881 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.881 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.881 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.881 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.881 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.881 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.881 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.881 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.881 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.881 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.881 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.881 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.881 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.882 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.882 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.882 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.882 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.882 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.882 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.882 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.882 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.882 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.882 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.882 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.882 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.882 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.883 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.883 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.883 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.883 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.883 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.883 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.883 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.883 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.883 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.883 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.883 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "nfs", 2024-05-20T17:19:10.884 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.884 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.884 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.884 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.884 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.884 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.884 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.884 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.884 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.884 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.884 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.884 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.884 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.884 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.885 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.885 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.885 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.885 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.885 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.885 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.885 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.885 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.885 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.885 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.885 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.885 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.885 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.886 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.886 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.886 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.886 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.886 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.886 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.886 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.886 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.886 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.886 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.886 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.886 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.887 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.887 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.887 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.887 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.887 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.887 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.887 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.887 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.887 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.887 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.887 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.887 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.887 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.888 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.888 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.888 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.888 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.888 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.888 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.888 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.888 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.888 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.888 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.888 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.888 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.888 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.889 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.889 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.889 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.889 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.889 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.889 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.889 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2024-05-20T17:19:10.889 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.889 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.889 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.889 INFO:teuthology.orchestra.run.smithi006.stdout: "fail_fs": { 2024-05-20T17:19:10.889 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "fail_fs", 2024-05-20T17:19:10.890 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.890 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.890 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.890 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.890 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.890 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.890 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.890 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-20T17:19:10.890 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.890 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.890 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.890 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator": { 2024-05-20T17:19:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2024-05-20T17:19:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm", 2024-05-20T17:19:10.897 INFO:teuthology.orchestra.run.smithi006.stdout: "rook", 2024-05-20T17:19:10.897 INFO:teuthology.orchestra.run.smithi006.stdout: "test_orchestrator" 2024-05-20T17:19:10.897 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.897 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Orchestrator backend", 2024-05-20T17:19:10.897 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.897 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.897 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.897 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.897 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.897 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_perf_query", 2024-05-20T17:19:10.897 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.897 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.898 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.898 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.898 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.898 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.898 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.898 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.898 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.898 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.898 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.898 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.898 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.898 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.898 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.899 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.899 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.899 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.899 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.899 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.899 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.899 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.899 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.899 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.899 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.899 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.899 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.900 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.900 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.900 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.900 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.900 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.900 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.900 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.900 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.900 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.900 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.900 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.900 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.900 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.901 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.901 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.901 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.901 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.901 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.901 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.901 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.901 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.901 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.901 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.901 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.901 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.901 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.901 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.902 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.902 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.902 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.902 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.902 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.902 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.902 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.902 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.902 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.902 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.902 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.902 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.903 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.903 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.903 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.903 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.903 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.903 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_support", 2024-05-20T17:19:10.903 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.903 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.903 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.903 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.903 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.903 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.904 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.904 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.904 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.904 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.904 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.904 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.904 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.904 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.904 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.904 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.904 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.904 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.904 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.904 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.905 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.905 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.905 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.905 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.905 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.905 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.905 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.905 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.905 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.905 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.905 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.905 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.905 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.906 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.906 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.906 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.906 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.906 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.906 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.906 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.906 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.906 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.906 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.906 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.906 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.907 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.907 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.907 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.907 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.907 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.907 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.907 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.907 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.907 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.907 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.907 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.907 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.907 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.908 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.908 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.908 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.908 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.908 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.908 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.908 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.908 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.908 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.908 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.908 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.908 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.908 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.909 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_autoscaler", 2024-05-20T17:19:10.909 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.909 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.909 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.909 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.909 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.909 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.909 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.909 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.909 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.909 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.909 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.909 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.910 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.910 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.910 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.910 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.910 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.910 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.910 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.910 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.910 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.910 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.910 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.910 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.910 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.911 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.911 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.911 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.911 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.911 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.911 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.911 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.911 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.911 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.911 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.911 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.911 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.911 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.912 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.912 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.912 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.912 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.912 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.912 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.912 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.912 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.912 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.912 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.912 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.912 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.912 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.912 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.913 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.913 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.913 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.913 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.913 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.913 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.913 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.913 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.913 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.913 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.914 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.914 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.914 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.914 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.914 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.914 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.914 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.914 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-05-20T17:19:10.914 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-05-20T17:19:10.914 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.914 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.915 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.915 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-05-20T17:19:10.915 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.915 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.915 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.915 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.915 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.915 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.915 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.915 INFO:teuthology.orchestra.run.smithi006.stdout: "threshold": { 2024-05-20T17:19:10.915 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threshold", 2024-05-20T17:19:10.915 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:10.915 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.916 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.916 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2024-05-20T17:19:10.916 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1.0", 2024-05-20T17:19:10.916 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.916 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.916 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "scaling threshold", 2024-05-20T17:19:10.916 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-20T17:19:10.916 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.916 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.916 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.916 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.916 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "progress", 2024-05-20T17:19:10.917 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.917 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.917 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.917 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_pg_recovery_event": { 2024-05-20T17:19:10.917 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_pg_recovery_event", 2024-05-20T17:19:10.917 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.917 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.917 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.917 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.917 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.917 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.917 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.917 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-20T17:19:10.917 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.918 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.918 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.918 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2024-05-20T17:19:10.918 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2024-05-20T17:19:10.918 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.918 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.918 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.918 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.918 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.918 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.918 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.918 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.919 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.919 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.919 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.919 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.919 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.919 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.919 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.919 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.919 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.919 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.919 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.919 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.919 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.920 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.920 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.920 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.920 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.920 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.920 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.920 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.920 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.920 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.920 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.920 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.920 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.920 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.921 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.921 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.921 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.921 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.921 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.921 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.921 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.921 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.921 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.921 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.921 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.921 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.921 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.922 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.923 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.924 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.924 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.924 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.924 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.924 INFO:teuthology.orchestra.run.smithi006.stdout: "max_completed_events": { 2024-05-20T17:19:10.924 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_completed_events", 2024-05-20T17:19:10.924 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.924 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.924 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.924 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "50", 2024-05-20T17:19:10.924 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.924 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.924 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.925 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "number of past completed events to remember", 2024-05-20T17:19:10.925 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.925 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.925 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.925 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-05-20T17:19:10.925 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-05-20T17:19:10.925 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:10.925 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.925 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.925 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-05-20T17:19:10.925 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.925 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.925 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.925 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long the module is going to sleep", 2024-05-20T17:19:10.926 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.926 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.926 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.926 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.926 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.926 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus", 2024-05-20T17:19:10.926 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.926 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.926 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.926 INFO:teuthology.orchestra.run.smithi006.stdout: "cache": { 2024-05-20T17:19:10.926 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cache", 2024-05-20T17:19:10.927 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.927 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.927 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.927 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.927 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.927 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.927 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.927 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.927 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.927 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.927 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.927 INFO:teuthology.orchestra.run.smithi006.stdout: "exclude_perf_counters": { 2024-05-20T17:19:10.928 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "exclude_perf_counters", 2024-05-20T17:19:10.928 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.928 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.928 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.928 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.928 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.928 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.928 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.928 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-20T17:19:10.928 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-20T17:19:10.928 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.928 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.928 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.929 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.929 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.929 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.929 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.929 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.929 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.929 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.929 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.929 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.929 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.929 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.929 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.929 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.930 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.930 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.930 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.930 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.930 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.930 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.930 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.930 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.930 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.930 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.930 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.930 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.930 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.931 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.931 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.931 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.931 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.931 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.931 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.931 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.931 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.931 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.931 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.931 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.931 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.932 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.932 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.932 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.932 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.932 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.932 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.932 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.932 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.932 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.932 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.932 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.932 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.932 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.932 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.933 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.933 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.933 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.933 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.933 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.933 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.933 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.933 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.933 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.933 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.933 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.933 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.934 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.934 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools": { 2024-05-20T17:19:10.934 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools", 2024-05-20T17:19:10.934 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.934 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.934 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.934 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.934 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.934 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.934 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.935 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.935 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.935 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.935 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.935 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-20T17:19:10.935 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-20T17:19:10.935 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.935 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.935 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.935 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300", 2024-05-20T17:19:10.935 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.935 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.935 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.936 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.936 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.936 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.936 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.936 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_interval": { 2024-05-20T17:19:10.936 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_interval", 2024-05-20T17:19:10.936 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:10.936 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.936 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.936 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15.0", 2024-05-20T17:19:10.936 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.936 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.937 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.937 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.937 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.937 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.937 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.937 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-05-20T17:19:10.937 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-05-20T17:19:10.937 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.937 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.937 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.937 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2024-05-20T17:19:10.937 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.937 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.938 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.938 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-20T17:19:10.938 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.938 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.938 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.938 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-05-20T17:19:10.938 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-05-20T17:19:10.938 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.938 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.938 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.938 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "9283", 2024-05-20T17:19:10.938 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.938 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.939 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.939 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-20T17:19:10.939 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.939 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.939 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.939 INFO:teuthology.orchestra.run.smithi006.stdout: "stale_cache_strategy": { 2024-05-20T17:19:10.939 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stale_cache_strategy", 2024-05-20T17:19:10.939 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.939 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.939 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.939 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "log", 2024-05-20T17:19:10.939 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.939 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.940 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.940 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.940 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.940 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.940 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.940 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2024-05-20T17:19:10.940 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2024-05-20T17:19:10.940 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.940 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.940 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.940 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "default", 2024-05-20T17:19:10.940 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "default", 2024-05-20T17:19:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "error" 2024-05-20T17:19:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2024-05-20T17:19:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2024-05-20T17:19:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.942 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.942 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-05-20T17:19:10.942 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2024-05-20T17:19:10.942 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2024-05-20T17:19:10.942 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.942 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.942 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.942 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.942 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.942 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.942 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.943 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_support", 2024-05-20T17:19:10.943 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.943 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.943 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.943 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.943 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.943 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.943 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.943 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.943 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.943 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.943 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.943 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.943 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.944 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.944 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.944 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.944 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.944 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.944 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.944 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.944 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.944 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.944 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.944 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.944 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.945 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.945 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.945 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.945 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.945 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.945 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.945 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.945 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.945 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.945 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.945 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.945 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.945 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.946 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.946 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.946 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.946 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.946 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.946 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.946 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.946 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.946 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.946 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.946 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.946 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.946 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.947 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.947 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.947 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.947 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.947 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.947 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.947 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.947 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.947 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.947 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.947 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.947 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.947 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.948 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.948 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.948 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.948 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.948 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.948 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_snap_create": { 2024-05-20T17:19:10.948 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_snap_create", 2024-05-20T17:19:10.948 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.948 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.948 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.948 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:10.948 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.948 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.949 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.949 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.949 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.949 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.949 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.949 INFO:teuthology.orchestra.run.smithi006.stdout: "mirror_snapshot_schedule": { 2024-05-20T17:19:10.949 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirror_snapshot_schedule", 2024-05-20T17:19:10.949 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.949 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.949 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.949 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.949 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.949 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.950 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.950 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.950 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.950 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.950 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.950 INFO:teuthology.orchestra.run.smithi006.stdout: "trash_purge_schedule": { 2024-05-20T17:19:10.950 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "trash_purge_schedule", 2024-05-20T17:19:10.950 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.950 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.950 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.950 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.950 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.951 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.951 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.951 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.951 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.951 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.951 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.951 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.951 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.951 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "restful", 2024-05-20T17:19:10.951 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.951 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.951 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.951 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_auth": { 2024-05-20T17:19:10.952 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_auth", 2024-05-20T17:19:10.952 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.952 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.952 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.952 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.952 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.952 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.952 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.952 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.952 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.952 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.952 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.953 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2024-05-20T17:19:10.953 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2024-05-20T17:19:10.953 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.953 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.953 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.953 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.953 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.953 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.953 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.953 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.953 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.954 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.954 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.954 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.954 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.954 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.954 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.954 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.954 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.954 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.954 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.954 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.955 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.955 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.955 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.955 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.955 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.955 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.955 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.955 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.955 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.955 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.955 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.956 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.956 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.956 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.956 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.956 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.956 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.956 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.956 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.956 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.956 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.956 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.956 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.956 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.957 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.957 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.957 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.957 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.957 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.957 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.957 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.957 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.957 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.957 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.957 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.957 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.957 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.958 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.958 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.958 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.958 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.958 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.958 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.958 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.958 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.958 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.958 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.958 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.958 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.959 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.959 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.959 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.959 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.959 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.959 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.959 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.959 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.959 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-05-20T17:19:10.959 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-05-20T17:19:10.959 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.959 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.959 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.960 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.960 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.960 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.960 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.960 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.960 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.960 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.960 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.960 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-05-20T17:19:10.960 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-05-20T17:19:10.960 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.960 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.961 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.961 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.961 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.961 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.961 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.961 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.961 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.961 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.961 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.961 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.961 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.961 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rgw", 2024-05-20T17:19:10.962 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.962 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.962 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.962 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.962 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.962 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.962 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.962 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.962 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.962 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.962 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.962 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.962 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.962 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.963 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.963 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.963 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.963 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.963 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.963 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.963 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.963 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.963 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.963 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.963 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.963 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.963 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.964 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.964 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.964 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.964 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.964 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.964 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.964 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.964 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.964 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.964 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.964 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.964 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.964 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.965 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.965 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.965 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.965 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.965 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.965 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.965 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.965 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.965 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.965 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.965 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.965 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.965 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.965 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.966 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.966 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.966 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.966 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.966 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.966 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.966 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.966 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.966 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.966 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.966 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.966 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.966 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.967 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.967 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.967 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.967 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.967 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rook", 2024-05-20T17:19:10.967 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.967 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.967 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.967 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.967 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.967 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.967 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.968 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.968 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.968 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.968 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.968 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.968 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.968 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.968 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.968 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.968 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.968 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.968 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.968 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.968 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.969 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.969 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.969 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.969 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.969 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.969 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.969 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.969 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.969 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.969 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.969 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.969 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.970 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.970 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.970 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.970 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.970 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.970 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.970 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.970 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.970 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.970 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.970 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.970 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.971 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.971 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.971 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.971 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.971 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.971 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.971 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.971 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.971 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.971 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.971 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.971 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.972 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.972 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.972 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.972 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.972 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.972 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.972 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.972 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.972 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.972 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.972 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.972 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.973 INFO:teuthology.orchestra.run.smithi006.stdout: "storage_class": { 2024-05-20T17:19:10.973 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "storage_class", 2024-05-20T17:19:10.973 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.973 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.973 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.973 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "local", 2024-05-20T17:19:10.973 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.973 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.973 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.973 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-20T17:19:10.973 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.974 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.974 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.974 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.974 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.974 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.974 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "selftest", 2024-05-20T17:19:10.974 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.974 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.974 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.974 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.974 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.975 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.975 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.975 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.975 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.975 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.975 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.975 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.975 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.975 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.975 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.975 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.975 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.976 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.976 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.976 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.976 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.976 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.976 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.976 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.976 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.976 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.976 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.976 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.977 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.977 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.977 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.977 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.977 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.977 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.977 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.977 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.977 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.977 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.978 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.978 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.978 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.978 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:10.978 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.978 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.978 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.978 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.978 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.978 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.978 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.979 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.979 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.979 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.979 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.979 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.979 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.979 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.979 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:10.979 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:10.979 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.980 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.980 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.980 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.980 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.980 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.980 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.980 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.980 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.980 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.980 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.980 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.980 INFO:teuthology.orchestra.run.smithi006.stdout: "roption1": { 2024-05-20T17:19:10.981 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption1", 2024-05-20T17:19:10.981 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.981 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.981 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.981 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.981 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.981 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.981 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.981 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.981 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.981 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.981 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.982 INFO:teuthology.orchestra.run.smithi006.stdout: "roption2": { 2024-05-20T17:19:10.982 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption2", 2024-05-20T17:19:10.982 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.982 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.982 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.982 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "xyz", 2024-05-20T17:19:10.982 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.982 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.982 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.982 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.983 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.983 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.983 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.983 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption1": { 2024-05-20T17:19:10.983 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption1", 2024-05-20T17:19:10.983 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.983 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.983 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.983 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.983 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.983 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.984 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.984 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.984 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.984 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.984 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.984 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption2": { 2024-05-20T17:19:10.984 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption2", 2024-05-20T17:19:10.984 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.984 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.984 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.984 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.985 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.985 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.985 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.985 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.985 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.985 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.985 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.985 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption3": { 2024-05-20T17:19:10.985 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption3", 2024-05-20T17:19:10.985 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:10.985 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.986 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.986 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.986 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.986 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.986 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.986 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.986 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.986 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.986 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.986 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption4": { 2024-05-20T17:19:10.986 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption4", 2024-05-20T17:19:10.986 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.987 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.987 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.987 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.987 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.987 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.987 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.987 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.987 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.987 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.987 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.987 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption5": { 2024-05-20T17:19:10.987 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption5", 2024-05-20T17:19:10.987 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.988 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.988 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.988 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.988 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.988 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.988 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.988 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.988 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.988 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.988 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.988 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption6": { 2024-05-20T17:19:10.988 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption6", 2024-05-20T17:19:10.988 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.989 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.989 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.989 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:10.989 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.989 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.989 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.989 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.989 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.989 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.989 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.989 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption7": { 2024-05-20T17:19:10.989 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption7", 2024-05-20T17:19:10.989 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:10.990 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.990 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.990 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.990 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-05-20T17:19:10.990 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "42", 2024-05-20T17:19:10.990 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.990 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.990 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.990 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.990 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.990 INFO:teuthology.orchestra.run.smithi006.stdout: "testkey": { 2024-05-20T17:19:10.990 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testkey", 2024-05-20T17:19:10.991 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.991 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.991 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.991 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.991 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.991 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.991 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.991 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.991 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.991 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.991 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.991 INFO:teuthology.orchestra.run.smithi006.stdout: "testlkey": { 2024-05-20T17:19:10.991 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testlkey", 2024-05-20T17:19:10.992 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.992 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.992 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.992 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.992 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.992 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.992 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.992 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.992 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.992 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.992 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.992 INFO:teuthology.orchestra.run.smithi006.stdout: "testnewline": { 2024-05-20T17:19:10.992 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testnewline", 2024-05-20T17:19:10.993 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.993 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.993 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:10.993 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.993 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.993 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.993 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.993 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.993 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.993 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.993 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.993 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.993 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:10.993 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:10.994 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snap_schedule", 2024-05-20T17:19:10.994 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:10.994 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:10.994 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:10.994 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_m_granularity": { 2024-05-20T17:19:10.994 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_m_granularity", 2024-05-20T17:19:10.994 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.994 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.994 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.994 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.994 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.994 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.995 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.995 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow minute scheduled snapshots", 2024-05-20T17:19:10.995 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.995 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.995 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.995 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.995 INFO:teuthology.orchestra.run.smithi006.stdout: "dump_on_update": { 2024-05-20T17:19:10.995 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dump_on_update", 2024-05-20T17:19:10.995 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.995 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.995 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.995 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.996 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.996 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.996 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.996 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "dump database to debug log on update", 2024-05-20T17:19:10.996 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.996 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.996 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.996 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:10.996 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:10.996 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.996 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.996 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.996 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:10.997 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.997 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.997 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:10.997 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:10.997 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:10.997 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:10.997 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:10.997 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:10.997 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:10.997 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:10.998 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.998 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.998 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.998 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.998 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:10.998 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:10.998 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:10.998 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.998 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.998 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:10.999 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:10.999 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:10.999 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:10.999 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:10.999 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:10.999 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:10.999 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:10.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:10.999 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:10.999 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:10.999 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:10.999 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:10.999 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:10.999 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.000 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.000 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.000 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.000 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.000 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.000 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.000 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.000 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.000 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.000 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.000 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.000 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.000 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.001 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.001 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.001 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.001 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.001 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.001 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.001 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.001 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.001 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.001 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.001 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.001 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.001 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.002 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.002 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.002 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.002 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.002 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stats", 2024-05-20T17:19:11.002 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.002 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.002 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.002 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.002 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.002 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.003 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.003 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.003 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.003 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.003 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.003 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.003 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.004 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.004 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.004 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.004 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.004 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.004 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.004 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.004 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.005 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.005 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.005 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.005 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.005 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.005 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.005 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.005 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.006 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.006 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.006 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.006 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.006 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.006 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.006 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.006 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.006 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.006 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.006 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.007 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.007 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.007 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.007 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.007 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.007 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.007 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.007 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.007 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.007 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.007 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.007 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.007 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.007 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.008 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.008 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.008 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.008 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.008 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.008 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.008 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.008 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.008 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.009 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.009 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.009 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.009 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.009 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.009 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.009 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.009 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.009 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.009 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.009 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "status", 2024-05-20T17:19:11.009 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.010 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.010 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.010 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.010 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.010 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.010 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.010 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.010 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.010 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.010 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.010 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.010 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.011 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.011 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.011 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.011 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.011 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.011 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.011 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.011 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.011 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.011 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.012 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.012 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.012 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.012 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.012 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.013 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.013 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.013 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.013 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.013 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.013 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.014 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.014 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.014 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.014 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.014 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.014 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.015 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.015 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.015 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.015 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.015 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.015 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.016 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.016 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.016 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.016 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.016 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.017 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.017 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.017 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.017 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.017 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.017 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.018 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.018 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.018 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.018 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.018 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.019 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.019 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.019 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.019 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.019 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.019 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.020 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.020 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.020 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.020 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.020 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telegraf", 2024-05-20T17:19:11.021 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.021 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.021 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.021 INFO:teuthology.orchestra.run.smithi006.stdout: "address": { 2024-05-20T17:19:11.021 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "address", 2024-05-20T17:19:11.021 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.022 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.022 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.022 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-20T17:19:11.022 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.022 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.022 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.023 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.023 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.023 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.023 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.023 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.023 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-05-20T17:19:11.024 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-05-20T17:19:11.024 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.024 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.024 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.024 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15", 2024-05-20T17:19:11.024 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.024 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.025 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.025 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.025 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.025 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.025 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.025 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.026 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.026 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.026 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.026 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.026 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.026 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.026 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.027 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.027 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.027 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.027 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.027 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.027 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.027 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.028 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.028 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.028 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.028 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.028 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.028 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.029 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.029 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.029 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.029 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.029 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.029 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.029 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.030 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.030 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.030 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.030 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.030 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.031 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.031 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.031 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.031 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.031 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.031 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.032 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.032 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.032 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.032 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.032 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.032 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.033 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.033 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.033 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.033 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.033 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.033 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.034 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.034 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.034 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.034 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.035 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.035 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.035 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.035 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.035 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.035 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.035 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.036 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.036 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.036 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.036 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.036 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.036 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.036 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.036 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.037 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.037 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telemetry", 2024-05-20T17:19:11.037 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.037 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.037 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.037 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_basic": { 2024-05-20T17:19:11.037 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_basic", 2024-05-20T17:19:11.037 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.038 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.038 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.038 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.038 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.038 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.038 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.038 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-20T17:19:11.038 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.039 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.039 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.039 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_crash": { 2024-05-20T17:19:11.039 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_crash", 2024-05-20T17:19:11.039 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.040 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.040 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.040 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.040 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.040 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.040 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.040 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-20T17:19:11.041 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.041 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.041 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.041 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.041 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_device": { 2024-05-20T17:19:11.041 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_device", 2024-05-20T17:19:11.042 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.042 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.042 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.042 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.042 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.042 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.043 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.043 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-20T17:19:11.043 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.043 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.043 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.043 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_ident": { 2024-05-20T17:19:11.043 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_ident", 2024-05-20T17:19:11.044 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.044 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.044 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.044 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.044 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.044 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.044 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.045 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-20T17:19:11.045 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.045 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.045 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.045 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_perf": { 2024-05-20T17:19:11.045 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_perf", 2024-05-20T17:19:11.046 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.046 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.046 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.046 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.046 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.046 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.046 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.046 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-20T17:19:11.046 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.047 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.047 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.047 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.047 INFO:teuthology.orchestra.run.smithi006.stdout: "contact": { 2024-05-20T17:19:11.047 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "contact", 2024-05-20T17:19:11.047 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.047 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.047 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.047 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.048 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.048 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.048 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.048 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.048 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.048 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.048 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.048 INFO:teuthology.orchestra.run.smithi006.stdout: "description": { 2024-05-20T17:19:11.048 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "description", 2024-05-20T17:19:11.048 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.048 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.048 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.048 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.049 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.049 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.049 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.049 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.049 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.049 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.049 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.049 INFO:teuthology.orchestra.run.smithi006.stdout: "device_url": { 2024-05-20T17:19:11.049 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_url", 2024-05-20T17:19:11.050 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.050 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.050 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.050 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-20T17:19:11.050 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.050 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.050 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.050 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.050 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.050 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.050 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.050 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.050 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2024-05-20T17:19:11.051 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2024-05-20T17:19:11.051 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.051 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.051 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.051 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.051 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.051 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.051 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.051 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.051 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.051 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.051 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.051 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.051 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-05-20T17:19:11.052 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-05-20T17:19:11.052 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.052 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.052 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.052 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "24", 2024-05-20T17:19:11.052 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "8", 2024-05-20T17:19:11.052 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.052 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.052 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.052 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.052 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.052 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.053 INFO:teuthology.orchestra.run.smithi006.stdout: "last_opt_revision": { 2024-05-20T17:19:11.053 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "last_opt_revision", 2024-05-20T17:19:11.053 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.053 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.053 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.053 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1", 2024-05-20T17:19:11.053 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.053 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.053 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.053 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.053 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.053 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.054 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.054 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard": { 2024-05-20T17:19:11.054 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard", 2024-05-20T17:19:11.054 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.054 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.054 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.055 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.055 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.055 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.055 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.055 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.055 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.055 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.055 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.055 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard_description": { 2024-05-20T17:19:11.055 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard_description", 2024-05-20T17:19:11.055 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.055 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.055 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.056 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.056 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.056 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.056 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.056 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.056 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.056 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.056 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.056 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.056 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.056 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.056 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.057 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.057 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.057 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.057 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.057 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.057 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.057 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.057 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.057 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.058 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.058 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.058 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.058 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.058 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.058 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.058 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.058 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.058 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.058 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.058 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.058 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.058 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.059 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.059 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.059 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.059 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.059 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.059 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.059 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.059 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.059 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.059 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.059 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.061 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.061 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.061 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.061 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.061 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.061 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.061 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.061 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.061 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.061 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.062 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.062 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.062 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.062 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.062 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.062 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.062 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.062 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.062 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.062 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.062 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.062 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.063 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.063 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.063 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.063 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.063 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.063 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.063 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.063 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.063 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.063 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.063 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.064 INFO:teuthology.orchestra.run.smithi006.stdout: "organization": { 2024-05-20T17:19:11.064 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "organization", 2024-05-20T17:19:11.064 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.064 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.064 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.064 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.064 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.064 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.064 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.064 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.064 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.064 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.065 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.065 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.065 INFO:teuthology.orchestra.run.smithi006.stdout: "proxy": { 2024-05-20T17:19:11.065 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "proxy", 2024-05-20T17:19:11.065 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.065 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.065 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.065 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.065 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.065 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.066 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.066 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.066 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.066 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.066 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.066 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.066 INFO:teuthology.orchestra.run.smithi006.stdout: "url": { 2024-05-20T17:19:11.066 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url", 2024-05-20T17:19:11.066 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.066 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.066 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.066 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-20T17:19:11.066 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.067 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.067 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.067 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.067 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.067 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.067 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.067 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.067 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.067 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.067 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.067 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "test_orchestrator", 2024-05-20T17:19:11.068 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.068 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.068 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.068 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.068 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.068 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.068 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.068 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.068 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.068 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.069 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.069 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.069 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.069 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.069 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.069 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.069 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.069 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.069 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.069 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.069 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.069 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.069 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.069 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.070 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.070 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.070 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.070 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.070 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.070 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.070 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.070 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.070 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.071 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.071 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.071 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.071 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.071 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.071 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.071 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.071 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.071 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.071 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.071 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.072 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.072 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.072 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.072 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.072 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.072 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.073 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.073 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.073 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.073 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.073 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.073 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.074 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.074 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.074 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.074 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.075 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.075 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.075 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.075 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.075 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.075 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.076 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.076 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.076 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.076 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.076 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.076 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.077 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.077 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.077 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volumes", 2024-05-20T17:19:11.077 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.077 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.077 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.077 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.077 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.077 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.077 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.077 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.078 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.078 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.078 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.078 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.078 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.078 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.078 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.078 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.078 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.078 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.078 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.078 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.078 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.079 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.079 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.079 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.079 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.079 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.079 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.079 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.079 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.079 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.079 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.079 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.079 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.079 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.080 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.080 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.080 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.080 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.080 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.080 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.080 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.080 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.080 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.080 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.080 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.080 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.080 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.081 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.081 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.081 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.081 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.081 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.081 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.081 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.081 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.081 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.081 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.081 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.081 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.081 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.081 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.082 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.082 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.082 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.082 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.082 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.082 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.082 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.082 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.082 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.082 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.082 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_clones": { 2024-05-20T17:19:11.082 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_clones", 2024-05-20T17:19:11.082 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.082 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.083 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.083 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4", 2024-05-20T17:19:11.083 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.083 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.083 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.083 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-20T17:19:11.083 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.083 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.083 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.083 INFO:teuthology.orchestra.run.smithi006.stdout: "periodic_async_work": { 2024-05-20T17:19:11.083 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "periodic_async_work", 2024-05-20T17:19:11.083 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.083 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.084 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.084 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.084 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.084 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.084 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.084 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Periodically check for async work", 2024-05-20T17:19:11.084 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.084 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.084 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.084 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_delay": { 2024-05-20T17:19:11.084 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_delay", 2024-05-20T17:19:11.084 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.084 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.085 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.085 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-05-20T17:19:11.085 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.085 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.085 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.085 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-20T17:19:11.085 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.085 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.085 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.085 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_no_wait": { 2024-05-20T17:19:11.085 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_no_wait", 2024-05-20T17:19:11.085 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.086 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.086 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.086 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.086 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.086 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.086 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.086 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-20T17:19:11.086 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.086 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.086 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.086 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.086 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.086 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.086 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.087 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix", 2024-05-20T17:19:11.087 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.087 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.087 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.087 INFO:teuthology.orchestra.run.smithi006.stdout: "discovery_interval": { 2024-05-20T17:19:11.087 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "discovery_interval", 2024-05-20T17:19:11.087 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-05-20T17:19:11.087 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.087 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.087 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "100", 2024-05-20T17:19:11.087 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.087 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.087 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.087 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.088 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.088 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.088 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.088 INFO:teuthology.orchestra.run.smithi006.stdout: "identifier": { 2024-05-20T17:19:11.088 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "identifier", 2024-05-20T17:19:11.088 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.088 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.088 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.088 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.088 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.088 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.088 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.088 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.089 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.089 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.089 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.089 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-05-20T17:19:11.089 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-05-20T17:19:11.089 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.089 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.089 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.089 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-05-20T17:19:11.089 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.089 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.089 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.090 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.090 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.090 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.090 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.090 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.090 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.090 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.090 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.090 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.090 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.090 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.090 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.090 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.091 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.091 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.091 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.091 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.091 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.091 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.091 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.091 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.091 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.091 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.091 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.091 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.091 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.092 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.092 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.092 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.092 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.092 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.092 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.092 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.092 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.092 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.092 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.092 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.092 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.092 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.092 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.093 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.093 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.093 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.093 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.093 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.093 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.093 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.093 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.093 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.093 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.093 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.093 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.093 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.093 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.094 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.094 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.094 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.094 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.094 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.094 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.094 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.094 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.094 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.094 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.094 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.094 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.095 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.095 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.095 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.095 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.095 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.095 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.095 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_host": { 2024-05-20T17:19:11.095 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_host", 2024-05-20T17:19:11.095 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.095 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.095 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.095 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.095 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.095 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.096 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.096 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.096 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.096 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.096 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.096 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_port": { 2024-05-20T17:19:11.096 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_port", 2024-05-20T17:19:11.096 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.096 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.096 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.096 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10051", 2024-05-20T17:19:11.096 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.096 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.097 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.097 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.097 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.097 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.097 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.097 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.097 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_sender": { 2024-05-20T17:19:11.097 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_sender", 2024-05-20T17:19:11.097 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.097 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.097 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.097 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-20T17:19:11.097 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.097 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.098 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.098 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.098 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.098 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.098 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.098 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.098 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.098 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.098 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T17:19:11.098 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.098 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.098 INFO:teuthology.orchestra.run.smithi006.stdout: "modules": [ 2024-05-20T17:19:11.098 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm", 2024-05-20T17:19:11.098 INFO:teuthology.orchestra.run.smithi006.stdout: "dashboard", 2024-05-20T17:19:11.099 INFO:teuthology.orchestra.run.smithi006.stdout: "iostat", 2024-05-20T17:19:11.099 INFO:teuthology.orchestra.run.smithi006.stdout: "nfs", 2024-05-20T17:19:11.099 INFO:teuthology.orchestra.run.smithi006.stdout: "restful" 2024-05-20T17:19:11.099 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.099 INFO:teuthology.orchestra.run.smithi006.stdout: "available_modules": [ 2024-05-20T17:19:11.099 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.099 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "alerts", 2024-05-20T17:19:11.099 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.099 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.099 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.099 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-05-20T17:19:11.099 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-05-20T17:19:11.099 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.099 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.100 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.100 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-05-20T17:19:11.100 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.100 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.100 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.100 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How frequently to reexamine health status", 2024-05-20T17:19:11.100 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.100 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.100 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.100 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.100 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.100 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.100 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.101 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.101 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.101 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.101 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.101 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.101 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.101 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.101 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.101 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.101 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.101 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.101 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.101 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.101 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.102 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.102 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.102 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.102 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.102 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.102 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.102 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.102 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.102 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.102 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.102 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.102 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.102 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.102 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.103 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.103 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.103 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.103 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.103 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.103 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.103 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.103 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.103 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.103 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.103 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.103 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.104 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.104 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.104 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.104 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.104 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.104 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.104 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.104 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.104 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.104 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.104 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.104 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.104 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.104 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.105 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.105 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.105 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.105 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.105 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.105 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.105 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.105 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.105 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.105 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.105 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.105 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.105 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_destination": { 2024-05-20T17:19:11.105 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_destination", 2024-05-20T17:19:11.106 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.106 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.106 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.106 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.106 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.106 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.106 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.106 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email address to send alerts to", 2024-05-20T17:19:11.106 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.106 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.106 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.106 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.106 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_from_name": { 2024-05-20T17:19:11.106 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_from_name", 2024-05-20T17:19:11.107 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.107 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.107 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.107 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "Ceph", 2024-05-20T17:19:11.107 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.107 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.107 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.107 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email From: name", 2024-05-20T17:19:11.107 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.107 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.107 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.107 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.107 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_host": { 2024-05-20T17:19:11.107 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_host", 2024-05-20T17:19:11.108 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.108 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.108 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.108 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.108 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.108 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.108 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.108 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP server", 2024-05-20T17:19:11.108 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.108 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.108 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.108 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.108 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_password": { 2024-05-20T17:19:11.108 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_password", 2024-05-20T17:19:11.109 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.109 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.109 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.109 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.109 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.109 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.109 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.109 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Password to authenticate with", 2024-05-20T17:19:11.109 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.109 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.109 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.109 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.109 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_port": { 2024-05-20T17:19:11.109 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_port", 2024-05-20T17:19:11.110 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.110 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.110 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.110 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "465", 2024-05-20T17:19:11.110 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.110 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.110 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.110 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP port", 2024-05-20T17:19:11.110 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.110 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.110 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.110 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.110 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_sender": { 2024-05-20T17:19:11.110 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_sender", 2024-05-20T17:19:11.111 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.111 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.111 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.111 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.111 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.111 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.111 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.111 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP envelope sender", 2024-05-20T17:19:11.111 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.111 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.111 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.111 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.111 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_ssl": { 2024-05-20T17:19:11.111 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_ssl", 2024-05-20T17:19:11.112 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.112 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.112 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.112 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.112 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.112 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.112 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.112 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-20T17:19:11.112 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.112 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.112 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.112 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.112 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_user": { 2024-05-20T17:19:11.112 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_user", 2024-05-20T17:19:11.113 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.113 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.113 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.113 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.113 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.113 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.113 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.113 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "User to authenticate as", 2024-05-20T17:19:11.113 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.113 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.113 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.113 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.113 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.113 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.113 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.114 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "balancer", 2024-05-20T17:19:11.114 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.114 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.114 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.114 INFO:teuthology.orchestra.run.smithi006.stdout: "active": { 2024-05-20T17:19:11.114 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "active", 2024-05-20T17:19:11.114 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.114 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.114 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.114 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.114 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.114 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.114 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.114 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically balance PGs across cluster", 2024-05-20T17:19:11.115 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.115 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.115 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.115 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.115 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_time": { 2024-05-20T17:19:11.115 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_time", 2024-05-20T17:19:11.115 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.115 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.115 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.115 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0000", 2024-05-20T17:19:11.115 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.115 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.115 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.115 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "beginning time of day to automatically balance", 2024-05-20T17:19:11.116 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-20T17:19:11.116 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.116 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.116 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.116 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_weekday": { 2024-05-20T17:19:11.116 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_weekday", 2024-05-20T17:19:11.116 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-05-20T17:19:11.116 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.116 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.116 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-05-20T17:19:11.116 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2024-05-20T17:19:11.116 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2024-05-20T17:19:11.116 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.117 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-20T17:19:11.117 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-20T17:19:11.117 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.117 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.117 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.117 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_max_iterations": { 2024-05-20T17:19:11.117 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_max_iterations", 2024-05-20T17:19:11.117 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-05-20T17:19:11.117 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.117 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.117 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "25", 2024-05-20T17:19:11.117 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-05-20T17:19:11.117 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "250", 2024-05-20T17:19:11.117 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.118 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-20T17:19:11.118 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.118 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.118 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.118 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.118 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_metrics": { 2024-05-20T17:19:11.118 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_metrics", 2024-05-20T17:19:11.118 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.118 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.118 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.118 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "pgs,objects,bytes", 2024-05-20T17:19:11.118 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.118 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.118 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.119 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-20T17:19:11.119 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-20T17:19:11.119 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.119 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.119 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.119 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_step": { 2024-05-20T17:19:11.119 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_step", 2024-05-20T17:19:11.119 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:11.119 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.119 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.119 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.5", 2024-05-20T17:19:11.119 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0.001", 2024-05-20T17:19:11.119 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "0.999", 2024-05-20T17:19:11.119 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.120 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "aggressiveness of optimization", 2024-05-20T17:19:11.120 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-20T17:19:11.120 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.120 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.120 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.120 INFO:teuthology.orchestra.run.smithi006.stdout: "end_time": { 2024-05-20T17:19:11.120 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_time", 2024-05-20T17:19:11.120 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.120 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.120 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.120 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2359", 2024-05-20T17:19:11.120 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.120 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.120 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.121 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ending time of day to automatically balance", 2024-05-20T17:19:11.121 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-20T17:19:11.121 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.121 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.121 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.121 INFO:teuthology.orchestra.run.smithi006.stdout: "end_weekday": { 2024-05-20T17:19:11.121 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_weekday", 2024-05-20T17:19:11.121 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-05-20T17:19:11.121 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.121 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.121 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-05-20T17:19:11.121 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2024-05-20T17:19:11.121 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2024-05-20T17:19:11.121 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.122 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-20T17:19:11.122 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-20T17:19:11.122 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.122 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.122 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.122 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.122 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.122 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.122 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.122 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.122 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.122 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.122 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.123 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.123 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.123 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.123 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.123 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.123 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.123 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.123 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.123 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.123 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.123 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.123 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.123 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.123 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.124 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.124 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.124 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.124 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.124 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.124 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.124 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.124 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.124 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.124 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.124 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.124 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.124 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.124 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.125 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.125 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.125 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.125 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.125 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.125 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.125 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.125 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.125 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.125 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.125 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.125 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.125 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.125 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.126 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.126 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.126 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.126 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.126 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.126 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.126 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.126 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.126 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.126 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.126 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.126 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.126 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.126 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.127 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.127 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.127 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.127 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.127 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.127 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.127 INFO:teuthology.orchestra.run.smithi006.stdout: "min_score": { 2024-05-20T17:19:11.127 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_score", 2024-05-20T17:19:11.127 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:11.127 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.127 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.127 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-05-20T17:19:11.127 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.127 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.128 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.128 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-20T17:19:11.128 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.128 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.128 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.128 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.128 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2024-05-20T17:19:11.128 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2024-05-20T17:19:11.128 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.128 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.128 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.128 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "upmap", 2024-05-20T17:19:11.128 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.128 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.129 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.129 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-compat", 2024-05-20T17:19:11.129 INFO:teuthology.orchestra.run.smithi006.stdout: "none", 2024-05-20T17:19:11.129 INFO:teuthology.orchestra.run.smithi006.stdout: "read", 2024-05-20T17:19:11.129 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap", 2024-05-20T17:19:11.129 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap-read" 2024-05-20T17:19:11.129 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.129 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Balancer mode", 2024-05-20T17:19:11.129 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.129 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.129 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.129 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.129 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_ids": { 2024-05-20T17:19:11.129 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_ids", 2024-05-20T17:19:11.129 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.130 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.130 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.130 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.130 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.130 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.130 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.130 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-20T17:19:11.130 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.130 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.130 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.130 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.130 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-05-20T17:19:11.130 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-05-20T17:19:11.131 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.131 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.131 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.131 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-05-20T17:19:11.131 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.131 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.131 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.131 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-20T17:19:11.131 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.131 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.131 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.131 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.131 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_deviation": { 2024-05-20T17:19:11.131 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_deviation", 2024-05-20T17:19:11.132 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.132 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.132 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.132 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-05-20T17:19:11.132 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-05-20T17:19:11.132 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.132 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.132 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-20T17:19:11.132 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-20T17:19:11.132 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.132 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.132 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.132 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_optimizations": { 2024-05-20T17:19:11.132 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_optimizations", 2024-05-20T17:19:11.133 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-05-20T17:19:11.133 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.133 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.133 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:11.133 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.133 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.133 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.133 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-20T17:19:11.133 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.133 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.133 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.133 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.133 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.133 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.134 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.134 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm", 2024-05-20T17:19:11.134 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.134 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.134 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.134 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_down_multiplier": { 2024-05-20T17:19:11.134 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_down_multiplier", 2024-05-20T17:19:11.134 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:11.134 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.134 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.134 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2024-05-20T17:19:11.134 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.134 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.135 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.135 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-20T17:19:11.135 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.135 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.135 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.135 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.135 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_refresh_rate": { 2024-05-20T17:19:11.135 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_refresh_rate", 2024-05-20T17:19:11.135 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.135 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.135 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.135 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "20", 2024-05-20T17:19:11.135 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.135 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.136 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.136 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-20T17:19:11.136 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.136 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.136 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.136 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.136 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_starting_port": { 2024-05-20T17:19:11.136 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_starting_port", 2024-05-20T17:19:11.136 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.136 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.136 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.136 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4721", 2024-05-20T17:19:11.136 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.136 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.137 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.137 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-20T17:19:11.137 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.137 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.137 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.137 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_ptrace": { 2024-05-20T17:19:11.137 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_ptrace", 2024-05-20T17:19:11.137 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.137 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.137 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.137 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.137 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.137 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.138 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.138 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-20T17:19:11.138 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-20T17:19:11.138 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.138 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.138 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_interval": { 2024-05-20T17:19:11.138 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_interval", 2024-05-20T17:19:11.138 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.138 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.138 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.138 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-05-20T17:19:11.138 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.139 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.139 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.139 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-20T17:19:11.139 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.139 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.139 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.139 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.139 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_memory_target_ratio": { 2024-05-20T17:19:11.139 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_memory_target_ratio", 2024-05-20T17:19:11.139 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:11.139 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.139 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.139 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.7", 2024-05-20T17:19:11.139 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.140 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.140 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.140 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-20T17:19:11.140 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.140 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.140 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.140 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.140 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm_log_destination": { 2024-05-20T17:19:11.140 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm_log_destination", 2024-05-20T17:19:11.140 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.140 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.140 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.140 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.140 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.140 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.141 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.141 INFO:teuthology.orchestra.run.smithi006.stdout: "file", 2024-05-20T17:19:11.141 INFO:teuthology.orchestra.run.smithi006.stdout: "file,syslog", 2024-05-20T17:19:11.141 INFO:teuthology.orchestra.run.smithi006.stdout: "syslog" 2024-05-20T17:19:11.141 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.141 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-20T17:19:11.141 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.141 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.141 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.141 INFO:teuthology.orchestra.run.smithi006.stdout: "cgroups_split": { 2024-05-20T17:19:11.141 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cgroups_split", 2024-05-20T17:19:11.141 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.141 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.142 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.142 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.142 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.142 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.142 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.142 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-20T17:19:11.142 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.142 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.142 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.142 INFO:teuthology.orchestra.run.smithi006.stdout: "config_checks_enabled": { 2024-05-20T17:19:11.142 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_checks_enabled", 2024-05-20T17:19:11.142 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.142 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.143 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.143 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.143 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.143 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.143 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.143 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-20T17:19:11.143 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.143 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.143 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.143 INFO:teuthology.orchestra.run.smithi006.stdout: "config_dashboard": { 2024-05-20T17:19:11.143 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_dashboard", 2024-05-20T17:19:11.143 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.143 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.144 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.144 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.144 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.144 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.144 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.144 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-20T17:19:11.144 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.144 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.144 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.144 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_alertmanager": { 2024-05-20T17:19:11.144 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_alertmanager", 2024-05-20T17:19:11.144 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.144 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.145 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.145 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-20T17:19:11.145 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.145 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.145 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.145 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-05-20T17:19:11.145 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.145 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.145 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.145 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_base": { 2024-05-20T17:19:11.145 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_base", 2024-05-20T17:19:11.145 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.145 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.145 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.146 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-20T17:19:11.146 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.146 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.146 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.146 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Container image name, without the tag", 2024-05-20T17:19:11.146 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.146 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.146 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.146 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_elasticsearch": { 2024-05-20T17:19:11.146 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_elasticsearch", 2024-05-20T17:19:11.146 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.146 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.147 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.147 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-20T17:19:11.147 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.147 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.147 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.147 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "elasticsearch container image", 2024-05-20T17:19:11.147 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.147 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.147 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.147 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_grafana": { 2024-05-20T17:19:11.147 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_grafana", 2024-05-20T17:19:11.147 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.147 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.148 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.148 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-20T17:19:11.148 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.148 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.148 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.148 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-05-20T17:19:11.148 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.148 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.148 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.148 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_haproxy": { 2024-05-20T17:19:11.148 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_haproxy", 2024-05-20T17:19:11.148 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.148 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.149 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.149 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-20T17:19:11.149 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.149 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.149 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.149 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "HAproxy container image", 2024-05-20T17:19:11.149 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.149 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.149 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.149 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_agent": { 2024-05-20T17:19:11.149 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_agent", 2024-05-20T17:19:11.149 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.149 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.150 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.150 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-20T17:19:11.150 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.150 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.150 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.150 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger agent container image", 2024-05-20T17:19:11.150 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.150 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.150 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.150 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_collector": { 2024-05-20T17:19:11.150 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_collector", 2024-05-20T17:19:11.150 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.151 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.151 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.151 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-20T17:19:11.151 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.151 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.151 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.151 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger collector container image", 2024-05-20T17:19:11.151 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.151 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.151 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.151 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_query": { 2024-05-20T17:19:11.151 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_query", 2024-05-20T17:19:11.151 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.152 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.152 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.152 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-20T17:19:11.152 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.152 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.152 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.152 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger query container image", 2024-05-20T17:19:11.152 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.152 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.152 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.152 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_keepalived": { 2024-05-20T17:19:11.152 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_keepalived", 2024-05-20T17:19:11.152 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.153 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.153 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.153 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-20T17:19:11.153 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.153 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.153 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.153 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Keepalived container image", 2024-05-20T17:19:11.153 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.153 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.153 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.153 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.153 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_loki": { 2024-05-20T17:19:11.153 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_loki", 2024-05-20T17:19:11.153 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.153 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.154 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.154 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-20T17:19:11.154 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.154 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.154 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.154 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Loki container image", 2024-05-20T17:19:11.154 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.154 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.154 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.154 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_node_exporter": { 2024-05-20T17:19:11.154 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_node_exporter", 2024-05-20T17:19:11.154 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.155 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.155 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.155 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-20T17:19:11.155 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.155 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.155 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.155 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-05-20T17:19:11.155 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.155 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.155 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.155 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_nvmeof": { 2024-05-20T17:19:11.155 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_nvmeof", 2024-05-20T17:19:11.155 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.156 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.156 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.156 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-20T17:19:11.156 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.156 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.156 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.156 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Nvme-of container image", 2024-05-20T17:19:11.156 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.156 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.156 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.156 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_prometheus": { 2024-05-20T17:19:11.156 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_prometheus", 2024-05-20T17:19:11.156 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.157 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.157 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.157 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-20T17:19:11.157 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.157 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.157 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.157 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2024-05-20T17:19:11.157 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.157 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.157 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.157 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_promtail": { 2024-05-20T17:19:11.157 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_promtail", 2024-05-20T17:19:11.157 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.157 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.158 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.158 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-20T17:19:11.158 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.158 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.158 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.158 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Promtail container image", 2024-05-20T17:19:11.158 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.158 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.158 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.158 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_samba": { 2024-05-20T17:19:11.158 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_samba", 2024-05-20T17:19:11.158 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.158 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.159 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.159 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-20T17:19:11.159 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.159 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.159 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.159 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Samba/SMB container image", 2024-05-20T17:19:11.159 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.159 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.159 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.159 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_snmp_gateway": { 2024-05-20T17:19:11.159 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_snmp_gateway", 2024-05-20T17:19:11.159 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.159 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.160 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.160 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-20T17:19:11.160 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.160 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.160 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.160 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SNMP Gateway container image", 2024-05-20T17:19:11.160 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.160 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.160 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.160 INFO:teuthology.orchestra.run.smithi006.stdout: "container_init": { 2024-05-20T17:19:11.160 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_init", 2024-05-20T17:19:11.160 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.161 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.161 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.161 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.161 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.161 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.161 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.161 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Run podman/docker with `--init`", 2024-05-20T17:19:11.161 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.161 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.161 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.161 INFO:teuthology.orchestra.run.smithi006.stdout: "daemon_cache_timeout": { 2024-05-20T17:19:11.161 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "daemon_cache_timeout", 2024-05-20T17:19:11.161 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.162 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.162 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.162 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-05-20T17:19:11.162 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.162 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.162 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.162 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-20T17:19:11.162 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.162 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.162 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.162 INFO:teuthology.orchestra.run.smithi006.stdout: "default_cephadm_command_timeout": { 2024-05-20T17:19:11.162 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_cephadm_command_timeout", 2024-05-20T17:19:11.162 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.163 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.163 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.163 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "900", 2024-05-20T17:19:11.163 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.163 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.163 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.163 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-20T17:19:11.163 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.163 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.163 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.163 INFO:teuthology.orchestra.run.smithi006.stdout: "default_registry": { 2024-05-20T17:19:11.163 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_registry", 2024-05-20T17:19:11.163 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.164 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.164 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.164 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io", 2024-05-20T17:19:11.164 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.164 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.164 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.164 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-20T17:19:11.164 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.164 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.164 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.164 INFO:teuthology.orchestra.run.smithi006.stdout: "device_cache_timeout": { 2024-05-20T17:19:11.164 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_cache_timeout", 2024-05-20T17:19:11.165 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.165 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.165 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.165 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1800", 2024-05-20T17:19:11.165 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.165 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.165 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.165 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache device inventory", 2024-05-20T17:19:11.165 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.165 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.165 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.165 INFO:teuthology.orchestra.run.smithi006.stdout: "device_enhanced_scan": { 2024-05-20T17:19:11.165 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_enhanced_scan", 2024-05-20T17:19:11.166 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.166 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.166 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.166 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.166 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.166 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.166 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.166 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-20T17:19:11.166 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.166 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.166 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.166 INFO:teuthology.orchestra.run.smithi006.stdout: "facts_cache_timeout": { 2024-05-20T17:19:11.166 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "facts_cache_timeout", 2024-05-20T17:19:11.167 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.167 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.167 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.167 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-05-20T17:19:11.167 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.167 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.167 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.167 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache host facts data", 2024-05-20T17:19:11.167 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.167 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.167 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.167 INFO:teuthology.orchestra.run.smithi006.stdout: "grafana_dashboards_path": { 2024-05-20T17:19:11.167 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "grafana_dashboards_path", 2024-05-20T17:19:11.168 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.168 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.168 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.168 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-20T17:19:11.168 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.168 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.168 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.168 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-20T17:19:11.168 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.168 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.168 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.168 INFO:teuthology.orchestra.run.smithi006.stdout: "host_check_interval": { 2024-05-20T17:19:11.168 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "host_check_interval", 2024-05-20T17:19:11.169 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.169 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.169 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.169 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-05-20T17:19:11.169 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.169 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.169 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.169 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to perform a host check", 2024-05-20T17:19:11.169 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.169 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.169 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.169 INFO:teuthology.orchestra.run.smithi006.stdout: "hw_monitoring": { 2024-05-20T17:19:11.169 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hw_monitoring", 2024-05-20T17:19:11.170 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.170 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.170 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.170 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.170 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.170 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.170 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.170 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-20T17:19:11.170 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.170 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.170 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.170 INFO:teuthology.orchestra.run.smithi006.stdout: "inventory_list_all": { 2024-05-20T17:19:11.171 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "inventory_list_all", 2024-05-20T17:19:11.171 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.171 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.171 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.171 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.171 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.171 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.171 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.171 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-20T17:19:11.171 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.171 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.171 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.171 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.171 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.172 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.172 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.172 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.172 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.172 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.172 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.172 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.172 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.172 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.172 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.172 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.172 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.172 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.172 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.173 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.173 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.173 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.173 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.173 INFO:teuthology.orchestra.run.smithi006.stdout: "log_refresh_metadata": { 2024-05-20T17:19:11.173 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_refresh_metadata", 2024-05-20T17:19:11.173 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.173 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.173 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.173 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.173 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.173 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.173 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.174 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-20T17:19:11.174 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.174 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.174 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.174 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.174 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.174 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.174 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.174 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.174 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.174 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.174 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.174 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.175 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-20T17:19:11.175 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.175 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.175 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.175 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.175 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.175 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.175 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.175 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.175 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.175 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.175 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.176 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.176 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.176 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.176 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.176 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.176 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.176 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.176 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.176 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.176 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.176 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.176 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.176 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.177 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.177 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.177 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.177 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.177 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.177 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.177 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.177 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.177 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.177 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.177 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.177 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.177 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-20T17:19:11.178 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-20T17:19:11.178 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.178 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.178 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.178 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.178 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.178 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.178 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.178 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-20T17:19:11.178 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.178 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.178 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.178 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-20T17:19:11.179 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-20T17:19:11.179 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.179 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.179 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.179 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "*", 2024-05-20T17:19:11.179 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.179 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.179 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.179 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-20T17:19:11.179 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.179 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.179 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.180 INFO:teuthology.orchestra.run.smithi006.stdout: "max_count_per_host": { 2024-05-20T17:19:11.180 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_count_per_host", 2024-05-20T17:19:11.180 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.180 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.180 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.180 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:11.180 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.180 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.180 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.180 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of daemons per service per host", 2024-05-20T17:19:11.180 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.180 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.180 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.181 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd_draining_count": { 2024-05-20T17:19:11.181 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_osd_draining_count", 2024-05-20T17:19:11.181 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.181 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.181 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.181 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:11.181 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.181 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.181 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.181 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-20T17:19:11.181 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.181 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.181 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.182 INFO:teuthology.orchestra.run.smithi006.stdout: "migration_current": { 2024-05-20T17:19:11.182 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "migration_current", 2024-05-20T17:19:11.182 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.182 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.182 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.182 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.182 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.182 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.182 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.182 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "internal - do not modify", 2024-05-20T17:19:11.182 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.182 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.182 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.183 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2024-05-20T17:19:11.183 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2024-05-20T17:19:11.183 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.183 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.183 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.183 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "root", 2024-05-20T17:19:11.183 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.183 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.183 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.183 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm-package", 2024-05-20T17:19:11.183 INFO:teuthology.orchestra.run.smithi006.stdout: "root" 2024-05-20T17:19:11.183 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.183 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "mode for remote execution of cephadm", 2024-05-20T17:19:11.184 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.184 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.184 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.184 INFO:teuthology.orchestra.run.smithi006.stdout: "oob_default_addr": { 2024-05-20T17:19:11.184 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "oob_default_addr", 2024-05-20T17:19:11.184 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.184 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.184 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.184 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "169.254.1.1", 2024-05-20T17:19:11.184 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.184 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.184 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.184 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-20T17:19:11.185 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.185 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.185 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.185 INFO:teuthology.orchestra.run.smithi006.stdout: "prometheus_alerts_path": { 2024-05-20T17:19:11.185 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus_alerts_path", 2024-05-20T17:19:11.185 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.185 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.185 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.185 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-20T17:19:11.185 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.185 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.185 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.185 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-20T17:19:11.186 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.186 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.186 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.186 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_insecure": { 2024-05-20T17:19:11.186 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_insecure", 2024-05-20T17:19:11.186 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.186 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.186 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.186 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.186 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.186 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.186 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.187 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-20T17:19:11.187 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.187 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.187 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.187 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_password": { 2024-05-20T17:19:11.187 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_password", 2024-05-20T17:19:11.187 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.187 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.187 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.187 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.187 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.187 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.187 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.188 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-20T17:19:11.188 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.188 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.188 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.188 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_url": { 2024-05-20T17:19:11.188 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_url", 2024-05-20T17:19:11.188 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.188 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.188 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.188 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.188 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.188 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.188 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.188 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-20T17:19:11.189 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.189 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.189 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.189 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_username": { 2024-05-20T17:19:11.189 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_username", 2024-05-20T17:19:11.189 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.189 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.189 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.189 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.189 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.189 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.189 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.190 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-20T17:19:11.190 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.190 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.190 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.190 INFO:teuthology.orchestra.run.smithi006.stdout: "secure_monitoring_stack": { 2024-05-20T17:19:11.190 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "secure_monitoring_stack", 2024-05-20T17:19:11.190 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.190 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.190 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.190 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.190 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.190 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.190 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.191 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-20T17:19:11.191 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.191 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.191 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.191 INFO:teuthology.orchestra.run.smithi006.stdout: "service_discovery_port": { 2024-05-20T17:19:11.191 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "service_discovery_port", 2024-05-20T17:19:11.191 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.191 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.191 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.191 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8765", 2024-05-20T17:19:11.191 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.191 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.192 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.192 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "cephadm service discovery port", 2024-05-20T17:19:11.192 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.192 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.192 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.192 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_config_file": { 2024-05-20T17:19:11.192 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_config_file", 2024-05-20T17:19:11.192 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.192 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.192 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.192 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.192 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.192 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.193 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.193 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-20T17:19:11.193 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.193 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.193 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.193 INFO:teuthology.orchestra.run.smithi006.stdout: "use_agent": { 2024-05-20T17:19:11.193 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_agent", 2024-05-20T17:19:11.193 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.193 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.193 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.193 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.193 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.193 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.194 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.194 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-20T17:19:11.194 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.194 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.194 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.194 INFO:teuthology.orchestra.run.smithi006.stdout: "use_repo_digest": { 2024-05-20T17:19:11.194 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_repo_digest", 2024-05-20T17:19:11.194 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.194 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.194 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.194 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.194 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.194 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.195 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.195 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-20T17:19:11.195 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.195 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.195 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.195 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_failed_host_check": { 2024-05-20T17:19:11.195 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_failed_host_check", 2024-05-20T17:19:11.195 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.195 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.195 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.195 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.195 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.195 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.196 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.196 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if the host check fails", 2024-05-20T17:19:11.196 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.196 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.196 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.196 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_daemons": { 2024-05-20T17:19:11.196 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_daemons", 2024-05-20T17:19:11.196 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.196 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.196 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.196 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.196 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.196 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.197 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.197 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-20T17:19:11.197 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.197 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.197 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.197 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_hosts": { 2024-05-20T17:19:11.197 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_hosts", 2024-05-20T17:19:11.197 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.197 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.197 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.197 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.197 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.197 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.198 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.198 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-20T17:19:11.198 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.198 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.198 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.198 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.198 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.198 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crash", 2024-05-20T17:19:11.198 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.198 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.198 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.198 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.199 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.199 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.199 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.199 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.199 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.199 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.199 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.199 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.199 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.199 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.199 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.199 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.199 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.199 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.200 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.200 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.200 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.200 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.200 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.200 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.200 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.200 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.200 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.200 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.200 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.200 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.200 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.201 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.201 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.201 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.201 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.201 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.201 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.201 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.201 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.201 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.201 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.201 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.201 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.201 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.202 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.202 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.202 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.202 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.202 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.202 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.202 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.202 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.202 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.202 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.202 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.202 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.203 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.203 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.203 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.203 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.203 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.203 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.203 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.203 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.203 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.203 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.203 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.203 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.203 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.204 INFO:teuthology.orchestra.run.smithi006.stdout: "retain_interval": { 2024-05-20T17:19:11.204 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retain_interval", 2024-05-20T17:19:11.204 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.204 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.204 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.204 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "31536000", 2024-05-20T17:19:11.204 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.204 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.204 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.204 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-20T17:19:11.204 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.204 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.204 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.204 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_recent_interval": { 2024-05-20T17:19:11.205 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_recent_interval", 2024-05-20T17:19:11.205 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.205 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.205 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.205 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1209600", 2024-05-20T17:19:11.205 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.205 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.205 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.205 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-20T17:19:11.205 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.205 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.205 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.205 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.205 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.206 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.206 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dashboard", 2024-05-20T17:19:11.206 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.206 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.206 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.206 INFO:teuthology.orchestra.run.smithi006.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-20T17:19:11.206 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-20T17:19:11.206 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.206 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.206 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.206 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:11.206 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.207 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.207 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.207 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.207 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.207 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.207 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.207 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_HOST": { 2024-05-20T17:19:11.207 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-20T17:19:11.207 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.207 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.207 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.207 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.207 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.208 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.208 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.208 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.208 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.208 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.208 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.208 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-20T17:19:11.208 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-20T17:19:11.208 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.208 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.208 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.208 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.208 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.209 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.209 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.209 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.209 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.209 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.209 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.209 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_ENABLED": { 2024-05-20T17:19:11.209 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_ENABLED", 2024-05-20T17:19:11.209 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.209 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.209 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.209 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.209 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.210 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.210 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.210 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.210 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.210 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.210 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.210 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-20T17:19:11.210 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-20T17:19:11.210 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.210 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.210 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.210 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.210 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.211 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.211 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.211 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.211 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.211 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.211 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.211 INFO:teuthology.orchestra.run.smithi006.stdout: "ENABLE_BROWSABLE_API": { 2024-05-20T17:19:11.211 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-20T17:19:11.211 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.211 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.211 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.211 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.211 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.212 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.212 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.212 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.212 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.212 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.212 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.212 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-20T17:19:11.212 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-20T17:19:11.212 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.212 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.212 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.212 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.213 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.213 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.213 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.213 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.213 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.213 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.213 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.213 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-20T17:19:11.213 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-20T17:19:11.213 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.213 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.213 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.213 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.214 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.214 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.214 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.214 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.214 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.214 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.214 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.214 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-20T17:19:11.214 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-20T17:19:11.214 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.214 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.214 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.214 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.215 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.215 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.215 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.215 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.215 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.215 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.215 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.215 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-20T17:19:11.215 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-20T17:19:11.215 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.215 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.215 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.215 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.216 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.216 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.216 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.216 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.216 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.216 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.216 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.216 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-20T17:19:11.216 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-20T17:19:11.216 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.216 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.216 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.216 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.217 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.217 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.217 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.217 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.217 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.217 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.217 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.217 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-20T17:19:11.217 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-20T17:19:11.217 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.217 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.217 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.217 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.218 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.218 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.218 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.218 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.218 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.218 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.218 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.218 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-20T17:19:11.218 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-20T17:19:11.218 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.218 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.218 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.218 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.219 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.219 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.219 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.219 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.219 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.219 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.219 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.219 INFO:teuthology.orchestra.run.smithi006.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-20T17:19:11.219 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-20T17:19:11.219 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.219 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.219 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.219 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.220 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.220 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.220 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.220 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.220 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.220 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.220 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.220 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_PASSWORD": { 2024-05-20T17:19:11.220 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-20T17:19:11.220 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.220 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.220 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.220 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-05-20T17:19:11.221 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.221 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.221 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.221 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.221 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.221 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.221 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.221 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-20T17:19:11.221 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-20T17:19:11.221 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.221 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.221 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.221 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.222 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.222 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.222 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.222 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.222 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.222 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.222 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.222 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_URL": { 2024-05-20T17:19:11.222 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_URL", 2024-05-20T17:19:11.222 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.222 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.222 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.222 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.223 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.223 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.223 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.223 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.223 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.223 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.223 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.223 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_USERNAME": { 2024-05-20T17:19:11.223 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-20T17:19:11.223 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.223 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.223 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.224 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-05-20T17:19:11.224 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.224 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.224 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.224 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.224 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.224 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.224 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.224 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-20T17:19:11.224 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-20T17:19:11.224 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.224 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.224 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.225 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.225 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.225 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.225 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.225 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.225 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.225 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.225 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.225 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-20T17:19:11.225 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-20T17:19:11.225 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.225 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.225 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.226 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.226 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.226 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.226 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.226 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.226 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.226 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.226 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.226 INFO:teuthology.orchestra.run.smithi006.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-20T17:19:11.226 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-20T17:19:11.226 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.226 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.227 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.227 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.227 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.227 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.227 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.227 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.227 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.227 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.227 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.227 INFO:teuthology.orchestra.run.smithi006.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-20T17:19:11.227 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-20T17:19:11.227 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.227 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.228 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.228 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.228 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.228 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.228 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.228 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.228 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.228 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.228 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.228 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_HOST": { 2024-05-20T17:19:11.228 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-20T17:19:11.228 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.228 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.229 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.229 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.229 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.229 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.229 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.229 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.229 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.229 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.229 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.229 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-20T17:19:11.229 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-20T17:19:11.229 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.229 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.230 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.230 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.230 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.230 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.230 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.230 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.230 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.230 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.230 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.230 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-20T17:19:11.230 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-20T17:19:11.230 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.231 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.231 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.231 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.231 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.231 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.231 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.231 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.231 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.231 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.231 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.231 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-20T17:19:11.231 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-20T17:19:11.231 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.232 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.232 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.232 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.232 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.232 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.232 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.232 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.232 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.232 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.232 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.232 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-20T17:19:11.232 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-20T17:19:11.232 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.233 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.233 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.233 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.233 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.233 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.233 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.233 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.233 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.233 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.233 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.233 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-20T17:19:11.233 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-20T17:19:11.233 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.234 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.234 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.234 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.234 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.234 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.234 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.234 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.234 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.234 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.234 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.234 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-20T17:19:11.234 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-20T17:19:11.234 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.235 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.235 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.235 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.235 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.235 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.235 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.235 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.235 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.235 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.235 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.235 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-20T17:19:11.235 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-20T17:19:11.235 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.236 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.236 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.236 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.236 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.236 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.236 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.236 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.236 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.236 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.236 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.236 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.236 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-20T17:19:11.236 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-20T17:19:11.236 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.237 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.237 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.237 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.237 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.237 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.237 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.237 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.237 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.237 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.237 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.237 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_ENABLED": { 2024-05-20T17:19:11.237 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-20T17:19:11.237 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.237 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.238 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.238 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.238 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.238 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.238 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.238 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.238 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.238 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.238 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.238 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-20T17:19:11.238 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-20T17:19:11.238 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-20T17:19:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-20T17:19:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-20T17:19:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-20T17:19:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-20T17:19:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8", 2024-05-20T17:19:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-20T17:19:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-20T17:19:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "45", 2024-05-20T17:19:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ACCESS_KEY": { 2024-05-20T17:19:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-20T17:19:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-20T17:19:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-20T17:19:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2024-05-20T17:19:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SECRET_KEY": { 2024-05-20T17:19:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-20T17:19:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SSL_VERIFY": { 2024-05-20T17:19:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-20T17:19:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-20T17:19:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-20T17:19:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-05-20T17:19:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-20T17:19:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-20T17:19:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-20T17:19:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-20T17:19:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-05-20T17:19:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "cross_origin_url": { 2024-05-20T17:19:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cross_origin_url", 2024-05-20T17:19:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "crt_file": { 2024-05-20T17:19:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crt_file", 2024-05-20T17:19:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "debug": { 2024-05-20T17:19:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "debug", 2024-05-20T17:19:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable/disable debug options", 2024-05-20T17:19:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "jwt_token_ttl": { 2024-05-20T17:19:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "jwt_token_ttl", 2024-05-20T17:19:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "28800", 2024-05-20T17:19:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2024-05-20T17:19:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2024-05-20T17:19:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "motd": { 2024-05-20T17:19:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "motd", 2024-05-20T17:19:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "The message of the day", 2024-05-20T17:19:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect_resolve_ip_addr": { 2024-05-20T17:19:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "redirect_resolve_ip_addr", 2024-05-20T17:19:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-05-20T17:19:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-05-20T17:19:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2024-05-20T17:19:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-05-20T17:19:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-05-20T17:19:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8080", 2024-05-20T17:19:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2024-05-20T17:19:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2024-05-20T17:19:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl_server_port": { 2024-05-20T17:19:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl_server_port", 2024-05-20T17:19:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8443", 2024-05-20T17:19:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2024-05-20T17:19:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2024-05-20T17:19:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "redirect", 2024-05-20T17:19:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect" 2024-05-20T17:19:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2024-05-20T17:19:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2024-05-20T17:19:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-05-20T17:19:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2024-05-20T17:19:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2024-05-20T17:19:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "url_prefix": { 2024-05-20T17:19:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url_prefix", 2024-05-20T17:19:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "devicehealth", 2024-05-20T17:19:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_monitoring": { 2024-05-20T17:19:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_monitoring", 2024-05-20T17:19:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "monitor device health metrics", 2024-05-20T17:19:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "mark_out_threshold": { 2024-05-20T17:19:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mark_out_threshold", 2024-05-20T17:19:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2419200", 2024-05-20T17:19:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-20T17:19:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": { 2024-05-20T17:19:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_name", 2024-05-20T17:19:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "device_health_metrics", 2024-05-20T17:19:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-20T17:19:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: "retention_period": { 2024-05-20T17:19:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retention_period", 2024-05-20T17:19:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15552000", 2024-05-20T17:19:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain device health metrics", 2024-05-20T17:19:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_frequency": { 2024-05-20T17:19:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_frequency", 2024-05-20T17:19:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2024-05-20T17:19:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-20T17:19:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: "self_heal": { 2024-05-20T17:19:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "self_heal", 2024-05-20T17:19:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-20T17:19:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-05-20T17:19:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-05-20T17:19:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-05-20T17:19:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and check device health", 2024-05-20T17:19:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_threshold": { 2024-05-20T17:19:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_threshold", 2024-05-20T17:19:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7257600", 2024-05-20T17:19:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-20T17:19:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "diskprediction_local", 2024-05-20T17:19:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: "predict_interval": { 2024-05-20T17:19:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predict_interval", 2024-05-20T17:19:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2024-05-20T17:19:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: "predictor_model": { 2024-05-20T17:19:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predictor_model", 2024-05-20T17:19:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "prophetstor", 2024-05-20T17:19:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-05-20T17:19:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-05-20T17:19:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2024-05-20T17:19:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "influx", 2024-05-20T17:19:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": false, 2024-05-20T17:19:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "influxdb python module not found", 2024-05-20T17:19:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "batch_size": { 2024-05-20T17:19:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "batch_size", 2024-05-20T17:19:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5000", 2024-05-20T17:19:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-20T17:19:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: "database": { 2024-05-20T17:19:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "database", 2024-05-20T17:19:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "ceph", 2024-05-20T17:19:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-20T17:19:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": { 2024-05-20T17:19:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hostname", 2024-05-20T17:19:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server hostname", 2024-05-20T17:19:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-05-20T17:19:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-05-20T17:19:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "30", 2024-05-20T17:19:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "5", 2024-05-20T17:19:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-20T17:19:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.298 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.298 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.298 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.298 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.298 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.298 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.298 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.298 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.298 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.302 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.302 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.302 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.302 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.302 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.302 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.302 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.302 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: "password": { 2024-05-20T17:19:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "password", 2024-05-20T17:19:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "password of InfluxDB server user", 2024-05-20T17:19:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "port": { 2024-05-20T17:19:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "port", 2024-05-20T17:19:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8086", 2024-05-20T17:19:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server port", 2024-05-20T17:19:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2024-05-20T17:19:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2024-05-20T17:19:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "false", 2024-05-20T17:19:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-20T17:19:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: "threads": { 2024-05-20T17:19:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threads", 2024-05-20T17:19:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-05-20T17:19:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-05-20T17:19:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "32", 2024-05-20T17:19:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-20T17:19:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: "username": { 2024-05-20T17:19:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "username", 2024-05-20T17:19:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "username of InfluxDB server user", 2024-05-20T17:19:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: "verify_ssl": { 2024-05-20T17:19:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "verify_ssl", 2024-05-20T17:19:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "true", 2024-05-20T17:19:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-20T17:19:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "insights", 2024-05-20T17:19:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "iostat", 2024-05-20T17:19:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.318 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.318 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.318 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.318 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.318 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.318 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.318 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.318 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "k8sevents", 2024-05-20T17:19:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_event_retention_days": { 2024-05-20T17:19:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ceph_event_retention_days", 2024-05-20T17:19:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7", 2024-05-20T17:19:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-20T17:19:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.326 INFO:teuthology.orchestra.run.smithi006.stdout: "config_check_secs": { 2024-05-20T17:19:11.326 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_check_secs", 2024-05-20T17:19:11.326 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.326 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.326 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.326 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:11.326 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "10", 2024-05-20T17:19:11.326 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.326 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.326 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-20T17:19:11.326 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.327 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.327 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.327 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.327 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.327 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.327 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.327 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.327 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.327 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.329 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.329 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.330 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.330 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.330 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.330 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.330 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.330 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.330 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.330 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.330 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.330 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.330 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.331 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.331 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.331 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.331 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.331 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.332 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.332 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.332 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.332 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.332 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.332 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.332 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.332 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.332 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.332 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.332 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.332 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.333 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.333 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.333 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.333 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.333 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.333 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.333 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.333 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.333 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.333 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.333 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.334 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.334 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.334 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.334 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.334 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.334 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.334 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.334 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.334 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.334 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.334 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.335 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.335 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.335 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.335 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.335 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.335 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.335 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.335 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.335 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.335 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "localpool", 2024-05-20T17:19:11.336 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.336 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.336 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.336 INFO:teuthology.orchestra.run.smithi006.stdout: "failure_domain": { 2024-05-20T17:19:11.336 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "failure_domain", 2024-05-20T17:19:11.336 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.337 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.337 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.337 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "host", 2024-05-20T17:19:11.337 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.337 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.337 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.337 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "failure domain for any created local pool", 2024-05-20T17:19:11.337 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-20T17:19:11.337 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.338 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.338 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.338 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.338 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.338 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.338 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.338 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.338 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.339 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.339 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.339 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.339 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.339 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.339 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.339 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.339 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.339 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.339 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.339 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.339 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.339 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.340 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.340 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.340 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.340 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.340 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.340 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.340 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.340 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.341 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.341 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.341 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.341 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.341 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.342 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.342 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.342 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.342 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.342 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.342 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.342 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.342 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.343 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.343 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.343 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.343 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.343 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.343 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.343 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.343 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.343 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.344 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.344 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.344 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.344 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.344 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.344 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.344 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.344 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.344 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.344 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.344 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.344 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.345 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.345 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.345 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.345 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.345 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": { 2024-05-20T17:19:11.345 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_size", 2024-05-20T17:19:11.345 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.345 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.345 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.345 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.345 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.345 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.345 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.346 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default min_size for any created local pool", 2024-05-20T17:19:11.346 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-20T17:19:11.346 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.346 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.346 INFO:teuthology.orchestra.run.smithi006.stdout: "num_rep": { 2024-05-20T17:19:11.346 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "num_rep", 2024-05-20T17:19:11.346 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.346 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.346 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.346 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3", 2024-05-20T17:19:11.346 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.346 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.347 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.347 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default replica count for any created local pool", 2024-05-20T17:19:11.347 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.347 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.347 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.347 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": { 2024-05-20T17:19:11.347 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_num", 2024-05-20T17:19:11.347 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.347 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.348 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.348 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "128", 2024-05-20T17:19:11.348 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.348 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.348 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.348 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default pg_num for any created local pool", 2024-05-20T17:19:11.349 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.349 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.349 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.349 INFO:teuthology.orchestra.run.smithi006.stdout: "prefix": { 2024-05-20T17:19:11.349 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prefix", 2024-05-20T17:19:11.349 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.349 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.349 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.349 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.349 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.349 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.349 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.350 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name prefix for any created local pool", 2024-05-20T17:19:11.350 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.350 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.350 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.350 INFO:teuthology.orchestra.run.smithi006.stdout: "subtree": { 2024-05-20T17:19:11.350 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "subtree", 2024-05-20T17:19:11.350 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.350 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.350 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.350 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "rack", 2024-05-20T17:19:11.350 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.350 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.351 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.351 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-20T17:19:11.351 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-20T17:19:11.351 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.351 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.351 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.351 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.351 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mds_autoscaler", 2024-05-20T17:19:11.351 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.351 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.351 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.351 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.352 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.352 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.352 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.352 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.352 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.352 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.352 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.352 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.352 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.352 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.352 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.353 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.353 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.353 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.353 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.353 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.353 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.353 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.354 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.354 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.354 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.354 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.354 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.354 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.354 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.354 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.354 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.355 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.355 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.355 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.355 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.355 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.355 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.355 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.355 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.355 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.355 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.355 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.355 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.355 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.356 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.356 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.356 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.356 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.356 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.356 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.356 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.356 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.356 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.356 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.356 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.356 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.357 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.357 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.357 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.357 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.357 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.357 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.357 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.357 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.357 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.357 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.357 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.357 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.357 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.357 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.358 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.358 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirroring", 2024-05-20T17:19:11.358 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.358 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.358 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.358 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.358 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.358 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.358 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.358 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.358 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.359 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.359 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.359 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.359 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.359 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.359 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.359 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.360 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.360 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.360 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.360 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.360 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.360 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.361 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.361 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.361 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.361 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.362 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.362 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.362 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.362 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.362 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.362 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.362 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.363 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.363 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.363 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.363 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.363 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.364 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.364 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.364 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.364 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.364 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.364 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.364 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.365 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.365 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.365 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.365 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.365 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.365 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.365 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.365 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.365 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.365 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.365 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.365 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.365 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.366 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.366 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.366 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.366 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.366 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.366 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.366 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.366 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.366 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.366 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.366 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.366 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.367 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.367 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "nfs", 2024-05-20T17:19:11.367 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.367 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.367 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.367 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.367 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.367 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.367 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.367 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.367 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.367 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.368 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.368 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.368 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.368 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.368 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.368 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.368 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.368 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.368 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.368 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.368 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.368 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.368 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.369 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.369 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.369 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.369 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.369 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.369 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.369 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.369 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.369 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.369 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.369 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.369 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.369 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.370 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.370 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.370 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.370 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.370 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.370 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.370 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.370 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.370 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.370 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.370 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.370 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.370 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.371 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.371 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.371 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.371 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.371 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.371 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.371 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.371 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.371 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.371 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.371 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.371 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.371 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.372 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.372 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.372 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.372 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.372 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.372 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.372 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.372 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.372 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.372 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2024-05-20T17:19:11.373 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.373 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.373 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.373 INFO:teuthology.orchestra.run.smithi006.stdout: "fail_fs": { 2024-05-20T17:19:11.373 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "fail_fs", 2024-05-20T17:19:11.373 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.373 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.373 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.373 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.373 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.373 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.374 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.374 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-20T17:19:11.374 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.374 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.374 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.374 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.375 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.375 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.375 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.375 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.375 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.375 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.375 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.375 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.375 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.375 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.375 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.376 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.376 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.376 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.376 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.376 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.376 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.376 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.376 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.377 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.377 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.377 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.377 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.377 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.377 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.377 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.377 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.377 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.377 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.377 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.377 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.378 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.378 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.378 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.378 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.378 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.378 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.378 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.378 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.378 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.378 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.378 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.379 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.379 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.379 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.379 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.379 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.379 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.379 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.379 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.379 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.379 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.379 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.379 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.380 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.380 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.380 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.380 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.380 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.380 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.380 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.380 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.380 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.380 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.380 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.381 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator": { 2024-05-20T17:19:11.381 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2024-05-20T17:19:11.381 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.381 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.381 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.382 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.382 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.382 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.382 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.382 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm", 2024-05-20T17:19:11.382 INFO:teuthology.orchestra.run.smithi006.stdout: "rook", 2024-05-20T17:19:11.383 INFO:teuthology.orchestra.run.smithi006.stdout: "test_orchestrator" 2024-05-20T17:19:11.383 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.383 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Orchestrator backend", 2024-05-20T17:19:11.383 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.383 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.383 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.384 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.384 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.384 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_perf_query", 2024-05-20T17:19:11.384 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.384 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.385 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.385 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.385 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.385 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.385 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.385 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.386 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.386 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.386 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.386 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.386 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.386 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.387 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.387 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.387 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.387 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.387 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.387 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.388 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.388 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.388 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.388 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.388 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.389 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.389 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.389 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.389 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.389 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.389 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.390 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.390 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.390 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.390 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.390 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.391 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.391 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.391 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.391 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.391 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.392 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.392 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.392 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.392 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.392 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.392 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.392 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.393 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.393 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.393 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.393 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.393 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.393 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.394 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.394 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.394 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.394 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.394 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.395 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.395 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.395 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.395 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.395 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.395 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.396 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.396 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.396 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.396 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.396 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.396 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.397 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_support", 2024-05-20T17:19:11.397 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.397 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.397 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.398 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.398 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.398 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.398 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.398 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.398 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.399 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.399 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.399 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.399 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.399 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.400 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.400 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.400 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.400 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.400 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.400 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.400 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.401 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.401 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.401 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.401 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.401 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.402 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.402 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.402 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.402 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.402 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.402 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.403 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.403 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.403 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.403 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.403 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.404 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.404 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.404 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.404 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.404 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.404 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.405 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.405 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.405 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.405 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.405 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.405 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.406 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.406 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.406 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.406 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.406 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.407 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.407 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.407 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.407 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.407 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.408 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.408 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.408 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.408 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.408 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.408 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.409 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.409 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.409 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.409 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.409 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.409 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.410 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_autoscaler", 2024-05-20T17:19:11.410 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.410 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.410 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.411 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.411 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.411 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.411 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.411 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.411 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.412 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.412 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.412 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.412 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.412 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.412 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.413 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.413 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.413 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.413 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.413 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.414 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.414 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.414 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.414 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.414 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.414 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.414 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.414 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.415 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.415 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.415 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.415 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.415 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.415 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.415 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.415 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.415 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.415 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.415 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.415 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.416 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.416 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.416 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.416 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.416 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.416 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.416 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.416 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.416 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.416 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.416 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.416 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.416 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.416 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.417 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.417 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.417 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.417 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.417 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.417 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.417 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.417 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.417 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.417 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.417 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.417 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.418 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.418 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.418 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.418 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-05-20T17:19:11.418 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-05-20T17:19:11.418 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.418 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.418 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.418 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-05-20T17:19:11.418 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.418 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.418 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.419 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.419 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.419 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.419 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.419 INFO:teuthology.orchestra.run.smithi006.stdout: "threshold": { 2024-05-20T17:19:11.419 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threshold", 2024-05-20T17:19:11.419 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:11.419 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.419 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.419 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2024-05-20T17:19:11.419 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1.0", 2024-05-20T17:19:11.419 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.419 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.420 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "scaling threshold", 2024-05-20T17:19:11.420 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-20T17:19:11.420 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.420 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.420 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.420 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.420 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "progress", 2024-05-20T17:19:11.420 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.420 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.420 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.420 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_pg_recovery_event": { 2024-05-20T17:19:11.420 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_pg_recovery_event", 2024-05-20T17:19:11.421 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.421 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.421 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.421 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.421 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.421 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.421 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.421 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-20T17:19:11.421 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.421 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.421 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.421 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2024-05-20T17:19:11.421 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2024-05-20T17:19:11.422 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.422 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.422 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.422 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.422 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.422 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.422 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.422 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.422 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.422 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.422 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.422 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.423 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.423 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.423 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.423 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.423 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.423 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.423 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.423 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.423 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.423 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.423 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.423 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.423 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.423 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.424 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.424 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.424 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.424 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.424 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.424 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.424 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.424 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.424 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.424 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.424 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.424 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.424 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.425 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.425 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.425 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.425 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.425 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.425 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.425 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.425 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.425 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.425 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.425 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.425 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.425 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.426 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.426 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.426 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.426 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.426 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.426 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.426 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.426 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.426 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.426 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.426 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.426 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.427 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.427 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.427 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.427 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.427 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.427 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.427 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.427 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.427 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.427 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.427 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.427 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.427 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.428 INFO:teuthology.orchestra.run.smithi006.stdout: "max_completed_events": { 2024-05-20T17:19:11.428 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_completed_events", 2024-05-20T17:19:11.428 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.428 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.428 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.428 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "50", 2024-05-20T17:19:11.428 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.428 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.428 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.428 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "number of past completed events to remember", 2024-05-20T17:19:11.428 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.428 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.428 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.428 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2024-05-20T17:19:11.429 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2024-05-20T17:19:11.429 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.429 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.429 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.429 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2024-05-20T17:19:11.429 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.429 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.429 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.429 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long the module is going to sleep", 2024-05-20T17:19:11.429 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.429 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.429 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.429 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.429 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.430 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus", 2024-05-20T17:19:11.430 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.430 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.430 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.430 INFO:teuthology.orchestra.run.smithi006.stdout: "cache": { 2024-05-20T17:19:11.430 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cache", 2024-05-20T17:19:11.430 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.430 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.430 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.430 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.430 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.431 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.431 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.431 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.431 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.431 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.431 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.431 INFO:teuthology.orchestra.run.smithi006.stdout: "exclude_perf_counters": { 2024-05-20T17:19:11.431 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "exclude_perf_counters", 2024-05-20T17:19:11.431 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.431 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.431 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.431 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.432 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.432 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.432 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.432 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-20T17:19:11.432 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-20T17:19:11.432 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.432 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.432 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.432 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.432 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.432 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.432 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.432 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.433 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.433 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.433 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.433 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.433 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.433 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.433 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.433 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.433 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.433 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.433 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.433 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.433 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.433 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.434 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.434 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.434 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.434 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.434 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.434 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.434 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.434 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.434 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.434 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.434 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.434 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.435 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.435 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.435 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.435 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.435 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.435 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.435 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.435 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.435 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.435 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.435 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.435 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.435 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.436 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.436 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.436 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.436 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.436 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.436 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.436 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.436 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.436 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.436 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.436 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.436 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.437 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.437 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.437 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.437 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.437 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.437 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.437 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.437 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.437 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.437 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools": { 2024-05-20T17:19:11.437 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools", 2024-05-20T17:19:11.437 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.437 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.438 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.438 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.438 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.438 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.438 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.438 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.438 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.438 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.438 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.438 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-20T17:19:11.438 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-20T17:19:11.438 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.438 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.439 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.439 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300", 2024-05-20T17:19:11.439 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.439 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.439 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.439 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.439 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.439 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.439 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.439 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_interval": { 2024-05-20T17:19:11.439 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_interval", 2024-05-20T17:19:11.439 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:11.440 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.440 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.440 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15.0", 2024-05-20T17:19:11.440 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.440 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.440 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.440 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.440 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.440 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.440 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.440 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-05-20T17:19:11.440 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-05-20T17:19:11.440 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.441 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.441 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.441 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2024-05-20T17:19:11.441 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.441 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.441 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.441 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-20T17:19:11.441 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.441 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.441 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.441 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-05-20T17:19:11.441 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-05-20T17:19:11.441 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.442 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.442 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.442 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "9283", 2024-05-20T17:19:11.442 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.442 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.442 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.442 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-20T17:19:11.442 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.442 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.442 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.442 INFO:teuthology.orchestra.run.smithi006.stdout: "stale_cache_strategy": { 2024-05-20T17:19:11.442 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stale_cache_strategy", 2024-05-20T17:19:11.443 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.443 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.443 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.443 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "log", 2024-05-20T17:19:11.443 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.443 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.443 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.443 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.443 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.443 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.443 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.443 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2024-05-20T17:19:11.443 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2024-05-20T17:19:11.444 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.444 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.444 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.444 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "default", 2024-05-20T17:19:11.444 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.444 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.444 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.444 INFO:teuthology.orchestra.run.smithi006.stdout: "default", 2024-05-20T17:19:11.444 INFO:teuthology.orchestra.run.smithi006.stdout: "error" 2024-05-20T17:19:11.444 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.444 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.444 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.444 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.444 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.445 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2024-05-20T17:19:11.445 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2024-05-20T17:19:11.445 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.445 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.445 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.445 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2024-05-20T17:19:11.445 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2024-05-20T17:19:11.445 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2024-05-20T17:19:11.445 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.445 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.445 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.445 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.445 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.446 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.446 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.446 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.446 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_support", 2024-05-20T17:19:11.446 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.446 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.446 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.446 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.446 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.446 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.446 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.446 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.446 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.447 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.447 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.447 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.447 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.447 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.447 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.447 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.447 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.447 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.447 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.447 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.447 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.447 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.447 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.448 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.448 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.448 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.448 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.448 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.448 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.448 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.448 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.448 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.448 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.448 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.448 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.449 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.449 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.449 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.449 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.449 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.449 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.449 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.449 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.449 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.449 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.449 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.449 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.449 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.450 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.450 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.450 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.450 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.450 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.450 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.450 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.450 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.450 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.450 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.450 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.450 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.451 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.451 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.451 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.451 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.451 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.451 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.451 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.451 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.451 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.451 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_snap_create": { 2024-05-20T17:19:11.451 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_snap_create", 2024-05-20T17:19:11.451 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.451 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.452 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.452 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2024-05-20T17:19:11.452 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.452 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.452 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.452 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.452 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.452 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.452 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.452 INFO:teuthology.orchestra.run.smithi006.stdout: "mirror_snapshot_schedule": { 2024-05-20T17:19:11.452 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirror_snapshot_schedule", 2024-05-20T17:19:11.452 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.452 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.453 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.453 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.453 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.453 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.453 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.453 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.453 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.453 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.453 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.453 INFO:teuthology.orchestra.run.smithi006.stdout: "trash_purge_schedule": { 2024-05-20T17:19:11.453 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "trash_purge_schedule", 2024-05-20T17:19:11.453 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.454 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.454 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.454 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.454 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.454 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.454 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.454 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.454 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.454 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.454 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.454 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.454 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.454 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "restful", 2024-05-20T17:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_auth": { 2024-05-20T17:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_auth", 2024-05-20T17:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.455 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.456 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.456 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.456 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.456 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2024-05-20T17:19:11.456 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2024-05-20T17:19:11.456 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.456 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.456 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.456 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.456 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.456 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.456 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.457 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.457 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.457 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.457 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.457 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.457 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.457 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.457 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.457 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.457 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.457 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.457 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.457 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.457 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.458 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.458 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.458 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.458 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.458 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.458 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.458 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.458 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.458 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.458 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.458 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.458 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.458 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.459 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.459 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.459 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.459 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.459 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.459 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.459 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.459 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.459 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.459 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.459 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.459 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.459 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.460 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.460 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.460 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.460 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.460 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.460 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.460 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.460 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.460 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.460 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.460 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.460 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.460 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.460 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.461 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.461 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.461 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.461 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.461 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.461 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.461 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.461 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.461 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.461 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.461 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.461 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.461 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.461 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.462 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.462 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.462 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.462 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.462 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2024-05-20T17:19:11.462 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2024-05-20T17:19:11.462 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.462 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.462 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.462 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.462 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.462 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.462 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.463 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.463 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.463 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.463 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.463 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.463 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2024-05-20T17:19:11.463 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2024-05-20T17:19:11.463 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.463 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.463 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.463 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.463 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.463 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.463 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.464 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.464 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.464 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.464 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.464 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.464 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.464 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.464 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rgw", 2024-05-20T17:19:11.464 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.464 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.464 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.464 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.464 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.465 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.465 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.465 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.465 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.465 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.465 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.465 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.465 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.465 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.465 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.465 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.465 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.465 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.465 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.466 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.466 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.466 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.466 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.466 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.466 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.466 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.466 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.466 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.466 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.466 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.466 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.467 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.467 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.467 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.467 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.467 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.467 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.467 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.467 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.467 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.467 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.467 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.467 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.469 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.469 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.469 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.469 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.469 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.469 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.469 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.469 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.469 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.469 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.470 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.470 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.470 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.470 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.470 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.470 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.470 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.470 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.470 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.470 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.470 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.470 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.471 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.471 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.471 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.471 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.471 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.471 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.471 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rook", 2024-05-20T17:19:11.471 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.471 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.471 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.471 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.471 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.472 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.472 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.472 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.472 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.472 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.472 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.472 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.472 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.472 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.472 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.472 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.472 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.472 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.472 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.473 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.473 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.473 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.473 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.473 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.473 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.473 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.473 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.473 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.473 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.473 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.473 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.473 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.474 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.474 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.474 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.474 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.474 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.474 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.474 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.474 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.474 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.474 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.474 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.474 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.474 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.475 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.475 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.475 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.475 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.475 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.475 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.475 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.475 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.475 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.475 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.475 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.475 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.475 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.476 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.476 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.476 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.476 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.476 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.476 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.476 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.476 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.476 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.476 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.476 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.476 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.476 INFO:teuthology.orchestra.run.smithi006.stdout: "storage_class": { 2024-05-20T17:19:11.477 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "storage_class", 2024-05-20T17:19:11.477 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.477 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.477 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.477 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "local", 2024-05-20T17:19:11.477 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.477 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.477 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.477 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-20T17:19:11.477 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.477 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.477 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.477 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.477 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.478 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.478 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.478 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "selftest", 2024-05-20T17:19:11.478 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.478 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.478 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.478 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.478 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.478 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.478 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.478 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.478 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.478 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.478 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.479 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.479 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.479 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.479 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.479 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.479 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.479 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.479 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.479 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.479 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.479 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.479 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.479 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.480 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.480 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.480 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.480 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.480 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.480 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.480 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.480 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.480 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.480 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.480 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.480 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.480 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.480 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.481 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.481 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.481 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.481 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.481 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.481 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.481 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.481 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.481 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.481 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.481 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.481 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.481 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.481 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.481 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.482 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.482 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.482 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.482 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.482 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.482 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.482 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.482 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.482 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.482 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.482 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.482 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.482 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.482 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.483 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.483 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.483 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.483 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.483 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.483 INFO:teuthology.orchestra.run.smithi006.stdout: "roption1": { 2024-05-20T17:19:11.483 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption1", 2024-05-20T17:19:11.483 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.483 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.483 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.483 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.483 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.483 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.484 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.484 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.484 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.484 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.484 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.484 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.484 INFO:teuthology.orchestra.run.smithi006.stdout: "roption2": { 2024-05-20T17:19:11.484 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption2", 2024-05-20T17:19:11.484 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.484 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.484 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.484 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "xyz", 2024-05-20T17:19:11.484 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.484 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.485 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.485 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.485 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.485 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.485 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.485 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.485 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption1": { 2024-05-20T17:19:11.485 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption1", 2024-05-20T17:19:11.485 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.485 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.485 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.485 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.485 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.485 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.486 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.486 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.486 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.486 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.486 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.486 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.486 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption2": { 2024-05-20T17:19:11.486 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption2", 2024-05-20T17:19:11.486 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.486 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.486 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.486 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.486 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.487 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.487 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.487 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.487 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.487 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.487 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.487 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption3": { 2024-05-20T17:19:11.487 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption3", 2024-05-20T17:19:11.487 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2024-05-20T17:19:11.487 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.487 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.487 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.487 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.488 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.488 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.488 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.488 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.488 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.488 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.488 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption4": { 2024-05-20T17:19:11.488 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption4", 2024-05-20T17:19:11.488 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.488 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.488 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.488 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.488 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.488 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.489 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.489 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.489 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.489 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.489 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.489 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption5": { 2024-05-20T17:19:11.489 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption5", 2024-05-20T17:19:11.489 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.489 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.489 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.489 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.489 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.490 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.490 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.490 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.490 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.490 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.490 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.490 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption6": { 2024-05-20T17:19:11.490 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption6", 2024-05-20T17:19:11.490 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.490 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.490 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.490 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.490 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.491 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.491 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.491 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.491 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.491 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.491 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.491 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.491 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption7": { 2024-05-20T17:19:11.491 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption7", 2024-05-20T17:19:11.491 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.491 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.491 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.491 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.491 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2024-05-20T17:19:11.492 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "42", 2024-05-20T17:19:11.492 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.492 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.492 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.492 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.492 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.492 INFO:teuthology.orchestra.run.smithi006.stdout: "testkey": { 2024-05-20T17:19:11.492 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testkey", 2024-05-20T17:19:11.492 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.492 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.492 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.492 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.492 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.493 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.493 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.493 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.493 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.493 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.493 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.493 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.493 INFO:teuthology.orchestra.run.smithi006.stdout: "testlkey": { 2024-05-20T17:19:11.493 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testlkey", 2024-05-20T17:19:11.493 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.493 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.493 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.493 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.493 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.494 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.494 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.494 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.494 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.494 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.494 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.494 INFO:teuthology.orchestra.run.smithi006.stdout: "testnewline": { 2024-05-20T17:19:11.494 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testnewline", 2024-05-20T17:19:11.494 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.494 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.494 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.494 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.495 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.495 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.495 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.495 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.495 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.495 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.495 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.495 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.495 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.495 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.495 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snap_schedule", 2024-05-20T17:19:11.495 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.495 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.496 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.496 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_m_granularity": { 2024-05-20T17:19:11.496 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_m_granularity", 2024-05-20T17:19:11.496 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.496 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.496 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.496 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.496 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.496 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.496 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.496 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow minute scheduled snapshots", 2024-05-20T17:19:11.496 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.496 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.496 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.497 INFO:teuthology.orchestra.run.smithi006.stdout: "dump_on_update": { 2024-05-20T17:19:11.497 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dump_on_update", 2024-05-20T17:19:11.497 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.497 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.497 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.497 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.497 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.497 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.497 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.497 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "dump database to debug log on update", 2024-05-20T17:19:11.497 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.497 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.497 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.498 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.498 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.498 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.498 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.498 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.498 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.498 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.498 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.498 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.498 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.498 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.498 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.498 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.499 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.499 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.499 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.499 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.499 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.499 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.499 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.499 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.499 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.499 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.499 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.499 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.499 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.499 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.500 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.500 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.500 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.500 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.500 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.500 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.500 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.500 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.500 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.500 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.500 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.500 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.501 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.501 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.501 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.501 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.501 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.501 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.501 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.501 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.501 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.501 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.501 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.501 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.501 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.501 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.502 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.502 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.502 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.502 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.502 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.502 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.502 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.502 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.502 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.502 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.502 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.502 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.502 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.502 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.503 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.503 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.503 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.503 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stats", 2024-05-20T17:19:11.503 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.503 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.503 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.503 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.503 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.503 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.503 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.503 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.503 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.504 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.504 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.504 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.504 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.504 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.504 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.504 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.504 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.504 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.504 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.504 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.504 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.504 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.504 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.505 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.505 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.505 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.505 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.505 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.505 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.505 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.505 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.505 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.505 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.505 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.505 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.506 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.506 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.506 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.506 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.506 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.506 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.506 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.506 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.506 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.506 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.506 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.506 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.506 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.507 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.507 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.507 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.507 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.507 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.507 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.507 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.507 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.507 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.507 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.507 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.507 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.507 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.508 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.508 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.508 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.508 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.508 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.508 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.508 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.508 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.508 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.508 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.508 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "status", 2024-05-20T17:19:11.509 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.509 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.509 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.509 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.509 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.509 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.509 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.509 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.509 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.509 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.509 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.509 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.509 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.509 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.510 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.510 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.510 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.510 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.510 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.510 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.510 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.510 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.510 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.510 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.510 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.510 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.511 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.511 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.511 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.511 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.511 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.511 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.511 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.511 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.511 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.511 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.511 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.511 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.511 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.512 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.512 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.512 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.512 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.512 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.512 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.512 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.512 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.512 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.512 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.512 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.512 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.512 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.512 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.513 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.513 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.513 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.513 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.513 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.513 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.513 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.513 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.513 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.513 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.513 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.513 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.513 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.513 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.514 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.514 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.514 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.514 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.514 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telegraf", 2024-05-20T17:19:11.514 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.514 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.514 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.514 INFO:teuthology.orchestra.run.smithi006.stdout: "address": { 2024-05-20T17:19:11.514 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "address", 2024-05-20T17:19:11.514 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.515 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.515 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.515 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-20T17:19:11.515 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.515 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.515 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.515 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.515 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.515 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.515 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.515 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-05-20T17:19:11.515 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-05-20T17:19:11.515 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.516 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.516 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.516 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15", 2024-05-20T17:19:11.516 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.516 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.516 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.516 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.516 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.516 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.516 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.516 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.516 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.516 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.517 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.517 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.517 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.517 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.517 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.517 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.517 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.517 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.517 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.517 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.517 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.517 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.517 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.517 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.518 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.518 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.518 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.518 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.518 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.518 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.518 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.518 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.518 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.518 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.518 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.518 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.519 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.519 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.519 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.519 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.519 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.519 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.519 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.519 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.519 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.519 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.519 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.519 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.519 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.520 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.520 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.520 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.520 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.520 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.520 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.520 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.520 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.520 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.520 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.520 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.520 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.520 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.521 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.521 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.521 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.521 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.521 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.521 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.521 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.521 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.521 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.521 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.521 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.521 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.521 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.522 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telemetry", 2024-05-20T17:19:11.522 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.522 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.522 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.522 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_basic": { 2024-05-20T17:19:11.522 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_basic", 2024-05-20T17:19:11.522 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.522 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.522 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.522 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.522 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.522 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.523 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.523 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-20T17:19:11.523 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.523 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.523 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.523 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_crash": { 2024-05-20T17:19:11.523 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_crash", 2024-05-20T17:19:11.523 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.523 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.523 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.523 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.523 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.523 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.524 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.524 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-20T17:19:11.524 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.524 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.524 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.524 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_device": { 2024-05-20T17:19:11.524 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_device", 2024-05-20T17:19:11.524 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.524 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.524 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.524 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.524 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.524 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.525 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.525 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-20T17:19:11.525 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.525 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.525 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.525 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_ident": { 2024-05-20T17:19:11.525 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_ident", 2024-05-20T17:19:11.525 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.525 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.525 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.525 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.525 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.526 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.526 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.526 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-20T17:19:11.526 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.526 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.526 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.526 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_perf": { 2024-05-20T17:19:11.526 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_perf", 2024-05-20T17:19:11.526 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.526 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.526 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.526 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.526 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.527 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.527 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.527 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-20T17:19:11.527 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.527 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.527 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.527 INFO:teuthology.orchestra.run.smithi006.stdout: "contact": { 2024-05-20T17:19:11.527 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "contact", 2024-05-20T17:19:11.527 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.527 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.527 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.527 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.527 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.528 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.528 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.528 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.528 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.528 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.528 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.528 INFO:teuthology.orchestra.run.smithi006.stdout: "description": { 2024-05-20T17:19:11.528 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "description", 2024-05-20T17:19:11.528 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.528 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.528 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.528 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.528 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.529 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.529 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.529 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.529 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.529 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.529 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.529 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.529 INFO:teuthology.orchestra.run.smithi006.stdout: "device_url": { 2024-05-20T17:19:11.529 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_url", 2024-05-20T17:19:11.529 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.529 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.529 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.529 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-20T17:19:11.529 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.530 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.530 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.530 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.530 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.530 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.530 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.530 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2024-05-20T17:19:11.530 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2024-05-20T17:19:11.530 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.530 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.530 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.530 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.530 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.531 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.531 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.531 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.531 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.531 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.531 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.531 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-05-20T17:19:11.531 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-05-20T17:19:11.531 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.531 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.531 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.531 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "24", 2024-05-20T17:19:11.531 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "8", 2024-05-20T17:19:11.532 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.532 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.532 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.532 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.532 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.532 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.532 INFO:teuthology.orchestra.run.smithi006.stdout: "last_opt_revision": { 2024-05-20T17:19:11.532 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "last_opt_revision", 2024-05-20T17:19:11.532 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.532 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.532 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.532 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1", 2024-05-20T17:19:11.532 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.533 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.533 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.533 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.533 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.533 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.533 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.533 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard": { 2024-05-20T17:19:11.533 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard", 2024-05-20T17:19:11.533 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.533 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.533 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.533 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.533 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.534 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.534 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.534 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.534 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.534 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.534 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.534 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard_description": { 2024-05-20T17:19:11.534 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard_description", 2024-05-20T17:19:11.534 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.534 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.534 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.534 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.534 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.535 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.535 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.535 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.535 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.535 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.535 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.535 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.535 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.535 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.535 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.535 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.535 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.536 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.536 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.536 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.536 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.536 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.536 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.536 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.536 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.536 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.536 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.536 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.536 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.536 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.536 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.537 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.537 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.537 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.537 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.537 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.537 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.537 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.537 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.537 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.537 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.537 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.537 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.538 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.538 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.538 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.538 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.538 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.538 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.538 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.538 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.538 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.538 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.538 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.538 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.539 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.539 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.539 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.539 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.539 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.539 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.539 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.539 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.539 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.539 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.539 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.539 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.539 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.540 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.540 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.540 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.540 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.540 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.540 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.540 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.540 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.540 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.540 INFO:teuthology.orchestra.run.smithi006.stdout: "organization": { 2024-05-20T17:19:11.540 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "organization", 2024-05-20T17:19:11.540 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.540 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.541 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.541 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.541 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.541 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.541 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.541 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.541 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.541 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.541 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.541 INFO:teuthology.orchestra.run.smithi006.stdout: "proxy": { 2024-05-20T17:19:11.541 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "proxy", 2024-05-20T17:19:11.541 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.541 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.542 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.542 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.542 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.542 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.542 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.542 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.542 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.542 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.542 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.542 INFO:teuthology.orchestra.run.smithi006.stdout: "url": { 2024-05-20T17:19:11.542 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url", 2024-05-20T17:19:11.542 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-20T17:19:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.544 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "test_orchestrator", 2024-05-20T17:19:11.544 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.544 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.544 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.544 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.544 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.544 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.544 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.544 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.544 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.544 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.544 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.544 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.544 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.545 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.545 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.545 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.545 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.545 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.545 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.545 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.545 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.545 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.545 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.545 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.545 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.545 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.546 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.546 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.546 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.546 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.546 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.546 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.546 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.546 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.546 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.546 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.546 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.546 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.546 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.547 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.547 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.547 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.547 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.547 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.547 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.547 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.547 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.547 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.547 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.547 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.547 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.547 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.547 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.548 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.548 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.548 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.548 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.548 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.548 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.548 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.548 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.548 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.548 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.548 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.548 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.548 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.549 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.549 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.549 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.549 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.549 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.549 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volumes", 2024-05-20T17:19:11.549 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.549 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.549 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.549 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.549 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.549 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.550 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.550 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.550 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.550 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.550 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.550 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.550 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.550 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.550 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.550 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.550 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.550 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.550 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.550 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.551 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.551 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.551 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.551 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.551 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.551 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.551 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.551 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.551 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.551 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.551 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.551 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.551 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.552 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.552 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.552 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.552 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.552 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.552 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.552 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.552 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.552 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.552 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.552 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.552 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.552 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.553 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.553 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.553 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.553 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.553 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.553 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.553 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.553 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.553 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.553 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.553 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.553 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.554 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.554 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.554 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.554 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.554 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.554 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.554 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.554 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.554 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.554 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.554 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.554 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_clones": { 2024-05-20T17:19:11.554 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_clones", 2024-05-20T17:19:11.555 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.555 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.555 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.555 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4", 2024-05-20T17:19:11.555 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.555 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.555 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.555 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-20T17:19:11.555 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.555 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.555 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.555 INFO:teuthology.orchestra.run.smithi006.stdout: "periodic_async_work": { 2024-05-20T17:19:11.555 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "periodic_async_work", 2024-05-20T17:19:11.556 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.556 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.556 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.556 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.556 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.556 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.556 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.556 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Periodically check for async work", 2024-05-20T17:19:11.556 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.556 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.556 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.556 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_delay": { 2024-05-20T17:19:11.557 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_delay", 2024-05-20T17:19:11.557 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.557 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.557 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.557 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2024-05-20T17:19:11.557 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.557 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.557 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.557 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-20T17:19:11.557 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.557 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.557 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.557 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_no_wait": { 2024-05-20T17:19:11.558 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_no_wait", 2024-05-20T17:19:11.558 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.558 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.558 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.558 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2024-05-20T17:19:11.558 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.558 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.558 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.558 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-20T17:19:11.558 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.558 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.558 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.558 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.558 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.559 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix", 2024-05-20T17:19:11.559 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2024-05-20T17:19:11.559 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2024-05-20T17:19:11.559 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2024-05-20T17:19:11.559 INFO:teuthology.orchestra.run.smithi006.stdout: "discovery_interval": { 2024-05-20T17:19:11.559 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "discovery_interval", 2024-05-20T17:19:11.559 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2024-05-20T17:19:11.559 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.559 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.559 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "100", 2024-05-20T17:19:11.559 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.560 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.560 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.560 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.560 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.560 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.560 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.560 INFO:teuthology.orchestra.run.smithi006.stdout: "identifier": { 2024-05-20T17:19:11.560 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "identifier", 2024-05-20T17:19:11.560 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.560 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.560 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.560 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.560 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.561 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.561 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.561 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.561 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.561 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.561 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.561 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2024-05-20T17:19:11.561 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2024-05-20T17:19:11.561 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2024-05-20T17:19:11.561 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.561 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.561 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2024-05-20T17:19:11.561 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.562 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.562 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.562 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.562 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.562 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.562 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.562 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2024-05-20T17:19:11.562 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2024-05-20T17:19:11.562 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.562 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.562 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.562 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.563 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.563 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.563 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.563 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.563 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.563 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.563 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.563 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.563 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.563 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.563 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.563 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.563 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.563 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.564 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2024-05-20T17:19:11.564 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2024-05-20T17:19:11.564 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.564 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.564 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.564 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.564 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.564 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.564 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.564 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.564 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.564 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.564 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.565 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2024-05-20T17:19:11.565 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2024-05-20T17:19:11.565 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.565 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.565 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.565 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2024-05-20T17:19:11.565 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.565 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.565 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2024-05-20T17:19:11.565 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2024-05-20T17:19:11.565 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2024-05-20T17:19:11.565 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2024-05-20T17:19:11.565 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2024-05-20T17:19:11.566 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2024-05-20T17:19:11.566 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2024-05-20T17:19:11.566 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.566 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.566 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.566 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.566 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.566 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2024-05-20T17:19:11.566 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2024-05-20T17:19:11.566 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2024-05-20T17:19:11.566 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.566 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-05-20T17:19:11.566 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2024-05-20T17:19:11.567 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.567 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.567 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.567 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.567 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.567 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.567 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.567 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_host": { 2024-05-20T17:19:11.567 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_host", 2024-05-20T17:19:11.567 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.567 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.567 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.567 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2024-05-20T17:19:11.568 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.568 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.568 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.568 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.568 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.568 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.568 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.568 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_port": { 2024-05-20T17:19:11.568 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_port", 2024-05-20T17:19:11.568 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2024-05-20T17:19:11.568 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.568 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.568 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10051", 2024-05-20T17:19:11.569 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.569 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.569 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.569 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.569 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.569 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.569 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.569 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_sender": { 2024-05-20T17:19:11.569 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_sender", 2024-05-20T17:19:11.569 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2024-05-20T17:19:11.569 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2024-05-20T17:19:11.569 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2024-05-20T17:19:11.570 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-20T17:19:11.570 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2024-05-20T17:19:11.570 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2024-05-20T17:19:11.570 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2024-05-20T17:19:11.570 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2024-05-20T17:19:11.570 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2024-05-20T17:19:11.570 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2024-05-20T17:19:11.570 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2024-05-20T17:19:11.570 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.570 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.570 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.570 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.570 INFO:teuthology.orchestra.run.smithi006.stdout: "services": { 2024-05-20T17:19:11.570 INFO:teuthology.orchestra.run.smithi006.stdout: "dashboard": "https://172.21.15.6:8443/" 2024-05-20T17:19:11.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.571 INFO:teuthology.orchestra.run.smithi006.stdout: "always_on_modules": { 2024-05-20T17:19:11.571 INFO:teuthology.orchestra.run.smithi006.stdout: "octopus": [ 2024-05-20T17:19:11.571 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2024-05-20T17:19:11.571 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-05-20T17:19:11.571 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2024-05-20T17:19:11.571 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2024-05-20T17:19:11.571 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2024-05-20T17:19:11.571 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2024-05-20T17:19:11.571 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2024-05-20T17:19:11.571 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2024-05-20T17:19:11.571 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2024-05-20T17:19:11.571 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2024-05-20T17:19:11.571 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.572 INFO:teuthology.orchestra.run.smithi006.stdout: "pacific": [ 2024-05-20T17:19:11.572 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2024-05-20T17:19:11.572 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-05-20T17:19:11.572 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2024-05-20T17:19:11.572 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2024-05-20T17:19:11.572 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2024-05-20T17:19:11.572 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2024-05-20T17:19:11.572 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2024-05-20T17:19:11.572 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2024-05-20T17:19:11.572 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2024-05-20T17:19:11.572 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2024-05-20T17:19:11.572 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.572 INFO:teuthology.orchestra.run.smithi006.stdout: "quincy": [ 2024-05-20T17:19:11.572 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2024-05-20T17:19:11.573 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-05-20T17:19:11.573 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2024-05-20T17:19:11.573 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2024-05-20T17:19:11.573 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2024-05-20T17:19:11.573 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2024-05-20T17:19:11.573 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2024-05-20T17:19:11.573 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2024-05-20T17:19:11.573 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2024-05-20T17:19:11.573 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2024-05-20T17:19:11.573 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.573 INFO:teuthology.orchestra.run.smithi006.stdout: "reef": [ 2024-05-20T17:19:11.573 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2024-05-20T17:19:11.573 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-05-20T17:19:11.573 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2024-05-20T17:19:11.574 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2024-05-20T17:19:11.574 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2024-05-20T17:19:11.574 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2024-05-20T17:19:11.574 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2024-05-20T17:19:11.574 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2024-05-20T17:19:11.574 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2024-05-20T17:19:11.574 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2024-05-20T17:19:11.574 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:19:11.574 INFO:teuthology.orchestra.run.smithi006.stdout: "squid": [ 2024-05-20T17:19:11.574 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2024-05-20T17:19:11.574 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-05-20T17:19:11.574 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2024-05-20T17:19:11.574 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2024-05-20T17:19:11.574 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2024-05-20T17:19:11.575 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2024-05-20T17:19:11.575 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2024-05-20T17:19:11.575 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2024-05-20T17:19:11.575 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2024-05-20T17:19:11.575 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2024-05-20T17:19:11.575 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T17:19:11.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.575 INFO:teuthology.orchestra.run.smithi006.stdout: "last_failure_osd_epoch": 3, 2024-05-20T17:19:11.575 INFO:teuthology.orchestra.run.smithi006.stdout: "active_clients": [ 2024-05-20T17:19:11.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.575 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "devicehealth", 2024-05-20T17:19:11.575 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-05-20T17:19:11.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.575 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-05-20T17:19:11.576 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2024-05-20T17:19:11.576 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 953728063 2024-05-20T17:19:11.576 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.576 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T17:19:11.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.576 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "libcephsqlite", 2024-05-20T17:19:11.576 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-05-20T17:19:11.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.576 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-05-20T17:19:11.576 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2024-05-20T17:19:11.576 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3438686756 2024-05-20T17:19:11.576 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.576 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T17:19:11.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.577 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.577 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_support", 2024-05-20T17:19:11.577 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-05-20T17:19:11.577 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.577 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-05-20T17:19:11.577 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2024-05-20T17:19:11.577 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3635737455 2024-05-20T17:19:11.577 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.577 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T17:19:11.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:11.577 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.577 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volumes", 2024-05-20T17:19:11.577 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-05-20T17:19:11.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:19:11.578 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-05-20T17:19:11.578 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2024-05-20T17:19:11.578 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1135171957 2024-05-20T17:19:11.578 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.578 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T17:19:11.578 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:11.578 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T17:19:11.578 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:19:11.579 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:09 smithi171 ceph-mon[35901]: pgmap v727: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 28 MiB/s wr, 542 op/s 2024-05-20T17:19:11.580 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:09 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1118210223' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:19:11.580 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:09 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/474900445' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:19:11.580 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:10 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2967325021' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-20T17:19:11.580 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:09 smithi062 ceph-mon[35425]: pgmap v727: 129 pgs: 129 active+clean; 10 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 28 MiB/s wr, 542 op/s 2024-05-20T17:19:11.580 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:09 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1118210223' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:19:11.580 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:09 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/474900445' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:19:11.580 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:10 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2967325021' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-20T17:19:11.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:10.182+0000 7fa224d37640 1 -- 172.21.15.6:0/2967325021 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa2080a2e70 msgr2=0x7fa2080a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:11.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:10.182+0000 7fa224d37640 1 --2- 172.21.15.6:0/2967325021 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa2080a2e70 0x7fa2080a5380 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa218004af0 tx=0x7fa218000f40 comp rx=0 tx=0).stop 2024-05-20T17:19:11.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:10.182+0000 7fa224d37640 1 -- 172.21.15.6:0/2967325021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2201093d0 msgr2=0x7fa2201a7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:11.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:10.182+0000 7fa224d37640 1 --2- 172.21.15.6:0/2967325021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2201093d0 0x7fa2201a7fb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa21400c970 tx=0x7fa21400ce30 comp rx=0 tx=0).stop 2024-05-20T17:19:11.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:10.182+0000 7fa224d37640 1 -- 172.21.15.6:0/2967325021 shutdown_connections 2024-05-20T17:19:11.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:10.182+0000 7fa224d37640 1 --2- 172.21.15.6:0/2967325021 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fa2080a2e70 0x7fa2080a5380 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:11.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:10.182+0000 7fa224d37640 1 --2- 172.21.15.6:0/2967325021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22010f020 0x7fa2201af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:11.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:10.182+0000 7fa224d37640 1 --2- 172.21.15.6:0/2967325021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa22010a300 0x7fa2201a84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:11.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:10.182+0000 7fa224d37640 1 --2- 172.21.15.6:0/2967325021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2201093d0 0x7fa2201a7fb0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:11.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:10.182+0000 7fa224d37640 1 -- 172.21.15.6:0/2967325021 >> 172.21.15.6:0/2967325021 conn(0x7fa22006f4e0 msgr2=0x7fa22010b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:11.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:10.182+0000 7fa224d37640 1 -- 172.21.15.6:0/2967325021 shutdown_connections 2024-05-20T17:19:11.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:10.182+0000 7fa224d37640 1 -- 172.21.15.6:0/2967325021 wait complete. 2024-05-20T17:19:11.588 DEBUG:tasks.check_counter:Getting stats from a 2024-05-20T17:19:11.588 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph daemon mds.a perf dump 2024-05-20T17:19:11.588 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:10 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2967325021' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-20T17:19:12.077 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:19:12.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:11 smithi006 ceph-mon[32486]: pgmap v728: 129 pgs: 129 active+clean; 9.9 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 25 MiB/s wr, 474 op/s 2024-05-20T17:19:12.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:11 smithi006 ceph-mon[32486]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:19:12.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:11 smithi062 ceph-mon[35425]: pgmap v728: 129 pgs: 129 active+clean; 9.9 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 25 MiB/s wr, 474 op/s 2024-05-20T17:19:12.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:11 smithi062 ceph-mon[35425]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:19:12.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:11 smithi171 ceph-mon[35901]: pgmap v728: 129 pgs: 129 active+clean; 9.9 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 25 MiB/s wr, 474 op/s 2024-05-20T17:19:12.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:11 smithi171 ceph-mon[35901]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-20T17:19:14.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:13 smithi062 ceph-mon[35425]: pgmap v729: 129 pgs: 129 active+clean; 7.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 23 MiB/s wr, 481 op/s 2024-05-20T17:19:14.310 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:13 smithi006 ceph-mon[32486]: pgmap v729: 129 pgs: 129 active+clean; 7.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 23 MiB/s wr, 481 op/s 2024-05-20T17:19:14.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:13 smithi171 ceph-mon[35901]: pgmap v729: 129 pgs: 129 active+clean; 7.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 23 MiB/s wr, 481 op/s 2024-05-20T17:19:15.818 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:19:15.819 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:19:15.819 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 1641, 2024-05-20T17:19:15.819 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 1643, 2024-05-20T17:19:15.819 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 491616, 2024-05-20T17:19:15.819 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 521839, 2024-05-20T17:19:15.819 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 6, 2024-05-20T17:19:15.819 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 2, 2024-05-20T17:19:15.819 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.151975348, 2024-05-20T17:19:15.819 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.044808581, 2024-05-20T17:19:15.819 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.040453223, 2024-05-20T17:19:15.819 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.053412844, 2024-05-20T17:19:15.819 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:15.820 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 1641, 2024-05-20T17:19:15.820 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.125050578, 2024-05-20T17:19:15.820 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000076203 2024-05-20T17:19:15.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.820 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:15.820 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.820 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.820 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.820 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-20T17:19:15.820 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 0 2024-05-20T17:19:15.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.820 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:19:15.820 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 949, 2024-05-20T17:19:15.821 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 940, 2024-05-20T17:19:15.821 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 713824, 2024-05-20T17:19:15.821 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 366168, 2024-05-20T17:19:15.821 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2024-05-20T17:19:15.821 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 3, 2024-05-20T17:19:15.821 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.107156942, 2024-05-20T17:19:15.821 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.031906810, 2024-05-20T17:19:15.821 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.033296358, 2024-05-20T17:19:15.821 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.035796814, 2024-05-20T17:19:15.821 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:15.821 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 939, 2024-05-20T17:19:15.821 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.053937924, 2024-05-20T17:19:15.821 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000057441 2024-05-20T17:19:15.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.822 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:15.822 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.822 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.822 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.822 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 540480, 2024-05-20T17:19:15.822 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 142864 2024-05-20T17:19:15.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.822 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:19:15.822 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 6, 2024-05-20T17:19:15.822 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 178, 2024-05-20T17:19:15.822 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 3420, 2024-05-20T17:19:15.823 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 383518, 2024-05-20T17:19:15.823 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2024-05-20T17:19:15.823 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 3, 2024-05-20T17:19:15.823 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.013781377, 2024-05-20T17:19:15.823 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.010252879, 2024-05-20T17:19:15.823 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.002049484, 2024-05-20T17:19:15.823 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000017497, 2024-05-20T17:19:15.823 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:15.823 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 177, 2024-05-20T17:19:15.823 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.011106647, 2024-05-20T17:19:15.823 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000062749 2024-05-20T17:19:15.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.823 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:15.824 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.824 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.824 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.824 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-05-20T17:19:15.824 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 383200 2024-05-20T17:19:15.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.824 INFO:teuthology.orchestra.run.smithi006.stdout: "cct": { 2024-05-20T17:19:15.824 INFO:teuthology.orchestra.run.smithi006.stdout: "total_workers": 1, 2024-05-20T17:19:15.824 INFO:teuthology.orchestra.run.smithi006.stdout: "unhealthy_workers": 0 2024-05-20T17:19:15.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.824 INFO:teuthology.orchestra.run.smithi006.stdout: "finisher-MDSRank": { 2024-05-20T17:19:15.824 INFO:teuthology.orchestra.run.smithi006.stdout: "queue_len": 0, 2024-05-20T17:19:15.825 INFO:teuthology.orchestra.run.smithi006.stdout: "complete_latency": { 2024-05-20T17:19:15.825 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 3899, 2024-05-20T17:19:15.825 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.139355505, 2024-05-20T17:19:15.825 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000035741 2024-05-20T17:19:15.825 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:15.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.825 INFO:teuthology.orchestra.run.smithi006.stdout: "finisher-PurgeQueue": { 2024-05-20T17:19:15.825 INFO:teuthology.orchestra.run.smithi006.stdout: "queue_len": 0, 2024-05-20T17:19:15.825 INFO:teuthology.orchestra.run.smithi006.stdout: "complete_latency": { 2024-05-20T17:19:15.825 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.825 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.825 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.825 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:15.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.826 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-05-20T17:19:15.826 INFO:teuthology.orchestra.run.smithi006.stdout: "request": 0, 2024-05-20T17:19:15.826 INFO:teuthology.orchestra.run.smithi006.stdout: "reply": 0, 2024-05-20T17:19:15.826 INFO:teuthology.orchestra.run.smithi006.stdout: "reply_latency": { 2024-05-20T17:19:15.826 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.826 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.826 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.826 INFO:teuthology.orchestra.run.smithi006.stdout: "slow_reply": 0, 2024-05-20T17:19:15.826 INFO:teuthology.orchestra.run.smithi006.stdout: "forward": 0, 2024-05-20T17:19:15.826 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_fetch_complete": 0, 2024-05-20T17:19:15.826 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_fetch_keys": 0, 2024-05-20T17:19:15.826 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_commit": 0, 2024-05-20T17:19:15.827 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_split": 0, 2024-05-20T17:19:15.827 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_merge": 0, 2024-05-20T17:19:15.827 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes": 0, 2024-05-20T17:19:15.827 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_top": 0, 2024-05-20T17:19:15.827 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_bottom": 0, 2024-05-20T17:19:15.827 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_pin_tail": 0, 2024-05-20T17:19:15.827 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_pinned": 0, 2024-05-20T17:19:15.827 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_expired": 0, 2024-05-20T17:19:15.827 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_with_caps": 0, 2024-05-20T17:19:15.827 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": 0, 2024-05-20T17:19:15.827 INFO:teuthology.orchestra.run.smithi006.stdout: "subtrees": 1, 2024-05-20T17:19:15.827 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse": 0, 2024-05-20T17:19:15.827 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_hit": 0, 2024-05-20T17:19:15.828 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_forward": 0, 2024-05-20T17:19:15.828 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_discover": 0, 2024-05-20T17:19:15.828 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_dir_fetch": 0, 2024-05-20T17:19:15.828 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_remote_ino": 0, 2024-05-20T17:19:15.828 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_lock": 0, 2024-05-20T17:19:15.828 INFO:teuthology.orchestra.run.smithi006.stdout: "load_cent": 0, 2024-05-20T17:19:15.828 INFO:teuthology.orchestra.run.smithi006.stdout: "q": 0, 2024-05-20T17:19:15.828 INFO:teuthology.orchestra.run.smithi006.stdout: "exported": 0, 2024-05-20T17:19:15.828 INFO:teuthology.orchestra.run.smithi006.stdout: "exported_inodes": 0, 2024-05-20T17:19:15.828 INFO:teuthology.orchestra.run.smithi006.stdout: "imported": 0, 2024-05-20T17:19:15.828 INFO:teuthology.orchestra.run.smithi006.stdout: "imported_inodes": 0, 2024-05-20T17:19:15.828 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_dir_fetch": 0, 2024-05-20T17:19:15.828 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_backtrace_fetch": 0, 2024-05-20T17:19:15.829 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_peer_discover": 0, 2024-05-20T17:19:15.829 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rfiles": 0, 2024-05-20T17:19:15.829 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rbytes": 0, 2024-05-20T17:19:15.829 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rsnaps": 0, 2024-05-20T17:19:15.829 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_backtrace_fetch": 0, 2024-05-20T17:19:15.829 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_set_tag": 0, 2024-05-20T17:19:15.829 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_backtrace_repaired": 0, 2024-05-20T17:19:15.829 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_inotable_repaired": 0, 2024-05-20T17:19:15.829 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dir_inodes": 0, 2024-05-20T17:19:15.829 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dir_base_inodes": 0, 2024-05-20T17:19:15.829 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dirfrag_rstats": 0, 2024-05-20T17:19:15.829 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_file_inodes": 0, 2024-05-20T17:19:15.829 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_inode_file_caps": 0, 2024-05-20T17:19:15.829 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_revoke": 0, 2024-05-20T17:19:15.830 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_grant": 0, 2024-05-20T17:19:15.830 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_trunc": 0, 2024-05-20T17:19:15.830 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-20T17:19:15.830 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-20T17:19:15.830 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_caps": 0, 2024-05-20T17:19:15.830 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_caps_dirty": 0, 2024-05-20T17:19:15.830 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_cap_release": 0, 2024-05-20T17:19:15.830 INFO:teuthology.orchestra.run.smithi006.stdout: "process_request_cap_release": 0 2024-05-20T17:19:15.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.830 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache": { 2024-05-20T17:19:15.830 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_update": 0, 2024-05-20T17:19:15.830 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_update_receipt": 0, 2024-05-20T17:19:15.830 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_try_discover": 0, 2024-05-20T17:19:15.831 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_send_discover": 0, 2024-05-20T17:19:15.831 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_handle_discover": 0, 2024-05-20T17:19:15.831 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays": 0, 2024-05-20T17:19:15.831 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays_delayed": 0, 2024-05-20T17:19:15.831 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays_enqueuing": 0, 2024-05-20T17:19:15.831 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_created": 0, 2024-05-20T17:19:15.831 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_enqueued": 0, 2024-05-20T17:19:15.831 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_reintegrated": 0, 2024-05-20T17:19:15.831 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_migrated": 0, 2024-05-20T17:19:15.831 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_processing": 0, 2024-05-20T17:19:15.831 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_enqueued": 0, 2024-05-20T17:19:15.831 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_prioritized": 0, 2024-05-20T17:19:15.831 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_started": 0, 2024-05-20T17:19:15.831 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_completed": 0, 2024-05-20T17:19:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_quiesce_path": 0, 2024-05-20T17:19:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_quiesce_inode": 0, 2024-05-20T17:19:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_enqueue_scrub": 0, 2024-05-20T17:19:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_exportdir": 0, 2024-05-20T17:19:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_flush": 0, 2024-05-20T17:19:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_fragmentdir": 0, 2024-05-20T17:19:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_fragstats": 0, 2024-05-20T17:19:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_inodestats": 0 2024-05-20T17:19:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log": { 2024-05-20T17:19:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "evlrg": 0, 2024-05-20T17:19:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "evadd": 0, 2024-05-20T17:19:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "evex": 0, 2024-05-20T17:19:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "evtrm": 0, 2024-05-20T17:19:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "ev": 3, 2024-05-20T17:19:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "evexg": 0, 2024-05-20T17:19:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "evexd": 0, 2024-05-20T17:19:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "segadd": 0, 2024-05-20T17:19:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "segex": 0, 2024-05-20T17:19:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "segtrm": 0, 2024-05-20T17:19:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "seg": 2, 2024-05-20T17:19:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "segmjr": 2, 2024-05-20T17:19:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "segexg": 0, 2024-05-20T17:19:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "segexd": 0, 2024-05-20T17:19:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "expos": 4194304, 2024-05-20T17:19:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "wrpos": 4195385, 2024-05-20T17:19:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "rdpos": 4194892, 2024-05-20T17:19:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "jlat": { 2024-05-20T17:19:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "replayed": 3 2024-05-20T17:19:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_mem": { 2024-05-20T17:19:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 3, 2024-05-20T17:19:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "ino+": 3, 2024-05-20T17:19:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "ino-": 0, 2024-05-20T17:19:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "dir": 1, 2024-05-20T17:19:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "dir+": 1, 2024-05-20T17:19:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "dir-": 0, 2024-05-20T17:19:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "dn": 0, 2024-05-20T17:19:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "dn+": 0, 2024-05-20T17:19:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "dn-": 0, 2024-05-20T17:19:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "cap": 0, 2024-05-20T17:19:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "cap+": 0, 2024-05-20T17:19:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "cap-": 0, 2024-05-20T17:19:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "rss": 118956, 2024-05-20T17:19:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "heap": 215444 2024-05-20T17:19:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_server": { 2024-05-20T17:19:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "dispatch_client_request": 0, 2024-05-20T17:19:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "dispatch_server_request": 0, 2024-05-20T17:19:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_request": 0, 2024-05-20T17:19:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_session": 0, 2024-05-20T17:19:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_peer_request": 0, 2024-05-20T17:19:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "req_create_latency": { 2024-05-20T17:19:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getattr_latency": { 2024-05-20T17:19:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getfilelock_latency": { 2024-05-20T17:19:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "req_link_latency": { 2024-05-20T17:19:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookup_latency": { 2024-05-20T17:19:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookuphash_latency": { 2024-05-20T17:19:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupino_latency": { 2024-05-20T17:19:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupname_latency": { 2024-05-20T17:19:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupparent_latency": { 2024-05-20T17:19:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupsnap_latency": { 2024-05-20T17:19:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lssnap_latency": { 2024-05-20T17:19:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.840 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mkdir_latency": { 2024-05-20T17:19:15.840 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.840 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.840 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.840 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mknod_latency": { 2024-05-20T17:19:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mksnap_latency": { 2024-05-20T17:19:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "req_open_latency": { 2024-05-20T17:19:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "req_readdir_latency": { 2024-05-20T17:19:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rename_latency": { 2024-05-20T17:19:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "req_renamesnap_latency": { 2024-05-20T17:19:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "req_snapdiff_latency": { 2024-05-20T17:19:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmdir_latency": { 2024-05-20T17:19:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmsnap_latency": { 2024-05-20T17:19:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmxattr_latency": { 2024-05-20T17:19:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setattr_latency": { 2024-05-20T17:19:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setdirlayout_latency": { 2024-05-20T17:19:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setfilelock_latency": { 2024-05-20T17:19:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setlayout_latency": { 2024-05-20T17:19:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setxattr_latency": { 2024-05-20T17:19:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "req_symlink_latency": { 2024-05-20T17:19:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "req_unlink_latency": { 2024-05-20T17:19:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "cap_revoke_eviction": 0, 2024-05-20T17:19:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "cap_acquisition_throttle": 0, 2024-05-20T17:19:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getvxattr_latency": { 2024-05-20T17:19:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_sessions": { 2024-05-20T17:19:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "session_count": 1, 2024-05-20T17:19:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "session_add": 1, 2024-05-20T17:19:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "session_remove": 0, 2024-05-20T17:19:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "sessions_open": 1, 2024-05-20T17:19:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "sessions_stale": 0, 2024-05-20T17:19:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "total_load": 0, 2024-05-20T17:19:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "average_load": 0, 2024-05-20T17:19:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "avg_session_uptime": 1863, 2024-05-20T17:19:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "mdthresh_evicted": 0 2024-05-20T17:19:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool": { 2024-05-20T17:19:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:19:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_items": 0, 2024-05-20T17:19:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:19:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:19:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:19:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:19:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:19:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:19:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:19:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:19:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:19:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:19:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:19:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:19:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:19:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_items": 0, 2024-05-20T17:19:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:19:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_items": 0, 2024-05-20T17:19:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:19:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:19:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:19:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:19:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:19:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:19:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:19:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_items": 0, 2024-05-20T17:19:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:19:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:19:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:19:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_items": 0, 2024-05-20T17:19:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_bytes": 0, 2024-05-20T17:19:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_items": 0, 2024-05-20T17:19:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:19:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:19:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:19:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:19:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_bytes": 189463, 2024-05-20T17:19:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_items": 52, 2024-05-20T17:19:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:19:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_items": 0, 2024-05-20T17:19:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bytes": 0, 2024-05-20T17:19:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_items": 0, 2024-05-20T17:19:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:19:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_items": 0, 2024-05-20T17:19:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:19:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_items": 0, 2024-05-20T17:19:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_bytes": 8984, 2024-05-20T17:19:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_items": 172, 2024-05-20T17:19:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:19:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:19:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_bytes": 0, 2024-05-20T17:19:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_items": 0, 2024-05-20T17:19:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_bytes": 8464, 2024-05-20T17:19:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_items": 13, 2024-05-20T17:19:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_bytes": 0, 2024-05-20T17:19:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_items": 0, 2024-05-20T17:19:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_bytes": 0, 2024-05-20T17:19:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_items": 0 2024-05-20T17:19:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter": { 2024-05-20T17:19:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "op_active": 0, 2024-05-20T17:19:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "op_laggy": 0, 2024-05-20T17:19:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "op_send": 2344, 2024-05-20T17:19:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "op_send_bytes": 21, 2024-05-20T17:19:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "op_resend": 3, 2024-05-20T17:19:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "op_reply": 2344, 2024-05-20T17:19:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "op_latency": { 2024-05-20T17:19:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 2344, 2024-05-20T17:19:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 1.846978142, 2024-05-20T17:19:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000787959 2024-05-20T17:19:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "op_inflight": 0, 2024-05-20T17:19:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "oplen_avg": { 2024-05-20T17:19:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 2344, 2024-05-20T17:19:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 2345 2024-05-20T17:19:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "op": 2344, 2024-05-20T17:19:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "op_r": 2344, 2024-05-20T17:19:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "op_w": 0, 2024-05-20T17:19:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "op_rmw": 0, 2024-05-20T17:19:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "op_pg": 0, 2024-05-20T17:19:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_stat": 1518, 2024-05-20T17:19:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_create": 0, 2024-05-20T17:19:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_read": 824, 2024-05-20T17:19:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_write": 0, 2024-05-20T17:19:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_writefull": 0, 2024-05-20T17:19:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_writesame": 0, 2024-05-20T17:19:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_append": 0, 2024-05-20T17:19:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_zero": 0, 2024-05-20T17:19:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_truncate": 0, 2024-05-20T17:19:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_delete": 0, 2024-05-20T17:19:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_mapext": 0, 2024-05-20T17:19:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_sparse_read": 0, 2024-05-20T17:19:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_clonerange": 0, 2024-05-20T17:19:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_getxattr": 1, 2024-05-20T17:19:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_setxattr": 0, 2024-05-20T17:19:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_cmpxattr": 0, 2024-05-20T17:19:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_rmxattr": 0, 2024-05-20T17:19:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_resetxattrs": 0, 2024-05-20T17:19:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_call": 0, 2024-05-20T17:19:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_watch": 0, 2024-05-20T17:19:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_notify": 0, 2024-05-20T17:19:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_src_cmpxattr": 0, 2024-05-20T17:19:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_pgls": 0, 2024-05-20T17:19:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_pgls_filter": 0, 2024-05-20T17:19:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_other": 0, 2024-05-20T17:19:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_active": 0, 2024-05-20T17:19:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_send": 0, 2024-05-20T17:19:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_resend": 0, 2024-05-20T17:19:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_ping": 0, 2024-05-20T17:19:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_active": 0, 2024-05-20T17:19:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_send": 0, 2024-05-20T17:19:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_resend": 0, 2024-05-20T17:19:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_active": 0, 2024-05-20T17:19:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_send": 0, 2024-05-20T17:19:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_resend": 0, 2024-05-20T17:19:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_active": 0, 2024-05-20T17:19:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_send": 0, 2024-05-20T17:19:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_resend": 0, 2024-05-20T17:19:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "command_active": 0, 2024-05-20T17:19:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "command_send": 0, 2024-05-20T17:19:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "command_resend": 0, 2024-05-20T17:19:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "map_epoch": 94, 2024-05-20T17:19:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "map_full": 0, 2024-05-20T17:19:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "map_inc": 4, 2024-05-20T17:19:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_sessions": 5, 2024-05-20T17:19:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_session_open": 5, 2024-05-20T17:19:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_session_close": 0, 2024-05-20T17:19:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_laggy": 0, 2024-05-20T17:19:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_wr": 0, 2024-05-20T17:19:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_rd": 2, 2024-05-20T17:19:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_del": 0 2024-05-20T17:19:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "oft": { 2024-05-20T17:19:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_objs": 0, 2024-05-20T17:19:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_kv_pairs": 0, 2024-05-20T17:19:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_updates": 0, 2024-05-20T17:19:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_removes": 0 2024-05-20T17:19:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "osd-slow-ops": { 2024-05-20T17:19:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "slow_ops_count": 0 2024-05-20T17:19:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "purge_queue": { 2024-05-20T17:19:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_ops": 0, 2024-05-20T17:19:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_ops_high_water": 0, 2024-05-20T17:19:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing": 0, 2024-05-20T17:19:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_high_water": 0, 2024-05-20T17:19:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executed_ops": 0, 2024-05-20T17:19:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executed": 0, 2024-05-20T17:19:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_item_in_journal": 0 2024-05-20T17:19:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:19:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-05-20T17:19:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2024-05-20T17:19:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-05-20T17:19:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 2592, 2024-05-20T17:19:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 959914, 2024-05-20T17:19:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 2592, 2024-05-20T17:19:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2024-05-20T17:19:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2024-05-20T17:19:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 2592, 2024-05-20T17:19:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 959914, 2024-05-20T17:19:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-05-20T17:19:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-objecter_bytes": { 2024-05-20T17:19:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-05-20T17:19:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2024-05-20T17:19:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-05-20T17:19:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2024-05-20T17:19:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2024-05-20T17:19:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 2344, 2024-05-20T17:19:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 1086, 2024-05-20T17:19:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 2344, 2024-05-20T17:19:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 1086, 2024-05-20T17:19:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-05-20T17:19:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-objecter_ops": { 2024-05-20T17:19:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-05-20T17:19:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 1024, 2024-05-20T17:19:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-05-20T17:19:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2024-05-20T17:19:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2024-05-20T17:19:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 2344, 2024-05-20T17:19:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 2344, 2024-05-20T17:19:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 2344, 2024-05-20T17:19:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 2344, 2024-05-20T17:19:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-05-20T17:19:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-write_buf_throttle": { 2024-05-20T17:19:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-05-20T17:19:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 3758096384, 2024-05-20T17:19:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-05-20T17:19:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2024-05-20T17:19:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2024-05-20T17:19:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2024-05-20T17:19:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2024-05-20T17:19:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 0, 2024-05-20T17:19:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 0, 2024-05-20T17:19:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-05-20T17:19:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-write_buf_throttle-0x55f955306c30": { 2024-05-20T17:19:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-05-20T17:19:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 3758096384, 2024-05-20T17:19:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-05-20T17:19:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2024-05-20T17:19:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2024-05-20T17:19:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2024-05-20T17:19:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2024-05-20T17:19:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 0, 2024-05-20T17:19:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 0, 2024-05-20T17:19:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-05-20T17:19:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:15.866 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:19:16.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:15 smithi006 ceph-mon[32486]: pgmap v730: 129 pgs: 129 active+clean; 6.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 15 MiB/s wr, 365 op/s 2024-05-20T17:19:16.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:15 smithi062 ceph-mon[35425]: pgmap v730: 129 pgs: 129 active+clean; 6.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 15 MiB/s wr, 365 op/s 2024-05-20T17:19:16.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:15 smithi171 ceph-mon[35901]: pgmap v730: 129 pgs: 129 active+clean; 6.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 15 MiB/s wr, 365 op/s 2024-05-20T17:19:16.783 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-05-20T17:19:16.783 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-05-20T17:19:16.783 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-05-20T17:19:16.783 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-05-20T17:19:16.783 DEBUG:tasks.check_counter:Getting stats from d 2024-05-20T17:19:16.783 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph daemon mds.d perf dump 2024-05-20T17:19:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:19:18.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:17 smithi062 ceph-mon[35425]: pgmap v731: 129 pgs: 129 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 11 MiB/s wr, 389 op/s 2024-05-20T17:19:18.324 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:17 smithi006 ceph-mon[32486]: pgmap v731: 129 pgs: 129 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 11 MiB/s wr, 389 op/s 2024-05-20T17:19:18.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:17 smithi171 ceph-mon[35901]: pgmap v731: 129 pgs: 129 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 11 MiB/s wr, 389 op/s 2024-05-20T17:19:20.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:19 smithi006 ceph-mon[32486]: pgmap v732: 129 pgs: 129 active+clean; 994 MiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 6.4 MiB/s wr, 323 op/s 2024-05-20T17:19:20.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:19 smithi062 ceph-mon[35425]: pgmap v732: 129 pgs: 129 active+clean; 994 MiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 6.4 MiB/s wr, 323 op/s 2024-05-20T17:19:20.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:19 smithi171 ceph-mon[35901]: pgmap v732: 129 pgs: 129 active+clean; 994 MiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 6.4 MiB/s wr, 323 op/s 2024-05-20T17:19:22.198 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:21 smithi006 ceph-mon[32486]: pgmap v733: 129 pgs: 129 active+clean; 21 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 2.6 MiB/s wr, 277 op/s 2024-05-20T17:19:22.199 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:21 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:19:22.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:21 smithi062 ceph-mon[35425]: pgmap v733: 129 pgs: 129 active+clean; 21 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 2.6 MiB/s wr, 277 op/s 2024-05-20T17:19:22.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:21 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:19:22.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:21 smithi171 ceph-mon[35901]: pgmap v733: 129 pgs: 129 active+clean; 21 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 2.6 MiB/s wr, 277 op/s 2024-05-20T17:19:22.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:21 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-20T17:19:23.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:23 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:19:23.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:23 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:19:23.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:23 smithi171 ceph-mon[35901]: pgmap v734: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 410 KiB/s wr, 231 op/s 2024-05-20T17:19:23.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:23 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:19:23.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:23 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:19:23.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:23 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:19:23.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:23 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:19:23.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:23 smithi006 ceph-mon[32486]: pgmap v734: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 410 KiB/s wr, 231 op/s 2024-05-20T17:19:23.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:23 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:19:23.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:23 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:19:23.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:23 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:19:23.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:23 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:19:23.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:23 smithi062 ceph-mon[35425]: pgmap v734: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 410 KiB/s wr, 231 op/s 2024-05-20T17:19:23.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:23 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:19:23.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:23 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:19:24.286 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:19:24.287 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:19:24.287 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 4, 2024-05-20T17:19:24.287 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 4, 2024-05-20T17:19:24.287 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 2992, 2024-05-20T17:19:24.287 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 448, 2024-05-20T17:19:24.287 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2024-05-20T17:19:24.287 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 0, 2024-05-20T17:19:24.287 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.001812222, 2024-05-20T17:19:24.287 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.000040658, 2024-05-20T17:19:24.287 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.000751992, 2024-05-20T17:19:24.287 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-20T17:19:24.287 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 3, 2024-05-20T17:19:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000851740, 2024-05-20T17:19:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000283913 2024-05-20T17:19:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-20T17:19:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 448 2024-05-20T17:19:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:24.288 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:19:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 1, 2024-05-20T17:19:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 181, 2024-05-20T17:19:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 160, 2024-05-20T17:19:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 109504, 2024-05-20T17:19:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 3, 2024-05-20T17:19:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 2, 2024-05-20T17:19:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.015696639, 2024-05-20T17:19:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.010512061, 2024-05-20T17:19:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.001292560, 2024-05-20T17:19:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-20T17:19:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 179, 2024-05-20T17:19:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.008124863, 2024-05-20T17:19:24.289 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000045390 2024-05-20T17:19:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-20T17:19:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 109504 2024-05-20T17:19:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:19:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 241, 2024-05-20T17:19:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 238, 2024-05-20T17:19:24.290 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 484224, 2024-05-20T17:19:24.291 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 146624, 2024-05-20T17:19:24.291 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 2, 2024-05-20T17:19:24.291 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 1, 2024-05-20T17:19:24.291 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.037855344, 2024-05-20T17:19:24.291 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.014765930, 2024-05-20T17:19:24.291 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.017711465, 2024-05-20T17:19:24.291 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.005706674, 2024-05-20T17:19:24.291 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:24.291 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 237, 2024-05-20T17:19:24.291 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.014643791, 2024-05-20T17:19:24.291 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000061788 2024-05-20T17:19:24.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:24.291 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:24.291 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:24.292 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:24.292 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:24.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:24.292 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 484224, 2024-05-20T17:19:24.292 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 146624 2024-05-20T17:19:24.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:24.292 INFO:teuthology.orchestra.run.smithi006.stdout: "cct": { 2024-05-20T17:19:24.292 INFO:teuthology.orchestra.run.smithi006.stdout: "total_workers": 0, 2024-05-20T17:19:24.292 INFO:teuthology.orchestra.run.smithi006.stdout: "unhealthy_workers": 0 2024-05-20T17:19:24.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:24.292 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool": { 2024-05-20T17:19:24.292 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:19:24.292 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_items": 0, 2024-05-20T17:19:24.292 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:19:24.292 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:19:24.293 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:19:24.293 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:19:24.293 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:19:24.293 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:19:24.293 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:19:24.293 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:19:24.293 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:19:24.293 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:19:24.293 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:19:24.293 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:19:24.293 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:19:24.293 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_items": 0, 2024-05-20T17:19:24.293 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:19:24.293 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_items": 0, 2024-05-20T17:19:24.294 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:19:24.294 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:19:24.294 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:19:24.294 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:19:24.294 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:19:24.294 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:19:24.294 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:19:24.294 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_items": 0, 2024-05-20T17:19:24.294 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:19:24.294 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:19:24.294 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:19:24.294 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_items": 0, 2024-05-20T17:19:24.294 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_bytes": 0, 2024-05-20T17:19:24.294 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_items": 0, 2024-05-20T17:19:24.295 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:19:24.295 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:19:24.295 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:19:24.295 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:19:24.295 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_bytes": 148985, 2024-05-20T17:19:24.295 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_items": 30, 2024-05-20T17:19:24.295 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:19:24.295 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_items": 0, 2024-05-20T17:19:24.295 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bytes": 0, 2024-05-20T17:19:24.295 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_items": 0, 2024-05-20T17:19:24.295 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:19:24.295 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_items": 0, 2024-05-20T17:19:24.295 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:19:24.295 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_items": 0, 2024-05-20T17:19:24.295 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_bytes": 0, 2024-05-20T17:19:24.296 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_items": 0, 2024-05-20T17:19:24.296 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:19:24.296 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:19:24.296 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_bytes": 0, 2024-05-20T17:19:24.296 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_items": 0, 2024-05-20T17:19:24.296 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_bytes": 928, 2024-05-20T17:19:24.296 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_items": 2, 2024-05-20T17:19:24.296 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_bytes": 0, 2024-05-20T17:19:24.296 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_items": 0, 2024-05-20T17:19:24.296 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_bytes": 0, 2024-05-20T17:19:24.296 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_items": 0 2024-05-20T17:19:24.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:24.296 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:19:24.297 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-05-20T17:19:24.297 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2024-05-20T17:19:24.297 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-05-20T17:19:24.297 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 242, 2024-05-20T17:19:24.297 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 450150, 2024-05-20T17:19:24.297 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:24.297 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 242, 2024-05-20T17:19:24.297 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2024-05-20T17:19:24.297 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2024-05-20T17:19:24.297 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 242, 2024-05-20T17:19:24.297 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 450150, 2024-05-20T17:19:24.297 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-05-20T17:19:24.297 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:24.297 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:24.298 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:24.298 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:24.298 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:24.298 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:19:24.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:24 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:19:24.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:24 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:19:24.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:24 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:19:24.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:24 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:19:24.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:24 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:19:24.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:24 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:19:24.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:24 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-20T17:19:24.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:24 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-20T17:19:24.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:24 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' 2024-05-20T17:19:25.012 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-05-20T17:19:25.012 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-05-20T17:19:25.012 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-05-20T17:19:25.012 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-05-20T17:19:25.012 DEBUG:tasks.check_counter:Getting stats from g 2024-05-20T17:19:25.013 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph daemon mds.g perf dump 2024-05-20T17:19:25.269 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:19:25.553 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:25 smithi006 ceph-mon[32486]: pgmap v735: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.7 KiB/s wr, 180 op/s 2024-05-20T17:19:25.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:25 smithi171 ceph-mon[35901]: pgmap v735: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.7 KiB/s wr, 180 op/s 2024-05-20T17:19:25.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:25 smithi062 ceph-mon[35425]: pgmap v735: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.7 KiB/s wr, 180 op/s 2024-05-20T17:19:27.067 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:19:27.067 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:19:27.067 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 827, 2024-05-20T17:19:27.067 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 829, 2024-05-20T17:19:27.067 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 277817, 2024-05-20T17:19:27.067 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 262987, 2024-05-20T17:19:27.067 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 6, 2024-05-20T17:19:27.067 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 2, 2024-05-20T17:19:27.067 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.114288845, 2024-05-20T17:19:27.068 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.035469485, 2024-05-20T17:19:27.068 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.027623144, 2024-05-20T17:19:27.068 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.039452606, 2024-05-20T17:19:27.068 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:27.068 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 827, 2024-05-20T17:19:27.068 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.063426443, 2024-05-20T17:19:27.068 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000076694 2024-05-20T17:19:27.068 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.068 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:27.068 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.068 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.068 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.068 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.068 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-20T17:19:27.069 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 0 2024-05-20T17:19:27.069 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.069 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:19:27.069 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 1790, 2024-05-20T17:19:27.069 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 1779, 2024-05-20T17:19:27.069 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 936531, 2024-05-20T17:19:27.069 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 634075, 2024-05-20T17:19:27.069 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2024-05-20T17:19:27.069 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 3, 2024-05-20T17:19:27.069 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.159307099, 2024-05-20T17:19:27.069 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.045937587, 2024-05-20T17:19:27.069 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.049390529, 2024-05-20T17:19:27.070 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.057801447, 2024-05-20T17:19:27.070 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:27.070 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 1779, 2024-05-20T17:19:27.070 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.123571715, 2024-05-20T17:19:27.070 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000069461 2024-05-20T17:19:27.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.070 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:27.070 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.070 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.070 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.070 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 544560, 2024-05-20T17:19:27.070 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 145888 2024-05-20T17:19:27.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.071 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:19:27.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 4, 2024-05-20T17:19:27.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 181, 2024-05-20T17:19:27.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 1508, 2024-05-20T17:19:27.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 387477, 2024-05-20T17:19:27.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 5, 2024-05-20T17:19:27.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 4, 2024-05-20T17:19:27.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.015210242, 2024-05-20T17:19:27.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.011352177, 2024-05-20T17:19:27.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.002390663, 2024-05-20T17:19:27.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000052404, 2024-05-20T17:19:27.071 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:27.072 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 179, 2024-05-20T17:19:27.072 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.019741286, 2024-05-20T17:19:27.072 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000110286 2024-05-20T17:19:27.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.072 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:27.072 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.072 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.072 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.072 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-20T17:19:27.072 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 386512 2024-05-20T17:19:27.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.072 INFO:teuthology.orchestra.run.smithi006.stdout: "cct": { 2024-05-20T17:19:27.072 INFO:teuthology.orchestra.run.smithi006.stdout: "total_workers": 1, 2024-05-20T17:19:27.073 INFO:teuthology.orchestra.run.smithi006.stdout: "unhealthy_workers": 0 2024-05-20T17:19:27.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.073 INFO:teuthology.orchestra.run.smithi006.stdout: "finisher-MDSRank": { 2024-05-20T17:19:27.073 INFO:teuthology.orchestra.run.smithi006.stdout: "queue_len": 0, 2024-05-20T17:19:27.073 INFO:teuthology.orchestra.run.smithi006.stdout: "complete_latency": { 2024-05-20T17:19:27.073 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 3770, 2024-05-20T17:19:27.073 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.119890586, 2024-05-20T17:19:27.073 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000031801 2024-05-20T17:19:27.073 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:27.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.073 INFO:teuthology.orchestra.run.smithi006.stdout: "finisher-PurgeQueue": { 2024-05-20T17:19:27.073 INFO:teuthology.orchestra.run.smithi006.stdout: "queue_len": 0, 2024-05-20T17:19:27.073 INFO:teuthology.orchestra.run.smithi006.stdout: "complete_latency": { 2024-05-20T17:19:27.073 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.073 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.074 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.074 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:27.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.074 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-05-20T17:19:27.074 INFO:teuthology.orchestra.run.smithi006.stdout: "request": 0, 2024-05-20T17:19:27.074 INFO:teuthology.orchestra.run.smithi006.stdout: "reply": 0, 2024-05-20T17:19:27.074 INFO:teuthology.orchestra.run.smithi006.stdout: "reply_latency": { 2024-05-20T17:19:27.074 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.074 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.074 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.074 INFO:teuthology.orchestra.run.smithi006.stdout: "slow_reply": 0, 2024-05-20T17:19:27.074 INFO:teuthology.orchestra.run.smithi006.stdout: "forward": 0, 2024-05-20T17:19:27.074 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_fetch_complete": 0, 2024-05-20T17:19:27.075 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_fetch_keys": 0, 2024-05-20T17:19:27.075 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_commit": 0, 2024-05-20T17:19:27.075 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_split": 0, 2024-05-20T17:19:27.075 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_merge": 0, 2024-05-20T17:19:27.075 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes": 0, 2024-05-20T17:19:27.075 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_top": 0, 2024-05-20T17:19:27.075 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_bottom": 0, 2024-05-20T17:19:27.075 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_pin_tail": 0, 2024-05-20T17:19:27.075 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_pinned": 0, 2024-05-20T17:19:27.075 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_expired": 0, 2024-05-20T17:19:27.075 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_with_caps": 0, 2024-05-20T17:19:27.075 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": 0, 2024-05-20T17:19:27.076 INFO:teuthology.orchestra.run.smithi006.stdout: "subtrees": 1, 2024-05-20T17:19:27.076 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse": 0, 2024-05-20T17:19:27.076 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_hit": 0, 2024-05-20T17:19:27.076 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_forward": 0, 2024-05-20T17:19:27.076 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_discover": 0, 2024-05-20T17:19:27.076 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_dir_fetch": 0, 2024-05-20T17:19:27.076 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_remote_ino": 0, 2024-05-20T17:19:27.076 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_lock": 0, 2024-05-20T17:19:27.076 INFO:teuthology.orchestra.run.smithi006.stdout: "load_cent": 0, 2024-05-20T17:19:27.076 INFO:teuthology.orchestra.run.smithi006.stdout: "q": 0, 2024-05-20T17:19:27.076 INFO:teuthology.orchestra.run.smithi006.stdout: "exported": 0, 2024-05-20T17:19:27.076 INFO:teuthology.orchestra.run.smithi006.stdout: "exported_inodes": 0, 2024-05-20T17:19:27.076 INFO:teuthology.orchestra.run.smithi006.stdout: "imported": 0, 2024-05-20T17:19:27.076 INFO:teuthology.orchestra.run.smithi006.stdout: "imported_inodes": 0, 2024-05-20T17:19:27.077 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_dir_fetch": 0, 2024-05-20T17:19:27.077 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_backtrace_fetch": 0, 2024-05-20T17:19:27.077 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_peer_discover": 0, 2024-05-20T17:19:27.077 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rfiles": 0, 2024-05-20T17:19:27.077 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rbytes": 0, 2024-05-20T17:19:27.077 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rsnaps": 0, 2024-05-20T17:19:27.077 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_backtrace_fetch": 0, 2024-05-20T17:19:27.077 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_set_tag": 0, 2024-05-20T17:19:27.077 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_backtrace_repaired": 0, 2024-05-20T17:19:27.077 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_inotable_repaired": 0, 2024-05-20T17:19:27.077 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dir_inodes": 0, 2024-05-20T17:19:27.077 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dir_base_inodes": 0, 2024-05-20T17:19:27.077 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dirfrag_rstats": 0, 2024-05-20T17:19:27.077 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_file_inodes": 0, 2024-05-20T17:19:27.078 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_inode_file_caps": 0, 2024-05-20T17:19:27.078 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_revoke": 0, 2024-05-20T17:19:27.078 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_grant": 0, 2024-05-20T17:19:27.078 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_trunc": 0, 2024-05-20T17:19:27.078 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-20T17:19:27.078 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-20T17:19:27.078 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_caps": 0, 2024-05-20T17:19:27.078 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_caps_dirty": 0, 2024-05-20T17:19:27.078 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_cap_release": 0, 2024-05-20T17:19:27.078 INFO:teuthology.orchestra.run.smithi006.stdout: "process_request_cap_release": 0 2024-05-20T17:19:27.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.078 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache": { 2024-05-20T17:19:27.078 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_update": 0, 2024-05-20T17:19:27.078 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_update_receipt": 0, 2024-05-20T17:19:27.079 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_try_discover": 0, 2024-05-20T17:19:27.079 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_send_discover": 0, 2024-05-20T17:19:27.079 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_handle_discover": 0, 2024-05-20T17:19:27.079 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays": 0, 2024-05-20T17:19:27.079 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays_delayed": 0, 2024-05-20T17:19:27.079 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays_enqueuing": 0, 2024-05-20T17:19:27.079 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_created": 0, 2024-05-20T17:19:27.079 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_enqueued": 0, 2024-05-20T17:19:27.079 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_reintegrated": 0, 2024-05-20T17:19:27.079 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_migrated": 0, 2024-05-20T17:19:27.079 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_processing": 0, 2024-05-20T17:19:27.079 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_enqueued": 0, 2024-05-20T17:19:27.079 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_prioritized": 0, 2024-05-20T17:19:27.079 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_started": 0, 2024-05-20T17:19:27.080 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_completed": 0, 2024-05-20T17:19:27.080 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_quiesce_path": 0, 2024-05-20T17:19:27.080 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_quiesce_inode": 0, 2024-05-20T17:19:27.080 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_enqueue_scrub": 0, 2024-05-20T17:19:27.080 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_exportdir": 0, 2024-05-20T17:19:27.080 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_flush": 0, 2024-05-20T17:19:27.080 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_fragmentdir": 0, 2024-05-20T17:19:27.080 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_fragstats": 0, 2024-05-20T17:19:27.080 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_inodestats": 0 2024-05-20T17:19:27.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.080 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log": { 2024-05-20T17:19:27.080 INFO:teuthology.orchestra.run.smithi006.stdout: "evlrg": 0, 2024-05-20T17:19:27.080 INFO:teuthology.orchestra.run.smithi006.stdout: "evadd": 0, 2024-05-20T17:19:27.080 INFO:teuthology.orchestra.run.smithi006.stdout: "evex": 0, 2024-05-20T17:19:27.081 INFO:teuthology.orchestra.run.smithi006.stdout: "evtrm": 0, 2024-05-20T17:19:27.081 INFO:teuthology.orchestra.run.smithi006.stdout: "ev": 3, 2024-05-20T17:19:27.081 INFO:teuthology.orchestra.run.smithi006.stdout: "evexg": 0, 2024-05-20T17:19:27.081 INFO:teuthology.orchestra.run.smithi006.stdout: "evexd": 0, 2024-05-20T17:19:27.081 INFO:teuthology.orchestra.run.smithi006.stdout: "segadd": 0, 2024-05-20T17:19:27.081 INFO:teuthology.orchestra.run.smithi006.stdout: "segex": 0, 2024-05-20T17:19:27.081 INFO:teuthology.orchestra.run.smithi006.stdout: "segtrm": 0, 2024-05-20T17:19:27.081 INFO:teuthology.orchestra.run.smithi006.stdout: "seg": 2, 2024-05-20T17:19:27.081 INFO:teuthology.orchestra.run.smithi006.stdout: "segmjr": 2, 2024-05-20T17:19:27.081 INFO:teuthology.orchestra.run.smithi006.stdout: "segexg": 0, 2024-05-20T17:19:27.081 INFO:teuthology.orchestra.run.smithi006.stdout: "segexd": 0, 2024-05-20T17:19:27.081 INFO:teuthology.orchestra.run.smithi006.stdout: "expos": 4194304, 2024-05-20T17:19:27.081 INFO:teuthology.orchestra.run.smithi006.stdout: "wrpos": 4195385, 2024-05-20T17:19:27.081 INFO:teuthology.orchestra.run.smithi006.stdout: "rdpos": 4194892, 2024-05-20T17:19:27.082 INFO:teuthology.orchestra.run.smithi006.stdout: "jlat": { 2024-05-20T17:19:27.082 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.082 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.082 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.082 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.082 INFO:teuthology.orchestra.run.smithi006.stdout: "replayed": 3 2024-05-20T17:19:27.082 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.082 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_mem": { 2024-05-20T17:19:27.082 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 3, 2024-05-20T17:19:27.082 INFO:teuthology.orchestra.run.smithi006.stdout: "ino+": 3, 2024-05-20T17:19:27.082 INFO:teuthology.orchestra.run.smithi006.stdout: "ino-": 0, 2024-05-20T17:19:27.082 INFO:teuthology.orchestra.run.smithi006.stdout: "dir": 1, 2024-05-20T17:19:27.082 INFO:teuthology.orchestra.run.smithi006.stdout: "dir+": 1, 2024-05-20T17:19:27.082 INFO:teuthology.orchestra.run.smithi006.stdout: "dir-": 0, 2024-05-20T17:19:27.083 INFO:teuthology.orchestra.run.smithi006.stdout: "dn": 0, 2024-05-20T17:19:27.083 INFO:teuthology.orchestra.run.smithi006.stdout: "dn+": 0, 2024-05-20T17:19:27.083 INFO:teuthology.orchestra.run.smithi006.stdout: "dn-": 0, 2024-05-20T17:19:27.083 INFO:teuthology.orchestra.run.smithi006.stdout: "cap": 0, 2024-05-20T17:19:27.083 INFO:teuthology.orchestra.run.smithi006.stdout: "cap+": 0, 2024-05-20T17:19:27.083 INFO:teuthology.orchestra.run.smithi006.stdout: "cap-": 0, 2024-05-20T17:19:27.083 INFO:teuthology.orchestra.run.smithi006.stdout: "rss": 117692, 2024-05-20T17:19:27.083 INFO:teuthology.orchestra.run.smithi006.stdout: "heap": 215444 2024-05-20T17:19:27.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.083 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_server": { 2024-05-20T17:19:27.083 INFO:teuthology.orchestra.run.smithi006.stdout: "dispatch_client_request": 0, 2024-05-20T17:19:27.083 INFO:teuthology.orchestra.run.smithi006.stdout: "dispatch_server_request": 0, 2024-05-20T17:19:27.083 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_request": 0, 2024-05-20T17:19:27.083 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_session": 0, 2024-05-20T17:19:27.084 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_peer_request": 0, 2024-05-20T17:19:27.084 INFO:teuthology.orchestra.run.smithi006.stdout: "req_create_latency": { 2024-05-20T17:19:27.084 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.084 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.084 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.084 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getattr_latency": { 2024-05-20T17:19:27.084 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.084 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.084 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.084 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getfilelock_latency": { 2024-05-20T17:19:27.084 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.084 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.085 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.085 INFO:teuthology.orchestra.run.smithi006.stdout: "req_link_latency": { 2024-05-20T17:19:27.085 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.085 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.085 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.085 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookup_latency": { 2024-05-20T17:19:27.085 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.085 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.085 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.085 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookuphash_latency": { 2024-05-20T17:19:27.085 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.086 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.086 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.086 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.086 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupino_latency": { 2024-05-20T17:19:27.086 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.086 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.086 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.086 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.086 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupname_latency": { 2024-05-20T17:19:27.086 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.086 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.086 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.087 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.087 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupparent_latency": { 2024-05-20T17:19:27.087 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.087 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.087 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.087 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.087 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupsnap_latency": { 2024-05-20T17:19:27.087 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.087 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.087 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.087 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.087 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lssnap_latency": { 2024-05-20T17:19:27.087 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.087 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.087 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.088 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mkdir_latency": { 2024-05-20T17:19:27.088 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.088 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.088 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.089 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mknod_latency": { 2024-05-20T17:19:27.089 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.089 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.089 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.089 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mksnap_latency": { 2024-05-20T17:19:27.089 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.089 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.089 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.089 INFO:teuthology.orchestra.run.smithi006.stdout: "req_open_latency": { 2024-05-20T17:19:27.089 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.090 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.090 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.090 INFO:teuthology.orchestra.run.smithi006.stdout: "req_readdir_latency": { 2024-05-20T17:19:27.090 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.090 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.090 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.090 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rename_latency": { 2024-05-20T17:19:27.090 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.090 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.090 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.091 INFO:teuthology.orchestra.run.smithi006.stdout: "req_renamesnap_latency": { 2024-05-20T17:19:27.091 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.091 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.091 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.091 INFO:teuthology.orchestra.run.smithi006.stdout: "req_snapdiff_latency": { 2024-05-20T17:19:27.091 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.091 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.091 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.091 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmdir_latency": { 2024-05-20T17:19:27.091 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.092 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.092 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.092 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.092 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmsnap_latency": { 2024-05-20T17:19:27.092 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.092 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.092 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.092 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.092 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmxattr_latency": { 2024-05-20T17:19:27.092 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.092 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.092 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.092 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.092 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setattr_latency": { 2024-05-20T17:19:27.093 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.093 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.093 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.093 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.093 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setdirlayout_latency": { 2024-05-20T17:19:27.093 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.093 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.093 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.093 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.093 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setfilelock_latency": { 2024-05-20T17:19:27.093 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.093 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.093 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.094 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setlayout_latency": { 2024-05-20T17:19:27.094 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.094 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.094 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.094 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setxattr_latency": { 2024-05-20T17:19:27.094 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.094 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.094 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.094 INFO:teuthology.orchestra.run.smithi006.stdout: "req_symlink_latency": { 2024-05-20T17:19:27.094 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.095 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.095 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.095 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.095 INFO:teuthology.orchestra.run.smithi006.stdout: "req_unlink_latency": { 2024-05-20T17:19:27.095 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.095 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.095 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.095 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.095 INFO:teuthology.orchestra.run.smithi006.stdout: "cap_revoke_eviction": 0, 2024-05-20T17:19:27.095 INFO:teuthology.orchestra.run.smithi006.stdout: "cap_acquisition_throttle": 0, 2024-05-20T17:19:27.095 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getvxattr_latency": { 2024-05-20T17:19:27.095 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.095 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.095 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.096 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:27.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.096 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_sessions": { 2024-05-20T17:19:27.096 INFO:teuthology.orchestra.run.smithi006.stdout: "session_count": 1, 2024-05-20T17:19:27.096 INFO:teuthology.orchestra.run.smithi006.stdout: "session_add": 1, 2024-05-20T17:19:27.096 INFO:teuthology.orchestra.run.smithi006.stdout: "session_remove": 0, 2024-05-20T17:19:27.096 INFO:teuthology.orchestra.run.smithi006.stdout: "sessions_open": 1, 2024-05-20T17:19:27.096 INFO:teuthology.orchestra.run.smithi006.stdout: "sessions_stale": 0, 2024-05-20T17:19:27.096 INFO:teuthology.orchestra.run.smithi006.stdout: "total_load": 0, 2024-05-20T17:19:27.096 INFO:teuthology.orchestra.run.smithi006.stdout: "average_load": 0, 2024-05-20T17:19:27.096 INFO:teuthology.orchestra.run.smithi006.stdout: "avg_session_uptime": 1875, 2024-05-20T17:19:27.096 INFO:teuthology.orchestra.run.smithi006.stdout: "mdthresh_evicted": 0 2024-05-20T17:19:27.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.096 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool": { 2024-05-20T17:19:27.096 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:19:27.096 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_items": 0, 2024-05-20T17:19:27.097 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:19:27.097 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:19:27.097 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:19:27.097 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:19:27.097 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:19:27.097 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:19:27.097 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:19:27.097 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:19:27.097 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:19:27.097 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:19:27.097 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:19:27.097 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:19:27.097 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:19:27.097 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_items": 0, 2024-05-20T17:19:27.097 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:19:27.098 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_items": 0, 2024-05-20T17:19:27.098 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:19:27.098 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:19:27.098 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:19:27.098 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:19:27.098 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:19:27.098 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:19:27.098 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:19:27.098 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_items": 0, 2024-05-20T17:19:27.098 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:19:27.098 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:19:27.098 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:19:27.098 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_items": 0, 2024-05-20T17:19:27.098 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_bytes": 0, 2024-05-20T17:19:27.099 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_items": 0, 2024-05-20T17:19:27.099 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:19:27.099 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:19:27.099 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:19:27.099 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:19:27.099 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_bytes": 197463, 2024-05-20T17:19:27.099 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_items": 54, 2024-05-20T17:19:27.099 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:19:27.099 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_items": 0, 2024-05-20T17:19:27.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bytes": 0, 2024-05-20T17:19:27.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_items": 0, 2024-05-20T17:19:27.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:19:27.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_items": 0, 2024-05-20T17:19:27.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:19:27.100 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_items": 0, 2024-05-20T17:19:27.100 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_bytes": 8984, 2024-05-20T17:19:27.100 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_items": 172, 2024-05-20T17:19:27.100 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:19:27.100 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:19:27.100 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_bytes": 0, 2024-05-20T17:19:27.100 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_items": 0, 2024-05-20T17:19:27.100 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_bytes": 8464, 2024-05-20T17:19:27.100 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_items": 13, 2024-05-20T17:19:27.100 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_bytes": 0, 2024-05-20T17:19:27.100 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_items": 0, 2024-05-20T17:19:27.100 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_bytes": 0, 2024-05-20T17:19:27.100 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_items": 0 2024-05-20T17:19:27.100 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.100 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter": { 2024-05-20T17:19:27.101 INFO:teuthology.orchestra.run.smithi006.stdout: "op_active": 0, 2024-05-20T17:19:27.101 INFO:teuthology.orchestra.run.smithi006.stdout: "op_laggy": 0, 2024-05-20T17:19:27.101 INFO:teuthology.orchestra.run.smithi006.stdout: "op_send": 2365, 2024-05-20T17:19:27.101 INFO:teuthology.orchestra.run.smithi006.stdout: "op_send_bytes": 21, 2024-05-20T17:19:27.101 INFO:teuthology.orchestra.run.smithi006.stdout: "op_resend": 3, 2024-05-20T17:19:27.101 INFO:teuthology.orchestra.run.smithi006.stdout: "op_reply": 2365, 2024-05-20T17:19:27.101 INFO:teuthology.orchestra.run.smithi006.stdout: "op_latency": { 2024-05-20T17:19:27.101 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 2365, 2024-05-20T17:19:27.101 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 5.711933160, 2024-05-20T17:19:27.101 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.002415193 2024-05-20T17:19:27.101 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.101 INFO:teuthology.orchestra.run.smithi006.stdout: "op_inflight": 0, 2024-05-20T17:19:27.101 INFO:teuthology.orchestra.run.smithi006.stdout: "oplen_avg": { 2024-05-20T17:19:27.101 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 2365, 2024-05-20T17:19:27.102 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 2366 2024-05-20T17:19:27.102 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.102 INFO:teuthology.orchestra.run.smithi006.stdout: "op": 2365, 2024-05-20T17:19:27.102 INFO:teuthology.orchestra.run.smithi006.stdout: "op_r": 2365, 2024-05-20T17:19:27.102 INFO:teuthology.orchestra.run.smithi006.stdout: "op_w": 0, 2024-05-20T17:19:27.102 INFO:teuthology.orchestra.run.smithi006.stdout: "op_rmw": 0, 2024-05-20T17:19:27.102 INFO:teuthology.orchestra.run.smithi006.stdout: "op_pg": 0, 2024-05-20T17:19:27.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_stat": 1532, 2024-05-20T17:19:27.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_create": 0, 2024-05-20T17:19:27.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_read": 831, 2024-05-20T17:19:27.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_write": 0, 2024-05-20T17:19:27.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_writefull": 0, 2024-05-20T17:19:27.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_writesame": 0, 2024-05-20T17:19:27.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_append": 0, 2024-05-20T17:19:27.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_zero": 0, 2024-05-20T17:19:27.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_truncate": 0, 2024-05-20T17:19:27.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_delete": 0, 2024-05-20T17:19:27.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_mapext": 0, 2024-05-20T17:19:27.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_sparse_read": 0, 2024-05-20T17:19:27.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_clonerange": 0, 2024-05-20T17:19:27.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_getxattr": 1, 2024-05-20T17:19:27.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_setxattr": 0, 2024-05-20T17:19:27.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_cmpxattr": 0, 2024-05-20T17:19:27.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_rmxattr": 0, 2024-05-20T17:19:27.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_resetxattrs": 0, 2024-05-20T17:19:27.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_call": 0, 2024-05-20T17:19:27.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_watch": 0, 2024-05-20T17:19:27.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_notify": 0, 2024-05-20T17:19:27.104 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_src_cmpxattr": 0, 2024-05-20T17:19:27.104 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_pgls": 0, 2024-05-20T17:19:27.104 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_pgls_filter": 0, 2024-05-20T17:19:27.104 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_other": 0, 2024-05-20T17:19:27.104 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_active": 0, 2024-05-20T17:19:27.104 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_send": 0, 2024-05-20T17:19:27.104 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_resend": 0, 2024-05-20T17:19:27.104 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_ping": 0, 2024-05-20T17:19:27.104 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_active": 0, 2024-05-20T17:19:27.104 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_send": 0, 2024-05-20T17:19:27.104 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_resend": 0, 2024-05-20T17:19:27.104 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_active": 0, 2024-05-20T17:19:27.104 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_send": 0, 2024-05-20T17:19:27.104 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_resend": 0, 2024-05-20T17:19:27.104 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_active": 0, 2024-05-20T17:19:27.105 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_send": 0, 2024-05-20T17:19:27.105 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_resend": 0, 2024-05-20T17:19:27.105 INFO:teuthology.orchestra.run.smithi006.stdout: "command_active": 0, 2024-05-20T17:19:27.105 INFO:teuthology.orchestra.run.smithi006.stdout: "command_send": 0, 2024-05-20T17:19:27.105 INFO:teuthology.orchestra.run.smithi006.stdout: "command_resend": 0, 2024-05-20T17:19:27.105 INFO:teuthology.orchestra.run.smithi006.stdout: "map_epoch": 94, 2024-05-20T17:19:27.105 INFO:teuthology.orchestra.run.smithi006.stdout: "map_full": 0, 2024-05-20T17:19:27.105 INFO:teuthology.orchestra.run.smithi006.stdout: "map_inc": 4, 2024-05-20T17:19:27.105 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_sessions": 6, 2024-05-20T17:19:27.105 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_session_open": 6, 2024-05-20T17:19:27.105 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_session_close": 0, 2024-05-20T17:19:27.105 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_laggy": 0, 2024-05-20T17:19:27.105 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_wr": 0, 2024-05-20T17:19:27.105 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_rd": 2, 2024-05-20T17:19:27.105 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_del": 0 2024-05-20T17:19:27.106 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.106 INFO:teuthology.orchestra.run.smithi006.stdout: "oft": { 2024-05-20T17:19:27.106 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_objs": 0, 2024-05-20T17:19:27.106 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_kv_pairs": 0, 2024-05-20T17:19:27.106 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_updates": 0, 2024-05-20T17:19:27.106 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_removes": 0 2024-05-20T17:19:27.106 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.106 INFO:teuthology.orchestra.run.smithi006.stdout: "osd-slow-ops": { 2024-05-20T17:19:27.106 INFO:teuthology.orchestra.run.smithi006.stdout: "slow_ops_count": 0 2024-05-20T17:19:27.106 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.106 INFO:teuthology.orchestra.run.smithi006.stdout: "purge_queue": { 2024-05-20T17:19:27.106 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_ops": 0, 2024-05-20T17:19:27.106 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_ops_high_water": 0, 2024-05-20T17:19:27.106 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing": 0, 2024-05-20T17:19:27.107 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_high_water": 0, 2024-05-20T17:19:27.107 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executed_ops": 0, 2024-05-20T17:19:27.107 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executed": 0, 2024-05-20T17:19:27.107 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_item_in_journal": 0 2024-05-20T17:19:27.107 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.107 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:19:27.107 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-05-20T17:19:27.107 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2024-05-20T17:19:27.107 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-05-20T17:19:27.107 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 2617, 2024-05-20T17:19:27.107 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 964452, 2024-05-20T17:19:27.107 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:27.107 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 2617, 2024-05-20T17:19:27.107 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2024-05-20T17:19:27.108 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2024-05-20T17:19:27.108 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 2617, 2024-05-20T17:19:27.108 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 964452, 2024-05-20T17:19:27.108 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-05-20T17:19:27.108 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.108 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.108 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.108 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:27.108 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.108 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-objecter_bytes": { 2024-05-20T17:19:27.108 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-05-20T17:19:27.108 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2024-05-20T17:19:27.108 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-05-20T17:19:27.108 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2024-05-20T17:19:27.109 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2024-05-20T17:19:27.109 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:27.109 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:27.109 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 2365, 2024-05-20T17:19:27.109 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 1086, 2024-05-20T17:19:27.109 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 2365, 2024-05-20T17:19:27.109 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 1086, 2024-05-20T17:19:27.109 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-05-20T17:19:27.109 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.109 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.109 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.109 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:27.109 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.109 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-objecter_ops": { 2024-05-20T17:19:27.110 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-05-20T17:19:27.110 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 1024, 2024-05-20T17:19:27.110 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-05-20T17:19:27.110 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2024-05-20T17:19:27.110 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2024-05-20T17:19:27.110 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:27.110 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:27.110 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 2365, 2024-05-20T17:19:27.110 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 2365, 2024-05-20T17:19:27.110 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 2365, 2024-05-20T17:19:27.110 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 2365, 2024-05-20T17:19:27.110 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-05-20T17:19:27.110 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.110 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-write_buf_throttle": { 2024-05-20T17:19:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-05-20T17:19:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 3758096384, 2024-05-20T17:19:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-05-20T17:19:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2024-05-20T17:19:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2024-05-20T17:19:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2024-05-20T17:19:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2024-05-20T17:19:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 0, 2024-05-20T17:19:27.111 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 0, 2024-05-20T17:19:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-05-20T17:19:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-write_buf_throttle-0x55e41ea4cb60": { 2024-05-20T17:19:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-05-20T17:19:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 3758096384, 2024-05-20T17:19:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-05-20T17:19:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2024-05-20T17:19:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2024-05-20T17:19:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:27.112 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2024-05-20T17:19:27.113 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2024-05-20T17:19:27.113 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 0, 2024-05-20T17:19:27.113 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 0, 2024-05-20T17:19:27.113 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-05-20T17:19:27.113 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:27.113 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:27.113 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:27.113 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:27.113 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:27.113 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:19:27.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:27 smithi062 ceph-mon[35425]: pgmap v736: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 145 op/s 2024-05-20T17:19:27.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:27 smithi171 ceph-mon[35901]: pgmap v736: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 145 op/s 2024-05-20T17:19:27.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:27 smithi006 ceph-mon[32486]: pgmap v736: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 145 op/s 2024-05-20T17:19:27.963 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-05-20T17:19:27.963 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-05-20T17:19:27.964 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-05-20T17:19:27.964 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-05-20T17:19:27.964 DEBUG:tasks.check_counter:Getting stats from j 2024-05-20T17:19:27.964 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph daemon mds.j perf dump 2024-05-20T17:19:28.221 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.a/config 2024-05-20T17:19:29.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:29 smithi006 ceph-mon[32486]: pgmap v737: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 60 op/s 2024-05-20T17:19:29.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:29 smithi062 ceph-mon[35425]: pgmap v737: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 60 op/s 2024-05-20T17:19:29.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:29 smithi171 ceph-mon[35901]: pgmap v737: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 60 op/s 2024-05-20T17:19:29.935 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:19:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:19:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 0, 2024-05-20T17:19:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 2, 2024-05-20T17:19:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 0, 2024-05-20T17:19:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 0, 2024-05-20T17:19:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2024-05-20T17:19:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 0, 2024-05-20T17:19:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.001328592, 2024-05-20T17:19:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.000000000, 2024-05-20T17:19:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.000239506, 2024-05-20T17:19:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-20T17:19:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-20T17:19:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 0 2024-05-20T17:19:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:19:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 247, 2024-05-20T17:19:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 242, 2024-05-20T17:19:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 487760, 2024-05-20T17:19:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 148352, 2024-05-20T17:19:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 2, 2024-05-20T17:19:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 1, 2024-05-20T17:19:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.038245190, 2024-05-20T17:19:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.015164514, 2024-05-20T17:19:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.016949971, 2024-05-20T17:19:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.005648898, 2024-05-20T17:19:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 242, 2024-05-20T17:19:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.015833173, 2024-05-20T17:19:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000065426 2024-05-20T17:19:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 487760, 2024-05-20T17:19:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 148352 2024-05-20T17:19:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:19:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 1, 2024-05-20T17:19:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 183, 2024-05-20T17:19:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 160, 2024-05-20T17:19:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 109856, 2024-05-20T17:19:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 3, 2024-05-20T17:19:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 2, 2024-05-20T17:19:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.015401482, 2024-05-20T17:19:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.011584211, 2024-05-20T17:19:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.001341635, 2024-05-20T17:19:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-20T17:19:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 181, 2024-05-20T17:19:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.007097280, 2024-05-20T17:19:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000039211 2024-05-20T17:19:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-20T17:19:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 109856 2024-05-20T17:19:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "cct": { 2024-05-20T17:19:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "total_workers": 0, 2024-05-20T17:19:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "unhealthy_workers": 0 2024-05-20T17:19:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool": { 2024-05-20T17:19:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:19:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_items": 0, 2024-05-20T17:19:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:19:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:19:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:19:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:19:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:19:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:19:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:19:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:19:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:19:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:19:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:19:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:19:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:19:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_items": 0, 2024-05-20T17:19:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:19:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_items": 0, 2024-05-20T17:19:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:19:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:19:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:19:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:19:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:19:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:19:29.944 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:19:29.944 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_items": 0, 2024-05-20T17:19:29.944 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:19:29.944 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:19:29.944 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:19:29.944 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_items": 0, 2024-05-20T17:19:29.944 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_bytes": 0, 2024-05-20T17:19:29.944 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_items": 0, 2024-05-20T17:19:29.944 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:19:29.944 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:19:29.944 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:19:29.945 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:19:29.945 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_bytes": 148952, 2024-05-20T17:19:29.945 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_items": 29, 2024-05-20T17:19:29.945 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:19:29.945 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_items": 0, 2024-05-20T17:19:29.945 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bytes": 0, 2024-05-20T17:19:29.945 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_items": 0, 2024-05-20T17:19:29.945 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:19:29.945 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_items": 0, 2024-05-20T17:19:29.945 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:19:29.945 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_items": 0, 2024-05-20T17:19:29.945 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_bytes": 0, 2024-05-20T17:19:29.946 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_items": 0, 2024-05-20T17:19:29.946 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:19:29.946 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:19:29.946 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_bytes": 0, 2024-05-20T17:19:29.946 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_items": 0, 2024-05-20T17:19:29.946 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_bytes": 928, 2024-05-20T17:19:29.946 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_items": 2, 2024-05-20T17:19:29.946 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_bytes": 0, 2024-05-20T17:19:29.946 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_items": 0, 2024-05-20T17:19:29.946 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_bytes": 0, 2024-05-20T17:19:29.946 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_items": 0 2024-05-20T17:19:29.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:19:29.946 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:19:29.947 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2024-05-20T17:19:29.947 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2024-05-20T17:19:29.947 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2024-05-20T17:19:29.947 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 244, 2024-05-20T17:19:29.947 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 450410, 2024-05-20T17:19:29.947 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:29.947 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 244, 2024-05-20T17:19:29.947 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2024-05-20T17:19:29.947 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2024-05-20T17:19:29.947 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 244, 2024-05-20T17:19:29.947 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 450410, 2024-05-20T17:19:29.947 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2024-05-20T17:19:29.947 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2024-05-20T17:19:29.947 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2024-05-20T17:19:29.948 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2024-05-20T17:19:29.948 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:29.948 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:19:29.948 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:19:30.663 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-05-20T17:19:30.663 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-05-20T17:19:30.663 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-05-20T17:19:30.663 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-05-20T17:19:30.664 DEBUG:tasks.check_counter:Getting stats from b 2024-05-20T17:19:30.664 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph daemon mds.b perf dump 2024-05-20T17:19:30.946 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:19:31.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:31 smithi062 ceph-mon[35425]: pgmap v738: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 682 B/s wr, 32 op/s 2024-05-20T17:19:31.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:31 smithi171 ceph-mon[35901]: pgmap v738: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 682 B/s wr, 32 op/s 2024-05-20T17:19:31.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:31 smithi006 ceph-mon[32486]: pgmap v738: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 682 B/s wr, 32 op/s 2024-05-20T17:19:33.056 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-20T17:19:33.056 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:19:33.056 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 1984, 2024-05-20T17:19:33.056 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 1822, 2024-05-20T17:19:33.057 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 627202, 2024-05-20T17:19:33.057 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 1321421, 2024-05-20T17:19:33.057 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 11, 2024-05-20T17:19:33.057 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 5, 2024-05-20T17:19:33.057 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.183434623, 2024-05-20T17:19:33.057 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.046143038, 2024-05-20T17:19:33.057 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.069350118, 2024-05-20T17:19:33.057 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.057928909, 2024-05-20T17:19:33.057 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:33.057 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 1821, 2024-05-20T17:19:33.057 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.351424151, 2024-05-20T17:19:33.057 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000192984 2024-05-20T17:19:33.058 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.058 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:33.058 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 1078, 2024-05-20T17:19:33.058 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000294749, 2024-05-20T17:19:33.058 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000273 2024-05-20T17:19:33.058 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.058 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-20T17:19:33.058 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 448 2024-05-20T17:19:33.058 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.058 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:19:33.058 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 2078, 2024-05-20T17:19:33.058 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 1947, 2024-05-20T17:19:33.058 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 738049, 2024-05-20T17:19:33.059 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 1002898, 2024-05-20T17:19:33.059 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 9, 2024-05-20T17:19:33.059 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 5, 2024-05-20T17:19:33.059 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.209939979, 2024-05-20T17:19:33.059 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.063053377, 2024-05-20T17:19:33.059 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.077608546, 2024-05-20T17:19:33.059 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.062810634, 2024-05-20T17:19:33.059 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:33.059 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 1951, 2024-05-20T17:19:33.059 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.562377725, 2024-05-20T17:19:33.059 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000288251 2024-05-20T17:19:33.059 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.059 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:33.060 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 2039, 2024-05-20T17:19:33.060 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000518849, 2024-05-20T17:19:33.060 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000254 2024-05-20T17:19:33.060 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.060 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-20T17:19:33.060 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 400608 2024-05-20T17:19:33.060 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.060 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:19:33.060 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 3128, 2024-05-20T17:19:33.060 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 2368, 2024-05-20T17:19:33.060 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 1570635, 2024-05-20T17:19:33.060 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 965935, 2024-05-20T17:19:33.060 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 18, 2024-05-20T17:19:33.061 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 12, 2024-05-20T17:19:33.061 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.345898533, 2024-05-20T17:19:33.061 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.097100489, 2024-05-20T17:19:33.061 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.154515782, 2024-05-20T17:19:33.061 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.104066009, 2024-05-20T17:19:33.061 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:33.061 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 2361, 2024-05-20T17:19:33.061 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.683032125, 2024-05-20T17:19:33.061 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000289297 2024-05-20T17:19:33.061 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.061 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:33.061 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 2585, 2024-05-20T17:19:33.061 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000643017, 2024-05-20T17:19:33.062 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000248 2024-05-20T17:19:33.062 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.062 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 637152, 2024-05-20T17:19:33.062 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 181664 2024-05-20T17:19:33.062 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.062 INFO:teuthology.orchestra.run.smithi062.stdout: "cct": { 2024-05-20T17:19:33.062 INFO:teuthology.orchestra.run.smithi062.stdout: "total_workers": 1, 2024-05-20T17:19:33.062 INFO:teuthology.orchestra.run.smithi062.stdout: "unhealthy_workers": 0 2024-05-20T17:19:33.062 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.062 INFO:teuthology.orchestra.run.smithi062.stdout: "finisher-MDSRank": { 2024-05-20T17:19:33.062 INFO:teuthology.orchestra.run.smithi062.stdout: "queue_len": 0, 2024-05-20T17:19:33.062 INFO:teuthology.orchestra.run.smithi062.stdout: "complete_latency": { 2024-05-20T17:19:33.062 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 343, 2024-05-20T17:19:33.063 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.146857296, 2024-05-20T17:19:33.063 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000428155 2024-05-20T17:19:33.063 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:33.063 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.063 INFO:teuthology.orchestra.run.smithi062.stdout: "finisher-PurgeQueue": { 2024-05-20T17:19:33.063 INFO:teuthology.orchestra.run.smithi062.stdout: "queue_len": 0, 2024-05-20T17:19:33.063 INFO:teuthology.orchestra.run.smithi062.stdout: "complete_latency": { 2024-05-20T17:19:33.063 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 2489, 2024-05-20T17:19:33.063 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.098496118, 2024-05-20T17:19:33.063 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000039572 2024-05-20T17:19:33.063 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:33.063 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.064 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-20T17:19:33.064 INFO:teuthology.orchestra.run.smithi062.stdout: "request": 115, 2024-05-20T17:19:33.064 INFO:teuthology.orchestra.run.smithi062.stdout: "reply": 113, 2024-05-20T17:19:33.064 INFO:teuthology.orchestra.run.smithi062.stdout: "reply_latency": { 2024-05-20T17:19:33.064 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 113, 2024-05-20T17:19:33.064 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.173085240, 2024-05-20T17:19:33.064 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.001531727 2024-05-20T17:19:33.064 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.064 INFO:teuthology.orchestra.run.smithi062.stdout: "slow_reply": 0, 2024-05-20T17:19:33.064 INFO:teuthology.orchestra.run.smithi062.stdout: "forward": 2, 2024-05-20T17:19:33.064 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_fetch_complete": 0, 2024-05-20T17:19:33.064 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_fetch_keys": 0, 2024-05-20T17:19:33.065 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_commit": 12, 2024-05-20T17:19:33.065 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_split": 0, 2024-05-20T17:19:33.065 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_merge": 0, 2024-05-20T17:19:33.065 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes": 25, 2024-05-20T17:19:33.065 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_top": 0, 2024-05-20T17:19:33.065 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_bottom": 25, 2024-05-20T17:19:33.065 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_pin_tail": 0, 2024-05-20T17:19:33.065 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_pinned": 24, 2024-05-20T17:19:33.065 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_expired": 2, 2024-05-20T17:19:33.065 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_with_caps": 2, 2024-05-20T17:19:33.065 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": 2, 2024-05-20T17:19:33.065 INFO:teuthology.orchestra.run.smithi062.stdout: "subtrees": 2, 2024-05-20T17:19:33.066 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse": 165, 2024-05-20T17:19:33.066 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_hit": 150, 2024-05-20T17:19:33.066 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_forward": 0, 2024-05-20T17:19:33.066 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_discover": 0, 2024-05-20T17:19:33.066 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_dir_fetch": 0, 2024-05-20T17:19:33.066 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_remote_ino": 0, 2024-05-20T17:19:33.066 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_lock": 0, 2024-05-20T17:19:33.066 INFO:teuthology.orchestra.run.smithi062.stdout: "load_cent": 121, 2024-05-20T17:19:33.066 INFO:teuthology.orchestra.run.smithi062.stdout: "q": 0, 2024-05-20T17:19:33.066 INFO:teuthology.orchestra.run.smithi062.stdout: "exported": 1, 2024-05-20T17:19:33.066 INFO:teuthology.orchestra.run.smithi062.stdout: "exported_inodes": 2, 2024-05-20T17:19:33.066 INFO:teuthology.orchestra.run.smithi062.stdout: "imported": 1, 2024-05-20T17:19:33.067 INFO:teuthology.orchestra.run.smithi062.stdout: "imported_inodes": 0, 2024-05-20T17:19:33.067 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_dir_fetch": 0, 2024-05-20T17:19:33.067 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_backtrace_fetch": 0, 2024-05-20T17:19:33.067 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_peer_discover": 0, 2024-05-20T17:19:33.067 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rfiles": 4, 2024-05-20T17:19:33.067 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rbytes": 234, 2024-05-20T17:19:33.067 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rsnaps": 0, 2024-05-20T17:19:33.067 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_backtrace_fetch": 0, 2024-05-20T17:19:33.068 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_set_tag": 0, 2024-05-20T17:19:33.068 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_backtrace_repaired": 0, 2024-05-20T17:19:33.068 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_inotable_repaired": 0, 2024-05-20T17:19:33.068 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dir_inodes": 0, 2024-05-20T17:19:33.068 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dir_base_inodes": 0, 2024-05-20T17:19:33.068 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dirfrag_rstats": 0, 2024-05-20T17:19:33.068 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_file_inodes": 0, 2024-05-20T17:19:33.068 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_inode_file_caps": 0, 2024-05-20T17:19:33.068 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_revoke": 41, 2024-05-20T17:19:33.068 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_grant": 133, 2024-05-20T17:19:33.069 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_trunc": 0, 2024-05-20T17:19:33.069 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-20T17:19:33.069 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-20T17:19:33.069 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_caps": 178, 2024-05-20T17:19:33.069 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_caps_dirty": 143, 2024-05-20T17:19:33.069 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_cap_release": 3, 2024-05-20T17:19:33.069 INFO:teuthology.orchestra.run.smithi062.stdout: "process_request_cap_release": 80 2024-05-20T17:19:33.069 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.069 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache": { 2024-05-20T17:19:33.069 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_update": 18, 2024-05-20T17:19:33.069 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_update_receipt": 0, 2024-05-20T17:19:33.069 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_try_discover": 0, 2024-05-20T17:19:33.069 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_send_discover": 0, 2024-05-20T17:19:33.070 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_handle_discover": 42, 2024-05-20T17:19:33.070 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays": 1, 2024-05-20T17:19:33.070 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays_delayed": 0, 2024-05-20T17:19:33.070 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays_enqueuing": 0, 2024-05-20T17:19:33.070 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_created": 20, 2024-05-20T17:19:33.070 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_enqueued": 19, 2024-05-20T17:19:33.070 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_reintegrated": 0, 2024-05-20T17:19:33.070 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_migrated": 0, 2024-05-20T17:19:33.070 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_processing": 0, 2024-05-20T17:19:33.070 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_enqueued": 0, 2024-05-20T17:19:33.070 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_prioritized": 0, 2024-05-20T17:19:33.070 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_started": 0, 2024-05-20T17:19:33.070 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_completed": 0, 2024-05-20T17:19:33.071 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_quiesce_path": 0, 2024-05-20T17:19:33.071 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_quiesce_inode": 0, 2024-05-20T17:19:33.071 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_enqueue_scrub": 0, 2024-05-20T17:19:33.071 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_exportdir": 1, 2024-05-20T17:19:33.071 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_flush": 0, 2024-05-20T17:19:33.071 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_fragmentdir": 0, 2024-05-20T17:19:33.071 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_fragstats": 0, 2024-05-20T17:19:33.071 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_inodestats": 0 2024-05-20T17:19:33.071 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.071 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log": { 2024-05-20T17:19:33.071 INFO:teuthology.orchestra.run.smithi062.stdout: "evlrg": 0, 2024-05-20T17:19:33.071 INFO:teuthology.orchestra.run.smithi062.stdout: "evadd": 274, 2024-05-20T17:19:33.071 INFO:teuthology.orchestra.run.smithi062.stdout: "evex": 0, 2024-05-20T17:19:33.071 INFO:teuthology.orchestra.run.smithi062.stdout: "evtrm": 0, 2024-05-20T17:19:33.072 INFO:teuthology.orchestra.run.smithi062.stdout: "ev": 274, 2024-05-20T17:19:33.072 INFO:teuthology.orchestra.run.smithi062.stdout: "evexg": 0, 2024-05-20T17:19:33.072 INFO:teuthology.orchestra.run.smithi062.stdout: "evexd": 0, 2024-05-20T17:19:33.072 INFO:teuthology.orchestra.run.smithi062.stdout: "segadd": 2, 2024-05-20T17:19:33.072 INFO:teuthology.orchestra.run.smithi062.stdout: "segex": 0, 2024-05-20T17:19:33.072 INFO:teuthology.orchestra.run.smithi062.stdout: "segtrm": 0, 2024-05-20T17:19:33.072 INFO:teuthology.orchestra.run.smithi062.stdout: "seg": 2, 2024-05-20T17:19:33.072 INFO:teuthology.orchestra.run.smithi062.stdout: "segmjr": 2, 2024-05-20T17:19:33.072 INFO:teuthology.orchestra.run.smithi062.stdout: "segexg": 0, 2024-05-20T17:19:33.072 INFO:teuthology.orchestra.run.smithi062.stdout: "segexd": 0, 2024-05-20T17:19:33.072 INFO:teuthology.orchestra.run.smithi062.stdout: "expos": 4194304, 2024-05-20T17:19:33.072 INFO:teuthology.orchestra.run.smithi062.stdout: "wrpos": 4903821, 2024-05-20T17:19:33.072 INFO:teuthology.orchestra.run.smithi062.stdout: "rdpos": 0, 2024-05-20T17:19:33.073 INFO:teuthology.orchestra.run.smithi062.stdout: "jlat": { 2024-05-20T17:19:33.073 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 150, 2024-05-20T17:19:33.073 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.349442499, 2024-05-20T17:19:33.073 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.002329616 2024-05-20T17:19:33.073 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.073 INFO:teuthology.orchestra.run.smithi062.stdout: "replayed": 0 2024-05-20T17:19:33.073 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.073 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_mem": { 2024-05-20T17:19:33.073 INFO:teuthology.orchestra.run.smithi062.stdout: "ino": 24, 2024-05-20T17:19:33.073 INFO:teuthology.orchestra.run.smithi062.stdout: "ino+": 45, 2024-05-20T17:19:33.073 INFO:teuthology.orchestra.run.smithi062.stdout: "ino-": 21, 2024-05-20T17:19:33.073 INFO:teuthology.orchestra.run.smithi062.stdout: "dir": 19, 2024-05-20T17:19:33.073 INFO:teuthology.orchestra.run.smithi062.stdout: "dir+": 22, 2024-05-20T17:19:33.074 INFO:teuthology.orchestra.run.smithi062.stdout: "dir-": 3, 2024-05-20T17:19:33.074 INFO:teuthology.orchestra.run.smithi062.stdout: "dn": 25, 2024-05-20T17:19:33.074 INFO:teuthology.orchestra.run.smithi062.stdout: "dn+": 64, 2024-05-20T17:19:33.074 INFO:teuthology.orchestra.run.smithi062.stdout: "dn-": 39, 2024-05-20T17:19:33.074 INFO:teuthology.orchestra.run.smithi062.stdout: "cap": 2, 2024-05-20T17:19:33.074 INFO:teuthology.orchestra.run.smithi062.stdout: "cap+": 36, 2024-05-20T17:19:33.074 INFO:teuthology.orchestra.run.smithi062.stdout: "cap-": 34, 2024-05-20T17:19:33.074 INFO:teuthology.orchestra.run.smithi062.stdout: "rss": 125668, 2024-05-20T17:19:33.074 INFO:teuthology.orchestra.run.smithi062.stdout: "heap": 231828 2024-05-20T17:19:33.074 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.074 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_server": { 2024-05-20T17:19:33.074 INFO:teuthology.orchestra.run.smithi062.stdout: "dispatch_client_request": 164, 2024-05-20T17:19:33.074 INFO:teuthology.orchestra.run.smithi062.stdout: "dispatch_server_request": 4, 2024-05-20T17:19:33.074 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_request": 115, 2024-05-20T17:19:33.075 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_session": 21, 2024-05-20T17:19:33.075 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_peer_request": 16, 2024-05-20T17:19:33.075 INFO:teuthology.orchestra.run.smithi062.stdout: "req_create_latency": { 2024-05-20T17:19:33.075 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 22, 2024-05-20T17:19:33.075 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.021821014, 2024-05-20T17:19:33.075 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000991864 2024-05-20T17:19:33.075 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.075 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getattr_latency": { 2024-05-20T17:19:33.075 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 41, 2024-05-20T17:19:33.075 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.009994827, 2024-05-20T17:19:33.075 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000243776 2024-05-20T17:19:33.075 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.076 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getfilelock_latency": { 2024-05-20T17:19:33.076 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.076 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.076 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.076 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.076 INFO:teuthology.orchestra.run.smithi062.stdout: "req_link_latency": { 2024-05-20T17:19:33.076 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.076 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.076 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.076 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.076 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookup_latency": { 2024-05-20T17:19:33.076 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 3, 2024-05-20T17:19:33.076 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.009262339, 2024-05-20T17:19:33.077 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.003087446 2024-05-20T17:19:33.077 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.077 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookuphash_latency": { 2024-05-20T17:19:33.077 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.077 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.077 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.077 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.077 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupino_latency": { 2024-05-20T17:19:33.077 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.077 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.077 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.077 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.077 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupname_latency": { 2024-05-20T17:19:33.077 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.078 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.078 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.078 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.078 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupparent_latency": { 2024-05-20T17:19:33.078 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.078 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.078 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.078 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.078 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupsnap_latency": { 2024-05-20T17:19:33.078 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.078 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.078 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.079 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.079 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lssnap_latency": { 2024-05-20T17:19:33.079 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.079 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.079 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.079 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.080 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mkdir_latency": { 2024-05-20T17:19:33.080 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 10, 2024-05-20T17:19:33.080 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.022910122, 2024-05-20T17:19:33.080 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.002291012 2024-05-20T17:19:33.080 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.080 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mknod_latency": { 2024-05-20T17:19:33.080 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.080 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.080 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.080 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.080 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mksnap_latency": { 2024-05-20T17:19:33.080 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.080 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.080 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.081 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.081 INFO:teuthology.orchestra.run.smithi062.stdout: "req_open_latency": { 2024-05-20T17:19:33.081 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 1, 2024-05-20T17:19:33.081 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000434941, 2024-05-20T17:19:33.081 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000434941 2024-05-20T17:19:33.081 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.081 INFO:teuthology.orchestra.run.smithi062.stdout: "req_readdir_latency": { 2024-05-20T17:19:33.081 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 4, 2024-05-20T17:19:33.081 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.015189454, 2024-05-20T17:19:33.081 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.003797363 2024-05-20T17:19:33.081 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.081 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rename_latency": { 2024-05-20T17:19:33.082 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 2, 2024-05-20T17:19:33.082 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.002217665, 2024-05-20T17:19:33.082 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.001108832 2024-05-20T17:19:33.082 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.082 INFO:teuthology.orchestra.run.smithi062.stdout: "req_renamesnap_latency": { 2024-05-20T17:19:33.082 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.082 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.082 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.082 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.082 INFO:teuthology.orchestra.run.smithi062.stdout: "req_snapdiff_latency": { 2024-05-20T17:19:33.082 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.083 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.083 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.083 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.083 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmdir_latency": { 2024-05-20T17:19:33.083 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 4, 2024-05-20T17:19:33.083 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.044333432, 2024-05-20T17:19:33.083 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.011083358 2024-05-20T17:19:33.083 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.083 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmsnap_latency": { 2024-05-20T17:19:33.083 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.083 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.083 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.084 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.084 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmxattr_latency": { 2024-05-20T17:19:33.084 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.084 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.084 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.084 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.084 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setattr_latency": { 2024-05-20T17:19:33.084 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 2, 2024-05-20T17:19:33.084 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.001424489, 2024-05-20T17:19:33.085 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000712244 2024-05-20T17:19:33.085 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.085 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setdirlayout_latency": { 2024-05-20T17:19:33.085 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.085 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.085 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.085 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.085 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setfilelock_latency": { 2024-05-20T17:19:33.085 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.085 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.085 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.086 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.086 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setlayout_latency": { 2024-05-20T17:19:33.086 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.086 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.086 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.086 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.086 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setxattr_latency": { 2024-05-20T17:19:33.086 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 8, 2024-05-20T17:19:33.086 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.021181715, 2024-05-20T17:19:33.086 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.002647714 2024-05-20T17:19:33.086 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.086 INFO:teuthology.orchestra.run.smithi062.stdout: "req_symlink_latency": { 2024-05-20T17:19:33.087 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.087 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.087 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.087 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.087 INFO:teuthology.orchestra.run.smithi062.stdout: "req_unlink_latency": { 2024-05-20T17:19:33.087 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 16, 2024-05-20T17:19:33.087 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.024315242, 2024-05-20T17:19:33.087 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.001519702 2024-05-20T17:19:33.087 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.087 INFO:teuthology.orchestra.run.smithi062.stdout: "cap_revoke_eviction": 0, 2024-05-20T17:19:33.087 INFO:teuthology.orchestra.run.smithi062.stdout: "cap_acquisition_throttle": 0, 2024-05-20T17:19:33.087 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getvxattr_latency": { 2024-05-20T17:19:33.087 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.088 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.088 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.088 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:33.088 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.088 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_sessions": { 2024-05-20T17:19:33.088 INFO:teuthology.orchestra.run.smithi062.stdout: "session_count": 1, 2024-05-20T17:19:33.088 INFO:teuthology.orchestra.run.smithi062.stdout: "session_add": 3, 2024-05-20T17:19:33.088 INFO:teuthology.orchestra.run.smithi062.stdout: "session_remove": 2, 2024-05-20T17:19:33.088 INFO:teuthology.orchestra.run.smithi062.stdout: "sessions_open": 1, 2024-05-20T17:19:33.088 INFO:teuthology.orchestra.run.smithi062.stdout: "sessions_stale": 0, 2024-05-20T17:19:33.088 INFO:teuthology.orchestra.run.smithi062.stdout: "total_load": 41, 2024-05-20T17:19:33.089 INFO:teuthology.orchestra.run.smithi062.stdout: "average_load": 41, 2024-05-20T17:19:33.089 INFO:teuthology.orchestra.run.smithi062.stdout: "avg_session_uptime": 714, 2024-05-20T17:19:33.089 INFO:teuthology.orchestra.run.smithi062.stdout: "mdthresh_evicted": 0 2024-05-20T17:19:33.089 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.089 INFO:teuthology.orchestra.run.smithi062.stdout: "mempool": { 2024-05-20T17:19:33.089 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:19:33.089 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_items": 0, 2024-05-20T17:19:33.089 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:19:33.089 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:19:33.089 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:19:33.089 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:19:33.089 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:19:33.090 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:19:33.090 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:19:33.090 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:19:33.090 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:19:33.090 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:19:33.090 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:19:33.090 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:19:33.090 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:19:33.090 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_items": 0, 2024-05-20T17:19:33.090 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:19:33.091 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_items": 0, 2024-05-20T17:19:33.091 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:19:33.091 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:19:33.091 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:19:33.091 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:19:33.092 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:19:33.092 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:19:33.092 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:19:33.092 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_items": 0, 2024-05-20T17:19:33.092 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:19:33.092 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:19:33.092 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:19:33.092 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_items": 0, 2024-05-20T17:19:33.092 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_bytes": 0, 2024-05-20T17:19:33.093 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_items": 0, 2024-05-20T17:19:33.093 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:19:33.093 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:19:33.093 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:19:33.093 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:19:33.093 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_bytes": 292078, 2024-05-20T17:19:33.093 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_items": 121, 2024-05-20T17:19:33.093 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:19:33.093 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_items": 0, 2024-05-20T17:19:33.093 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_bytes": 0, 2024-05-20T17:19:33.093 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_items": 0, 2024-05-20T17:19:33.093 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:19:33.093 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_items": 0, 2024-05-20T17:19:33.093 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:19:33.094 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_items": 0, 2024-05-20T17:19:33.094 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_bytes": 8984, 2024-05-20T17:19:33.094 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_items": 172, 2024-05-20T17:19:33.094 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:19:33.094 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:19:33.094 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_bytes": 0, 2024-05-20T17:19:33.094 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_items": 0, 2024-05-20T17:19:33.094 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_bytes": 101389, 2024-05-20T17:19:33.094 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_items": 787, 2024-05-20T17:19:33.095 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_bytes": 0, 2024-05-20T17:19:33.095 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_items": 0, 2024-05-20T17:19:33.095 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_bytes": 0, 2024-05-20T17:19:33.095 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_items": 0 2024-05-20T17:19:33.095 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.095 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter": { 2024-05-20T17:19:33.095 INFO:teuthology.orchestra.run.smithi062.stdout: "op_active": 0, 2024-05-20T17:19:33.095 INFO:teuthology.orchestra.run.smithi062.stdout: "op_laggy": 0, 2024-05-20T17:19:33.095 INFO:teuthology.orchestra.run.smithi062.stdout: "op_send": 3340, 2024-05-20T17:19:33.095 INFO:teuthology.orchestra.run.smithi062.stdout: "op_send_bytes": 729259, 2024-05-20T17:19:33.095 INFO:teuthology.orchestra.run.smithi062.stdout: "op_resend": 33, 2024-05-20T17:19:33.095 INFO:teuthology.orchestra.run.smithi062.stdout: "op_reply": 3340, 2024-05-20T17:19:33.095 INFO:teuthology.orchestra.run.smithi062.stdout: "op_latency": { 2024-05-20T17:19:33.096 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 3340, 2024-05-20T17:19:33.096 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 89.012715522, 2024-05-20T17:19:33.096 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.026650513 2024-05-20T17:19:33.096 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.096 INFO:teuthology.orchestra.run.smithi062.stdout: "op_inflight": 0, 2024-05-20T17:19:33.096 INFO:teuthology.orchestra.run.smithi062.stdout: "oplen_avg": { 2024-05-20T17:19:33.096 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 3340, 2024-05-20T17:19:33.096 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 3387 2024-05-20T17:19:33.096 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.096 INFO:teuthology.orchestra.run.smithi062.stdout: "op": 3340, 2024-05-20T17:19:33.096 INFO:teuthology.orchestra.run.smithi062.stdout: "op_r": 5, 2024-05-20T17:19:33.096 INFO:teuthology.orchestra.run.smithi062.stdout: "op_w": 3335, 2024-05-20T17:19:33.097 INFO:teuthology.orchestra.run.smithi062.stdout: "op_rmw": 0, 2024-05-20T17:19:33.097 INFO:teuthology.orchestra.run.smithi062.stdout: "op_pg": 0, 2024-05-20T17:19:33.097 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_stat": 0, 2024-05-20T17:19:33.097 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_create": 11, 2024-05-20T17:19:33.097 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_read": 5, 2024-05-20T17:19:33.097 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_write": 155, 2024-05-20T17:19:33.097 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_writefull": 29, 2024-05-20T17:19:33.097 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_writesame": 0, 2024-05-20T17:19:33.097 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_append": 0, 2024-05-20T17:19:33.097 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_zero": 0, 2024-05-20T17:19:33.097 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_truncate": 0, 2024-05-20T17:19:33.097 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_delete": 3107, 2024-05-20T17:19:33.097 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_mapext": 0, 2024-05-20T17:19:33.098 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_sparse_read": 0, 2024-05-20T17:19:33.098 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_clonerange": 0, 2024-05-20T17:19:33.098 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_getxattr": 0, 2024-05-20T17:19:33.098 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_setxattr": 22, 2024-05-20T17:19:33.098 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_cmpxattr": 0, 2024-05-20T17:19:33.098 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_rmxattr": 0, 2024-05-20T17:19:33.098 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_resetxattrs": 0, 2024-05-20T17:19:33.098 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_call": 0, 2024-05-20T17:19:33.098 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_watch": 0, 2024-05-20T17:19:33.098 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_notify": 0, 2024-05-20T17:19:33.098 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_src_cmpxattr": 0, 2024-05-20T17:19:33.098 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_pgls": 0, 2024-05-20T17:19:33.098 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_pgls_filter": 0, 2024-05-20T17:19:33.099 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_other": 0, 2024-05-20T17:19:33.099 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_active": 0, 2024-05-20T17:19:33.099 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_send": 0, 2024-05-20T17:19:33.099 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_resend": 0, 2024-05-20T17:19:33.099 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_ping": 0, 2024-05-20T17:19:33.099 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_active": 0, 2024-05-20T17:19:33.099 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_send": 0, 2024-05-20T17:19:33.099 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_resend": 0, 2024-05-20T17:19:33.099 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_active": 0, 2024-05-20T17:19:33.099 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_send": 0, 2024-05-20T17:19:33.099 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_resend": 0, 2024-05-20T17:19:33.099 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_active": 0, 2024-05-20T17:19:33.099 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_send": 0, 2024-05-20T17:19:33.099 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_resend": 0, 2024-05-20T17:19:33.100 INFO:teuthology.orchestra.run.smithi062.stdout: "command_active": 0, 2024-05-20T17:19:33.100 INFO:teuthology.orchestra.run.smithi062.stdout: "command_send": 0, 2024-05-20T17:19:33.100 INFO:teuthology.orchestra.run.smithi062.stdout: "command_resend": 0, 2024-05-20T17:19:33.100 INFO:teuthology.orchestra.run.smithi062.stdout: "map_epoch": 94, 2024-05-20T17:19:33.100 INFO:teuthology.orchestra.run.smithi062.stdout: "map_full": 0, 2024-05-20T17:19:33.100 INFO:teuthology.orchestra.run.smithi062.stdout: "map_inc": 9, 2024-05-20T17:19:33.100 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_sessions": 12, 2024-05-20T17:19:33.100 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_session_open": 12, 2024-05-20T17:19:33.100 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_session_close": 0, 2024-05-20T17:19:33.100 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_laggy": 0, 2024-05-20T17:19:33.100 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_wr": 46, 2024-05-20T17:19:33.100 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_rd": 0, 2024-05-20T17:19:33.100 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_del": 12 2024-05-20T17:19:33.100 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.101 INFO:teuthology.orchestra.run.smithi062.stdout: "oft": { 2024-05-20T17:19:33.101 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_objs": 1, 2024-05-20T17:19:33.101 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_kv_pairs": 0, 2024-05-20T17:19:33.101 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_updates": 0, 2024-05-20T17:19:33.101 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_removes": 0 2024-05-20T17:19:33.101 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.101 INFO:teuthology.orchestra.run.smithi062.stdout: "osd-slow-ops": { 2024-05-20T17:19:33.101 INFO:teuthology.orchestra.run.smithi062.stdout: "slow_ops_count": 0 2024-05-20T17:19:33.101 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.101 INFO:teuthology.orchestra.run.smithi062.stdout: "purge_queue": { 2024-05-20T17:19:33.101 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_ops": 0, 2024-05-20T17:19:33.101 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_ops_high_water": 522, 2024-05-20T17:19:33.101 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing": 0, 2024-05-20T17:19:33.101 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_high_water": 5, 2024-05-20T17:19:33.102 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executed_ops": 2595, 2024-05-20T17:19:33.102 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executed": 19, 2024-05-20T17:19:33.102 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_item_in_journal": 0 2024-05-20T17:19:33.102 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.102 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:19:33.102 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-05-20T17:19:33.102 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 104857600, 2024-05-20T17:19:33.102 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-05-20T17:19:33.102 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 7186, 2024-05-20T17:19:33.102 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 2265700, 2024-05-20T17:19:33.102 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:33.102 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 7186, 2024-05-20T17:19:33.102 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-05-20T17:19:33.103 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-05-20T17:19:33.103 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 7186, 2024-05-20T17:19:33.103 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 2265700, 2024-05-20T17:19:33.103 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-05-20T17:19:33.103 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.103 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.103 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.103 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:33.103 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.103 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-objecter_bytes": { 2024-05-20T17:19:33.103 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-05-20T17:19:33.103 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 104857600, 2024-05-20T17:19:33.103 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-05-20T17:19:33.103 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-05-20T17:19:33.103 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-05-20T17:19:33.104 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:33.104 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:33.104 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 3340, 2024-05-20T17:19:33.104 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 731306, 2024-05-20T17:19:33.104 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 3340, 2024-05-20T17:19:33.104 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 731306, 2024-05-20T17:19:33.104 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-05-20T17:19:33.104 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.104 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.104 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.104 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:33.104 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.105 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-objecter_ops": { 2024-05-20T17:19:33.105 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-05-20T17:19:33.105 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 1024, 2024-05-20T17:19:33.105 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-05-20T17:19:33.105 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-05-20T17:19:33.105 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-05-20T17:19:33.105 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:33.105 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:33.105 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 3340, 2024-05-20T17:19:33.106 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 3340, 2024-05-20T17:19:33.106 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 3340, 2024-05-20T17:19:33.106 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 3340, 2024-05-20T17:19:33.106 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-05-20T17:19:33.106 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.107 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.107 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.107 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:33.107 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.107 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-write_buf_throttle": { 2024-05-20T17:19:33.107 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-05-20T17:19:33.107 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 3758096384, 2024-05-20T17:19:33.107 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-05-20T17:19:33.107 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 19, 2024-05-20T17:19:33.107 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 2047, 2024-05-20T17:19:33.107 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:33.107 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 19, 2024-05-20T17:19:33.107 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-05-20T17:19:33.108 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-05-20T17:19:33.108 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 5, 2024-05-20T17:19:33.108 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 2047, 2024-05-20T17:19:33.108 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-05-20T17:19:33.108 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.108 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.108 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.108 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:33.108 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:33.108 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-write_buf_throttle-0x56143ccbab60": { 2024-05-20T17:19:33.108 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-05-20T17:19:33.108 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 3758096384, 2024-05-20T17:19:33.108 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-05-20T17:19:33.108 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 274, 2024-05-20T17:19:33.109 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 709517, 2024-05-20T17:19:33.109 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:33.109 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 274, 2024-05-20T17:19:33.109 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-05-20T17:19:33.109 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-05-20T17:19:33.109 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 150, 2024-05-20T17:19:33.109 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 709517, 2024-05-20T17:19:33.109 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-05-20T17:19:33.109 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:33.109 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:33.109 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:33.109 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:33.109 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:33.109 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-20T17:19:33.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:33 smithi062 ceph-mon[35425]: pgmap v739: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-20T17:19:33.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:33 smithi171 ceph-mon[35901]: pgmap v739: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-20T17:19:33.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:33 smithi006 ceph-mon[32486]: pgmap v739: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-20T17:19:34.002 INFO:tasks.check_counter:Daemon mds.b mds.exported=1 2024-05-20T17:19:34.002 INFO:tasks.check_counter:Daemon mds.b mds.imported=1 2024-05-20T17:19:34.002 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=18 2024-05-20T17:19:34.003 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-05-20T17:19:34.003 DEBUG:tasks.check_counter:Getting stats from e 2024-05-20T17:19:34.003 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph daemon mds.e perf dump 2024-05-20T17:19:34.262 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:19:35.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:35 smithi062 ceph-mon[35425]: pgmap v740: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-20T17:19:35.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:35 smithi171 ceph-mon[35901]: pgmap v740: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-20T17:19:35.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:35 smithi006 ceph-mon[32486]: pgmap v740: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-20T17:19:36.568 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-20T17:19:36.568 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:19:36.568 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 378, 2024-05-20T17:19:36.568 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 365, 2024-05-20T17:19:36.568 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 615385, 2024-05-20T17:19:36.569 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 252983, 2024-05-20T17:19:36.569 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 14, 2024-05-20T17:19:36.569 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 2, 2024-05-20T17:19:36.569 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.049550212, 2024-05-20T17:19:36.569 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.016576826, 2024-05-20T17:19:36.569 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.028186148, 2024-05-20T17:19:36.569 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.006321259, 2024-05-20T17:19:36.569 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:36.569 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 364, 2024-05-20T17:19:36.569 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.036287062, 2024-05-20T17:19:36.569 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000099689 2024-05-20T17:19:36.569 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.569 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:36.570 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 123, 2024-05-20T17:19:36.570 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000040868, 2024-05-20T17:19:36.570 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000332 2024-05-20T17:19:36.570 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.570 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 567088, 2024-05-20T17:19:36.570 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 154224 2024-05-20T17:19:36.570 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.570 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:19:36.570 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 77, 2024-05-20T17:19:36.570 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 259, 2024-05-20T17:19:36.570 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 49805, 2024-05-20T17:19:36.570 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 447811, 2024-05-20T17:19:36.570 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 8, 2024-05-20T17:19:36.571 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 4, 2024-05-20T17:19:36.571 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.017747642, 2024-05-20T17:19:36.571 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.009193211, 2024-05-20T17:19:36.571 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.007433346, 2024-05-20T17:19:36.571 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.000238602, 2024-05-20T17:19:36.571 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:36.571 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 258, 2024-05-20T17:19:36.571 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.039256195, 2024-05-20T17:19:36.571 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000152155 2024-05-20T17:19:36.571 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.571 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:36.571 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 103, 2024-05-20T17:19:36.571 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000024676, 2024-05-20T17:19:36.571 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000239 2024-05-20T17:19:36.572 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.572 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-05-20T17:19:36.572 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 392688 2024-05-20T17:19:36.572 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.572 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:19:36.572 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 524, 2024-05-20T17:19:36.572 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 676, 2024-05-20T17:19:36.572 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 205011, 2024-05-20T17:19:36.572 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 313499, 2024-05-20T17:19:36.572 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 8, 2024-05-20T17:19:36.572 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 4, 2024-05-20T17:19:36.572 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.070354560, 2024-05-20T17:19:36.572 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.030207458, 2024-05-20T17:19:36.573 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.036022302, 2024-05-20T17:19:36.573 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.004766017, 2024-05-20T17:19:36.573 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:36.573 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 674, 2024-05-20T17:19:36.573 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.053143939, 2024-05-20T17:19:36.573 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000078848 2024-05-20T17:19:36.573 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.573 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:36.573 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 1134, 2024-05-20T17:19:36.573 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000336442, 2024-05-20T17:19:36.573 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000296 2024-05-20T17:19:36.573 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.573 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-20T17:19:36.573 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 0 2024-05-20T17:19:36.574 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.574 INFO:teuthology.orchestra.run.smithi062.stdout: "cct": { 2024-05-20T17:19:36.574 INFO:teuthology.orchestra.run.smithi062.stdout: "total_workers": 1, 2024-05-20T17:19:36.574 INFO:teuthology.orchestra.run.smithi062.stdout: "unhealthy_workers": 0 2024-05-20T17:19:36.574 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.574 INFO:teuthology.orchestra.run.smithi062.stdout: "finisher-MDSRank": { 2024-05-20T17:19:36.574 INFO:teuthology.orchestra.run.smithi062.stdout: "queue_len": 0, 2024-05-20T17:19:36.574 INFO:teuthology.orchestra.run.smithi062.stdout: "complete_latency": { 2024-05-20T17:19:36.574 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 50, 2024-05-20T17:19:36.574 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.001187047, 2024-05-20T17:19:36.574 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000023740 2024-05-20T17:19:36.574 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:36.574 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.574 INFO:teuthology.orchestra.run.smithi062.stdout: "finisher-PurgeQueue": { 2024-05-20T17:19:36.575 INFO:teuthology.orchestra.run.smithi062.stdout: "queue_len": 0, 2024-05-20T17:19:36.575 INFO:teuthology.orchestra.run.smithi062.stdout: "complete_latency": { 2024-05-20T17:19:36.575 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 2, 2024-05-20T17:19:36.575 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000008960, 2024-05-20T17:19:36.575 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000004480 2024-05-20T17:19:36.575 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:36.575 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.575 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-20T17:19:36.575 INFO:teuthology.orchestra.run.smithi062.stdout: "request": 1, 2024-05-20T17:19:36.575 INFO:teuthology.orchestra.run.smithi062.stdout: "reply": 0, 2024-05-20T17:19:36.575 INFO:teuthology.orchestra.run.smithi062.stdout: "reply_latency": { 2024-05-20T17:19:36.575 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.575 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.576 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.576 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.576 INFO:teuthology.orchestra.run.smithi062.stdout: "slow_reply": 0, 2024-05-20T17:19:36.576 INFO:teuthology.orchestra.run.smithi062.stdout: "forward": 1, 2024-05-20T17:19:36.576 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_fetch_complete": 0, 2024-05-20T17:19:36.576 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_fetch_keys": 0, 2024-05-20T17:19:36.576 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_commit": 11, 2024-05-20T17:19:36.576 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_split": 0, 2024-05-20T17:19:36.576 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_merge": 0, 2024-05-20T17:19:36.576 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes": 16, 2024-05-20T17:19:36.576 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_top": 0, 2024-05-20T17:19:36.576 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_bottom": 16, 2024-05-20T17:19:36.576 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_pin_tail": 0, 2024-05-20T17:19:36.577 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_pinned": 13, 2024-05-20T17:19:36.577 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_expired": 8, 2024-05-20T17:19:36.577 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_with_caps": 0, 2024-05-20T17:19:36.577 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": 0, 2024-05-20T17:19:36.577 INFO:teuthology.orchestra.run.smithi062.stdout: "subtrees": 3, 2024-05-20T17:19:36.577 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse": 12, 2024-05-20T17:19:36.577 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_hit": 7, 2024-05-20T17:19:36.577 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_forward": 1, 2024-05-20T17:19:36.577 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_discover": 4, 2024-05-20T17:19:36.577 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_dir_fetch": 0, 2024-05-20T17:19:36.577 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_remote_ino": 0, 2024-05-20T17:19:36.577 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_lock": 0, 2024-05-20T17:19:36.577 INFO:teuthology.orchestra.run.smithi062.stdout: "load_cent": 0, 2024-05-20T17:19:36.577 INFO:teuthology.orchestra.run.smithi062.stdout: "q": 0, 2024-05-20T17:19:36.578 INFO:teuthology.orchestra.run.smithi062.stdout: "exported": 0, 2024-05-20T17:19:36.578 INFO:teuthology.orchestra.run.smithi062.stdout: "exported_inodes": 0, 2024-05-20T17:19:36.578 INFO:teuthology.orchestra.run.smithi062.stdout: "imported": 0, 2024-05-20T17:19:36.578 INFO:teuthology.orchestra.run.smithi062.stdout: "imported_inodes": 0, 2024-05-20T17:19:36.578 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_dir_fetch": 0, 2024-05-20T17:19:36.578 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_backtrace_fetch": 0, 2024-05-20T17:19:36.578 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_peer_discover": 0, 2024-05-20T17:19:36.578 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rfiles": 4, 2024-05-20T17:19:36.578 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rbytes": 234, 2024-05-20T17:19:36.578 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rsnaps": 0, 2024-05-20T17:19:36.578 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_backtrace_fetch": 0, 2024-05-20T17:19:36.578 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_set_tag": 0, 2024-05-20T17:19:36.578 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_backtrace_repaired": 0, 2024-05-20T17:19:36.578 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_inotable_repaired": 0, 2024-05-20T17:19:36.579 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dir_inodes": 0, 2024-05-20T17:19:36.579 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dir_base_inodes": 0, 2024-05-20T17:19:36.579 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dirfrag_rstats": 0, 2024-05-20T17:19:36.579 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_file_inodes": 0, 2024-05-20T17:19:36.579 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_inode_file_caps": 0, 2024-05-20T17:19:36.579 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_revoke": 0, 2024-05-20T17:19:36.579 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_grant": 0, 2024-05-20T17:19:36.579 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_trunc": 0, 2024-05-20T17:19:36.579 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-20T17:19:36.579 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-20T17:19:36.579 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_caps": 0, 2024-05-20T17:19:36.579 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_caps_dirty": 0, 2024-05-20T17:19:36.579 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_cap_release": 0, 2024-05-20T17:19:36.579 INFO:teuthology.orchestra.run.smithi062.stdout: "process_request_cap_release": 0 2024-05-20T17:19:36.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.580 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache": { 2024-05-20T17:19:36.580 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_update": 0, 2024-05-20T17:19:36.580 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_update_receipt": 16, 2024-05-20T17:19:36.580 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_try_discover": 10, 2024-05-20T17:19:36.580 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_send_discover": 12, 2024-05-20T17:19:36.580 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_handle_discover": 0, 2024-05-20T17:19:36.580 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays": 0, 2024-05-20T17:19:36.580 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays_delayed": 0, 2024-05-20T17:19:36.580 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays_enqueuing": 0, 2024-05-20T17:19:36.580 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_created": 0, 2024-05-20T17:19:36.580 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_enqueued": 0, 2024-05-20T17:19:36.580 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_reintegrated": 0, 2024-05-20T17:19:36.580 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_migrated": 0, 2024-05-20T17:19:36.581 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_processing": 0, 2024-05-20T17:19:36.581 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_enqueued": 0, 2024-05-20T17:19:36.581 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_prioritized": 0, 2024-05-20T17:19:36.581 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_started": 0, 2024-05-20T17:19:36.581 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_completed": 0, 2024-05-20T17:19:36.581 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_quiesce_path": 0, 2024-05-20T17:19:36.581 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_quiesce_inode": 0, 2024-05-20T17:19:36.581 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_enqueue_scrub": 0, 2024-05-20T17:19:36.581 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_exportdir": 0, 2024-05-20T17:19:36.581 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_flush": 0, 2024-05-20T17:19:36.581 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_fragmentdir": 0, 2024-05-20T17:19:36.581 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_fragstats": 0, 2024-05-20T17:19:36.581 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_inodestats": 0 2024-05-20T17:19:36.581 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.582 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log": { 2024-05-20T17:19:36.582 INFO:teuthology.orchestra.run.smithi062.stdout: "evlrg": 0, 2024-05-20T17:19:36.582 INFO:teuthology.orchestra.run.smithi062.stdout: "evadd": 3, 2024-05-20T17:19:36.582 INFO:teuthology.orchestra.run.smithi062.stdout: "evex": 0, 2024-05-20T17:19:36.582 INFO:teuthology.orchestra.run.smithi062.stdout: "evtrm": 0, 2024-05-20T17:19:36.582 INFO:teuthology.orchestra.run.smithi062.stdout: "ev": 3, 2024-05-20T17:19:36.582 INFO:teuthology.orchestra.run.smithi062.stdout: "evexg": 0, 2024-05-20T17:19:36.582 INFO:teuthology.orchestra.run.smithi062.stdout: "evexd": 0, 2024-05-20T17:19:36.582 INFO:teuthology.orchestra.run.smithi062.stdout: "segadd": 2, 2024-05-20T17:19:36.582 INFO:teuthology.orchestra.run.smithi062.stdout: "segex": 0, 2024-05-20T17:19:36.582 INFO:teuthology.orchestra.run.smithi062.stdout: "segtrm": 0, 2024-05-20T17:19:36.582 INFO:teuthology.orchestra.run.smithi062.stdout: "seg": 2, 2024-05-20T17:19:36.582 INFO:teuthology.orchestra.run.smithi062.stdout: "segmjr": 2, 2024-05-20T17:19:36.582 INFO:teuthology.orchestra.run.smithi062.stdout: "segexg": 0, 2024-05-20T17:19:36.582 INFO:teuthology.orchestra.run.smithi062.stdout: "segexd": 0, 2024-05-20T17:19:36.583 INFO:teuthology.orchestra.run.smithi062.stdout: "expos": 4194304, 2024-05-20T17:19:36.583 INFO:teuthology.orchestra.run.smithi062.stdout: "wrpos": 4195385, 2024-05-20T17:19:36.583 INFO:teuthology.orchestra.run.smithi062.stdout: "rdpos": 0, 2024-05-20T17:19:36.583 INFO:teuthology.orchestra.run.smithi062.stdout: "jlat": { 2024-05-20T17:19:36.583 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 2, 2024-05-20T17:19:36.583 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.003378773, 2024-05-20T17:19:36.583 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.001689386 2024-05-20T17:19:36.583 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.583 INFO:teuthology.orchestra.run.smithi062.stdout: "replayed": 0 2024-05-20T17:19:36.583 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.583 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_mem": { 2024-05-20T17:19:36.583 INFO:teuthology.orchestra.run.smithi062.stdout: "ino": 20, 2024-05-20T17:19:36.583 INFO:teuthology.orchestra.run.smithi062.stdout: "ino+": 24, 2024-05-20T17:19:36.583 INFO:teuthology.orchestra.run.smithi062.stdout: "ino-": 4, 2024-05-20T17:19:36.584 INFO:teuthology.orchestra.run.smithi062.stdout: "dir": 19, 2024-05-20T17:19:36.584 INFO:teuthology.orchestra.run.smithi062.stdout: "dir+": 25, 2024-05-20T17:19:36.584 INFO:teuthology.orchestra.run.smithi062.stdout: "dir-": 6, 2024-05-20T17:19:36.584 INFO:teuthology.orchestra.run.smithi062.stdout: "dn": 16, 2024-05-20T17:19:36.584 INFO:teuthology.orchestra.run.smithi062.stdout: "dn+": 24, 2024-05-20T17:19:36.584 INFO:teuthology.orchestra.run.smithi062.stdout: "dn-": 8, 2024-05-20T17:19:36.584 INFO:teuthology.orchestra.run.smithi062.stdout: "cap": 0, 2024-05-20T17:19:36.584 INFO:teuthology.orchestra.run.smithi062.stdout: "cap+": 0, 2024-05-20T17:19:36.584 INFO:teuthology.orchestra.run.smithi062.stdout: "cap-": 0, 2024-05-20T17:19:36.584 INFO:teuthology.orchestra.run.smithi062.stdout: "rss": 123212, 2024-05-20T17:19:36.584 INFO:teuthology.orchestra.run.smithi062.stdout: "heap": 223636 2024-05-20T17:19:36.584 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.584 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_server": { 2024-05-20T17:19:36.584 INFO:teuthology.orchestra.run.smithi062.stdout: "dispatch_client_request": 1, 2024-05-20T17:19:36.585 INFO:teuthology.orchestra.run.smithi062.stdout: "dispatch_server_request": 1, 2024-05-20T17:19:36.585 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_request": 1, 2024-05-20T17:19:36.585 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_session": 10, 2024-05-20T17:19:36.585 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_peer_request": 2, 2024-05-20T17:19:36.585 INFO:teuthology.orchestra.run.smithi062.stdout: "req_create_latency": { 2024-05-20T17:19:36.585 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.585 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.585 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.585 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getattr_latency": { 2024-05-20T17:19:36.585 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.585 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.585 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.586 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getfilelock_latency": { 2024-05-20T17:19:36.586 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.586 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.586 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.586 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.586 INFO:teuthology.orchestra.run.smithi062.stdout: "req_link_latency": { 2024-05-20T17:19:36.586 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.586 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.586 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.586 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.586 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookup_latency": { 2024-05-20T17:19:36.586 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.586 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.586 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.587 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.587 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookuphash_latency": { 2024-05-20T17:19:36.587 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.587 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.587 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.587 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.587 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupino_latency": { 2024-05-20T17:19:36.587 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.587 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.587 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.587 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.588 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupname_latency": { 2024-05-20T17:19:36.588 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.588 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.588 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.588 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.588 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupparent_latency": { 2024-05-20T17:19:36.588 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.588 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.588 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.588 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.588 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupsnap_latency": { 2024-05-20T17:19:36.588 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.588 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.588 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.589 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lssnap_latency": { 2024-05-20T17:19:36.589 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.589 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.589 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.589 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mkdir_latency": { 2024-05-20T17:19:36.589 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.590 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.590 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.590 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.590 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mknod_latency": { 2024-05-20T17:19:36.590 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.590 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.590 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.590 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.590 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mksnap_latency": { 2024-05-20T17:19:36.591 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.591 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.591 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.591 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.591 INFO:teuthology.orchestra.run.smithi062.stdout: "req_open_latency": { 2024-05-20T17:19:36.591 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.591 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.591 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.591 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.591 INFO:teuthology.orchestra.run.smithi062.stdout: "req_readdir_latency": { 2024-05-20T17:19:36.591 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.591 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.591 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.591 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.592 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rename_latency": { 2024-05-20T17:19:36.592 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.592 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.592 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.592 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.592 INFO:teuthology.orchestra.run.smithi062.stdout: "req_renamesnap_latency": { 2024-05-20T17:19:36.592 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.592 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.592 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.592 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.592 INFO:teuthology.orchestra.run.smithi062.stdout: "req_snapdiff_latency": { 2024-05-20T17:19:36.592 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.592 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.592 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.593 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmdir_latency": { 2024-05-20T17:19:36.593 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.593 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.593 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.593 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmsnap_latency": { 2024-05-20T17:19:36.593 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.593 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.593 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.593 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmxattr_latency": { 2024-05-20T17:19:36.593 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.593 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.594 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.594 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setattr_latency": { 2024-05-20T17:19:36.594 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.594 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.594 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.594 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setdirlayout_latency": { 2024-05-20T17:19:36.594 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.594 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.595 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.595 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.595 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setfilelock_latency": { 2024-05-20T17:19:36.595 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.595 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.595 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.595 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.595 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setlayout_latency": { 2024-05-20T17:19:36.595 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.595 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.595 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.595 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.595 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setxattr_latency": { 2024-05-20T17:19:36.595 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.596 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.596 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.596 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.596 INFO:teuthology.orchestra.run.smithi062.stdout: "req_symlink_latency": { 2024-05-20T17:19:36.596 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.596 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.596 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.596 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.596 INFO:teuthology.orchestra.run.smithi062.stdout: "req_unlink_latency": { 2024-05-20T17:19:36.596 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.597 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.597 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.597 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.597 INFO:teuthology.orchestra.run.smithi062.stdout: "cap_revoke_eviction": 0, 2024-05-20T17:19:36.597 INFO:teuthology.orchestra.run.smithi062.stdout: "cap_acquisition_throttle": 0, 2024-05-20T17:19:36.597 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getvxattr_latency": { 2024-05-20T17:19:36.597 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.597 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.597 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.597 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:36.597 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.597 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_sessions": { 2024-05-20T17:19:36.597 INFO:teuthology.orchestra.run.smithi062.stdout: "session_count": 1, 2024-05-20T17:19:36.597 INFO:teuthology.orchestra.run.smithi062.stdout: "session_add": 1, 2024-05-20T17:19:36.598 INFO:teuthology.orchestra.run.smithi062.stdout: "session_remove": 0, 2024-05-20T17:19:36.598 INFO:teuthology.orchestra.run.smithi062.stdout: "sessions_open": 1, 2024-05-20T17:19:36.598 INFO:teuthology.orchestra.run.smithi062.stdout: "sessions_stale": 0, 2024-05-20T17:19:36.598 INFO:teuthology.orchestra.run.smithi062.stdout: "total_load": 0, 2024-05-20T17:19:36.598 INFO:teuthology.orchestra.run.smithi062.stdout: "average_load": 0, 2024-05-20T17:19:36.598 INFO:teuthology.orchestra.run.smithi062.stdout: "avg_session_uptime": 718, 2024-05-20T17:19:36.598 INFO:teuthology.orchestra.run.smithi062.stdout: "mdthresh_evicted": 0 2024-05-20T17:19:36.598 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.598 INFO:teuthology.orchestra.run.smithi062.stdout: "mempool": { 2024-05-20T17:19:36.598 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:19:36.598 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_items": 0, 2024-05-20T17:19:36.598 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:19:36.598 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:19:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:19:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:19:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:19:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:19:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:19:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:19:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:19:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:19:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:19:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:19:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:19:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_items": 0, 2024-05-20T17:19:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:19:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_items": 0, 2024-05-20T17:19:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:19:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:19:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:19:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:19:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:19:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:19:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:19:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_items": 0, 2024-05-20T17:19:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:19:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:19:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:19:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_items": 0, 2024-05-20T17:19:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_bytes": 0, 2024-05-20T17:19:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_items": 0, 2024-05-20T17:19:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:19:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:19:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:19:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:19:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_bytes": 258863, 2024-05-20T17:19:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_items": 85, 2024-05-20T17:19:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:19:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_items": 0, 2024-05-20T17:19:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_bytes": 0, 2024-05-20T17:19:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_items": 0, 2024-05-20T17:19:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:19:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_items": 0, 2024-05-20T17:19:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:19:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_items": 0, 2024-05-20T17:19:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_bytes": 8984, 2024-05-20T17:19:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_items": 172, 2024-05-20T17:19:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:19:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:19:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_bytes": 0, 2024-05-20T17:19:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_items": 0, 2024-05-20T17:19:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_bytes": 80621, 2024-05-20T17:19:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_items": 324, 2024-05-20T17:19:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_bytes": 0, 2024-05-20T17:19:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_items": 0, 2024-05-20T17:19:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_bytes": 0, 2024-05-20T17:19:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_items": 0 2024-05-20T17:19:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter": { 2024-05-20T17:19:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: "op_active": 0, 2024-05-20T17:19:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: "op_laggy": 0, 2024-05-20T17:19:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: "op_send": 37, 2024-05-20T17:19:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: "op_send_bytes": 11293, 2024-05-20T17:19:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: "op_resend": 33, 2024-05-20T17:19:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: "op_reply": 37, 2024-05-20T17:19:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: "op_latency": { 2024-05-20T17:19:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 37, 2024-05-20T17:19:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.229996579, 2024-05-20T17:19:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.006216123 2024-05-20T17:19:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: "op_inflight": 0, 2024-05-20T17:19:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: "oplen_avg": { 2024-05-20T17:19:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 37, 2024-05-20T17:19:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 59 2024-05-20T17:19:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: "op": 37, 2024-05-20T17:19:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: "op_r": 0, 2024-05-20T17:19:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: "op_w": 37, 2024-05-20T17:19:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: "op_rmw": 0, 2024-05-20T17:19:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: "op_pg": 0, 2024-05-20T17:19:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_stat": 0, 2024-05-20T17:19:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_create": 10, 2024-05-20T17:19:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_read": 0, 2024-05-20T17:19:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_write": 2, 2024-05-20T17:19:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_writefull": 6, 2024-05-20T17:19:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_writesame": 0, 2024-05-20T17:19:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_append": 0, 2024-05-20T17:19:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_zero": 0, 2024-05-20T17:19:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_truncate": 0, 2024-05-20T17:19:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_delete": 6, 2024-05-20T17:19:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_mapext": 0, 2024-05-20T17:19:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_sparse_read": 0, 2024-05-20T17:19:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_clonerange": 0, 2024-05-20T17:19:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_getxattr": 0, 2024-05-20T17:19:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_setxattr": 20, 2024-05-20T17:19:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_cmpxattr": 0, 2024-05-20T17:19:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_rmxattr": 0, 2024-05-20T17:19:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_resetxattrs": 0, 2024-05-20T17:19:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_call": 0, 2024-05-20T17:19:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_watch": 0, 2024-05-20T17:19:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_notify": 0, 2024-05-20T17:19:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_src_cmpxattr": 0, 2024-05-20T17:19:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_pgls": 0, 2024-05-20T17:19:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_pgls_filter": 0, 2024-05-20T17:19:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_other": 0, 2024-05-20T17:19:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_active": 0, 2024-05-20T17:19:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_send": 0, 2024-05-20T17:19:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_resend": 0, 2024-05-20T17:19:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_ping": 0, 2024-05-20T17:19:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_active": 0, 2024-05-20T17:19:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_send": 0, 2024-05-20T17:19:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_resend": 0, 2024-05-20T17:19:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_active": 0, 2024-05-20T17:19:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_send": 0, 2024-05-20T17:19:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_resend": 0, 2024-05-20T17:19:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_active": 0, 2024-05-20T17:19:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_send": 0, 2024-05-20T17:19:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_resend": 0, 2024-05-20T17:19:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: "command_active": 0, 2024-05-20T17:19:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: "command_send": 0, 2024-05-20T17:19:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: "command_resend": 0, 2024-05-20T17:19:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: "map_epoch": 94, 2024-05-20T17:19:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: "map_full": 0, 2024-05-20T17:19:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: "map_inc": 4, 2024-05-20T17:19:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_sessions": 8, 2024-05-20T17:19:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_session_open": 8, 2024-05-20T17:19:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_session_close": 0, 2024-05-20T17:19:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_laggy": 0, 2024-05-20T17:19:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_wr": 14, 2024-05-20T17:19:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_rd": 0, 2024-05-20T17:19:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_del": 1 2024-05-20T17:19:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: "oft": { 2024-05-20T17:19:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_objs": 1, 2024-05-20T17:19:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_kv_pairs": 0, 2024-05-20T17:19:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_updates": 0, 2024-05-20T17:19:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_removes": 0 2024-05-20T17:19:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: "osd-slow-ops": { 2024-05-20T17:19:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: "slow_ops_count": 0 2024-05-20T17:19:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: "purge_queue": { 2024-05-20T17:19:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_ops": 0, 2024-05-20T17:19:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_ops_high_water": 0, 2024-05-20T17:19:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing": 0, 2024-05-20T17:19:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_high_water": 0, 2024-05-20T17:19:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executed_ops": 0, 2024-05-20T17:19:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executed": 0, 2024-05-20T17:19:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_item_in_journal": 0 2024-05-20T17:19:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:19:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-05-20T17:19:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 104857600, 2024-05-20T17:19:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-05-20T17:19:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 975, 2024-05-20T17:19:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 764647, 2024-05-20T17:19:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 975, 2024-05-20T17:19:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-05-20T17:19:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-05-20T17:19:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 975, 2024-05-20T17:19:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 764647, 2024-05-20T17:19:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-05-20T17:19:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-objecter_bytes": { 2024-05-20T17:19:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-05-20T17:19:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 104857600, 2024-05-20T17:19:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-05-20T17:19:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-05-20T17:19:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-05-20T17:19:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 37, 2024-05-20T17:19:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 11293, 2024-05-20T17:19:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 37, 2024-05-20T17:19:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 11293, 2024-05-20T17:19:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-05-20T17:19:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-objecter_ops": { 2024-05-20T17:19:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-05-20T17:19:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 1024, 2024-05-20T17:19:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-05-20T17:19:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-05-20T17:19:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-05-20T17:19:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 37, 2024-05-20T17:19:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 37, 2024-05-20T17:19:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 37, 2024-05-20T17:19:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 37, 2024-05-20T17:19:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-05-20T17:19:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-write_buf_throttle": { 2024-05-20T17:19:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-05-20T17:19:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 3758096384, 2024-05-20T17:19:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-05-20T17:19:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-05-20T17:19:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-05-20T17:19:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-05-20T17:19:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-05-20T17:19:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 0, 2024-05-20T17:19:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 0, 2024-05-20T17:19:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-05-20T17:19:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-write_buf_throttle-0x558b40396b60": { 2024-05-20T17:19:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-05-20T17:19:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 3758096384, 2024-05-20T17:19:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-05-20T17:19:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 3, 2024-05-20T17:19:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 1081, 2024-05-20T17:19:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 3, 2024-05-20T17:19:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-05-20T17:19:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-05-20T17:19:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 2, 2024-05-20T17:19:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 1081, 2024-05-20T17:19:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-05-20T17:19:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:36.616 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-20T17:19:37.305 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-05-20T17:19:37.306 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-05-20T17:19:37.306 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-05-20T17:19:37.306 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=16 2024-05-20T17:19:37.306 DEBUG:tasks.check_counter:Getting stats from h 2024-05-20T17:19:37.306 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph daemon mds.h perf dump 2024-05-20T17:19:37.561 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:19:37.684 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:37 smithi062 ceph-mon[35425]: pgmap v741: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-20T17:19:37.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:37 smithi171 ceph-mon[35901]: pgmap v741: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-20T17:19:37.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:37 smithi006 ceph-mon[32486]: pgmap v741: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-20T17:19:39.317 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-20T17:19:39.317 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:19:39.318 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 2014, 2024-05-20T17:19:39.318 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 1996, 2024-05-20T17:19:39.318 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 1804905, 2024-05-20T17:19:39.318 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 704322, 2024-05-20T17:19:39.318 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 5, 2024-05-20T17:19:39.318 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 1, 2024-05-20T17:19:39.318 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.200604722, 2024-05-20T17:19:39.318 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.068209866, 2024-05-20T17:19:39.318 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.059241639, 2024-05-20T17:19:39.318 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.061053662, 2024-05-20T17:19:39.318 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:39.318 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 1996, 2024-05-20T17:19:39.318 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.096085786, 2024-05-20T17:19:39.319 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000048139 2024-05-20T17:19:39.319 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.319 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:39.319 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.319 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.319 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.319 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.319 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 575856, 2024-05-20T17:19:39.319 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 149408 2024-05-20T17:19:39.319 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.319 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:19:39.319 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 5, 2024-05-20T17:19:39.320 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 186, 2024-05-20T17:19:39.320 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 1816, 2024-05-20T17:19:39.320 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 393402, 2024-05-20T17:19:39.320 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 5, 2024-05-20T17:19:39.320 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 4, 2024-05-20T17:19:39.320 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.010613885, 2024-05-20T17:19:39.320 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.007117044, 2024-05-20T17:19:39.320 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.001801255, 2024-05-20T17:19:39.320 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.000102548, 2024-05-20T17:19:39.320 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:39.320 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 184, 2024-05-20T17:19:39.320 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.011006340, 2024-05-20T17:19:39.321 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000059817 2024-05-20T17:19:39.321 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.321 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:39.321 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.321 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.321 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.321 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.321 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-20T17:19:39.321 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 392064 2024-05-20T17:19:39.321 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.321 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:19:39.321 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 849, 2024-05-20T17:19:39.321 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 851, 2024-05-20T17:19:39.322 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 208960, 2024-05-20T17:19:39.322 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 269989, 2024-05-20T17:19:39.322 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 4, 2024-05-20T17:19:39.322 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 3, 2024-05-20T17:19:39.322 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.073665116, 2024-05-20T17:19:39.322 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.018364821, 2024-05-20T17:19:39.322 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.017298557, 2024-05-20T17:19:39.322 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.030080539, 2024-05-20T17:19:39.322 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:39.322 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 849, 2024-05-20T17:19:39.322 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.029283541, 2024-05-20T17:19:39.322 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000034491 2024-05-20T17:19:39.322 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.323 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:39.323 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.323 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.323 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.323 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.323 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-20T17:19:39.323 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 0 2024-05-20T17:19:39.323 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.323 INFO:teuthology.orchestra.run.smithi062.stdout: "cct": { 2024-05-20T17:19:39.323 INFO:teuthology.orchestra.run.smithi062.stdout: "total_workers": 1, 2024-05-20T17:19:39.323 INFO:teuthology.orchestra.run.smithi062.stdout: "unhealthy_workers": 0 2024-05-20T17:19:39.323 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.323 INFO:teuthology.orchestra.run.smithi062.stdout: "finisher-MDSRank": { 2024-05-20T17:19:39.324 INFO:teuthology.orchestra.run.smithi062.stdout: "queue_len": 0, 2024-05-20T17:19:39.324 INFO:teuthology.orchestra.run.smithi062.stdout: "complete_latency": { 2024-05-20T17:19:39.324 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 4280, 2024-05-20T17:19:39.324 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.125165009, 2024-05-20T17:19:39.324 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000029244 2024-05-20T17:19:39.324 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:39.324 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.324 INFO:teuthology.orchestra.run.smithi062.stdout: "finisher-PurgeQueue": { 2024-05-20T17:19:39.324 INFO:teuthology.orchestra.run.smithi062.stdout: "queue_len": 0, 2024-05-20T17:19:39.324 INFO:teuthology.orchestra.run.smithi062.stdout: "complete_latency": { 2024-05-20T17:19:39.324 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.324 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.324 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.325 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:39.325 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.325 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-20T17:19:39.325 INFO:teuthology.orchestra.run.smithi062.stdout: "request": 0, 2024-05-20T17:19:39.325 INFO:teuthology.orchestra.run.smithi062.stdout: "reply": 0, 2024-05-20T17:19:39.325 INFO:teuthology.orchestra.run.smithi062.stdout: "reply_latency": { 2024-05-20T17:19:39.325 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.325 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.325 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.325 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.325 INFO:teuthology.orchestra.run.smithi062.stdout: "slow_reply": 0, 2024-05-20T17:19:39.325 INFO:teuthology.orchestra.run.smithi062.stdout: "forward": 0, 2024-05-20T17:19:39.325 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_fetch_complete": 0, 2024-05-20T17:19:39.325 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_fetch_keys": 0, 2024-05-20T17:19:39.326 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_commit": 0, 2024-05-20T17:19:39.326 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_split": 0, 2024-05-20T17:19:39.326 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_merge": 0, 2024-05-20T17:19:39.326 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes": 36, 2024-05-20T17:19:39.326 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_top": 0, 2024-05-20T17:19:39.326 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_bottom": 36, 2024-05-20T17:19:39.326 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_pin_tail": 0, 2024-05-20T17:19:39.326 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_pinned": 36, 2024-05-20T17:19:39.326 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_expired": 0, 2024-05-20T17:19:39.326 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_with_caps": 0, 2024-05-20T17:19:39.326 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": 0, 2024-05-20T17:19:39.326 INFO:teuthology.orchestra.run.smithi062.stdout: "subtrees": 2, 2024-05-20T17:19:39.326 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse": 0, 2024-05-20T17:19:39.327 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_hit": 0, 2024-05-20T17:19:39.327 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_forward": 0, 2024-05-20T17:19:39.327 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_discover": 0, 2024-05-20T17:19:39.327 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_dir_fetch": 0, 2024-05-20T17:19:39.327 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_remote_ino": 0, 2024-05-20T17:19:39.327 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_lock": 0, 2024-05-20T17:19:39.327 INFO:teuthology.orchestra.run.smithi062.stdout: "load_cent": 0, 2024-05-20T17:19:39.327 INFO:teuthology.orchestra.run.smithi062.stdout: "q": 0, 2024-05-20T17:19:39.327 INFO:teuthology.orchestra.run.smithi062.stdout: "exported": 0, 2024-05-20T17:19:39.327 INFO:teuthology.orchestra.run.smithi062.stdout: "exported_inodes": 0, 2024-05-20T17:19:39.327 INFO:teuthology.orchestra.run.smithi062.stdout: "imported": 0, 2024-05-20T17:19:39.327 INFO:teuthology.orchestra.run.smithi062.stdout: "imported_inodes": 0, 2024-05-20T17:19:39.327 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_dir_fetch": 0, 2024-05-20T17:19:39.327 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_backtrace_fetch": 0, 2024-05-20T17:19:39.328 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_peer_discover": 0, 2024-05-20T17:19:39.328 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rfiles": 4, 2024-05-20T17:19:39.328 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rbytes": 234, 2024-05-20T17:19:39.328 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rsnaps": 0, 2024-05-20T17:19:39.328 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_backtrace_fetch": 0, 2024-05-20T17:19:39.328 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_set_tag": 0, 2024-05-20T17:19:39.328 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_backtrace_repaired": 0, 2024-05-20T17:19:39.328 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_inotable_repaired": 0, 2024-05-20T17:19:39.328 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dir_inodes": 0, 2024-05-20T17:19:39.328 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dir_base_inodes": 0, 2024-05-20T17:19:39.328 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dirfrag_rstats": 0, 2024-05-20T17:19:39.328 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_file_inodes": 0, 2024-05-20T17:19:39.328 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_inode_file_caps": 0, 2024-05-20T17:19:39.329 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_revoke": 0, 2024-05-20T17:19:39.329 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_grant": 0, 2024-05-20T17:19:39.329 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_trunc": 0, 2024-05-20T17:19:39.329 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-20T17:19:39.329 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-20T17:19:39.329 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_caps": 0, 2024-05-20T17:19:39.329 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_caps_dirty": 0, 2024-05-20T17:19:39.329 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_cap_release": 0, 2024-05-20T17:19:39.329 INFO:teuthology.orchestra.run.smithi062.stdout: "process_request_cap_release": 0 2024-05-20T17:19:39.329 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.329 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache": { 2024-05-20T17:19:39.329 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_update": 0, 2024-05-20T17:19:39.330 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_update_receipt": 0, 2024-05-20T17:19:39.330 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_try_discover": 0, 2024-05-20T17:19:39.330 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_send_discover": 0, 2024-05-20T17:19:39.330 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_handle_discover": 0, 2024-05-20T17:19:39.330 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays": 0, 2024-05-20T17:19:39.330 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays_delayed": 0, 2024-05-20T17:19:39.330 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays_enqueuing": 0, 2024-05-20T17:19:39.330 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_created": 0, 2024-05-20T17:19:39.330 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_enqueued": 0, 2024-05-20T17:19:39.330 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_reintegrated": 0, 2024-05-20T17:19:39.330 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_migrated": 0, 2024-05-20T17:19:39.330 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_processing": 0, 2024-05-20T17:19:39.330 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_enqueued": 0, 2024-05-20T17:19:39.331 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_prioritized": 0, 2024-05-20T17:19:39.331 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_started": 0, 2024-05-20T17:19:39.331 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_completed": 0, 2024-05-20T17:19:39.331 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_quiesce_path": 0, 2024-05-20T17:19:39.331 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_quiesce_inode": 0, 2024-05-20T17:19:39.331 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_enqueue_scrub": 0, 2024-05-20T17:19:39.331 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_exportdir": 0, 2024-05-20T17:19:39.331 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_flush": 0, 2024-05-20T17:19:39.331 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_fragmentdir": 0, 2024-05-20T17:19:39.331 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_fragstats": 0, 2024-05-20T17:19:39.331 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_inodestats": 0 2024-05-20T17:19:39.331 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.331 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log": { 2024-05-20T17:19:39.331 INFO:teuthology.orchestra.run.smithi062.stdout: "evlrg": 0, 2024-05-20T17:19:39.331 INFO:teuthology.orchestra.run.smithi062.stdout: "evadd": 0, 2024-05-20T17:19:39.332 INFO:teuthology.orchestra.run.smithi062.stdout: "evex": 0, 2024-05-20T17:19:39.332 INFO:teuthology.orchestra.run.smithi062.stdout: "evtrm": 0, 2024-05-20T17:19:39.332 INFO:teuthology.orchestra.run.smithi062.stdout: "ev": 274, 2024-05-20T17:19:39.332 INFO:teuthology.orchestra.run.smithi062.stdout: "evexg": 0, 2024-05-20T17:19:39.332 INFO:teuthology.orchestra.run.smithi062.stdout: "evexd": 0, 2024-05-20T17:19:39.332 INFO:teuthology.orchestra.run.smithi062.stdout: "segadd": 0, 2024-05-20T17:19:39.332 INFO:teuthology.orchestra.run.smithi062.stdout: "segex": 0, 2024-05-20T17:19:39.332 INFO:teuthology.orchestra.run.smithi062.stdout: "segtrm": 0, 2024-05-20T17:19:39.332 INFO:teuthology.orchestra.run.smithi062.stdout: "seg": 2, 2024-05-20T17:19:39.332 INFO:teuthology.orchestra.run.smithi062.stdout: "segmjr": 2, 2024-05-20T17:19:39.332 INFO:teuthology.orchestra.run.smithi062.stdout: "segexg": 0, 2024-05-20T17:19:39.332 INFO:teuthology.orchestra.run.smithi062.stdout: "segexd": 0, 2024-05-20T17:19:39.332 INFO:teuthology.orchestra.run.smithi062.stdout: "expos": 4194304, 2024-05-20T17:19:39.332 INFO:teuthology.orchestra.run.smithi062.stdout: "wrpos": 4903821, 2024-05-20T17:19:39.333 INFO:teuthology.orchestra.run.smithi062.stdout: "rdpos": 4899184, 2024-05-20T17:19:39.333 INFO:teuthology.orchestra.run.smithi062.stdout: "jlat": { 2024-05-20T17:19:39.333 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.333 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.333 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.333 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.333 INFO:teuthology.orchestra.run.smithi062.stdout: "replayed": 274 2024-05-20T17:19:39.333 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.333 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_mem": { 2024-05-20T17:19:39.333 INFO:teuthology.orchestra.run.smithi062.stdout: "ino": 15, 2024-05-20T17:19:39.333 INFO:teuthology.orchestra.run.smithi062.stdout: "ino+": 36, 2024-05-20T17:19:39.333 INFO:teuthology.orchestra.run.smithi062.stdout: "ino-": 21, 2024-05-20T17:19:39.333 INFO:teuthology.orchestra.run.smithi062.stdout: "dir": 10, 2024-05-20T17:19:39.333 INFO:teuthology.orchestra.run.smithi062.stdout: "dir+": 13, 2024-05-20T17:19:39.334 INFO:teuthology.orchestra.run.smithi062.stdout: "dir-": 3, 2024-05-20T17:19:39.334 INFO:teuthology.orchestra.run.smithi062.stdout: "dn": 36, 2024-05-20T17:19:39.334 INFO:teuthology.orchestra.run.smithi062.stdout: "dn+": 55, 2024-05-20T17:19:39.334 INFO:teuthology.orchestra.run.smithi062.stdout: "dn-": 19, 2024-05-20T17:19:39.334 INFO:teuthology.orchestra.run.smithi062.stdout: "cap": 0, 2024-05-20T17:19:39.334 INFO:teuthology.orchestra.run.smithi062.stdout: "cap+": 0, 2024-05-20T17:19:39.334 INFO:teuthology.orchestra.run.smithi062.stdout: "cap-": 0, 2024-05-20T17:19:39.334 INFO:teuthology.orchestra.run.smithi062.stdout: "rss": 119424, 2024-05-20T17:19:39.334 INFO:teuthology.orchestra.run.smithi062.stdout: "heap": 215444 2024-05-20T17:19:39.334 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.334 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_server": { 2024-05-20T17:19:39.335 INFO:teuthology.orchestra.run.smithi062.stdout: "dispatch_client_request": 0, 2024-05-20T17:19:39.335 INFO:teuthology.orchestra.run.smithi062.stdout: "dispatch_server_request": 0, 2024-05-20T17:19:39.335 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_request": 0, 2024-05-20T17:19:39.335 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_session": 0, 2024-05-20T17:19:39.335 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_peer_request": 0, 2024-05-20T17:19:39.335 INFO:teuthology.orchestra.run.smithi062.stdout: "req_create_latency": { 2024-05-20T17:19:39.335 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.335 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.335 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.335 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.335 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getattr_latency": { 2024-05-20T17:19:39.335 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.335 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.335 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.336 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.336 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getfilelock_latency": { 2024-05-20T17:19:39.336 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.336 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.336 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.336 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.336 INFO:teuthology.orchestra.run.smithi062.stdout: "req_link_latency": { 2024-05-20T17:19:39.336 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.336 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.336 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.336 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.336 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookup_latency": { 2024-05-20T17:19:39.336 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.336 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.337 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.337 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.337 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookuphash_latency": { 2024-05-20T17:19:39.337 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.337 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.337 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.337 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.337 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupino_latency": { 2024-05-20T17:19:39.337 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.337 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.337 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.337 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.337 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupname_latency": { 2024-05-20T17:19:39.338 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.338 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.338 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.338 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.338 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupparent_latency": { 2024-05-20T17:19:39.338 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.338 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.338 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.338 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.338 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupsnap_latency": { 2024-05-20T17:19:39.338 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.338 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.338 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.338 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.339 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lssnap_latency": { 2024-05-20T17:19:39.339 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.339 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.339 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.339 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.339 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mkdir_latency": { 2024-05-20T17:19:39.339 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.340 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.340 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.340 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.340 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mknod_latency": { 2024-05-20T17:19:39.340 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.340 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.340 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.340 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.340 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mksnap_latency": { 2024-05-20T17:19:39.340 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.340 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.340 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.340 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.341 INFO:teuthology.orchestra.run.smithi062.stdout: "req_open_latency": { 2024-05-20T17:19:39.341 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.341 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.341 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.341 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.341 INFO:teuthology.orchestra.run.smithi062.stdout: "req_readdir_latency": { 2024-05-20T17:19:39.341 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.341 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.341 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.341 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.341 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rename_latency": { 2024-05-20T17:19:39.341 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.341 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.341 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.342 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.342 INFO:teuthology.orchestra.run.smithi062.stdout: "req_renamesnap_latency": { 2024-05-20T17:19:39.342 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.342 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.342 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.342 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.342 INFO:teuthology.orchestra.run.smithi062.stdout: "req_snapdiff_latency": { 2024-05-20T17:19:39.342 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.342 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.342 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.342 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.342 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmdir_latency": { 2024-05-20T17:19:39.343 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.343 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.343 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.343 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.343 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmsnap_latency": { 2024-05-20T17:19:39.343 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.343 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.343 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.343 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.343 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmxattr_latency": { 2024-05-20T17:19:39.343 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.343 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.343 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.343 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.344 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setattr_latency": { 2024-05-20T17:19:39.344 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.344 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.344 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.344 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.344 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setdirlayout_latency": { 2024-05-20T17:19:39.344 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.344 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.344 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.344 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.344 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setfilelock_latency": { 2024-05-20T17:19:39.344 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.344 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.345 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.345 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.345 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setlayout_latency": { 2024-05-20T17:19:39.345 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.345 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.345 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.345 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.345 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setxattr_latency": { 2024-05-20T17:19:39.345 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.345 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.345 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.345 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.345 INFO:teuthology.orchestra.run.smithi062.stdout: "req_symlink_latency": { 2024-05-20T17:19:39.345 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.346 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.346 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.346 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.346 INFO:teuthology.orchestra.run.smithi062.stdout: "req_unlink_latency": { 2024-05-20T17:19:39.346 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.346 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.346 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.346 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.346 INFO:teuthology.orchestra.run.smithi062.stdout: "cap_revoke_eviction": 0, 2024-05-20T17:19:39.346 INFO:teuthology.orchestra.run.smithi062.stdout: "cap_acquisition_throttle": 0, 2024-05-20T17:19:39.346 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getvxattr_latency": { 2024-05-20T17:19:39.346 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.347 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.347 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.347 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:39.347 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.347 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_sessions": { 2024-05-20T17:19:39.347 INFO:teuthology.orchestra.run.smithi062.stdout: "session_count": 1, 2024-05-20T17:19:39.347 INFO:teuthology.orchestra.run.smithi062.stdout: "session_add": 3, 2024-05-20T17:19:39.347 INFO:teuthology.orchestra.run.smithi062.stdout: "session_remove": 2, 2024-05-20T17:19:39.347 INFO:teuthology.orchestra.run.smithi062.stdout: "sessions_open": 1, 2024-05-20T17:19:39.347 INFO:teuthology.orchestra.run.smithi062.stdout: "sessions_stale": 0, 2024-05-20T17:19:39.347 INFO:teuthology.orchestra.run.smithi062.stdout: "total_load": 0, 2024-05-20T17:19:39.347 INFO:teuthology.orchestra.run.smithi062.stdout: "average_load": 0, 2024-05-20T17:19:39.347 INFO:teuthology.orchestra.run.smithi062.stdout: "avg_session_uptime": 1888, 2024-05-20T17:19:39.348 INFO:teuthology.orchestra.run.smithi062.stdout: "mdthresh_evicted": 0 2024-05-20T17:19:39.348 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.348 INFO:teuthology.orchestra.run.smithi062.stdout: "mempool": { 2024-05-20T17:19:39.348 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:19:39.348 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_items": 0, 2024-05-20T17:19:39.348 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:19:39.348 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:19:39.348 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:19:39.348 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:19:39.348 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:19:39.348 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:19:39.348 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:19:39.348 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:19:39.349 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:19:39.349 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:19:39.349 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:19:39.349 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:19:39.349 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:19:39.349 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_items": 0, 2024-05-20T17:19:39.349 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:19:39.349 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_items": 0, 2024-05-20T17:19:39.349 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:19:39.349 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:19:39.349 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:19:39.349 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:19:39.349 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:19:39.349 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:19:39.350 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:19:39.350 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_items": 0, 2024-05-20T17:19:39.350 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:19:39.350 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:19:39.350 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:19:39.350 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_items": 0, 2024-05-20T17:19:39.350 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_bytes": 0, 2024-05-20T17:19:39.350 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_items": 0, 2024-05-20T17:19:39.350 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:19:39.350 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:19:39.350 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:19:39.350 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:19:39.350 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_bytes": 189400, 2024-05-20T17:19:39.350 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_items": 51, 2024-05-20T17:19:39.351 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:19:39.351 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_items": 0, 2024-05-20T17:19:39.351 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_bytes": 0, 2024-05-20T17:19:39.351 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_items": 0, 2024-05-20T17:19:39.351 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:19:39.351 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_items": 0, 2024-05-20T17:19:39.351 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:19:39.351 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_items": 0, 2024-05-20T17:19:39.351 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_bytes": 8984, 2024-05-20T17:19:39.351 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_items": 172, 2024-05-20T17:19:39.351 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:19:39.351 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:19:39.351 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_bytes": 0, 2024-05-20T17:19:39.351 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_items": 0, 2024-05-20T17:19:39.352 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_bytes": 71677, 2024-05-20T17:19:39.352 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_items": 414, 2024-05-20T17:19:39.352 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_bytes": 0, 2024-05-20T17:19:39.352 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_items": 0, 2024-05-20T17:19:39.352 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_bytes": 0, 2024-05-20T17:19:39.352 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_items": 0 2024-05-20T17:19:39.352 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.352 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter": { 2024-05-20T17:19:39.352 INFO:teuthology.orchestra.run.smithi062.stdout: "op_active": 0, 2024-05-20T17:19:39.352 INFO:teuthology.orchestra.run.smithi062.stdout: "op_laggy": 0, 2024-05-20T17:19:39.352 INFO:teuthology.orchestra.run.smithi062.stdout: "op_send": 2598, 2024-05-20T17:19:39.352 INFO:teuthology.orchestra.run.smithi062.stdout: "op_send_bytes": 26, 2024-05-20T17:19:39.352 INFO:teuthology.orchestra.run.smithi062.stdout: "op_resend": 4, 2024-05-20T17:19:39.353 INFO:teuthology.orchestra.run.smithi062.stdout: "op_reply": 2598, 2024-05-20T17:19:39.353 INFO:teuthology.orchestra.run.smithi062.stdout: "op_latency": { 2024-05-20T17:19:39.353 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 2598, 2024-05-20T17:19:39.353 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 1.547977112, 2024-05-20T17:19:39.353 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000595834 2024-05-20T17:19:39.353 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.353 INFO:teuthology.orchestra.run.smithi062.stdout: "op_inflight": 0, 2024-05-20T17:19:39.353 INFO:teuthology.orchestra.run.smithi062.stdout: "oplen_avg": { 2024-05-20T17:19:39.353 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 2598, 2024-05-20T17:19:39.353 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 2599 2024-05-20T17:19:39.353 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.354 INFO:teuthology.orchestra.run.smithi062.stdout: "op": 2598, 2024-05-20T17:19:39.354 INFO:teuthology.orchestra.run.smithi062.stdout: "op_r": 2598, 2024-05-20T17:19:39.354 INFO:teuthology.orchestra.run.smithi062.stdout: "op_w": 0, 2024-05-20T17:19:39.354 INFO:teuthology.orchestra.run.smithi062.stdout: "op_rmw": 0, 2024-05-20T17:19:39.354 INFO:teuthology.orchestra.run.smithi062.stdout: "op_pg": 0, 2024-05-20T17:19:39.354 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_stat": 1692, 2024-05-20T17:19:39.354 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_create": 0, 2024-05-20T17:19:39.354 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_read": 903, 2024-05-20T17:19:39.354 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_write": 0, 2024-05-20T17:19:39.354 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_writefull": 0, 2024-05-20T17:19:39.354 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_writesame": 0, 2024-05-20T17:19:39.354 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_append": 0, 2024-05-20T17:19:39.355 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_zero": 0, 2024-05-20T17:19:39.355 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_truncate": 0, 2024-05-20T17:19:39.355 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_delete": 0, 2024-05-20T17:19:39.355 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_mapext": 0, 2024-05-20T17:19:39.355 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_sparse_read": 0, 2024-05-20T17:19:39.355 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_clonerange": 0, 2024-05-20T17:19:39.355 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_getxattr": 2, 2024-05-20T17:19:39.355 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_setxattr": 0, 2024-05-20T17:19:39.355 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_cmpxattr": 0, 2024-05-20T17:19:39.355 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_rmxattr": 0, 2024-05-20T17:19:39.355 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_resetxattrs": 0, 2024-05-20T17:19:39.355 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_call": 0, 2024-05-20T17:19:39.355 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_watch": 0, 2024-05-20T17:19:39.356 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_notify": 0, 2024-05-20T17:19:39.356 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_src_cmpxattr": 0, 2024-05-20T17:19:39.356 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_pgls": 0, 2024-05-20T17:19:39.356 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_pgls_filter": 0, 2024-05-20T17:19:39.356 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_other": 0, 2024-05-20T17:19:39.356 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_active": 0, 2024-05-20T17:19:39.356 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_send": 0, 2024-05-20T17:19:39.356 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_resend": 0, 2024-05-20T17:19:39.356 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_ping": 0, 2024-05-20T17:19:39.356 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_active": 0, 2024-05-20T17:19:39.356 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_send": 0, 2024-05-20T17:19:39.356 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_resend": 0, 2024-05-20T17:19:39.356 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_active": 0, 2024-05-20T17:19:39.356 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_send": 0, 2024-05-20T17:19:39.356 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_resend": 0, 2024-05-20T17:19:39.357 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_active": 0, 2024-05-20T17:19:39.357 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_send": 0, 2024-05-20T17:19:39.357 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_resend": 0, 2024-05-20T17:19:39.357 INFO:teuthology.orchestra.run.smithi062.stdout: "command_active": 0, 2024-05-20T17:19:39.357 INFO:teuthology.orchestra.run.smithi062.stdout: "command_send": 0, 2024-05-20T17:19:39.357 INFO:teuthology.orchestra.run.smithi062.stdout: "command_resend": 0, 2024-05-20T17:19:39.357 INFO:teuthology.orchestra.run.smithi062.stdout: "map_epoch": 94, 2024-05-20T17:19:39.357 INFO:teuthology.orchestra.run.smithi062.stdout: "map_full": 0, 2024-05-20T17:19:39.357 INFO:teuthology.orchestra.run.smithi062.stdout: "map_inc": 4, 2024-05-20T17:19:39.357 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_sessions": 5, 2024-05-20T17:19:39.357 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_session_open": 5, 2024-05-20T17:19:39.357 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_session_close": 0, 2024-05-20T17:19:39.357 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_laggy": 0, 2024-05-20T17:19:39.358 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_wr": 0, 2024-05-20T17:19:39.358 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_rd": 2, 2024-05-20T17:19:39.358 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_del": 0 2024-05-20T17:19:39.358 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.358 INFO:teuthology.orchestra.run.smithi062.stdout: "oft": { 2024-05-20T17:19:39.358 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_objs": 0, 2024-05-20T17:19:39.358 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_kv_pairs": 0, 2024-05-20T17:19:39.358 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_updates": 0, 2024-05-20T17:19:39.358 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_removes": 0 2024-05-20T17:19:39.358 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.358 INFO:teuthology.orchestra.run.smithi062.stdout: "osd-slow-ops": { 2024-05-20T17:19:39.358 INFO:teuthology.orchestra.run.smithi062.stdout: "slow_ops_count": 0 2024-05-20T17:19:39.358 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.359 INFO:teuthology.orchestra.run.smithi062.stdout: "purge_queue": { 2024-05-20T17:19:39.359 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_ops": 0, 2024-05-20T17:19:39.359 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_ops_high_water": 0, 2024-05-20T17:19:39.359 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing": 0, 2024-05-20T17:19:39.359 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_high_water": 0, 2024-05-20T17:19:39.359 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executed_ops": 0, 2024-05-20T17:19:39.359 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executed": 0, 2024-05-20T17:19:39.359 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_item_in_journal": 0 2024-05-20T17:19:39.359 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.359 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:19:39.359 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-05-20T17:19:39.359 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 104857600, 2024-05-20T17:19:39.359 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-05-20T17:19:39.359 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 2864, 2024-05-20T17:19:39.360 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 1741372, 2024-05-20T17:19:39.360 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:39.360 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 2864, 2024-05-20T17:19:39.360 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-05-20T17:19:39.360 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-05-20T17:19:39.360 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 2864, 2024-05-20T17:19:39.360 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 1741372, 2024-05-20T17:19:39.360 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-05-20T17:19:39.360 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.360 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.360 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.360 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:39.360 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.360 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-objecter_bytes": { 2024-05-20T17:19:39.361 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-05-20T17:19:39.361 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 104857600, 2024-05-20T17:19:39.361 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-05-20T17:19:39.361 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-05-20T17:19:39.361 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-05-20T17:19:39.361 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:39.361 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:39.361 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 2598, 2024-05-20T17:19:39.361 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 709527, 2024-05-20T17:19:39.361 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 2598, 2024-05-20T17:19:39.361 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 709527, 2024-05-20T17:19:39.361 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-05-20T17:19:39.361 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.362 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.362 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.362 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:39.362 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.362 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-objecter_ops": { 2024-05-20T17:19:39.362 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-05-20T17:19:39.362 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 1024, 2024-05-20T17:19:39.362 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-05-20T17:19:39.362 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-05-20T17:19:39.362 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-05-20T17:19:39.362 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:39.362 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:39.362 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 2598, 2024-05-20T17:19:39.363 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 2598, 2024-05-20T17:19:39.363 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 2598, 2024-05-20T17:19:39.363 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 2598, 2024-05-20T17:19:39.363 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-05-20T17:19:39.363 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.363 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.363 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.363 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:39.363 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.363 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-write_buf_throttle": { 2024-05-20T17:19:39.363 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-05-20T17:19:39.363 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 3758096384, 2024-05-20T17:19:39.363 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-05-20T17:19:39.363 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-05-20T17:19:39.364 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-05-20T17:19:39.364 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:39.364 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:39.364 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-05-20T17:19:39.364 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-05-20T17:19:39.364 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 0, 2024-05-20T17:19:39.364 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 0, 2024-05-20T17:19:39.364 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-05-20T17:19:39.364 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.364 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.364 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.364 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:39.364 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:39.364 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-write_buf_throttle-0x55742fcc0c30": { 2024-05-20T17:19:39.365 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-05-20T17:19:39.365 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 3758096384, 2024-05-20T17:19:39.365 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-05-20T17:19:39.365 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-05-20T17:19:39.365 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-05-20T17:19:39.365 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:39.365 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:39.365 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-05-20T17:19:39.365 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-05-20T17:19:39.365 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 0, 2024-05-20T17:19:39.365 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 0, 2024-05-20T17:19:39.365 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-05-20T17:19:39.365 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:39.366 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:39.366 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:39.366 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:39.366 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:39.366 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-20T17:19:39.772 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:39 smithi062 ceph-mon[35425]: pgmap v742: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:19:39.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:39 smithi171 ceph-mon[35901]: pgmap v742: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:19:39.880 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:39 smithi006 ceph-mon[32486]: pgmap v742: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:19:40.108 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-05-20T17:19:40.108 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-05-20T17:19:40.108 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-05-20T17:19:40.108 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-05-20T17:19:40.108 DEBUG:tasks.check_counter:Getting stats from k 2024-05-20T17:19:40.108 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph daemon mds.k perf dump 2024-05-20T17:19:40.361 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.b/config 2024-05-20T17:19:41.773 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:41 smithi062 ceph-mon[35425]: pgmap v743: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:19:41.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:41 smithi171 ceph-mon[35901]: pgmap v743: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:19:41.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:41 smithi006 ceph-mon[32486]: pgmap v743: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:19:42.379 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-20T17:19:42.379 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:19:42.379 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 579, 2024-05-20T17:19:42.379 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 732, 2024-05-20T17:19:42.379 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 244346, 2024-05-20T17:19:42.379 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 354694, 2024-05-20T17:19:42.379 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 10, 2024-05-20T17:19:42.379 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 4, 2024-05-20T17:19:42.379 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.074148975, 2024-05-20T17:19:42.379 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.031401455, 2024-05-20T17:19:42.380 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.036955649, 2024-05-20T17:19:42.380 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.004698527, 2024-05-20T17:19:42.380 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:42.380 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 733, 2024-05-20T17:19:42.380 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.059321374, 2024-05-20T17:19:42.380 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000080929 2024-05-20T17:19:42.380 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.380 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:42.380 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 1209, 2024-05-20T17:19:42.380 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000276760, 2024-05-20T17:19:42.380 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000228 2024-05-20T17:19:42.380 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.380 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-20T17:19:42.381 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 448 2024-05-20T17:19:42.381 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.381 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:19:42.381 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 25, 2024-05-20T17:19:42.381 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 212, 2024-05-20T17:19:42.381 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 4967, 2024-05-20T17:19:42.381 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 541234, 2024-05-20T17:19:42.381 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 15, 2024-05-20T17:19:42.381 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 4, 2024-05-20T17:19:42.381 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.017554742, 2024-05-20T17:19:42.381 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.008955189, 2024-05-20T17:19:42.381 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.006093160, 2024-05-20T17:19:42.382 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.000602330, 2024-05-20T17:19:42.382 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:42.382 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 208, 2024-05-20T17:19:42.382 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.020722249, 2024-05-20T17:19:42.382 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000099626 2024-05-20T17:19:42.382 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.382 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:42.382 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 24, 2024-05-20T17:19:42.382 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000005668, 2024-05-20T17:19:42.382 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000236 2024-05-20T17:19:42.382 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.382 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-20T17:19:42.382 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 481840 2024-05-20T17:19:42.382 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.383 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:19:42.383 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 368, 2024-05-20T17:19:42.383 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 357, 2024-05-20T17:19:42.383 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 606737, 2024-05-20T17:19:42.383 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 206853, 2024-05-20T17:19:42.383 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 7, 2024-05-20T17:19:42.383 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 5, 2024-05-20T17:19:42.383 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.047276647, 2024-05-20T17:19:42.383 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.016805900, 2024-05-20T17:19:42.383 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.027697548, 2024-05-20T17:19:42.383 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.006812197, 2024-05-20T17:19:42.383 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:42.383 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 356, 2024-05-20T17:19:42.384 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.035966856, 2024-05-20T17:19:42.384 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000101030 2024-05-20T17:19:42.384 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.384 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:42.384 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 96, 2024-05-20T17:19:42.384 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000024152, 2024-05-20T17:19:42.384 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000251 2024-05-20T17:19:42.384 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.384 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 560304, 2024-05-20T17:19:42.384 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 157136 2024-05-20T17:19:42.384 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.384 INFO:teuthology.orchestra.run.smithi062.stdout: "cct": { 2024-05-20T17:19:42.385 INFO:teuthology.orchestra.run.smithi062.stdout: "total_workers": 1, 2024-05-20T17:19:42.385 INFO:teuthology.orchestra.run.smithi062.stdout: "unhealthy_workers": 0 2024-05-20T17:19:42.385 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.385 INFO:teuthology.orchestra.run.smithi062.stdout: "finisher-MDSRank": { 2024-05-20T17:19:42.385 INFO:teuthology.orchestra.run.smithi062.stdout: "queue_len": 0, 2024-05-20T17:19:42.385 INFO:teuthology.orchestra.run.smithi062.stdout: "complete_latency": { 2024-05-20T17:19:42.385 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 32, 2024-05-20T17:19:42.385 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.001454562, 2024-05-20T17:19:42.385 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000045455 2024-05-20T17:19:42.385 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:42.385 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.385 INFO:teuthology.orchestra.run.smithi062.stdout: "finisher-PurgeQueue": { 2024-05-20T17:19:42.385 INFO:teuthology.orchestra.run.smithi062.stdout: "queue_len": 0, 2024-05-20T17:19:42.385 INFO:teuthology.orchestra.run.smithi062.stdout: "complete_latency": { 2024-05-20T17:19:42.386 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 2, 2024-05-20T17:19:42.386 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000006371, 2024-05-20T17:19:42.386 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000003185 2024-05-20T17:19:42.386 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:42.386 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.386 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-20T17:19:42.386 INFO:teuthology.orchestra.run.smithi062.stdout: "request": 0, 2024-05-20T17:19:42.386 INFO:teuthology.orchestra.run.smithi062.stdout: "reply": 0, 2024-05-20T17:19:42.386 INFO:teuthology.orchestra.run.smithi062.stdout: "reply_latency": { 2024-05-20T17:19:42.386 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.386 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.386 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.386 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.387 INFO:teuthology.orchestra.run.smithi062.stdout: "slow_reply": 0, 2024-05-20T17:19:42.387 INFO:teuthology.orchestra.run.smithi062.stdout: "forward": 0, 2024-05-20T17:19:42.387 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_fetch_complete": 0, 2024-05-20T17:19:42.387 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_fetch_keys": 0, 2024-05-20T17:19:42.387 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_commit": 11, 2024-05-20T17:19:42.387 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_split": 0, 2024-05-20T17:19:42.387 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_merge": 0, 2024-05-20T17:19:42.387 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes": 16, 2024-05-20T17:19:42.387 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_top": 0, 2024-05-20T17:19:42.387 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_bottom": 16, 2024-05-20T17:19:42.387 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_pin_tail": 0, 2024-05-20T17:19:42.387 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_pinned": 13, 2024-05-20T17:19:42.387 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_expired": 8, 2024-05-20T17:19:42.388 INFO:teuthology.orchestra.run.smithi062.stdout: "inodes_with_caps": 0, 2024-05-20T17:19:42.388 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": 0, 2024-05-20T17:19:42.388 INFO:teuthology.orchestra.run.smithi062.stdout: "subtrees": 3, 2024-05-20T17:19:42.388 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse": 10, 2024-05-20T17:19:42.388 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_hit": 6, 2024-05-20T17:19:42.388 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_forward": 0, 2024-05-20T17:19:42.388 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_discover": 4, 2024-05-20T17:19:42.388 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_dir_fetch": 0, 2024-05-20T17:19:42.388 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_remote_ino": 0, 2024-05-20T17:19:42.388 INFO:teuthology.orchestra.run.smithi062.stdout: "traverse_lock": 0, 2024-05-20T17:19:42.388 INFO:teuthology.orchestra.run.smithi062.stdout: "load_cent": 0, 2024-05-20T17:19:42.388 INFO:teuthology.orchestra.run.smithi062.stdout: "q": 0, 2024-05-20T17:19:42.388 INFO:teuthology.orchestra.run.smithi062.stdout: "exported": 0, 2024-05-20T17:19:42.389 INFO:teuthology.orchestra.run.smithi062.stdout: "exported_inodes": 0, 2024-05-20T17:19:42.389 INFO:teuthology.orchestra.run.smithi062.stdout: "imported": 0, 2024-05-20T17:19:42.389 INFO:teuthology.orchestra.run.smithi062.stdout: "imported_inodes": 0, 2024-05-20T17:19:42.389 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_dir_fetch": 0, 2024-05-20T17:19:42.389 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_backtrace_fetch": 0, 2024-05-20T17:19:42.389 INFO:teuthology.orchestra.run.smithi062.stdout: "openino_peer_discover": 0, 2024-05-20T17:19:42.389 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rfiles": 4, 2024-05-20T17:19:42.389 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rbytes": 234, 2024-05-20T17:19:42.389 INFO:teuthology.orchestra.run.smithi062.stdout: "root_rsnaps": 0, 2024-05-20T17:19:42.389 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_backtrace_fetch": 0, 2024-05-20T17:19:42.389 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_set_tag": 0, 2024-05-20T17:19:42.389 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_backtrace_repaired": 0, 2024-05-20T17:19:42.389 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_inotable_repaired": 0, 2024-05-20T17:19:42.389 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dir_inodes": 0, 2024-05-20T17:19:42.390 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dir_base_inodes": 0, 2024-05-20T17:19:42.390 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_dirfrag_rstats": 0, 2024-05-20T17:19:42.390 INFO:teuthology.orchestra.run.smithi062.stdout: "scrub_file_inodes": 0, 2024-05-20T17:19:42.390 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_inode_file_caps": 0, 2024-05-20T17:19:42.390 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_revoke": 0, 2024-05-20T17:19:42.390 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_grant": 0, 2024-05-20T17:19:42.390 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_trunc": 0, 2024-05-20T17:19:42.390 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-20T17:19:42.390 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-20T17:19:42.390 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_caps": 0, 2024-05-20T17:19:42.390 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_caps_dirty": 0, 2024-05-20T17:19:42.390 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_cap_release": 0, 2024-05-20T17:19:42.391 INFO:teuthology.orchestra.run.smithi062.stdout: "process_request_cap_release": 0 2024-05-20T17:19:42.391 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.391 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_cache": { 2024-05-20T17:19:42.391 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_update": 0, 2024-05-20T17:19:42.391 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_update_receipt": 14, 2024-05-20T17:19:42.391 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_try_discover": 9, 2024-05-20T17:19:42.391 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_send_discover": 11, 2024-05-20T17:19:42.391 INFO:teuthology.orchestra.run.smithi062.stdout: "dir_handle_discover": 0, 2024-05-20T17:19:42.391 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays": 0, 2024-05-20T17:19:42.391 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays_delayed": 0, 2024-05-20T17:19:42.391 INFO:teuthology.orchestra.run.smithi062.stdout: "num_strays_enqueuing": 0, 2024-05-20T17:19:42.391 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_created": 0, 2024-05-20T17:19:42.391 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_enqueued": 0, 2024-05-20T17:19:42.391 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_reintegrated": 0, 2024-05-20T17:19:42.392 INFO:teuthology.orchestra.run.smithi062.stdout: "strays_migrated": 0, 2024-05-20T17:19:42.392 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_processing": 0, 2024-05-20T17:19:42.392 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_enqueued": 0, 2024-05-20T17:19:42.392 INFO:teuthology.orchestra.run.smithi062.stdout: "num_recovering_prioritized": 0, 2024-05-20T17:19:42.392 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_started": 0, 2024-05-20T17:19:42.392 INFO:teuthology.orchestra.run.smithi062.stdout: "recovery_completed": 0, 2024-05-20T17:19:42.392 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_quiesce_path": 0, 2024-05-20T17:19:42.392 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_quiesce_inode": 0, 2024-05-20T17:19:42.392 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_enqueue_scrub": 0, 2024-05-20T17:19:42.392 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_exportdir": 0, 2024-05-20T17:19:42.392 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_flush": 0, 2024-05-20T17:19:42.392 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_fragmentdir": 0, 2024-05-20T17:19:42.392 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_fragstats": 0, 2024-05-20T17:19:42.392 INFO:teuthology.orchestra.run.smithi062.stdout: "ireq_inodestats": 0 2024-05-20T17:19:42.393 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.393 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_log": { 2024-05-20T17:19:42.393 INFO:teuthology.orchestra.run.smithi062.stdout: "evlrg": 0, 2024-05-20T17:19:42.393 INFO:teuthology.orchestra.run.smithi062.stdout: "evadd": 3, 2024-05-20T17:19:42.393 INFO:teuthology.orchestra.run.smithi062.stdout: "evex": 0, 2024-05-20T17:19:42.393 INFO:teuthology.orchestra.run.smithi062.stdout: "evtrm": 0, 2024-05-20T17:19:42.393 INFO:teuthology.orchestra.run.smithi062.stdout: "ev": 3, 2024-05-20T17:19:42.393 INFO:teuthology.orchestra.run.smithi062.stdout: "evexg": 0, 2024-05-20T17:19:42.393 INFO:teuthology.orchestra.run.smithi062.stdout: "evexd": 0, 2024-05-20T17:19:42.393 INFO:teuthology.orchestra.run.smithi062.stdout: "segadd": 2, 2024-05-20T17:19:42.393 INFO:teuthology.orchestra.run.smithi062.stdout: "segex": 0, 2024-05-20T17:19:42.393 INFO:teuthology.orchestra.run.smithi062.stdout: "segtrm": 0, 2024-05-20T17:19:42.393 INFO:teuthology.orchestra.run.smithi062.stdout: "seg": 2, 2024-05-20T17:19:42.393 INFO:teuthology.orchestra.run.smithi062.stdout: "segmjr": 2, 2024-05-20T17:19:42.393 INFO:teuthology.orchestra.run.smithi062.stdout: "segexg": 0, 2024-05-20T17:19:42.394 INFO:teuthology.orchestra.run.smithi062.stdout: "segexd": 0, 2024-05-20T17:19:42.394 INFO:teuthology.orchestra.run.smithi062.stdout: "expos": 4194304, 2024-05-20T17:19:42.394 INFO:teuthology.orchestra.run.smithi062.stdout: "wrpos": 4195385, 2024-05-20T17:19:42.394 INFO:teuthology.orchestra.run.smithi062.stdout: "rdpos": 0, 2024-05-20T17:19:42.394 INFO:teuthology.orchestra.run.smithi062.stdout: "jlat": { 2024-05-20T17:19:42.394 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 2, 2024-05-20T17:19:42.394 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.003297889, 2024-05-20T17:19:42.394 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.001648944 2024-05-20T17:19:42.394 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.394 INFO:teuthology.orchestra.run.smithi062.stdout: "replayed": 0 2024-05-20T17:19:42.394 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.395 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_mem": { 2024-05-20T17:19:42.395 INFO:teuthology.orchestra.run.smithi062.stdout: "ino": 20, 2024-05-20T17:19:42.395 INFO:teuthology.orchestra.run.smithi062.stdout: "ino+": 24, 2024-05-20T17:19:42.395 INFO:teuthology.orchestra.run.smithi062.stdout: "ino-": 4, 2024-05-20T17:19:42.395 INFO:teuthology.orchestra.run.smithi062.stdout: "dir": 19, 2024-05-20T17:19:42.395 INFO:teuthology.orchestra.run.smithi062.stdout: "dir+": 24, 2024-05-20T17:19:42.395 INFO:teuthology.orchestra.run.smithi062.stdout: "dir-": 5, 2024-05-20T17:19:42.395 INFO:teuthology.orchestra.run.smithi062.stdout: "dn": 16, 2024-05-20T17:19:42.395 INFO:teuthology.orchestra.run.smithi062.stdout: "dn+": 24, 2024-05-20T17:19:42.395 INFO:teuthology.orchestra.run.smithi062.stdout: "dn-": 8, 2024-05-20T17:19:42.395 INFO:teuthology.orchestra.run.smithi062.stdout: "cap": 0, 2024-05-20T17:19:42.395 INFO:teuthology.orchestra.run.smithi062.stdout: "cap+": 0, 2024-05-20T17:19:42.395 INFO:teuthology.orchestra.run.smithi062.stdout: "cap-": 0, 2024-05-20T17:19:42.396 INFO:teuthology.orchestra.run.smithi062.stdout: "rss": 121884, 2024-05-20T17:19:42.396 INFO:teuthology.orchestra.run.smithi062.stdout: "heap": 223636 2024-05-20T17:19:42.396 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.396 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_server": { 2024-05-20T17:19:42.396 INFO:teuthology.orchestra.run.smithi062.stdout: "dispatch_client_request": 0, 2024-05-20T17:19:42.396 INFO:teuthology.orchestra.run.smithi062.stdout: "dispatch_server_request": 1, 2024-05-20T17:19:42.396 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_request": 0, 2024-05-20T17:19:42.396 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_client_session": 10, 2024-05-20T17:19:42.396 INFO:teuthology.orchestra.run.smithi062.stdout: "handle_peer_request": 2, 2024-05-20T17:19:42.396 INFO:teuthology.orchestra.run.smithi062.stdout: "req_create_latency": { 2024-05-20T17:19:42.396 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.396 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.397 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.397 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.397 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getattr_latency": { 2024-05-20T17:19:42.397 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.397 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.397 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.397 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.397 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getfilelock_latency": { 2024-05-20T17:19:42.397 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.397 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.397 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.397 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.397 INFO:teuthology.orchestra.run.smithi062.stdout: "req_link_latency": { 2024-05-20T17:19:42.398 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.398 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.398 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.398 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.398 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookup_latency": { 2024-05-20T17:19:42.398 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.398 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.398 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.398 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.398 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookuphash_latency": { 2024-05-20T17:19:42.398 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.398 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.398 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.399 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.399 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupino_latency": { 2024-05-20T17:19:42.399 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.399 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.399 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.399 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.399 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupname_latency": { 2024-05-20T17:19:42.399 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.399 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.399 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.399 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.399 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupparent_latency": { 2024-05-20T17:19:42.399 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.399 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.399 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.400 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.400 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lookupsnap_latency": { 2024-05-20T17:19:42.400 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.400 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.400 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.400 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.400 INFO:teuthology.orchestra.run.smithi062.stdout: "req_lssnap_latency": { 2024-05-20T17:19:42.400 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.400 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.400 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.400 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.400 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mkdir_latency": { 2024-05-20T17:19:42.401 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.401 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.401 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.401 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.401 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mknod_latency": { 2024-05-20T17:19:42.402 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.402 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.402 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.402 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.402 INFO:teuthology.orchestra.run.smithi062.stdout: "req_mksnap_latency": { 2024-05-20T17:19:42.402 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.402 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.402 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.402 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.402 INFO:teuthology.orchestra.run.smithi062.stdout: "req_open_latency": { 2024-05-20T17:19:42.402 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.402 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.402 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.403 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.403 INFO:teuthology.orchestra.run.smithi062.stdout: "req_readdir_latency": { 2024-05-20T17:19:42.403 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.403 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.403 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.403 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.403 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rename_latency": { 2024-05-20T17:19:42.403 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.403 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.403 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.403 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.403 INFO:teuthology.orchestra.run.smithi062.stdout: "req_renamesnap_latency": { 2024-05-20T17:19:42.403 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.403 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.404 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.404 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.404 INFO:teuthology.orchestra.run.smithi062.stdout: "req_snapdiff_latency": { 2024-05-20T17:19:42.404 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.404 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.404 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.404 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.404 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmdir_latency": { 2024-05-20T17:19:42.404 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.404 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.404 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.404 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.404 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmsnap_latency": { 2024-05-20T17:19:42.404 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.405 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.405 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.405 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.405 INFO:teuthology.orchestra.run.smithi062.stdout: "req_rmxattr_latency": { 2024-05-20T17:19:42.405 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.405 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.405 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.405 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.405 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setattr_latency": { 2024-05-20T17:19:42.405 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.405 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.405 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.405 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.406 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setdirlayout_latency": { 2024-05-20T17:19:42.406 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.406 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.406 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.406 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.406 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setfilelock_latency": { 2024-05-20T17:19:42.406 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.406 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.406 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.406 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.406 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setlayout_latency": { 2024-05-20T17:19:42.406 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.407 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.407 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.407 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.407 INFO:teuthology.orchestra.run.smithi062.stdout: "req_setxattr_latency": { 2024-05-20T17:19:42.407 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.407 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.407 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.407 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.407 INFO:teuthology.orchestra.run.smithi062.stdout: "req_symlink_latency": { 2024-05-20T17:19:42.407 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.407 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.407 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.408 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.408 INFO:teuthology.orchestra.run.smithi062.stdout: "req_unlink_latency": { 2024-05-20T17:19:42.408 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.408 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.408 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.408 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.408 INFO:teuthology.orchestra.run.smithi062.stdout: "cap_revoke_eviction": 0, 2024-05-20T17:19:42.408 INFO:teuthology.orchestra.run.smithi062.stdout: "cap_acquisition_throttle": 0, 2024-05-20T17:19:42.408 INFO:teuthology.orchestra.run.smithi062.stdout: "req_getvxattr_latency": { 2024-05-20T17:19:42.408 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.408 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.408 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.408 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:42.409 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.409 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_sessions": { 2024-05-20T17:19:42.409 INFO:teuthology.orchestra.run.smithi062.stdout: "session_count": 1, 2024-05-20T17:19:42.409 INFO:teuthology.orchestra.run.smithi062.stdout: "session_add": 1, 2024-05-20T17:19:42.409 INFO:teuthology.orchestra.run.smithi062.stdout: "session_remove": 0, 2024-05-20T17:19:42.409 INFO:teuthology.orchestra.run.smithi062.stdout: "sessions_open": 1, 2024-05-20T17:19:42.409 INFO:teuthology.orchestra.run.smithi062.stdout: "sessions_stale": 0, 2024-05-20T17:19:42.409 INFO:teuthology.orchestra.run.smithi062.stdout: "total_load": 0, 2024-05-20T17:19:42.409 INFO:teuthology.orchestra.run.smithi062.stdout: "average_load": 0, 2024-05-20T17:19:42.409 INFO:teuthology.orchestra.run.smithi062.stdout: "avg_session_uptime": 725, 2024-05-20T17:19:42.409 INFO:teuthology.orchestra.run.smithi062.stdout: "mdthresh_evicted": 0 2024-05-20T17:19:42.409 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.409 INFO:teuthology.orchestra.run.smithi062.stdout: "mempool": { 2024-05-20T17:19:42.410 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:19:42.410 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_items": 0, 2024-05-20T17:19:42.410 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:19:42.410 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:19:42.410 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:19:42.410 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:19:42.410 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:19:42.410 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:19:42.410 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:19:42.410 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:19:42.410 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:19:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:19:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:19:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:19:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:19:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_items": 0, 2024-05-20T17:19:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:19:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_items": 0, 2024-05-20T17:19:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:19:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:19:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:19:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:19:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:19:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:19:42.411 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:19:42.412 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_items": 0, 2024-05-20T17:19:42.412 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:19:42.412 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:19:42.412 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:19:42.412 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_items": 0, 2024-05-20T17:19:42.412 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_bytes": 0, 2024-05-20T17:19:42.412 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_items": 0, 2024-05-20T17:19:42.412 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:19:42.412 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:19:42.412 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:19:42.412 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:19:42.412 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_bytes": 250831, 2024-05-20T17:19:42.412 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_items": 82, 2024-05-20T17:19:42.413 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:19:42.413 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_items": 0, 2024-05-20T17:19:42.413 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_bytes": 0, 2024-05-20T17:19:42.413 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_items": 0, 2024-05-20T17:19:42.413 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:19:42.413 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_items": 0, 2024-05-20T17:19:42.413 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:19:42.413 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_items": 0, 2024-05-20T17:19:42.413 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_bytes": 8984, 2024-05-20T17:19:42.413 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_items": 172, 2024-05-20T17:19:42.413 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:19:42.413 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:19:42.413 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_bytes": 0, 2024-05-20T17:19:42.414 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_items": 0, 2024-05-20T17:19:42.414 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_bytes": 80589, 2024-05-20T17:19:42.414 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_items": 320, 2024-05-20T17:19:42.414 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_bytes": 0, 2024-05-20T17:19:42.414 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_items": 0, 2024-05-20T17:19:42.414 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_bytes": 0, 2024-05-20T17:19:42.414 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_items": 0 2024-05-20T17:19:42.414 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.414 INFO:teuthology.orchestra.run.smithi062.stdout: "objecter": { 2024-05-20T17:19:42.414 INFO:teuthology.orchestra.run.smithi062.stdout: "op_active": 0, 2024-05-20T17:19:42.414 INFO:teuthology.orchestra.run.smithi062.stdout: "op_laggy": 0, 2024-05-20T17:19:42.414 INFO:teuthology.orchestra.run.smithi062.stdout: "op_send": 37, 2024-05-20T17:19:42.414 INFO:teuthology.orchestra.run.smithi062.stdout: "op_send_bytes": 11293, 2024-05-20T17:19:42.415 INFO:teuthology.orchestra.run.smithi062.stdout: "op_resend": 33, 2024-05-20T17:19:42.415 INFO:teuthology.orchestra.run.smithi062.stdout: "op_reply": 37, 2024-05-20T17:19:42.415 INFO:teuthology.orchestra.run.smithi062.stdout: "op_latency": { 2024-05-20T17:19:42.415 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 37, 2024-05-20T17:19:42.415 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.233996523, 2024-05-20T17:19:42.415 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.006324230 2024-05-20T17:19:42.415 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.415 INFO:teuthology.orchestra.run.smithi062.stdout: "op_inflight": 0, 2024-05-20T17:19:42.415 INFO:teuthology.orchestra.run.smithi062.stdout: "oplen_avg": { 2024-05-20T17:19:42.415 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 37, 2024-05-20T17:19:42.415 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 59 2024-05-20T17:19:42.415 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.415 INFO:teuthology.orchestra.run.smithi062.stdout: "op": 37, 2024-05-20T17:19:42.416 INFO:teuthology.orchestra.run.smithi062.stdout: "op_r": 0, 2024-05-20T17:19:42.416 INFO:teuthology.orchestra.run.smithi062.stdout: "op_w": 37, 2024-05-20T17:19:42.416 INFO:teuthology.orchestra.run.smithi062.stdout: "op_rmw": 0, 2024-05-20T17:19:42.416 INFO:teuthology.orchestra.run.smithi062.stdout: "op_pg": 0, 2024-05-20T17:19:42.416 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_stat": 0, 2024-05-20T17:19:42.416 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_create": 10, 2024-05-20T17:19:42.416 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_read": 0, 2024-05-20T17:19:42.416 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_write": 2, 2024-05-20T17:19:42.416 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_writefull": 6, 2024-05-20T17:19:42.416 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_writesame": 0, 2024-05-20T17:19:42.416 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_append": 0, 2024-05-20T17:19:42.416 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_zero": 0, 2024-05-20T17:19:42.416 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_truncate": 0, 2024-05-20T17:19:42.417 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_delete": 6, 2024-05-20T17:19:42.417 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_mapext": 0, 2024-05-20T17:19:42.417 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_sparse_read": 0, 2024-05-20T17:19:42.417 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_clonerange": 0, 2024-05-20T17:19:42.417 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_getxattr": 0, 2024-05-20T17:19:42.417 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_setxattr": 20, 2024-05-20T17:19:42.417 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_cmpxattr": 0, 2024-05-20T17:19:42.417 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_rmxattr": 0, 2024-05-20T17:19:42.417 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_resetxattrs": 0, 2024-05-20T17:19:42.417 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_call": 0, 2024-05-20T17:19:42.417 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_watch": 0, 2024-05-20T17:19:42.417 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_notify": 0, 2024-05-20T17:19:42.417 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_src_cmpxattr": 0, 2024-05-20T17:19:42.418 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_pgls": 0, 2024-05-20T17:19:42.418 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_pgls_filter": 0, 2024-05-20T17:19:42.418 INFO:teuthology.orchestra.run.smithi062.stdout: "osdop_other": 0, 2024-05-20T17:19:42.418 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_active": 0, 2024-05-20T17:19:42.418 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_send": 0, 2024-05-20T17:19:42.418 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_resend": 0, 2024-05-20T17:19:42.418 INFO:teuthology.orchestra.run.smithi062.stdout: "linger_ping": 0, 2024-05-20T17:19:42.418 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_active": 0, 2024-05-20T17:19:42.418 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_send": 0, 2024-05-20T17:19:42.418 INFO:teuthology.orchestra.run.smithi062.stdout: "poolop_resend": 0, 2024-05-20T17:19:42.418 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_active": 0, 2024-05-20T17:19:42.418 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_send": 0, 2024-05-20T17:19:42.418 INFO:teuthology.orchestra.run.smithi062.stdout: "poolstat_resend": 0, 2024-05-20T17:19:42.418 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_active": 0, 2024-05-20T17:19:42.419 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_send": 0, 2024-05-20T17:19:42.419 INFO:teuthology.orchestra.run.smithi062.stdout: "statfs_resend": 0, 2024-05-20T17:19:42.419 INFO:teuthology.orchestra.run.smithi062.stdout: "command_active": 0, 2024-05-20T17:19:42.419 INFO:teuthology.orchestra.run.smithi062.stdout: "command_send": 0, 2024-05-20T17:19:42.419 INFO:teuthology.orchestra.run.smithi062.stdout: "command_resend": 0, 2024-05-20T17:19:42.419 INFO:teuthology.orchestra.run.smithi062.stdout: "map_epoch": 94, 2024-05-20T17:19:42.419 INFO:teuthology.orchestra.run.smithi062.stdout: "map_full": 0, 2024-05-20T17:19:42.419 INFO:teuthology.orchestra.run.smithi062.stdout: "map_inc": 4, 2024-05-20T17:19:42.419 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_sessions": 9, 2024-05-20T17:19:42.419 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_session_open": 9, 2024-05-20T17:19:42.419 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_session_close": 0, 2024-05-20T17:19:42.419 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_laggy": 0, 2024-05-20T17:19:42.419 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_wr": 14, 2024-05-20T17:19:42.419 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_rd": 0, 2024-05-20T17:19:42.419 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_del": 1 2024-05-20T17:19:42.420 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.420 INFO:teuthology.orchestra.run.smithi062.stdout: "oft": { 2024-05-20T17:19:42.420 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_objs": 1, 2024-05-20T17:19:42.420 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_kv_pairs": 0, 2024-05-20T17:19:42.420 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_updates": 0, 2024-05-20T17:19:42.420 INFO:teuthology.orchestra.run.smithi062.stdout: "omap_total_removes": 0 2024-05-20T17:19:42.420 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.420 INFO:teuthology.orchestra.run.smithi062.stdout: "osd-slow-ops": { 2024-05-20T17:19:42.420 INFO:teuthology.orchestra.run.smithi062.stdout: "slow_ops_count": 0 2024-05-20T17:19:42.420 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.420 INFO:teuthology.orchestra.run.smithi062.stdout: "purge_queue": { 2024-05-20T17:19:42.420 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_ops": 0, 2024-05-20T17:19:42.420 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_ops_high_water": 0, 2024-05-20T17:19:42.420 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing": 0, 2024-05-20T17:19:42.421 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executing_high_water": 0, 2024-05-20T17:19:42.421 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executed_ops": 0, 2024-05-20T17:19:42.421 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_executed": 0, 2024-05-20T17:19:42.421 INFO:teuthology.orchestra.run.smithi062.stdout: "pq_item_in_journal": 0 2024-05-20T17:19:42.421 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.421 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:19:42.421 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-05-20T17:19:42.421 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 104857600, 2024-05-20T17:19:42.421 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-05-20T17:19:42.421 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 968, 2024-05-20T17:19:42.421 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 750934, 2024-05-20T17:19:42.421 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:42.421 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 968, 2024-05-20T17:19:42.422 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-05-20T17:19:42.422 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-05-20T17:19:42.422 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 968, 2024-05-20T17:19:42.422 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 750934, 2024-05-20T17:19:42.422 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-05-20T17:19:42.422 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.422 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.422 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.422 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:42.422 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.422 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-objecter_bytes": { 2024-05-20T17:19:42.422 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-05-20T17:19:42.422 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 104857600, 2024-05-20T17:19:42.423 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-05-20T17:19:42.423 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-05-20T17:19:42.423 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-05-20T17:19:42.423 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:42.423 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:42.423 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 37, 2024-05-20T17:19:42.423 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 11293, 2024-05-20T17:19:42.423 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 37, 2024-05-20T17:19:42.423 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 11293, 2024-05-20T17:19:42.423 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-05-20T17:19:42.423 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.423 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.423 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.423 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:42.424 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.424 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-objecter_ops": { 2024-05-20T17:19:42.424 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-05-20T17:19:42.424 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 1024, 2024-05-20T17:19:42.424 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-05-20T17:19:42.424 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-05-20T17:19:42.424 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-05-20T17:19:42.424 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:42.424 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:42.424 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 37, 2024-05-20T17:19:42.424 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 37, 2024-05-20T17:19:42.424 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 37, 2024-05-20T17:19:42.424 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 37, 2024-05-20T17:19:42.425 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-05-20T17:19:42.425 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.425 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.425 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.425 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:42.425 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.425 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-write_buf_throttle": { 2024-05-20T17:19:42.425 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-05-20T17:19:42.425 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 3758096384, 2024-05-20T17:19:42.425 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-05-20T17:19:42.425 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 0, 2024-05-20T17:19:42.425 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 0, 2024-05-20T17:19:42.425 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:42.425 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:42.426 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-05-20T17:19:42.426 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-05-20T17:19:42.426 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 0, 2024-05-20T17:19:42.426 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 0, 2024-05-20T17:19:42.426 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-05-20T17:19:42.426 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.426 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.426 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.426 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:42.426 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-20T17:19:42.426 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-write_buf_throttle-0x55d57fdecb60": { 2024-05-20T17:19:42.426 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-05-20T17:19:42.426 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 3758096384, 2024-05-20T17:19:42.427 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-05-20T17:19:42.427 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 3, 2024-05-20T17:19:42.427 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 1081, 2024-05-20T17:19:42.427 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:42.427 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 3, 2024-05-20T17:19:42.427 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-05-20T17:19:42.427 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-05-20T17:19:42.427 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 2, 2024-05-20T17:19:42.427 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 1081, 2024-05-20T17:19:42.427 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-05-20T17:19:42.427 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-05-20T17:19:42.427 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-05-20T17:19:42.427 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-05-20T17:19:42.427 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:42.427 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-20T17:19:42.428 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-20T17:19:43.240 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-05-20T17:19:43.241 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-05-20T17:19:43.241 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-05-20T17:19:43.241 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=14 2024-05-20T17:19:43.241 DEBUG:tasks.check_counter:Getting stats from c 2024-05-20T17:19:43.241 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph daemon mds.c perf dump 2024-05-20T17:19:43.535 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:19:43.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:43 smithi171 ceph-mon[35901]: pgmap v744: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:19:43.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:43 smithi006 ceph-mon[32486]: pgmap v744: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:19:44.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:43 smithi062 ceph-mon[35425]: pgmap v744: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:19:45.522 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-05-20T17:19:45.523 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:19:45.523 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 1123, 2024-05-20T17:19:45.523 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 1105, 2024-05-20T17:19:45.523 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 863408, 2024-05-20T17:19:45.523 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 421800, 2024-05-20T17:19:45.523 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 5, 2024-05-20T17:19:45.523 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 1, 2024-05-20T17:19:45.523 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.131384525, 2024-05-20T17:19:45.523 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.042152579, 2024-05-20T17:19:45.523 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.043363867, 2024-05-20T17:19:45.523 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.037728127, 2024-05-20T17:19:45.524 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:45.524 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1105, 2024-05-20T17:19:45.524 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.067665428, 2024-05-20T17:19:45.524 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000061235 2024-05-20T17:19:45.524 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.524 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:45.524 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.524 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.524 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.524 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.524 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 577136, 2024-05-20T17:19:45.524 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 150864 2024-05-20T17:19:45.524 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.524 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:19:45.525 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 4, 2024-05-20T17:19:45.525 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 187, 2024-05-20T17:19:45.525 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 876, 2024-05-20T17:19:45.525 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 483802, 2024-05-20T17:19:45.525 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 5, 2024-05-20T17:19:45.525 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 3, 2024-05-20T17:19:45.525 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.010703526, 2024-05-20T17:19:45.525 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.007378524, 2024-05-20T17:19:45.525 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.001657980, 2024-05-20T17:19:45.525 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.000086354, 2024-05-20T17:19:45.525 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:45.525 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 185, 2024-05-20T17:19:45.526 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.010313460, 2024-05-20T17:19:45.526 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000055748 2024-05-20T17:19:45.526 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.526 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:45.526 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.526 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.526 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.526 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.526 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-20T17:19:45.526 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 483104 2024-05-20T17:19:45.526 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.526 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:19:45.526 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 1647, 2024-05-20T17:19:45.526 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 1649, 2024-05-20T17:19:45.527 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 442680, 2024-05-20T17:19:45.527 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 523753, 2024-05-20T17:19:45.527 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 4, 2024-05-20T17:19:45.527 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 3, 2024-05-20T17:19:45.527 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.116264643, 2024-05-20T17:19:45.527 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.031850766, 2024-05-20T17:19:45.527 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.032848117, 2024-05-20T17:19:45.527 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.045057625, 2024-05-20T17:19:45.527 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:45.527 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1647, 2024-05-20T17:19:45.527 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.061127019, 2024-05-20T17:19:45.527 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000037114 2024-05-20T17:19:45.527 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.527 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:45.528 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.528 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.528 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.528 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.528 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-20T17:19:45.528 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 0 2024-05-20T17:19:45.528 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.528 INFO:teuthology.orchestra.run.smithi171.stdout: "cct": { 2024-05-20T17:19:45.528 INFO:teuthology.orchestra.run.smithi171.stdout: "total_workers": 1, 2024-05-20T17:19:45.528 INFO:teuthology.orchestra.run.smithi171.stdout: "unhealthy_workers": 0 2024-05-20T17:19:45.528 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.528 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-MDSRank": { 2024-05-20T17:19:45.528 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-05-20T17:19:45.529 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-05-20T17:19:45.529 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 4144, 2024-05-20T17:19:45.529 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.112925389, 2024-05-20T17:19:45.529 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000027250 2024-05-20T17:19:45.529 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:45.529 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.529 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-PurgeQueue": { 2024-05-20T17:19:45.529 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-05-20T17:19:45.529 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-05-20T17:19:45.529 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.529 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.529 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.529 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:45.529 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.530 INFO:teuthology.orchestra.run.smithi171.stdout: "mds": { 2024-05-20T17:19:45.530 INFO:teuthology.orchestra.run.smithi171.stdout: "request": 0, 2024-05-20T17:19:45.530 INFO:teuthology.orchestra.run.smithi171.stdout: "reply": 0, 2024-05-20T17:19:45.530 INFO:teuthology.orchestra.run.smithi171.stdout: "reply_latency": { 2024-05-20T17:19:45.530 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.530 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.530 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.530 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.530 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_reply": 0, 2024-05-20T17:19:45.530 INFO:teuthology.orchestra.run.smithi171.stdout: "forward": 0, 2024-05-20T17:19:45.530 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_complete": 0, 2024-05-20T17:19:45.530 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_keys": 0, 2024-05-20T17:19:45.530 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_commit": 0, 2024-05-20T17:19:45.530 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_split": 0, 2024-05-20T17:19:45.531 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_merge": 0, 2024-05-20T17:19:45.531 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes": 3, 2024-05-20T17:19:45.531 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_top": 0, 2024-05-20T17:19:45.531 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_bottom": 3, 2024-05-20T17:19:45.531 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pin_tail": 0, 2024-05-20T17:19:45.531 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pinned": 3, 2024-05-20T17:19:45.531 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_expired": 0, 2024-05-20T17:19:45.531 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_with_caps": 0, 2024-05-20T17:19:45.531 INFO:teuthology.orchestra.run.smithi171.stdout: "caps": 0, 2024-05-20T17:19:45.531 INFO:teuthology.orchestra.run.smithi171.stdout: "subtrees": 1, 2024-05-20T17:19:45.531 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse": 0, 2024-05-20T17:19:45.531 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_hit": 0, 2024-05-20T17:19:45.531 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_forward": 0, 2024-05-20T17:19:45.532 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_discover": 0, 2024-05-20T17:19:45.532 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_dir_fetch": 0, 2024-05-20T17:19:45.532 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_remote_ino": 0, 2024-05-20T17:19:45.532 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_lock": 0, 2024-05-20T17:19:45.532 INFO:teuthology.orchestra.run.smithi171.stdout: "load_cent": 0, 2024-05-20T17:19:45.532 INFO:teuthology.orchestra.run.smithi171.stdout: "q": 0, 2024-05-20T17:19:45.532 INFO:teuthology.orchestra.run.smithi171.stdout: "exported": 0, 2024-05-20T17:19:45.532 INFO:teuthology.orchestra.run.smithi171.stdout: "exported_inodes": 0, 2024-05-20T17:19:45.532 INFO:teuthology.orchestra.run.smithi171.stdout: "imported": 0, 2024-05-20T17:19:45.532 INFO:teuthology.orchestra.run.smithi171.stdout: "imported_inodes": 0, 2024-05-20T17:19:45.532 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_dir_fetch": 0, 2024-05-20T17:19:45.532 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_backtrace_fetch": 0, 2024-05-20T17:19:45.532 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_peer_discover": 0, 2024-05-20T17:19:45.532 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rfiles": 0, 2024-05-20T17:19:45.533 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rbytes": 0, 2024-05-20T17:19:45.533 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rsnaps": 0, 2024-05-20T17:19:45.533 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_fetch": 0, 2024-05-20T17:19:45.533 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_set_tag": 0, 2024-05-20T17:19:45.533 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_repaired": 0, 2024-05-20T17:19:45.533 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_inotable_repaired": 0, 2024-05-20T17:19:45.533 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_inodes": 0, 2024-05-20T17:19:45.533 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_base_inodes": 0, 2024-05-20T17:19:45.533 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dirfrag_rstats": 0, 2024-05-20T17:19:45.533 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_file_inodes": 0, 2024-05-20T17:19:45.533 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_inode_file_caps": 0, 2024-05-20T17:19:45.533 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_revoke": 0, 2024-05-20T17:19:45.533 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_grant": 0, 2024-05-20T17:19:45.534 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_trunc": 0, 2024-05-20T17:19:45.534 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-20T17:19:45.534 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-20T17:19:45.534 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps": 0, 2024-05-20T17:19:45.534 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps_dirty": 0, 2024-05-20T17:19:45.534 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_cap_release": 0, 2024-05-20T17:19:45.534 INFO:teuthology.orchestra.run.smithi171.stdout: "process_request_cap_release": 0 2024-05-20T17:19:45.534 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.534 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_cache": { 2024-05-20T17:19:45.534 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update": 0, 2024-05-20T17:19:45.534 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update_receipt": 0, 2024-05-20T17:19:45.534 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_try_discover": 0, 2024-05-20T17:19:45.534 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_send_discover": 0, 2024-05-20T17:19:45.535 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_handle_discover": 0, 2024-05-20T17:19:45.535 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays": 0, 2024-05-20T17:19:45.535 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_delayed": 0, 2024-05-20T17:19:45.535 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_enqueuing": 0, 2024-05-20T17:19:45.535 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_created": 0, 2024-05-20T17:19:45.535 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_enqueued": 0, 2024-05-20T17:19:45.535 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_reintegrated": 0, 2024-05-20T17:19:45.535 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_migrated": 0, 2024-05-20T17:19:45.535 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_processing": 0, 2024-05-20T17:19:45.535 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_enqueued": 0, 2024-05-20T17:19:45.535 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_prioritized": 0, 2024-05-20T17:19:45.535 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_started": 0, 2024-05-20T17:19:45.535 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_completed": 0, 2024-05-20T17:19:45.536 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_path": 0, 2024-05-20T17:19:45.536 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_inode": 0, 2024-05-20T17:19:45.536 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_enqueue_scrub": 0, 2024-05-20T17:19:45.536 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_exportdir": 0, 2024-05-20T17:19:45.536 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_flush": 0, 2024-05-20T17:19:45.536 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragmentdir": 0, 2024-05-20T17:19:45.536 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragstats": 0, 2024-05-20T17:19:45.536 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_inodestats": 0 2024-05-20T17:19:45.536 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.536 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_log": { 2024-05-20T17:19:45.536 INFO:teuthology.orchestra.run.smithi171.stdout: "evlrg": 0, 2024-05-20T17:19:45.536 INFO:teuthology.orchestra.run.smithi171.stdout: "evadd": 0, 2024-05-20T17:19:45.536 INFO:teuthology.orchestra.run.smithi171.stdout: "evex": 0, 2024-05-20T17:19:45.537 INFO:teuthology.orchestra.run.smithi171.stdout: "evtrm": 0, 2024-05-20T17:19:45.537 INFO:teuthology.orchestra.run.smithi171.stdout: "ev": 16, 2024-05-20T17:19:45.537 INFO:teuthology.orchestra.run.smithi171.stdout: "evexg": 0, 2024-05-20T17:19:45.537 INFO:teuthology.orchestra.run.smithi171.stdout: "evexd": 0, 2024-05-20T17:19:45.537 INFO:teuthology.orchestra.run.smithi171.stdout: "segadd": 0, 2024-05-20T17:19:45.537 INFO:teuthology.orchestra.run.smithi171.stdout: "segex": 0, 2024-05-20T17:19:45.537 INFO:teuthology.orchestra.run.smithi171.stdout: "segtrm": 0, 2024-05-20T17:19:45.537 INFO:teuthology.orchestra.run.smithi171.stdout: "seg": 2, 2024-05-20T17:19:45.537 INFO:teuthology.orchestra.run.smithi171.stdout: "segmjr": 2, 2024-05-20T17:19:45.537 INFO:teuthology.orchestra.run.smithi171.stdout: "segexg": 0, 2024-05-20T17:19:45.537 INFO:teuthology.orchestra.run.smithi171.stdout: "segexd": 0, 2024-05-20T17:19:45.537 INFO:teuthology.orchestra.run.smithi171.stdout: "expos": 4194304, 2024-05-20T17:19:45.537 INFO:teuthology.orchestra.run.smithi171.stdout: "wrpos": 4217545, 2024-05-20T17:19:45.537 INFO:teuthology.orchestra.run.smithi171.stdout: "rdpos": 4215894, 2024-05-20T17:19:45.537 INFO:teuthology.orchestra.run.smithi171.stdout: "jlat": { 2024-05-20T17:19:45.538 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.538 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.538 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.538 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.538 INFO:teuthology.orchestra.run.smithi171.stdout: "replayed": 16 2024-05-20T17:19:45.538 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.538 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_mem": { 2024-05-20T17:19:45.538 INFO:teuthology.orchestra.run.smithi171.stdout: "ino": 4, 2024-05-20T17:19:45.538 INFO:teuthology.orchestra.run.smithi171.stdout: "ino+": 16, 2024-05-20T17:19:45.538 INFO:teuthology.orchestra.run.smithi171.stdout: "ino-": 12, 2024-05-20T17:19:45.538 INFO:teuthology.orchestra.run.smithi171.stdout: "dir": 2, 2024-05-20T17:19:45.538 INFO:teuthology.orchestra.run.smithi171.stdout: "dir+": 13, 2024-05-20T17:19:45.538 INFO:teuthology.orchestra.run.smithi171.stdout: "dir-": 11, 2024-05-20T17:19:45.538 INFO:teuthology.orchestra.run.smithi171.stdout: "dn": 3, 2024-05-20T17:19:45.538 INFO:teuthology.orchestra.run.smithi171.stdout: "dn+": 15, 2024-05-20T17:19:45.539 INFO:teuthology.orchestra.run.smithi171.stdout: "dn-": 12, 2024-05-20T17:19:45.539 INFO:teuthology.orchestra.run.smithi171.stdout: "cap": 0, 2024-05-20T17:19:45.539 INFO:teuthology.orchestra.run.smithi171.stdout: "cap+": 0, 2024-05-20T17:19:45.539 INFO:teuthology.orchestra.run.smithi171.stdout: "cap-": 0, 2024-05-20T17:19:45.539 INFO:teuthology.orchestra.run.smithi171.stdout: "rss": 119188, 2024-05-20T17:19:45.539 INFO:teuthology.orchestra.run.smithi171.stdout: "heap": 215444 2024-05-20T17:19:45.539 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.539 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_server": { 2024-05-20T17:19:45.539 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_client_request": 0, 2024-05-20T17:19:45.539 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_server_request": 0, 2024-05-20T17:19:45.539 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_request": 0, 2024-05-20T17:19:45.539 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_session": 0, 2024-05-20T17:19:45.539 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_peer_request": 0, 2024-05-20T17:19:45.540 INFO:teuthology.orchestra.run.smithi171.stdout: "req_create_latency": { 2024-05-20T17:19:45.540 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.540 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.540 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.540 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.540 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getattr_latency": { 2024-05-20T17:19:45.540 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.540 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.540 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.540 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.540 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getfilelock_latency": { 2024-05-20T17:19:45.540 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.540 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.540 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.540 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.541 INFO:teuthology.orchestra.run.smithi171.stdout: "req_link_latency": { 2024-05-20T17:19:45.541 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.541 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.541 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.541 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.541 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookup_latency": { 2024-05-20T17:19:45.541 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.541 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.541 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.541 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.541 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookuphash_latency": { 2024-05-20T17:19:45.541 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.541 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.542 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.542 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.542 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupino_latency": { 2024-05-20T17:19:45.542 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.542 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.542 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.542 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.542 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupname_latency": { 2024-05-20T17:19:45.542 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.542 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.542 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.542 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.542 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupparent_latency": { 2024-05-20T17:19:45.543 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.543 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.543 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.543 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.543 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupsnap_latency": { 2024-05-20T17:19:45.543 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.543 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.543 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.543 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.543 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lssnap_latency": { 2024-05-20T17:19:45.543 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.543 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.543 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.544 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.544 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mkdir_latency": { 2024-05-20T17:19:45.544 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.544 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.544 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.544 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.545 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mknod_latency": { 2024-05-20T17:19:45.545 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.545 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.545 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.545 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.545 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mksnap_latency": { 2024-05-20T17:19:45.545 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.545 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.545 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.545 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.545 INFO:teuthology.orchestra.run.smithi171.stdout: "req_open_latency": { 2024-05-20T17:19:45.545 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.545 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.546 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.546 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.546 INFO:teuthology.orchestra.run.smithi171.stdout: "req_readdir_latency": { 2024-05-20T17:19:45.546 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.546 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.546 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.546 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.546 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rename_latency": { 2024-05-20T17:19:45.546 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.546 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.546 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.546 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.547 INFO:teuthology.orchestra.run.smithi171.stdout: "req_renamesnap_latency": { 2024-05-20T17:19:45.547 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.547 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.547 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.547 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.547 INFO:teuthology.orchestra.run.smithi171.stdout: "req_snapdiff_latency": { 2024-05-20T17:19:45.547 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.547 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.547 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.547 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.547 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmdir_latency": { 2024-05-20T17:19:45.547 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.547 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.548 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.548 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.548 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmsnap_latency": { 2024-05-20T17:19:45.548 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.548 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.548 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.548 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.548 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmxattr_latency": { 2024-05-20T17:19:45.548 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.548 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.548 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.548 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.548 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setattr_latency": { 2024-05-20T17:19:45.548 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.549 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.549 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.549 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.549 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setdirlayout_latency": { 2024-05-20T17:19:45.549 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.549 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.549 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.549 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.549 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setfilelock_latency": { 2024-05-20T17:19:45.549 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.549 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.549 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.549 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.550 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setlayout_latency": { 2024-05-20T17:19:45.550 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.550 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.550 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.550 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.550 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setxattr_latency": { 2024-05-20T17:19:45.550 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.550 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.550 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.550 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.550 INFO:teuthology.orchestra.run.smithi171.stdout: "req_symlink_latency": { 2024-05-20T17:19:45.550 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.550 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.551 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.551 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.551 INFO:teuthology.orchestra.run.smithi171.stdout: "req_unlink_latency": { 2024-05-20T17:19:45.551 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.551 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.551 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.551 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.551 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_revoke_eviction": 0, 2024-05-20T17:19:45.551 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_acquisition_throttle": 0, 2024-05-20T17:19:45.551 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getvxattr_latency": { 2024-05-20T17:19:45.551 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.551 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.551 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.552 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:45.552 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.552 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_sessions": { 2024-05-20T17:19:45.552 INFO:teuthology.orchestra.run.smithi171.stdout: "session_count": 1, 2024-05-20T17:19:45.552 INFO:teuthology.orchestra.run.smithi171.stdout: "session_add": 2, 2024-05-20T17:19:45.552 INFO:teuthology.orchestra.run.smithi171.stdout: "session_remove": 1, 2024-05-20T17:19:45.552 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_open": 1, 2024-05-20T17:19:45.552 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_stale": 0, 2024-05-20T17:19:45.552 INFO:teuthology.orchestra.run.smithi171.stdout: "total_load": 0, 2024-05-20T17:19:45.552 INFO:teuthology.orchestra.run.smithi171.stdout: "average_load": 0, 2024-05-20T17:19:45.552 INFO:teuthology.orchestra.run.smithi171.stdout: "avg_session_uptime": 1899, 2024-05-20T17:19:45.552 INFO:teuthology.orchestra.run.smithi171.stdout: "mdthresh_evicted": 0 2024-05-20T17:19:45.552 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.553 INFO:teuthology.orchestra.run.smithi171.stdout: "mempool": { 2024-05-20T17:19:45.553 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:19:45.553 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_items": 0, 2024-05-20T17:19:45.553 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:19:45.553 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:19:45.553 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:19:45.553 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:19:45.553 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:19:45.553 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:19:45.553 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:19:45.553 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:19:45.553 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:19:45.553 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:19:45.553 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:19:45.554 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:19:45.554 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:19:45.554 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_items": 0, 2024-05-20T17:19:45.554 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:19:45.554 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_items": 0, 2024-05-20T17:19:45.554 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:19:45.554 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:19:45.554 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:19:45.554 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:19:45.554 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:19:45.554 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:19:45.554 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:19:45.555 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_items": 0, 2024-05-20T17:19:45.555 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:19:45.555 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:19:45.555 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:19:45.555 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_items": 0, 2024-05-20T17:19:45.555 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_bytes": 0, 2024-05-20T17:19:45.555 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_items": 0, 2024-05-20T17:19:45.555 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:19:45.555 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:19:45.555 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:19:45.555 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:19:45.555 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_bytes": 181303, 2024-05-20T17:19:45.555 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_items": 46, 2024-05-20T17:19:45.555 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:19:45.556 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_items": 0, 2024-05-20T17:19:45.556 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_bytes": 0, 2024-05-20T17:19:45.556 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_items": 0, 2024-05-20T17:19:45.556 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:19:45.556 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_items": 0, 2024-05-20T17:19:45.556 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:19:45.556 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_items": 0, 2024-05-20T17:19:45.556 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_bytes": 8984, 2024-05-20T17:19:45.556 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_items": 172, 2024-05-20T17:19:45.556 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:19:45.556 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:19:45.556 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_bytes": 0, 2024-05-20T17:19:45.556 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_items": 0, 2024-05-20T17:19:45.557 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_bytes": 14096, 2024-05-20T17:19:45.557 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_items": 40, 2024-05-20T17:19:45.557 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_bytes": 0, 2024-05-20T17:19:45.557 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_items": 0, 2024-05-20T17:19:45.557 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_bytes": 0, 2024-05-20T17:19:45.557 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_items": 0 2024-05-20T17:19:45.557 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.557 INFO:teuthology.orchestra.run.smithi171.stdout: "objecter": { 2024-05-20T17:19:45.557 INFO:teuthology.orchestra.run.smithi171.stdout: "op_active": 0, 2024-05-20T17:19:45.557 INFO:teuthology.orchestra.run.smithi171.stdout: "op_laggy": 0, 2024-05-20T17:19:45.557 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send": 2501, 2024-05-20T17:19:45.557 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send_bytes": 21, 2024-05-20T17:19:45.557 INFO:teuthology.orchestra.run.smithi171.stdout: "op_resend": 3, 2024-05-20T17:19:45.557 INFO:teuthology.orchestra.run.smithi171.stdout: "op_reply": 2501, 2024-05-20T17:19:45.558 INFO:teuthology.orchestra.run.smithi171.stdout: "op_latency": { 2024-05-20T17:19:45.558 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2501, 2024-05-20T17:19:45.558 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 2.013960904, 2024-05-20T17:19:45.558 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000805262 2024-05-20T17:19:45.558 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.558 INFO:teuthology.orchestra.run.smithi171.stdout: "op_inflight": 0, 2024-05-20T17:19:45.558 INFO:teuthology.orchestra.run.smithi171.stdout: "oplen_avg": { 2024-05-20T17:19:45.558 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2501, 2024-05-20T17:19:45.558 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 2502 2024-05-20T17:19:45.558 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.558 INFO:teuthology.orchestra.run.smithi171.stdout: "op": 2501, 2024-05-20T17:19:45.558 INFO:teuthology.orchestra.run.smithi171.stdout: "op_r": 2501, 2024-05-20T17:19:45.558 INFO:teuthology.orchestra.run.smithi171.stdout: "op_w": 0, 2024-05-20T17:19:45.559 INFO:teuthology.orchestra.run.smithi171.stdout: "op_rmw": 0, 2024-05-20T17:19:45.559 INFO:teuthology.orchestra.run.smithi171.stdout: "op_pg": 0, 2024-05-20T17:19:45.559 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_stat": 1634, 2024-05-20T17:19:45.559 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_create": 0, 2024-05-20T17:19:45.559 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_read": 865, 2024-05-20T17:19:45.559 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_write": 0, 2024-05-20T17:19:45.559 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writefull": 0, 2024-05-20T17:19:45.559 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writesame": 0, 2024-05-20T17:19:45.559 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_append": 0, 2024-05-20T17:19:45.559 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_zero": 0, 2024-05-20T17:19:45.559 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_truncate": 0, 2024-05-20T17:19:45.559 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_delete": 0, 2024-05-20T17:19:45.559 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_mapext": 0, 2024-05-20T17:19:45.559 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_sparse_read": 0, 2024-05-20T17:19:45.559 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_clonerange": 0, 2024-05-20T17:19:45.560 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_getxattr": 1, 2024-05-20T17:19:45.560 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_setxattr": 0, 2024-05-20T17:19:45.560 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_cmpxattr": 0, 2024-05-20T17:19:45.560 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_rmxattr": 0, 2024-05-20T17:19:45.560 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_resetxattrs": 0, 2024-05-20T17:19:45.560 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_call": 0, 2024-05-20T17:19:45.560 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_watch": 0, 2024-05-20T17:19:45.560 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_notify": 0, 2024-05-20T17:19:45.560 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_src_cmpxattr": 0, 2024-05-20T17:19:45.560 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls": 0, 2024-05-20T17:19:45.560 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls_filter": 0, 2024-05-20T17:19:45.560 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_other": 0, 2024-05-20T17:19:45.560 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_active": 0, 2024-05-20T17:19:45.560 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_send": 0, 2024-05-20T17:19:45.561 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_resend": 0, 2024-05-20T17:19:45.561 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_ping": 0, 2024-05-20T17:19:45.561 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_active": 0, 2024-05-20T17:19:45.561 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_send": 0, 2024-05-20T17:19:45.561 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_resend": 0, 2024-05-20T17:19:45.561 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_active": 0, 2024-05-20T17:19:45.561 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_send": 0, 2024-05-20T17:19:45.561 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_resend": 0, 2024-05-20T17:19:45.561 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_active": 0, 2024-05-20T17:19:45.561 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_send": 0, 2024-05-20T17:19:45.561 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_resend": 0, 2024-05-20T17:19:45.561 INFO:teuthology.orchestra.run.smithi171.stdout: "command_active": 0, 2024-05-20T17:19:45.561 INFO:teuthology.orchestra.run.smithi171.stdout: "command_send": 0, 2024-05-20T17:19:45.561 INFO:teuthology.orchestra.run.smithi171.stdout: "command_resend": 0, 2024-05-20T17:19:45.562 INFO:teuthology.orchestra.run.smithi171.stdout: "map_epoch": 94, 2024-05-20T17:19:45.562 INFO:teuthology.orchestra.run.smithi171.stdout: "map_full": 0, 2024-05-20T17:19:45.562 INFO:teuthology.orchestra.run.smithi171.stdout: "map_inc": 4, 2024-05-20T17:19:45.562 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_sessions": 4, 2024-05-20T17:19:45.562 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_open": 4, 2024-05-20T17:19:45.562 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_close": 0, 2024-05-20T17:19:45.562 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_laggy": 0, 2024-05-20T17:19:45.562 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_wr": 0, 2024-05-20T17:19:45.562 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_rd": 2, 2024-05-20T17:19:45.562 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_del": 0 2024-05-20T17:19:45.562 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.562 INFO:teuthology.orchestra.run.smithi171.stdout: "oft": { 2024-05-20T17:19:45.562 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_objs": 0, 2024-05-20T17:19:45.562 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_kv_pairs": 0, 2024-05-20T17:19:45.563 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_updates": 0, 2024-05-20T17:19:45.563 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_removes": 0 2024-05-20T17:19:45.563 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.563 INFO:teuthology.orchestra.run.smithi171.stdout: "osd-slow-ops": { 2024-05-20T17:19:45.563 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_ops_count": 0 2024-05-20T17:19:45.563 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.563 INFO:teuthology.orchestra.run.smithi171.stdout: "purge_queue": { 2024-05-20T17:19:45.563 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops": 0, 2024-05-20T17:19:45.563 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops_high_water": 0, 2024-05-20T17:19:45.563 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing": 0, 2024-05-20T17:19:45.563 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_high_water": 0, 2024-05-20T17:19:45.563 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed_ops": 0, 2024-05-20T17:19:45.563 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed": 0, 2024-05-20T17:19:45.563 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_item_in_journal": 0 2024-05-20T17:19:45.564 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.564 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:19:45.564 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-20T17:19:45.564 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-05-20T17:19:45.564 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-20T17:19:45.564 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 2770, 2024-05-20T17:19:45.564 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 1040975, 2024-05-20T17:19:45.564 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:45.564 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 2770, 2024-05-20T17:19:45.564 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-20T17:19:45.564 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-20T17:19:45.564 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2770, 2024-05-20T17:19:45.564 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 1040975, 2024-05-20T17:19:45.565 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-20T17:19:45.565 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.565 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.565 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.565 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:45.565 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.565 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_bytes": { 2024-05-20T17:19:45.565 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-20T17:19:45.565 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-05-20T17:19:45.565 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-20T17:19:45.565 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-20T17:19:45.566 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-20T17:19:45.566 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:45.566 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:45.566 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 2501, 2024-05-20T17:19:45.566 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 23246, 2024-05-20T17:19:45.566 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2501, 2024-05-20T17:19:45.566 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 23246, 2024-05-20T17:19:45.566 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-20T17:19:45.566 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.566 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.566 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.566 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:45.566 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.566 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_ops": { 2024-05-20T17:19:45.567 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-20T17:19:45.567 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 1024, 2024-05-20T17:19:45.567 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-20T17:19:45.567 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-20T17:19:45.567 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-20T17:19:45.567 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:45.567 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:45.567 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 2501, 2024-05-20T17:19:45.567 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 2501, 2024-05-20T17:19:45.567 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2501, 2024-05-20T17:19:45.567 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 2501, 2024-05-20T17:19:45.567 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-20T17:19:45.567 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.567 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.568 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.568 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:45.568 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.568 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle": { 2024-05-20T17:19:45.568 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-20T17:19:45.568 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-05-20T17:19:45.568 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-20T17:19:45.568 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-20T17:19:45.568 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-20T17:19:45.568 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:45.568 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:45.568 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-20T17:19:45.569 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-20T17:19:45.569 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 0, 2024-05-20T17:19:45.569 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 0, 2024-05-20T17:19:45.569 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-20T17:19:45.569 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.569 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.569 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.569 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:45.569 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:45.569 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle-0x55bcd129ec30": { 2024-05-20T17:19:45.569 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-20T17:19:45.569 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-05-20T17:19:45.570 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-20T17:19:45.570 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-20T17:19:45.570 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-20T17:19:45.570 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:45.570 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:45.570 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-20T17:19:45.570 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-20T17:19:45.570 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 0, 2024-05-20T17:19:45.570 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 0, 2024-05-20T17:19:45.570 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-20T17:19:45.570 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:45.570 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:45.570 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:45.571 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:45.571 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:45.571 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-05-20T17:19:45.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:45 smithi171 ceph-mon[35901]: pgmap v745: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-20T17:19:45.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:45 smithi006 ceph-mon[32486]: pgmap v745: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-20T17:19:46.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:45 smithi062 ceph-mon[35425]: pgmap v745: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-20T17:19:46.317 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-05-20T17:19:46.317 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-05-20T17:19:46.317 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-05-20T17:19:46.317 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-05-20T17:19:46.317 DEBUG:tasks.check_counter:Getting stats from f 2024-05-20T17:19:46.318 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph daemon mds.f perf dump 2024-05-20T17:19:46.573 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:19:47.742 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:47 smithi171 ceph-mon[35901]: pgmap v746: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-20T17:19:47.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:47 smithi006 ceph-mon[32486]: pgmap v746: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-20T17:19:48.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:47 smithi062 ceph-mon[35425]: pgmap v746: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-20T17:19:48.360 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-05-20T17:19:48.360 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:19:48.360 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 536, 2024-05-20T17:19:48.360 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 695, 2024-05-20T17:19:48.361 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 207484, 2024-05-20T17:19:48.361 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 321388, 2024-05-20T17:19:48.361 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 9, 2024-05-20T17:19:48.361 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 3, 2024-05-20T17:19:48.361 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.065364302, 2024-05-20T17:19:48.361 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.024356909, 2024-05-20T17:19:48.361 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.034043586, 2024-05-20T17:19:48.361 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.005444170, 2024-05-20T17:19:48.361 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:48.361 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 695, 2024-05-20T17:19:48.361 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.047092251, 2024-05-20T17:19:48.361 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000067758 2024-05-20T17:19:48.361 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.361 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:48.361 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1154, 2024-05-20T17:19:48.362 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000339889, 2024-05-20T17:19:48.362 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000294 2024-05-20T17:19:48.362 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.362 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-20T17:19:48.362 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 0 2024-05-20T17:19:48.362 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.362 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:19:48.362 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 370, 2024-05-20T17:19:48.362 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 357, 2024-05-20T17:19:48.362 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 622498, 2024-05-20T17:19:48.362 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 210766, 2024-05-20T17:19:48.362 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 8, 2024-05-20T17:19:48.363 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 6, 2024-05-20T17:19:48.363 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.045652134, 2024-05-20T17:19:48.363 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.015978133, 2024-05-20T17:19:48.363 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.024732271, 2024-05-20T17:19:48.363 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.006640759, 2024-05-20T17:19:48.363 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:48.363 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 354, 2024-05-20T17:19:48.363 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.028727758, 2024-05-20T17:19:48.363 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000081151 2024-05-20T17:19:48.363 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.363 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:48.363 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 102, 2024-05-20T17:19:48.363 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000022015, 2024-05-20T17:19:48.363 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000215 2024-05-20T17:19:48.363 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.364 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 576064, 2024-05-20T17:19:48.364 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 155856 2024-05-20T17:19:48.364 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.364 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:19:48.364 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 85, 2024-05-20T17:19:48.364 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 267, 2024-05-20T17:19:48.364 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 49738, 2024-05-20T17:19:48.364 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 578810, 2024-05-20T17:19:48.364 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 14, 2024-05-20T17:19:48.364 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 4, 2024-05-20T17:19:48.364 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.019090861, 2024-05-20T17:19:48.365 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.009231023, 2024-05-20T17:19:48.365 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.008544899, 2024-05-20T17:19:48.365 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.000119706, 2024-05-20T17:19:48.365 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:48.365 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 266, 2024-05-20T17:19:48.365 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.025119448, 2024-05-20T17:19:48.365 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000094434 2024-05-20T17:19:48.365 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.365 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:48.365 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 124, 2024-05-20T17:19:48.365 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000027975, 2024-05-20T17:19:48.365 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000225 2024-05-20T17:19:48.365 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.366 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-05-20T17:19:48.366 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 483728 2024-05-20T17:19:48.366 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.366 INFO:teuthology.orchestra.run.smithi171.stdout: "cct": { 2024-05-20T17:19:48.366 INFO:teuthology.orchestra.run.smithi171.stdout: "total_workers": 1, 2024-05-20T17:19:48.366 INFO:teuthology.orchestra.run.smithi171.stdout: "unhealthy_workers": 0 2024-05-20T17:19:48.366 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.366 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-MDSRank": { 2024-05-20T17:19:48.366 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-05-20T17:19:48.366 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-05-20T17:19:48.366 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 51, 2024-05-20T17:19:48.366 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.001487088, 2024-05-20T17:19:48.367 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000029158 2024-05-20T17:19:48.367 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:48.367 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.367 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-PurgeQueue": { 2024-05-20T17:19:48.367 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-05-20T17:19:48.367 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-05-20T17:19:48.367 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2, 2024-05-20T17:19:48.367 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000007041, 2024-05-20T17:19:48.367 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000003520 2024-05-20T17:19:48.367 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:48.367 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.367 INFO:teuthology.orchestra.run.smithi171.stdout: "mds": { 2024-05-20T17:19:48.367 INFO:teuthology.orchestra.run.smithi171.stdout: "request": 2, 2024-05-20T17:19:48.367 INFO:teuthology.orchestra.run.smithi171.stdout: "reply": 1, 2024-05-20T17:19:48.368 INFO:teuthology.orchestra.run.smithi171.stdout: "reply_latency": { 2024-05-20T17:19:48.368 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1, 2024-05-20T17:19:48.368 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000308373, 2024-05-20T17:19:48.368 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000308373 2024-05-20T17:19:48.368 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.368 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_reply": 0, 2024-05-20T17:19:48.368 INFO:teuthology.orchestra.run.smithi171.stdout: "forward": 1, 2024-05-20T17:19:48.368 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_complete": 0, 2024-05-20T17:19:48.368 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_keys": 0, 2024-05-20T17:19:48.368 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_commit": 11, 2024-05-20T17:19:48.368 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_split": 0, 2024-05-20T17:19:48.368 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_merge": 0, 2024-05-20T17:19:48.368 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes": 16, 2024-05-20T17:19:48.369 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_top": 0, 2024-05-20T17:19:48.369 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_bottom": 16, 2024-05-20T17:19:48.369 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pin_tail": 0, 2024-05-20T17:19:48.369 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pinned": 13, 2024-05-20T17:19:48.369 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_expired": 8, 2024-05-20T17:19:48.369 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_with_caps": 1, 2024-05-20T17:19:48.369 INFO:teuthology.orchestra.run.smithi171.stdout: "caps": 1, 2024-05-20T17:19:48.369 INFO:teuthology.orchestra.run.smithi171.stdout: "subtrees": 3, 2024-05-20T17:19:48.369 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse": 13, 2024-05-20T17:19:48.369 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_hit": 8, 2024-05-20T17:19:48.369 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_forward": 1, 2024-05-20T17:19:48.369 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_discover": 4, 2024-05-20T17:19:48.369 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_dir_fetch": 0, 2024-05-20T17:19:48.369 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_remote_ino": 0, 2024-05-20T17:19:48.370 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_lock": 0, 2024-05-20T17:19:48.370 INFO:teuthology.orchestra.run.smithi171.stdout: "load_cent": 0, 2024-05-20T17:19:48.370 INFO:teuthology.orchestra.run.smithi171.stdout: "q": 0, 2024-05-20T17:19:48.370 INFO:teuthology.orchestra.run.smithi171.stdout: "exported": 0, 2024-05-20T17:19:48.370 INFO:teuthology.orchestra.run.smithi171.stdout: "exported_inodes": 0, 2024-05-20T17:19:48.370 INFO:teuthology.orchestra.run.smithi171.stdout: "imported": 0, 2024-05-20T17:19:48.370 INFO:teuthology.orchestra.run.smithi171.stdout: "imported_inodes": 0, 2024-05-20T17:19:48.370 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_dir_fetch": 0, 2024-05-20T17:19:48.370 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_backtrace_fetch": 0, 2024-05-20T17:19:48.370 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_peer_discover": 0, 2024-05-20T17:19:48.370 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rfiles": 4, 2024-05-20T17:19:48.370 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rbytes": 234, 2024-05-20T17:19:48.370 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rsnaps": 0, 2024-05-20T17:19:48.370 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_fetch": 0, 2024-05-20T17:19:48.371 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_set_tag": 0, 2024-05-20T17:19:48.371 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_repaired": 0, 2024-05-20T17:19:48.371 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_inotable_repaired": 0, 2024-05-20T17:19:48.371 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_inodes": 0, 2024-05-20T17:19:48.371 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_base_inodes": 0, 2024-05-20T17:19:48.371 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dirfrag_rstats": 0, 2024-05-20T17:19:48.371 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_file_inodes": 0, 2024-05-20T17:19:48.371 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_inode_file_caps": 0, 2024-05-20T17:19:48.371 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_revoke": 0, 2024-05-20T17:19:48.371 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_grant": 0, 2024-05-20T17:19:48.371 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_trunc": 0, 2024-05-20T17:19:48.371 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-20T17:19:48.371 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-20T17:19:48.371 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps": 0, 2024-05-20T17:19:48.372 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps_dirty": 0, 2024-05-20T17:19:48.372 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_cap_release": 0, 2024-05-20T17:19:48.372 INFO:teuthology.orchestra.run.smithi171.stdout: "process_request_cap_release": 0 2024-05-20T17:19:48.372 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.372 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_cache": { 2024-05-20T17:19:48.372 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update": 0, 2024-05-20T17:19:48.372 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update_receipt": 16, 2024-05-20T17:19:48.372 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_try_discover": 10, 2024-05-20T17:19:48.372 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_send_discover": 12, 2024-05-20T17:19:48.372 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_handle_discover": 0, 2024-05-20T17:19:48.372 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays": 0, 2024-05-20T17:19:48.372 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_delayed": 0, 2024-05-20T17:19:48.372 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_enqueuing": 0, 2024-05-20T17:19:48.372 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_created": 0, 2024-05-20T17:19:48.372 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_enqueued": 0, 2024-05-20T17:19:48.372 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_reintegrated": 0, 2024-05-20T17:19:48.373 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_migrated": 0, 2024-05-20T17:19:48.373 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_processing": 0, 2024-05-20T17:19:48.373 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_enqueued": 0, 2024-05-20T17:19:48.373 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_prioritized": 0, 2024-05-20T17:19:48.373 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_started": 0, 2024-05-20T17:19:48.373 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_completed": 0, 2024-05-20T17:19:48.373 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_path": 0, 2024-05-20T17:19:48.373 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_inode": 0, 2024-05-20T17:19:48.373 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_enqueue_scrub": 0, 2024-05-20T17:19:48.373 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_exportdir": 0, 2024-05-20T17:19:48.373 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_flush": 0, 2024-05-20T17:19:48.373 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragmentdir": 0, 2024-05-20T17:19:48.373 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragstats": 0, 2024-05-20T17:19:48.374 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_inodestats": 0 2024-05-20T17:19:48.374 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.374 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_log": { 2024-05-20T17:19:48.374 INFO:teuthology.orchestra.run.smithi171.stdout: "evlrg": 0, 2024-05-20T17:19:48.374 INFO:teuthology.orchestra.run.smithi171.stdout: "evadd": 3, 2024-05-20T17:19:48.374 INFO:teuthology.orchestra.run.smithi171.stdout: "evex": 0, 2024-05-20T17:19:48.374 INFO:teuthology.orchestra.run.smithi171.stdout: "evtrm": 0, 2024-05-20T17:19:48.374 INFO:teuthology.orchestra.run.smithi171.stdout: "ev": 3, 2024-05-20T17:19:48.374 INFO:teuthology.orchestra.run.smithi171.stdout: "evexg": 0, 2024-05-20T17:19:48.374 INFO:teuthology.orchestra.run.smithi171.stdout: "evexd": 0, 2024-05-20T17:19:48.374 INFO:teuthology.orchestra.run.smithi171.stdout: "segadd": 2, 2024-05-20T17:19:48.374 INFO:teuthology.orchestra.run.smithi171.stdout: "segex": 0, 2024-05-20T17:19:48.374 INFO:teuthology.orchestra.run.smithi171.stdout: "segtrm": 0, 2024-05-20T17:19:48.375 INFO:teuthology.orchestra.run.smithi171.stdout: "seg": 2, 2024-05-20T17:19:48.375 INFO:teuthology.orchestra.run.smithi171.stdout: "segmjr": 2, 2024-05-20T17:19:48.375 INFO:teuthology.orchestra.run.smithi171.stdout: "segexg": 0, 2024-05-20T17:19:48.375 INFO:teuthology.orchestra.run.smithi171.stdout: "segexd": 0, 2024-05-20T17:19:48.375 INFO:teuthology.orchestra.run.smithi171.stdout: "expos": 4194304, 2024-05-20T17:19:48.375 INFO:teuthology.orchestra.run.smithi171.stdout: "wrpos": 4195385, 2024-05-20T17:19:48.375 INFO:teuthology.orchestra.run.smithi171.stdout: "rdpos": 0, 2024-05-20T17:19:48.375 INFO:teuthology.orchestra.run.smithi171.stdout: "jlat": { 2024-05-20T17:19:48.375 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2, 2024-05-20T17:19:48.375 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.003810437, 2024-05-20T17:19:48.375 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.001905218 2024-05-20T17:19:48.375 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.375 INFO:teuthology.orchestra.run.smithi171.stdout: "replayed": 0 2024-05-20T17:19:48.375 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.375 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_mem": { 2024-05-20T17:19:48.376 INFO:teuthology.orchestra.run.smithi171.stdout: "ino": 20, 2024-05-20T17:19:48.376 INFO:teuthology.orchestra.run.smithi171.stdout: "ino+": 24, 2024-05-20T17:19:48.376 INFO:teuthology.orchestra.run.smithi171.stdout: "ino-": 4, 2024-05-20T17:19:48.376 INFO:teuthology.orchestra.run.smithi171.stdout: "dir": 19, 2024-05-20T17:19:48.376 INFO:teuthology.orchestra.run.smithi171.stdout: "dir+": 25, 2024-05-20T17:19:48.376 INFO:teuthology.orchestra.run.smithi171.stdout: "dir-": 6, 2024-05-20T17:19:48.376 INFO:teuthology.orchestra.run.smithi171.stdout: "dn": 16, 2024-05-20T17:19:48.376 INFO:teuthology.orchestra.run.smithi171.stdout: "dn+": 24, 2024-05-20T17:19:48.376 INFO:teuthology.orchestra.run.smithi171.stdout: "dn-": 8, 2024-05-20T17:19:48.376 INFO:teuthology.orchestra.run.smithi171.stdout: "cap": 1, 2024-05-20T17:19:48.376 INFO:teuthology.orchestra.run.smithi171.stdout: "cap+": 1, 2024-05-20T17:19:48.376 INFO:teuthology.orchestra.run.smithi171.stdout: "cap-": 0, 2024-05-20T17:19:48.376 INFO:teuthology.orchestra.run.smithi171.stdout: "rss": 120632, 2024-05-20T17:19:48.376 INFO:teuthology.orchestra.run.smithi171.stdout: "heap": 223636 2024-05-20T17:19:48.377 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.377 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_server": { 2024-05-20T17:19:48.377 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_client_request": 2, 2024-05-20T17:19:48.377 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_server_request": 1, 2024-05-20T17:19:48.377 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_request": 2, 2024-05-20T17:19:48.377 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_session": 10, 2024-05-20T17:19:48.377 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_peer_request": 2, 2024-05-20T17:19:48.377 INFO:teuthology.orchestra.run.smithi171.stdout: "req_create_latency": { 2024-05-20T17:19:48.377 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.377 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.377 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.377 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.377 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getattr_latency": { 2024-05-20T17:19:48.377 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1, 2024-05-20T17:19:48.378 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000308373, 2024-05-20T17:19:48.378 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000308373 2024-05-20T17:19:48.378 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.378 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getfilelock_latency": { 2024-05-20T17:19:48.378 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.378 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.378 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.378 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.378 INFO:teuthology.orchestra.run.smithi171.stdout: "req_link_latency": { 2024-05-20T17:19:48.378 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.378 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.378 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.378 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.379 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookup_latency": { 2024-05-20T17:19:48.379 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.379 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.379 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.379 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.379 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookuphash_latency": { 2024-05-20T17:19:48.379 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.379 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.379 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.379 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.379 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupino_latency": { 2024-05-20T17:19:48.379 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.379 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.380 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.380 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.380 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupname_latency": { 2024-05-20T17:19:48.380 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.380 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.380 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.380 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.380 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupparent_latency": { 2024-05-20T17:19:48.380 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.380 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.380 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.380 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.380 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupsnap_latency": { 2024-05-20T17:19:48.380 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.381 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.381 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.381 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.381 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lssnap_latency": { 2024-05-20T17:19:48.381 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.381 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.381 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.381 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.381 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mkdir_latency": { 2024-05-20T17:19:48.381 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.382 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.382 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.382 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.382 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mknod_latency": { 2024-05-20T17:19:48.382 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.382 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.382 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.382 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.382 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mksnap_latency": { 2024-05-20T17:19:48.382 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.383 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.383 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.383 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.383 INFO:teuthology.orchestra.run.smithi171.stdout: "req_open_latency": { 2024-05-20T17:19:48.383 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.383 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.383 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.383 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.383 INFO:teuthology.orchestra.run.smithi171.stdout: "req_readdir_latency": { 2024-05-20T17:19:48.383 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.383 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.383 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.384 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.384 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rename_latency": { 2024-05-20T17:19:48.384 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.384 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.384 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.384 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.384 INFO:teuthology.orchestra.run.smithi171.stdout: "req_renamesnap_latency": { 2024-05-20T17:19:48.384 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.384 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.384 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.384 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.384 INFO:teuthology.orchestra.run.smithi171.stdout: "req_snapdiff_latency": { 2024-05-20T17:19:48.384 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.384 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.385 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.385 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.385 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmdir_latency": { 2024-05-20T17:19:48.385 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.385 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.385 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.385 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.385 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmsnap_latency": { 2024-05-20T17:19:48.385 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.385 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.385 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.385 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.385 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmxattr_latency": { 2024-05-20T17:19:48.386 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.386 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.386 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.386 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.386 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setattr_latency": { 2024-05-20T17:19:48.386 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.386 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.386 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.386 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.386 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setdirlayout_latency": { 2024-05-20T17:19:48.386 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.386 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.386 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.387 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.387 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setfilelock_latency": { 2024-05-20T17:19:48.387 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.387 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.387 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.387 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.387 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setlayout_latency": { 2024-05-20T17:19:48.387 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.387 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.387 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.387 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.387 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setxattr_latency": { 2024-05-20T17:19:48.387 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.387 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.388 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.388 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.388 INFO:teuthology.orchestra.run.smithi171.stdout: "req_symlink_latency": { 2024-05-20T17:19:48.388 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.388 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.388 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.388 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.388 INFO:teuthology.orchestra.run.smithi171.stdout: "req_unlink_latency": { 2024-05-20T17:19:48.388 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.388 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.388 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.388 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.389 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_revoke_eviction": 0, 2024-05-20T17:19:48.389 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_acquisition_throttle": 0, 2024-05-20T17:19:48.389 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getvxattr_latency": { 2024-05-20T17:19:48.389 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.389 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.389 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.389 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:48.389 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.389 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_sessions": { 2024-05-20T17:19:48.389 INFO:teuthology.orchestra.run.smithi171.stdout: "session_count": 1, 2024-05-20T17:19:48.389 INFO:teuthology.orchestra.run.smithi171.stdout: "session_add": 1, 2024-05-20T17:19:48.389 INFO:teuthology.orchestra.run.smithi171.stdout: "session_remove": 0, 2024-05-20T17:19:48.389 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_open": 1, 2024-05-20T17:19:48.390 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_stale": 0, 2024-05-20T17:19:48.390 INFO:teuthology.orchestra.run.smithi171.stdout: "total_load": 1, 2024-05-20T17:19:48.390 INFO:teuthology.orchestra.run.smithi171.stdout: "average_load": 1, 2024-05-20T17:19:48.390 INFO:teuthology.orchestra.run.smithi171.stdout: "avg_session_uptime": 731, 2024-05-20T17:19:48.390 INFO:teuthology.orchestra.run.smithi171.stdout: "mdthresh_evicted": 0 2024-05-20T17:19:48.390 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.390 INFO:teuthology.orchestra.run.smithi171.stdout: "mempool": { 2024-05-20T17:19:48.390 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:19:48.390 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_items": 0, 2024-05-20T17:19:48.390 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:19:48.390 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:19:48.390 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:19:48.390 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:19:48.391 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:19:48.391 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:19:48.391 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:19:48.391 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:19:48.391 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:19:48.391 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:19:48.391 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:19:48.391 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:19:48.391 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:19:48.391 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_items": 0, 2024-05-20T17:19:48.391 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:19:48.391 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_items": 0, 2024-05-20T17:19:48.391 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:19:48.391 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:19:48.391 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:19:48.391 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:19:48.392 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:19:48.392 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:19:48.392 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:19:48.392 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_items": 0, 2024-05-20T17:19:48.392 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:19:48.392 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:19:48.392 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:19:48.392 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_items": 0, 2024-05-20T17:19:48.392 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_bytes": 0, 2024-05-20T17:19:48.392 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_items": 0, 2024-05-20T17:19:48.392 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:19:48.392 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:19:48.392 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:19:48.393 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:19:48.393 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_bytes": 242150, 2024-05-20T17:19:48.393 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_items": 78, 2024-05-20T17:19:48.393 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:19:48.393 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_items": 0, 2024-05-20T17:19:48.393 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_bytes": 0, 2024-05-20T17:19:48.393 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_items": 0, 2024-05-20T17:19:48.393 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:19:48.393 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_items": 0, 2024-05-20T17:19:48.393 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:19:48.393 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_items": 0, 2024-05-20T17:19:48.393 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_bytes": 8984, 2024-05-20T17:19:48.393 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_items": 172, 2024-05-20T17:19:48.393 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:19:48.394 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:19:48.394 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_bytes": 0, 2024-05-20T17:19:48.394 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_items": 0, 2024-05-20T17:19:48.394 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_bytes": 80981, 2024-05-20T17:19:48.394 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_items": 325, 2024-05-20T17:19:48.394 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_bytes": 0, 2024-05-20T17:19:48.394 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_items": 0, 2024-05-20T17:19:48.394 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_bytes": 0, 2024-05-20T17:19:48.394 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_items": 0 2024-05-20T17:19:48.394 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.394 INFO:teuthology.orchestra.run.smithi171.stdout: "objecter": { 2024-05-20T17:19:48.394 INFO:teuthology.orchestra.run.smithi171.stdout: "op_active": 0, 2024-05-20T17:19:48.394 INFO:teuthology.orchestra.run.smithi171.stdout: "op_laggy": 0, 2024-05-20T17:19:48.394 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send": 38, 2024-05-20T17:19:48.394 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send_bytes": 11387, 2024-05-20T17:19:48.395 INFO:teuthology.orchestra.run.smithi171.stdout: "op_resend": 33, 2024-05-20T17:19:48.395 INFO:teuthology.orchestra.run.smithi171.stdout: "op_reply": 38, 2024-05-20T17:19:48.395 INFO:teuthology.orchestra.run.smithi171.stdout: "op_latency": { 2024-05-20T17:19:48.395 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 38, 2024-05-20T17:19:48.395 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.235995280, 2024-05-20T17:19:48.395 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.006210402 2024-05-20T17:19:48.395 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.395 INFO:teuthology.orchestra.run.smithi171.stdout: "op_inflight": 0, 2024-05-20T17:19:48.395 INFO:teuthology.orchestra.run.smithi171.stdout: "oplen_avg": { 2024-05-20T17:19:48.395 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 38, 2024-05-20T17:19:48.395 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 61 2024-05-20T17:19:48.395 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.395 INFO:teuthology.orchestra.run.smithi171.stdout: "op": 38, 2024-05-20T17:19:48.395 INFO:teuthology.orchestra.run.smithi171.stdout: "op_r": 0, 2024-05-20T17:19:48.395 INFO:teuthology.orchestra.run.smithi171.stdout: "op_w": 38, 2024-05-20T17:19:48.396 INFO:teuthology.orchestra.run.smithi171.stdout: "op_rmw": 0, 2024-05-20T17:19:48.396 INFO:teuthology.orchestra.run.smithi171.stdout: "op_pg": 0, 2024-05-20T17:19:48.396 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_stat": 0, 2024-05-20T17:19:48.396 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_create": 10, 2024-05-20T17:19:48.396 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_read": 0, 2024-05-20T17:19:48.396 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_write": 2, 2024-05-20T17:19:48.396 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writefull": 6, 2024-05-20T17:19:48.396 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writesame": 0, 2024-05-20T17:19:48.396 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_append": 0, 2024-05-20T17:19:48.396 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_zero": 0, 2024-05-20T17:19:48.396 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_truncate": 0, 2024-05-20T17:19:48.396 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_delete": 6, 2024-05-20T17:19:48.396 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_mapext": 0, 2024-05-20T17:19:48.397 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_sparse_read": 0, 2024-05-20T17:19:48.397 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_clonerange": 0, 2024-05-20T17:19:48.397 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_getxattr": 0, 2024-05-20T17:19:48.397 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_setxattr": 20, 2024-05-20T17:19:48.397 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_cmpxattr": 0, 2024-05-20T17:19:48.397 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_rmxattr": 0, 2024-05-20T17:19:48.397 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_resetxattrs": 0, 2024-05-20T17:19:48.397 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_call": 0, 2024-05-20T17:19:48.397 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_watch": 0, 2024-05-20T17:19:48.397 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_notify": 0, 2024-05-20T17:19:48.397 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_src_cmpxattr": 0, 2024-05-20T17:19:48.397 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls": 0, 2024-05-20T17:19:48.397 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls_filter": 0, 2024-05-20T17:19:48.398 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_other": 0, 2024-05-20T17:19:48.398 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_active": 0, 2024-05-20T17:19:48.398 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_send": 0, 2024-05-20T17:19:48.398 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_resend": 0, 2024-05-20T17:19:48.398 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_ping": 0, 2024-05-20T17:19:48.398 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_active": 0, 2024-05-20T17:19:48.398 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_send": 0, 2024-05-20T17:19:48.398 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_resend": 0, 2024-05-20T17:19:48.398 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_active": 0, 2024-05-20T17:19:48.398 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_send": 0, 2024-05-20T17:19:48.398 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_resend": 0, 2024-05-20T17:19:48.398 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_active": 0, 2024-05-20T17:19:48.398 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_send": 0, 2024-05-20T17:19:48.399 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_resend": 0, 2024-05-20T17:19:48.399 INFO:teuthology.orchestra.run.smithi171.stdout: "command_active": 0, 2024-05-20T17:19:48.399 INFO:teuthology.orchestra.run.smithi171.stdout: "command_send": 0, 2024-05-20T17:19:48.399 INFO:teuthology.orchestra.run.smithi171.stdout: "command_resend": 0, 2024-05-20T17:19:48.399 INFO:teuthology.orchestra.run.smithi171.stdout: "map_epoch": 94, 2024-05-20T17:19:48.399 INFO:teuthology.orchestra.run.smithi171.stdout: "map_full": 0, 2024-05-20T17:19:48.399 INFO:teuthology.orchestra.run.smithi171.stdout: "map_inc": 4, 2024-05-20T17:19:48.399 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_sessions": 8, 2024-05-20T17:19:48.399 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_open": 8, 2024-05-20T17:19:48.399 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_close": 0, 2024-05-20T17:19:48.399 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_laggy": 0, 2024-05-20T17:19:48.399 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_wr": 16, 2024-05-20T17:19:48.399 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_rd": 0, 2024-05-20T17:19:48.399 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_del": 1 2024-05-20T17:19:48.400 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.400 INFO:teuthology.orchestra.run.smithi171.stdout: "oft": { 2024-05-20T17:19:48.400 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_objs": 1, 2024-05-20T17:19:48.400 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_kv_pairs": 0, 2024-05-20T17:19:48.400 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_updates": 0, 2024-05-20T17:19:48.400 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_removes": 0 2024-05-20T17:19:48.400 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.400 INFO:teuthology.orchestra.run.smithi171.stdout: "osd-slow-ops": { 2024-05-20T17:19:48.400 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_ops_count": 0 2024-05-20T17:19:48.400 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.400 INFO:teuthology.orchestra.run.smithi171.stdout: "purge_queue": { 2024-05-20T17:19:48.400 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops": 0, 2024-05-20T17:19:48.400 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops_high_water": 0, 2024-05-20T17:19:48.400 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing": 0, 2024-05-20T17:19:48.401 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_high_water": 0, 2024-05-20T17:19:48.401 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed_ops": 0, 2024-05-20T17:19:48.401 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed": 0, 2024-05-20T17:19:48.401 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_item_in_journal": 0 2024-05-20T17:19:48.401 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.401 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:19:48.401 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-20T17:19:48.401 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-05-20T17:19:48.401 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-20T17:19:48.401 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 987, 2024-05-20T17:19:48.401 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 772808, 2024-05-20T17:19:48.401 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:48.401 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 987, 2024-05-20T17:19:48.401 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-20T17:19:48.402 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-20T17:19:48.402 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 987, 2024-05-20T17:19:48.402 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 772808, 2024-05-20T17:19:48.402 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-20T17:19:48.402 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.402 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.402 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.402 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:48.402 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.402 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_bytes": { 2024-05-20T17:19:48.402 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-20T17:19:48.402 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-05-20T17:19:48.402 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-20T17:19:48.402 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-20T17:19:48.402 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-20T17:19:48.403 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:48.403 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:48.403 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 38, 2024-05-20T17:19:48.403 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 11387, 2024-05-20T17:19:48.403 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 38, 2024-05-20T17:19:48.403 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 11387, 2024-05-20T17:19:48.403 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-20T17:19:48.403 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.403 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.403 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.403 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:48.403 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.403 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_ops": { 2024-05-20T17:19:48.403 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-20T17:19:48.403 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 1024, 2024-05-20T17:19:48.404 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-20T17:19:48.404 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-20T17:19:48.404 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-20T17:19:48.404 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:48.404 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:48.404 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 38, 2024-05-20T17:19:48.404 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 38, 2024-05-20T17:19:48.404 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 38, 2024-05-20T17:19:48.404 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 38, 2024-05-20T17:19:48.404 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-20T17:19:48.404 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.404 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.404 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.404 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:48.405 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.405 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle": { 2024-05-20T17:19:48.405 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-20T17:19:48.405 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-05-20T17:19:48.405 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-20T17:19:48.405 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-20T17:19:48.405 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-20T17:19:48.405 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:48.405 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:48.405 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-20T17:19:48.405 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-20T17:19:48.405 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 0, 2024-05-20T17:19:48.405 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 0, 2024-05-20T17:19:48.405 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-20T17:19:48.405 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.406 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.406 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.406 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:48.406 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:48.406 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle-0x5605416129c0": { 2024-05-20T17:19:48.406 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-20T17:19:48.406 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-05-20T17:19:48.406 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-20T17:19:48.406 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 3, 2024-05-20T17:19:48.406 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 1081, 2024-05-20T17:19:48.406 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:48.406 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 3, 2024-05-20T17:19:48.406 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-20T17:19:48.407 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-20T17:19:48.407 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2, 2024-05-20T17:19:48.407 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 1081, 2024-05-20T17:19:48.407 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-20T17:19:48.407 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:48.407 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:48.407 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:48.407 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:48.407 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:48.407 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-05-20T17:19:49.177 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-05-20T17:19:49.177 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-05-20T17:19:49.177 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-05-20T17:19:49.177 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=16 2024-05-20T17:19:49.177 DEBUG:tasks.check_counter:Getting stats from i 2024-05-20T17:19:49.178 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph daemon mds.i perf dump 2024-05-20T17:19:49.420 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:19:49.819 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:49 smithi171 ceph-mon[35901]: pgmap v747: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:19:49.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:49 smithi006 ceph-mon[32486]: pgmap v747: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:19:50.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:49 smithi062 ceph-mon[35425]: pgmap v747: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:19:51.193 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-05-20T17:19:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:19:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 865, 2024-05-20T17:19:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 1014, 2024-05-20T17:19:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 803087, 2024-05-20T17:19:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 520615, 2024-05-20T17:19:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 9, 2024-05-20T17:19:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 3, 2024-05-20T17:19:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.112070546, 2024-05-20T17:19:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.039765705, 2024-05-20T17:19:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.060393919, 2024-05-20T17:19:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.012705136, 2024-05-20T17:19:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1013, 2024-05-20T17:19:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.090808583, 2024-05-20T17:19:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000089643 2024-05-20T17:19:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1202, 2024-05-20T17:19:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000342824, 2024-05-20T17:19:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000285 2024-05-20T17:19:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 580592, 2024-05-20T17:19:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 155232 2024-05-20T17:19:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:19:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 44, 2024-05-20T17:19:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 234, 2024-05-20T17:19:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 10344, 2024-05-20T17:19:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 461774, 2024-05-20T17:19:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 16, 2024-05-20T17:19:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 5, 2024-05-20T17:19:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.017956704, 2024-05-20T17:19:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.008647209, 2024-05-20T17:19:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.007326752, 2024-05-20T17:19:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.000420322, 2024-05-20T17:19:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 230, 2024-05-20T17:19:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.027513476, 2024-05-20T17:19:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000119623 2024-05-20T17:19:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 55, 2024-05-20T17:19:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000012007, 2024-05-20T17:19:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000218 2024-05-20T17:19:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 2096, 2024-05-20T17:19:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 398848 2024-05-20T17:19:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:19:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 158, 2024-05-20T17:19:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 152, 2024-05-20T17:19:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 110247, 2024-05-20T17:19:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 106048, 2024-05-20T17:19:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 9, 2024-05-20T17:19:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 7, 2024-05-20T17:19:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.014933881, 2024-05-20T17:19:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.005319674, 2024-05-20T17:19:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.010001094, 2024-05-20T17:19:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.000968726, 2024-05-20T17:19:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 153, 2024-05-20T17:19:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.034404224, 2024-05-20T17:19:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000224864 2024-05-20T17:19:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 222, 2024-05-20T17:19:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000043895, 2024-05-20T17:19:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000197 2024-05-20T17:19:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-20T17:19:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 448 2024-05-20T17:19:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: "cct": { 2024-05-20T17:19:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: "total_workers": 1, 2024-05-20T17:19:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: "unhealthy_workers": 0 2024-05-20T17:19:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-MDSRank": { 2024-05-20T17:19:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-05-20T17:19:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-05-20T17:19:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 70, 2024-05-20T17:19:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.005263253, 2024-05-20T17:19:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000075189 2024-05-20T17:19:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-PurgeQueue": { 2024-05-20T17:19:51.201 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-05-20T17:19:51.201 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-05-20T17:19:51.201 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 17, 2024-05-20T17:19:51.201 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000685441, 2024-05-20T17:19:51.201 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000040320 2024-05-20T17:19:51.201 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: "mds": { 2024-05-20T17:19:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: "request": 9, 2024-05-20T17:19:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: "reply": 7, 2024-05-20T17:19:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: "reply_latency": { 2024-05-20T17:19:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 7, 2024-05-20T17:19:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.006056699, 2024-05-20T17:19:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000865242 2024-05-20T17:19:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_reply": 0, 2024-05-20T17:19:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: "forward": 2, 2024-05-20T17:19:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_complete": 0, 2024-05-20T17:19:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_keys": 0, 2024-05-20T17:19:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_commit": 11, 2024-05-20T17:19:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_split": 0, 2024-05-20T17:19:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_merge": 0, 2024-05-20T17:19:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes": 16, 2024-05-20T17:19:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_top": 1, 2024-05-20T17:19:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_bottom": 15, 2024-05-20T17:19:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pin_tail": 0, 2024-05-20T17:19:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pinned": 13, 2024-05-20T17:19:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_expired": 8, 2024-05-20T17:19:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_with_caps": 2, 2024-05-20T17:19:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "caps": 2, 2024-05-20T17:19:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "subtrees": 3, 2024-05-20T17:19:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse": 26, 2024-05-20T17:19:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_hit": 15, 2024-05-20T17:19:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_forward": 0, 2024-05-20T17:19:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_discover": 5, 2024-05-20T17:19:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_dir_fetch": 0, 2024-05-20T17:19:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_remote_ino": 0, 2024-05-20T17:19:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_lock": 0, 2024-05-20T17:19:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "load_cent": 0, 2024-05-20T17:19:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "q": 0, 2024-05-20T17:19:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "exported": 1, 2024-05-20T17:19:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "exported_inodes": 0, 2024-05-20T17:19:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "imported": 1, 2024-05-20T17:19:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "imported_inodes": 2, 2024-05-20T17:19:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_dir_fetch": 0, 2024-05-20T17:19:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_backtrace_fetch": 0, 2024-05-20T17:19:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_peer_discover": 0, 2024-05-20T17:19:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rfiles": 4, 2024-05-20T17:19:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rbytes": 234, 2024-05-20T17:19:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rsnaps": 0, 2024-05-20T17:19:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_fetch": 0, 2024-05-20T17:19:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_set_tag": 0, 2024-05-20T17:19:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_repaired": 0, 2024-05-20T17:19:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_inotable_repaired": 0, 2024-05-20T17:19:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_inodes": 0, 2024-05-20T17:19:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_base_inodes": 0, 2024-05-20T17:19:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dirfrag_rstats": 0, 2024-05-20T17:19:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_file_inodes": 0, 2024-05-20T17:19:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_inode_file_caps": 0, 2024-05-20T17:19:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_revoke": 1, 2024-05-20T17:19:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_grant": 2, 2024-05-20T17:19:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_trunc": 0, 2024-05-20T17:19:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-20T17:19:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-20T17:19:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps": 1, 2024-05-20T17:19:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps_dirty": 0, 2024-05-20T17:19:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_cap_release": 1, 2024-05-20T17:19:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: "process_request_cap_release": 6 2024-05-20T17:19:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.209 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_cache": { 2024-05-20T17:19:51.209 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update": 3, 2024-05-20T17:19:51.209 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update_receipt": 12, 2024-05-20T17:19:51.209 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_try_discover": 8, 2024-05-20T17:19:51.209 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_send_discover": 10, 2024-05-20T17:19:51.209 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_handle_discover": 3, 2024-05-20T17:19:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays": 0, 2024-05-20T17:19:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_delayed": 0, 2024-05-20T17:19:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_enqueuing": 0, 2024-05-20T17:19:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_created": 2, 2024-05-20T17:19:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_enqueued": 2, 2024-05-20T17:19:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_reintegrated": 0, 2024-05-20T17:19:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_migrated": 0, 2024-05-20T17:19:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_processing": 0, 2024-05-20T17:19:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_enqueued": 0, 2024-05-20T17:19:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_prioritized": 0, 2024-05-20T17:19:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_started": 0, 2024-05-20T17:19:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_completed": 0, 2024-05-20T17:19:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_path": 0, 2024-05-20T17:19:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_inode": 0, 2024-05-20T17:19:51.212 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_enqueue_scrub": 0, 2024-05-20T17:19:51.212 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_exportdir": 1, 2024-05-20T17:19:51.212 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_flush": 0, 2024-05-20T17:19:51.212 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragmentdir": 0, 2024-05-20T17:19:51.212 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragstats": 0, 2024-05-20T17:19:51.212 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_inodestats": 0 2024-05-20T17:19:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_log": { 2024-05-20T17:19:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: "evlrg": 0, 2024-05-20T17:19:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: "evadd": 16, 2024-05-20T17:19:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: "evex": 0, 2024-05-20T17:19:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: "evtrm": 0, 2024-05-20T17:19:51.214 INFO:teuthology.orchestra.run.smithi171.stdout: "ev": 16, 2024-05-20T17:19:51.214 INFO:teuthology.orchestra.run.smithi171.stdout: "evexg": 0, 2024-05-20T17:19:51.214 INFO:teuthology.orchestra.run.smithi171.stdout: "evexd": 0, 2024-05-20T17:19:51.214 INFO:teuthology.orchestra.run.smithi171.stdout: "segadd": 2, 2024-05-20T17:19:51.214 INFO:teuthology.orchestra.run.smithi171.stdout: "segex": 0, 2024-05-20T17:19:51.214 INFO:teuthology.orchestra.run.smithi171.stdout: "segtrm": 0, 2024-05-20T17:19:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: "seg": 2, 2024-05-20T17:19:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: "segmjr": 2, 2024-05-20T17:19:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: "segexg": 0, 2024-05-20T17:19:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: "segexd": 0, 2024-05-20T17:19:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: "expos": 4194304, 2024-05-20T17:19:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: "wrpos": 4217545, 2024-05-20T17:19:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: "rdpos": 0, 2024-05-20T17:19:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: "jlat": { 2024-05-20T17:19:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 12, 2024-05-20T17:19:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.037499881, 2024-05-20T17:19:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.003124990 2024-05-20T17:19:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: "replayed": 0 2024-05-20T17:19:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_mem": { 2024-05-20T17:19:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: "ino": 20, 2024-05-20T17:19:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: "ino+": 26, 2024-05-20T17:19:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: "ino-": 6, 2024-05-20T17:19:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: "dir": 19, 2024-05-20T17:19:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: "dir+": 24, 2024-05-20T17:19:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: "dir-": 5, 2024-05-20T17:19:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: "dn": 16, 2024-05-20T17:19:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: "dn+": 28, 2024-05-20T17:19:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: "dn-": 12, 2024-05-20T17:19:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: "cap": 2, 2024-05-20T17:19:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: "cap+": 6, 2024-05-20T17:19:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: "cap-": 4, 2024-05-20T17:19:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: "rss": 121456, 2024-05-20T17:19:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: "heap": 223636 2024-05-20T17:19:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.218 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_server": { 2024-05-20T17:19:51.218 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_client_request": 17, 2024-05-20T17:19:51.218 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_server_request": 1, 2024-05-20T17:19:51.218 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_request": 9, 2024-05-20T17:19:51.218 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_session": 14, 2024-05-20T17:19:51.218 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_peer_request": 6, 2024-05-20T17:19:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: "req_create_latency": { 2024-05-20T17:19:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getattr_latency": { 2024-05-20T17:19:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 3, 2024-05-20T17:19:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.001993815, 2024-05-20T17:19:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000664605 2024-05-20T17:19:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getfilelock_latency": { 2024-05-20T17:19:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: "req_link_latency": { 2024-05-20T17:19:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookup_latency": { 2024-05-20T17:19:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1, 2024-05-20T17:19:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000316448, 2024-05-20T17:19:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000316448 2024-05-20T17:19:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookuphash_latency": { 2024-05-20T17:19:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupino_latency": { 2024-05-20T17:19:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupname_latency": { 2024-05-20T17:19:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupparent_latency": { 2024-05-20T17:19:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupsnap_latency": { 2024-05-20T17:19:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lssnap_latency": { 2024-05-20T17:19:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.224 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.224 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mkdir_latency": { 2024-05-20T17:19:51.224 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.224 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.224 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mknod_latency": { 2024-05-20T17:19:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mksnap_latency": { 2024-05-20T17:19:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: "req_open_latency": { 2024-05-20T17:19:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: "req_readdir_latency": { 2024-05-20T17:19:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1, 2024-05-20T17:19:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000381012, 2024-05-20T17:19:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000381012 2024-05-20T17:19:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rename_latency": { 2024-05-20T17:19:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: "req_renamesnap_latency": { 2024-05-20T17:19:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: "req_snapdiff_latency": { 2024-05-20T17:19:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmdir_latency": { 2024-05-20T17:19:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmsnap_latency": { 2024-05-20T17:19:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmxattr_latency": { 2024-05-20T17:19:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setattr_latency": { 2024-05-20T17:19:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setdirlayout_latency": { 2024-05-20T17:19:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setfilelock_latency": { 2024-05-20T17:19:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setlayout_latency": { 2024-05-20T17:19:51.231 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.231 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.231 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.231 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.231 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setxattr_latency": { 2024-05-20T17:19:51.231 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: "req_symlink_latency": { 2024-05-20T17:19:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: "req_unlink_latency": { 2024-05-20T17:19:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2, 2024-05-20T17:19:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.003365424, 2024-05-20T17:19:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.001682712 2024-05-20T17:19:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_revoke_eviction": 0, 2024-05-20T17:19:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_acquisition_throttle": 0, 2024-05-20T17:19:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getvxattr_latency": { 2024-05-20T17:19:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_sessions": { 2024-05-20T17:19:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: "session_count": 1, 2024-05-20T17:19:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: "session_add": 2, 2024-05-20T17:19:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: "session_remove": 1, 2024-05-20T17:19:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_open": 1, 2024-05-20T17:19:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_stale": 0, 2024-05-20T17:19:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: "total_load": 4, 2024-05-20T17:19:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: "average_load": 4, 2024-05-20T17:19:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: "avg_session_uptime": 735, 2024-05-20T17:19:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: "mdthresh_evicted": 0 2024-05-20T17:19:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: "mempool": { 2024-05-20T17:19:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:19:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_items": 0, 2024-05-20T17:19:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:19:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:19:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:19:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:19:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:19:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:19:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:19:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:19:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:19:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:19:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:19:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:19:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:19:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_items": 0, 2024-05-20T17:19:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:19:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_items": 0, 2024-05-20T17:19:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:19:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:19:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:19:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:19:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:19:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:19:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:19:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_items": 0, 2024-05-20T17:19:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:19:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:19:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:19:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_items": 0, 2024-05-20T17:19:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_bytes": 0, 2024-05-20T17:19:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_items": 0, 2024-05-20T17:19:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:19:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:19:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:19:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:19:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_bytes": 299533, 2024-05-20T17:19:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_items": 105, 2024-05-20T17:19:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:19:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_items": 0, 2024-05-20T17:19:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_bytes": 0, 2024-05-20T17:19:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_items": 0, 2024-05-20T17:19:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:19:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_items": 0, 2024-05-20T17:19:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:19:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_items": 0, 2024-05-20T17:19:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_bytes": 8984, 2024-05-20T17:19:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_items": 172, 2024-05-20T17:19:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:19:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:19:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_bytes": 0, 2024-05-20T17:19:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_items": 0, 2024-05-20T17:19:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_bytes": 81493, 2024-05-20T17:19:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_items": 345, 2024-05-20T17:19:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_bytes": 0, 2024-05-20T17:19:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_items": 0, 2024-05-20T17:19:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_bytes": 0, 2024-05-20T17:19:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_items": 0 2024-05-20T17:19:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "objecter": { 2024-05-20T17:19:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "op_active": 0, 2024-05-20T17:19:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "op_laggy": 0, 2024-05-20T17:19:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send": 68, 2024-05-20T17:19:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send_bytes": 35204, 2024-05-20T17:19:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "op_resend": 33, 2024-05-20T17:19:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "op_reply": 68, 2024-05-20T17:19:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "op_latency": { 2024-05-20T17:19:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 68, 2024-05-20T17:19:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.334993322, 2024-05-20T17:19:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.004926372 2024-05-20T17:19:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "op_inflight": 0, 2024-05-20T17:19:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "oplen_avg": { 2024-05-20T17:19:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 68, 2024-05-20T17:19:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 95 2024-05-20T17:19:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "op": 68, 2024-05-20T17:19:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "op_r": 1, 2024-05-20T17:19:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "op_w": 67, 2024-05-20T17:19:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "op_rmw": 0, 2024-05-20T17:19:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "op_pg": 0, 2024-05-20T17:19:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_stat": 0, 2024-05-20T17:19:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_create": 10, 2024-05-20T17:19:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_read": 1, 2024-05-20T17:19:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_write": 13, 2024-05-20T17:19:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writefull": 11, 2024-05-20T17:19:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writesame": 0, 2024-05-20T17:19:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_append": 0, 2024-05-20T17:19:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_zero": 0, 2024-05-20T17:19:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_truncate": 0, 2024-05-20T17:19:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_delete": 16, 2024-05-20T17:19:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_mapext": 0, 2024-05-20T17:19:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_sparse_read": 0, 2024-05-20T17:19:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_clonerange": 0, 2024-05-20T17:19:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_getxattr": 0, 2024-05-20T17:19:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_setxattr": 20, 2024-05-20T17:19:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_cmpxattr": 0, 2024-05-20T17:19:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_rmxattr": 0, 2024-05-20T17:19:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_resetxattrs": 0, 2024-05-20T17:19:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_call": 0, 2024-05-20T17:19:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_watch": 0, 2024-05-20T17:19:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_notify": 0, 2024-05-20T17:19:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_src_cmpxattr": 0, 2024-05-20T17:19:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls": 0, 2024-05-20T17:19:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls_filter": 0, 2024-05-20T17:19:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_other": 0, 2024-05-20T17:19:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_active": 0, 2024-05-20T17:19:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_send": 0, 2024-05-20T17:19:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_resend": 0, 2024-05-20T17:19:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_ping": 0, 2024-05-20T17:19:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_active": 0, 2024-05-20T17:19:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_send": 0, 2024-05-20T17:19:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_resend": 0, 2024-05-20T17:19:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_active": 0, 2024-05-20T17:19:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_send": 0, 2024-05-20T17:19:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_resend": 0, 2024-05-20T17:19:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_active": 0, 2024-05-20T17:19:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_send": 0, 2024-05-20T17:19:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_resend": 0, 2024-05-20T17:19:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "command_active": 0, 2024-05-20T17:19:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "command_send": 0, 2024-05-20T17:19:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "command_resend": 0, 2024-05-20T17:19:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "map_epoch": 94, 2024-05-20T17:19:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "map_full": 0, 2024-05-20T17:19:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "map_inc": 4, 2024-05-20T17:19:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_sessions": 11, 2024-05-20T17:19:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_open": 11, 2024-05-20T17:19:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_close": 0, 2024-05-20T17:19:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_laggy": 0, 2024-05-20T17:19:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_wr": 21, 2024-05-20T17:19:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_rd": 0, 2024-05-20T17:19:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_del": 3 2024-05-20T17:19:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: "oft": { 2024-05-20T17:19:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_objs": 1, 2024-05-20T17:19:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_kv_pairs": 0, 2024-05-20T17:19:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_updates": 0, 2024-05-20T17:19:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_removes": 0 2024-05-20T17:19:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: "osd-slow-ops": { 2024-05-20T17:19:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_ops_count": 0 2024-05-20T17:19:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "purge_queue": { 2024-05-20T17:19:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops": 0, 2024-05-20T17:19:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops_high_water": 4, 2024-05-20T17:19:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing": 0, 2024-05-20T17:19:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_high_water": 2, 2024-05-20T17:19:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed_ops": 4, 2024-05-20T17:19:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed": 2, 2024-05-20T17:19:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_item_in_journal": 0 2024-05-20T17:19:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:19:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-20T17:19:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-05-20T17:19:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-20T17:19:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 1063, 2024-05-20T17:19:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 809689, 2024-05-20T17:19:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 1063, 2024-05-20T17:19:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-20T17:19:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-20T17:19:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 1063, 2024-05-20T17:19:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 809689, 2024-05-20T17:19:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-20T17:19:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_bytes": { 2024-05-20T17:19:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-20T17:19:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-05-20T17:19:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-20T17:19:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-20T17:19:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-20T17:19:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 68, 2024-05-20T17:19:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 35422, 2024-05-20T17:19:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 68, 2024-05-20T17:19:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 35422, 2024-05-20T17:19:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-20T17:19:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_ops": { 2024-05-20T17:19:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-20T17:19:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 1024, 2024-05-20T17:19:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-20T17:19:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-20T17:19:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-20T17:19:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 68, 2024-05-20T17:19:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 68, 2024-05-20T17:19:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 68, 2024-05-20T17:19:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 68, 2024-05-20T17:19:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-20T17:19:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle": { 2024-05-20T17:19:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-20T17:19:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-05-20T17:19:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-20T17:19:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 2, 2024-05-20T17:19:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 218, 2024-05-20T17:19:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 2, 2024-05-20T17:19:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-20T17:19:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-20T17:19:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 1, 2024-05-20T17:19:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 218, 2024-05-20T17:19:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-20T17:19:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle-0x5640e6bce9c0": { 2024-05-20T17:19:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-20T17:19:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-05-20T17:19:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-20T17:19:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 16, 2024-05-20T17:19:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 23241, 2024-05-20T17:19:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 16, 2024-05-20T17:19:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-20T17:19:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-20T17:19:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 12, 2024-05-20T17:19:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 23241, 2024-05-20T17:19:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-20T17:19:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:51.252 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:51.252 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-05-20T17:19:51.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:51 smithi171 ceph-mon[35901]: pgmap v748: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:19:51.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:51 smithi006 ceph-mon[32486]: pgmap v748: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:19:51.992 INFO:tasks.check_counter:Daemon mds.i mds.exported=1 2024-05-20T17:19:51.992 INFO:tasks.check_counter:Daemon mds.i mds.imported=1 2024-05-20T17:19:51.992 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=3 2024-05-20T17:19:51.992 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=12 2024-05-20T17:19:51.993 DEBUG:tasks.check_counter:Getting stats from l 2024-05-20T17:19:51.993 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d shell --fsid c726c954-16c9-11ef-bc9a-c7b262605968 -- ceph daemon mds.l perf dump 2024-05-20T17:19:52.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:51 smithi062 ceph-mon[35425]: pgmap v748: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-20T17:19:52.245 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/mon.c/config 2024-05-20T17:19:53.740 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:53 smithi171 ceph-mon[35901]: pgmap v749: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:19:53.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:53 smithi006 ceph-mon[32486]: pgmap v749: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:19:54.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:53 smithi062 ceph-mon[35425]: pgmap v749: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-20T17:19:54.034 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-05-20T17:19:54.034 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-0": { 2024-05-20T17:19:54.034 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 860, 2024-05-20T17:19:54.034 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 862, 2024-05-20T17:19:54.034 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 227008, 2024-05-20T17:19:54.034 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 273544, 2024-05-20T17:19:54.034 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 6, 2024-05-20T17:19:54.034 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 2, 2024-05-20T17:19:54.034 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.072127929, 2024-05-20T17:19:54.034 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.020797209, 2024-05-20T17:19:54.035 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.019404114, 2024-05-20T17:19:54.035 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.024278253, 2024-05-20T17:19:54.035 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:54.035 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 860, 2024-05-20T17:19:54.035 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.035052688, 2024-05-20T17:19:54.035 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000040758 2024-05-20T17:19:54.035 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.035 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:54.035 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.035 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.035 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.035 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.035 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-20T17:19:54.036 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 0 2024-05-20T17:19:54.036 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.036 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-1": { 2024-05-20T17:19:54.036 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 1007, 2024-05-20T17:19:54.036 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 996, 2024-05-20T17:19:54.036 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 730652, 2024-05-20T17:19:54.036 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 389075, 2024-05-20T17:19:54.036 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 4, 2024-05-20T17:19:54.036 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 3, 2024-05-20T17:19:54.036 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.104698702, 2024-05-20T17:19:54.036 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.028746537, 2024-05-20T17:19:54.036 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.035683752, 2024-05-20T17:19:54.036 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.036387568, 2024-05-20T17:19:54.036 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:54.037 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 996, 2024-05-20T17:19:54.037 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.049080972, 2024-05-20T17:19:54.037 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000049278 2024-05-20T17:19:54.037 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.037 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:54.037 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.037 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.037 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.037 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.037 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 549328, 2024-05-20T17:19:54.037 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 154704 2024-05-20T17:19:54.037 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.037 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-2": { 2024-05-20T17:19:54.037 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 856, 2024-05-20T17:19:54.038 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 1044, 2024-05-20T17:19:54.038 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 287440, 2024-05-20T17:19:54.038 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 670034, 2024-05-20T17:19:54.038 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 4, 2024-05-20T17:19:54.038 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 3, 2024-05-20T17:19:54.038 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.104309549, 2024-05-20T17:19:54.038 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.034164399, 2024-05-20T17:19:54.038 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.027216972, 2024-05-20T17:19:54.038 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.033636326, 2024-05-20T17:19:54.038 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-20T17:19:54.038 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1042, 2024-05-20T17:19:54.038 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.062438989, 2024-05-20T17:19:54.038 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000059922 2024-05-20T17:19:54.039 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.039 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-20T17:19:54.039 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.039 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.039 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.039 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.039 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-20T17:19:54.039 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 398144 2024-05-20T17:19:54.039 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.039 INFO:teuthology.orchestra.run.smithi171.stdout: "cct": { 2024-05-20T17:19:54.039 INFO:teuthology.orchestra.run.smithi171.stdout: "total_workers": 1, 2024-05-20T17:19:54.039 INFO:teuthology.orchestra.run.smithi171.stdout: "unhealthy_workers": 0 2024-05-20T17:19:54.039 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.040 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-MDSRank": { 2024-05-20T17:19:54.040 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-05-20T17:19:54.040 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-05-20T17:19:54.040 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 4104, 2024-05-20T17:19:54.040 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.129238301, 2024-05-20T17:19:54.040 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000031490 2024-05-20T17:19:54.040 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:54.040 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.040 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-PurgeQueue": { 2024-05-20T17:19:54.040 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-05-20T17:19:54.040 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-05-20T17:19:54.040 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.040 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.040 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.041 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:54.041 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.041 INFO:teuthology.orchestra.run.smithi171.stdout: "mds": { 2024-05-20T17:19:54.041 INFO:teuthology.orchestra.run.smithi171.stdout: "request": 0, 2024-05-20T17:19:54.041 INFO:teuthology.orchestra.run.smithi171.stdout: "reply": 0, 2024-05-20T17:19:54.041 INFO:teuthology.orchestra.run.smithi171.stdout: "reply_latency": { 2024-05-20T17:19:54.041 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.041 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.041 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.041 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.042 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_reply": 0, 2024-05-20T17:19:54.042 INFO:teuthology.orchestra.run.smithi171.stdout: "forward": 0, 2024-05-20T17:19:54.042 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_complete": 0, 2024-05-20T17:19:54.042 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_keys": 0, 2024-05-20T17:19:54.042 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_commit": 0, 2024-05-20T17:19:54.042 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_split": 0, 2024-05-20T17:19:54.042 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_merge": 0, 2024-05-20T17:19:54.042 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes": 0, 2024-05-20T17:19:54.042 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_top": 0, 2024-05-20T17:19:54.042 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_bottom": 0, 2024-05-20T17:19:54.043 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pin_tail": 0, 2024-05-20T17:19:54.043 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pinned": 0, 2024-05-20T17:19:54.043 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_expired": 0, 2024-05-20T17:19:54.043 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_with_caps": 0, 2024-05-20T17:19:54.043 INFO:teuthology.orchestra.run.smithi171.stdout: "caps": 0, 2024-05-20T17:19:54.043 INFO:teuthology.orchestra.run.smithi171.stdout: "subtrees": 1, 2024-05-20T17:19:54.043 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse": 0, 2024-05-20T17:19:54.043 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_hit": 0, 2024-05-20T17:19:54.043 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_forward": 0, 2024-05-20T17:19:54.043 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_discover": 0, 2024-05-20T17:19:54.044 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_dir_fetch": 0, 2024-05-20T17:19:54.044 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_remote_ino": 0, 2024-05-20T17:19:54.044 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_lock": 0, 2024-05-20T17:19:54.044 INFO:teuthology.orchestra.run.smithi171.stdout: "load_cent": 0, 2024-05-20T17:19:54.044 INFO:teuthology.orchestra.run.smithi171.stdout: "q": 0, 2024-05-20T17:19:54.044 INFO:teuthology.orchestra.run.smithi171.stdout: "exported": 0, 2024-05-20T17:19:54.044 INFO:teuthology.orchestra.run.smithi171.stdout: "exported_inodes": 0, 2024-05-20T17:19:54.044 INFO:teuthology.orchestra.run.smithi171.stdout: "imported": 0, 2024-05-20T17:19:54.044 INFO:teuthology.orchestra.run.smithi171.stdout: "imported_inodes": 0, 2024-05-20T17:19:54.044 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_dir_fetch": 0, 2024-05-20T17:19:54.044 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_backtrace_fetch": 0, 2024-05-20T17:19:54.044 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_peer_discover": 0, 2024-05-20T17:19:54.044 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rfiles": 0, 2024-05-20T17:19:54.045 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rbytes": 0, 2024-05-20T17:19:54.045 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rsnaps": 0, 2024-05-20T17:19:54.045 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_fetch": 0, 2024-05-20T17:19:54.045 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_set_tag": 0, 2024-05-20T17:19:54.045 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_repaired": 0, 2024-05-20T17:19:54.045 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_inotable_repaired": 0, 2024-05-20T17:19:54.045 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_inodes": 0, 2024-05-20T17:19:54.045 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_base_inodes": 0, 2024-05-20T17:19:54.045 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dirfrag_rstats": 0, 2024-05-20T17:19:54.045 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_file_inodes": 0, 2024-05-20T17:19:54.045 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_inode_file_caps": 0, 2024-05-20T17:19:54.045 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_revoke": 0, 2024-05-20T17:19:54.045 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_grant": 0, 2024-05-20T17:19:54.046 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_trunc": 0, 2024-05-20T17:19:54.046 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-20T17:19:54.046 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-20T17:19:54.046 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps": 0, 2024-05-20T17:19:54.046 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps_dirty": 0, 2024-05-20T17:19:54.046 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_cap_release": 0, 2024-05-20T17:19:54.046 INFO:teuthology.orchestra.run.smithi171.stdout: "process_request_cap_release": 0 2024-05-20T17:19:54.046 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.046 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_cache": { 2024-05-20T17:19:54.046 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update": 0, 2024-05-20T17:19:54.046 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update_receipt": 0, 2024-05-20T17:19:54.046 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_try_discover": 0, 2024-05-20T17:19:54.046 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_send_discover": 0, 2024-05-20T17:19:54.047 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_handle_discover": 0, 2024-05-20T17:19:54.047 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays": 0, 2024-05-20T17:19:54.047 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_delayed": 0, 2024-05-20T17:19:54.047 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_enqueuing": 0, 2024-05-20T17:19:54.047 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_created": 0, 2024-05-20T17:19:54.047 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_enqueued": 0, 2024-05-20T17:19:54.047 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_reintegrated": 0, 2024-05-20T17:19:54.047 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_migrated": 0, 2024-05-20T17:19:54.047 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_processing": 0, 2024-05-20T17:19:54.047 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_enqueued": 0, 2024-05-20T17:19:54.047 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_prioritized": 0, 2024-05-20T17:19:54.047 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_started": 0, 2024-05-20T17:19:54.047 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_completed": 0, 2024-05-20T17:19:54.047 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_path": 0, 2024-05-20T17:19:54.048 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_inode": 0, 2024-05-20T17:19:54.048 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_enqueue_scrub": 0, 2024-05-20T17:19:54.048 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_exportdir": 0, 2024-05-20T17:19:54.048 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_flush": 0, 2024-05-20T17:19:54.048 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragmentdir": 0, 2024-05-20T17:19:54.048 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragstats": 0, 2024-05-20T17:19:54.048 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_inodestats": 0 2024-05-20T17:19:54.048 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.048 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_log": { 2024-05-20T17:19:54.048 INFO:teuthology.orchestra.run.smithi171.stdout: "evlrg": 0, 2024-05-20T17:19:54.048 INFO:teuthology.orchestra.run.smithi171.stdout: "evadd": 0, 2024-05-20T17:19:54.048 INFO:teuthology.orchestra.run.smithi171.stdout: "evex": 0, 2024-05-20T17:19:54.048 INFO:teuthology.orchestra.run.smithi171.stdout: "evtrm": 0, 2024-05-20T17:19:54.049 INFO:teuthology.orchestra.run.smithi171.stdout: "ev": 3, 2024-05-20T17:19:54.049 INFO:teuthology.orchestra.run.smithi171.stdout: "evexg": 0, 2024-05-20T17:19:54.049 INFO:teuthology.orchestra.run.smithi171.stdout: "evexd": 0, 2024-05-20T17:19:54.049 INFO:teuthology.orchestra.run.smithi171.stdout: "segadd": 0, 2024-05-20T17:19:54.049 INFO:teuthology.orchestra.run.smithi171.stdout: "segex": 0, 2024-05-20T17:19:54.049 INFO:teuthology.orchestra.run.smithi171.stdout: "segtrm": 0, 2024-05-20T17:19:54.049 INFO:teuthology.orchestra.run.smithi171.stdout: "seg": 2, 2024-05-20T17:19:54.049 INFO:teuthology.orchestra.run.smithi171.stdout: "segmjr": 2, 2024-05-20T17:19:54.049 INFO:teuthology.orchestra.run.smithi171.stdout: "segexg": 0, 2024-05-20T17:19:54.049 INFO:teuthology.orchestra.run.smithi171.stdout: "segexd": 0, 2024-05-20T17:19:54.049 INFO:teuthology.orchestra.run.smithi171.stdout: "expos": 4194304, 2024-05-20T17:19:54.049 INFO:teuthology.orchestra.run.smithi171.stdout: "wrpos": 4195385, 2024-05-20T17:19:54.049 INFO:teuthology.orchestra.run.smithi171.stdout: "rdpos": 4194892, 2024-05-20T17:19:54.050 INFO:teuthology.orchestra.run.smithi171.stdout: "jlat": { 2024-05-20T17:19:54.050 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.050 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.050 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.050 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.050 INFO:teuthology.orchestra.run.smithi171.stdout: "replayed": 3 2024-05-20T17:19:54.050 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.050 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_mem": { 2024-05-20T17:19:54.050 INFO:teuthology.orchestra.run.smithi171.stdout: "ino": 3, 2024-05-20T17:19:54.050 INFO:teuthology.orchestra.run.smithi171.stdout: "ino+": 3, 2024-05-20T17:19:54.050 INFO:teuthology.orchestra.run.smithi171.stdout: "ino-": 0, 2024-05-20T17:19:54.050 INFO:teuthology.orchestra.run.smithi171.stdout: "dir": 1, 2024-05-20T17:19:54.050 INFO:teuthology.orchestra.run.smithi171.stdout: "dir+": 1, 2024-05-20T17:19:54.051 INFO:teuthology.orchestra.run.smithi171.stdout: "dir-": 0, 2024-05-20T17:19:54.051 INFO:teuthology.orchestra.run.smithi171.stdout: "dn": 0, 2024-05-20T17:19:54.051 INFO:teuthology.orchestra.run.smithi171.stdout: "dn+": 0, 2024-05-20T17:19:54.051 INFO:teuthology.orchestra.run.smithi171.stdout: "dn-": 0, 2024-05-20T17:19:54.051 INFO:teuthology.orchestra.run.smithi171.stdout: "cap": 0, 2024-05-20T17:19:54.051 INFO:teuthology.orchestra.run.smithi171.stdout: "cap+": 0, 2024-05-20T17:19:54.051 INFO:teuthology.orchestra.run.smithi171.stdout: "cap-": 0, 2024-05-20T17:19:54.051 INFO:teuthology.orchestra.run.smithi171.stdout: "rss": 121424, 2024-05-20T17:19:54.051 INFO:teuthology.orchestra.run.smithi171.stdout: "heap": 215444 2024-05-20T17:19:54.051 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.051 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_server": { 2024-05-20T17:19:54.051 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_client_request": 0, 2024-05-20T17:19:54.051 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_server_request": 0, 2024-05-20T17:19:54.051 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_request": 0, 2024-05-20T17:19:54.051 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_session": 0, 2024-05-20T17:19:54.052 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_peer_request": 0, 2024-05-20T17:19:54.052 INFO:teuthology.orchestra.run.smithi171.stdout: "req_create_latency": { 2024-05-20T17:19:54.052 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.052 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.052 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.052 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.052 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getattr_latency": { 2024-05-20T17:19:54.052 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.052 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.052 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.052 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.052 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getfilelock_latency": { 2024-05-20T17:19:54.052 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.052 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.053 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.053 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.053 INFO:teuthology.orchestra.run.smithi171.stdout: "req_link_latency": { 2024-05-20T17:19:54.053 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.053 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.053 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.053 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.053 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookup_latency": { 2024-05-20T17:19:54.053 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.053 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.053 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.053 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.053 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookuphash_latency": { 2024-05-20T17:19:54.053 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.054 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.054 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.054 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.054 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupino_latency": { 2024-05-20T17:19:54.054 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.054 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.054 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.054 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.054 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupname_latency": { 2024-05-20T17:19:54.054 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.055 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.055 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.055 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.055 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupparent_latency": { 2024-05-20T17:19:54.055 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.055 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.055 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.055 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.055 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupsnap_latency": { 2024-05-20T17:19:54.055 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.055 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.055 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.055 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.055 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lssnap_latency": { 2024-05-20T17:19:54.056 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.056 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.056 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.056 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.056 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mkdir_latency": { 2024-05-20T17:19:54.056 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.056 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.057 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.057 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.057 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mknod_latency": { 2024-05-20T17:19:54.057 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.057 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.057 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.057 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.057 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mksnap_latency": { 2024-05-20T17:19:54.057 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.057 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.057 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.057 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.057 INFO:teuthology.orchestra.run.smithi171.stdout: "req_open_latency": { 2024-05-20T17:19:54.057 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.058 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.058 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.058 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.058 INFO:teuthology.orchestra.run.smithi171.stdout: "req_readdir_latency": { 2024-05-20T17:19:54.058 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.058 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.058 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.058 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.058 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rename_latency": { 2024-05-20T17:19:54.058 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.058 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.058 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.059 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.059 INFO:teuthology.orchestra.run.smithi171.stdout: "req_renamesnap_latency": { 2024-05-20T17:19:54.059 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.059 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.059 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.059 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.059 INFO:teuthology.orchestra.run.smithi171.stdout: "req_snapdiff_latency": { 2024-05-20T17:19:54.059 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.059 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.059 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.059 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.059 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmdir_latency": { 2024-05-20T17:19:54.059 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.060 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.060 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.060 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.060 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmsnap_latency": { 2024-05-20T17:19:54.060 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.060 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.060 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.060 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.060 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmxattr_latency": { 2024-05-20T17:19:54.060 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.060 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.060 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.060 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.060 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setattr_latency": { 2024-05-20T17:19:54.061 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.061 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.061 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.061 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.061 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setdirlayout_latency": { 2024-05-20T17:19:54.061 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.061 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.061 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.061 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.061 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setfilelock_latency": { 2024-05-20T17:19:54.061 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.061 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.061 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.061 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.062 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setlayout_latency": { 2024-05-20T17:19:54.062 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.062 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.062 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.062 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.062 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setxattr_latency": { 2024-05-20T17:19:54.062 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.062 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.062 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.062 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.063 INFO:teuthology.orchestra.run.smithi171.stdout: "req_symlink_latency": { 2024-05-20T17:19:54.063 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.063 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.063 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.063 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.063 INFO:teuthology.orchestra.run.smithi171.stdout: "req_unlink_latency": { 2024-05-20T17:19:54.063 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.063 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.063 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.063 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.063 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_revoke_eviction": 0, 2024-05-20T17:19:54.063 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_acquisition_throttle": 0, 2024-05-20T17:19:54.063 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getvxattr_latency": { 2024-05-20T17:19:54.063 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.064 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.064 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.064 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:54.064 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.064 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_sessions": { 2024-05-20T17:19:54.064 INFO:teuthology.orchestra.run.smithi171.stdout: "session_count": 1, 2024-05-20T17:19:54.064 INFO:teuthology.orchestra.run.smithi171.stdout: "session_add": 1, 2024-05-20T17:19:54.064 INFO:teuthology.orchestra.run.smithi171.stdout: "session_remove": 0, 2024-05-20T17:19:54.064 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_open": 1, 2024-05-20T17:19:54.064 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_stale": 0, 2024-05-20T17:19:54.065 INFO:teuthology.orchestra.run.smithi171.stdout: "total_load": 0, 2024-05-20T17:19:54.065 INFO:teuthology.orchestra.run.smithi171.stdout: "average_load": 0, 2024-05-20T17:19:54.065 INFO:teuthology.orchestra.run.smithi171.stdout: "avg_session_uptime": 1907, 2024-05-20T17:19:54.065 INFO:teuthology.orchestra.run.smithi171.stdout: "mdthresh_evicted": 0 2024-05-20T17:19:54.065 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.065 INFO:teuthology.orchestra.run.smithi171.stdout: "mempool": { 2024-05-20T17:19:54.065 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_bytes": 0, 2024-05-20T17:19:54.065 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_items": 0, 2024-05-20T17:19:54.065 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_bytes": 0, 2024-05-20T17:19:54.065 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_items": 0, 2024-05-20T17:19:54.065 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_bytes": 0, 2024-05-20T17:19:54.065 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_items": 0, 2024-05-20T17:19:54.065 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-20T17:19:54.065 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_items": 0, 2024-05-20T17:19:54.065 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-20T17:19:54.066 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_items": 0, 2024-05-20T17:19:54.066 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_bytes": 0, 2024-05-20T17:19:54.066 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_items": 0, 2024-05-20T17:19:54.066 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-20T17:19:54.066 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_items": 0, 2024-05-20T17:19:54.066 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_bytes": 0, 2024-05-20T17:19:54.066 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_items": 0, 2024-05-20T17:19:54.066 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_bytes": 0, 2024-05-20T17:19:54.066 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_items": 0, 2024-05-20T17:19:54.066 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-20T17:19:54.066 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_items": 0, 2024-05-20T17:19:54.066 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-20T17:19:54.067 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_items": 0, 2024-05-20T17:19:54.067 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_bytes": 0, 2024-05-20T17:19:54.067 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_items": 0, 2024-05-20T17:19:54.067 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_bytes": 0, 2024-05-20T17:19:54.067 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_items": 0, 2024-05-20T17:19:54.067 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-20T17:19:54.067 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_items": 0, 2024-05-20T17:19:54.067 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_bytes": 0, 2024-05-20T17:19:54.067 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_items": 0, 2024-05-20T17:19:54.067 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_bytes": 0, 2024-05-20T17:19:54.067 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_items": 0, 2024-05-20T17:19:54.067 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_bytes": 0, 2024-05-20T17:19:54.067 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_items": 0, 2024-05-20T17:19:54.068 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_bytes": 0, 2024-05-20T17:19:54.068 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_items": 0, 2024-05-20T17:19:54.068 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_bytes": 190145, 2024-05-20T17:19:54.068 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_items": 52, 2024-05-20T17:19:54.068 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_bytes": 0, 2024-05-20T17:19:54.068 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_items": 0, 2024-05-20T17:19:54.068 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_bytes": 0, 2024-05-20T17:19:54.068 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_items": 0, 2024-05-20T17:19:54.068 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_bytes": 0, 2024-05-20T17:19:54.068 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_items": 0, 2024-05-20T17:19:54.068 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_bytes": 0, 2024-05-20T17:19:54.068 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_items": 0, 2024-05-20T17:19:54.068 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_bytes": 8984, 2024-05-20T17:19:54.068 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_items": 172, 2024-05-20T17:19:54.069 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_bytes": 0, 2024-05-20T17:19:54.069 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_items": 0, 2024-05-20T17:19:54.069 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_bytes": 0, 2024-05-20T17:19:54.069 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_items": 0, 2024-05-20T17:19:54.069 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_bytes": 8464, 2024-05-20T17:19:54.069 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_items": 13, 2024-05-20T17:19:54.069 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_bytes": 0, 2024-05-20T17:19:54.069 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_items": 0, 2024-05-20T17:19:54.069 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_bytes": 0, 2024-05-20T17:19:54.069 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_items": 0 2024-05-20T17:19:54.069 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.069 INFO:teuthology.orchestra.run.smithi171.stdout: "objecter": { 2024-05-20T17:19:54.069 INFO:teuthology.orchestra.run.smithi171.stdout: "op_active": 0, 2024-05-20T17:19:54.069 INFO:teuthology.orchestra.run.smithi171.stdout: "op_laggy": 0, 2024-05-20T17:19:54.070 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send": 2452, 2024-05-20T17:19:54.070 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send_bytes": 21, 2024-05-20T17:19:54.070 INFO:teuthology.orchestra.run.smithi171.stdout: "op_resend": 3, 2024-05-20T17:19:54.070 INFO:teuthology.orchestra.run.smithi171.stdout: "op_reply": 2452, 2024-05-20T17:19:54.070 INFO:teuthology.orchestra.run.smithi171.stdout: "op_latency": { 2024-05-20T17:19:54.070 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2452, 2024-05-20T17:19:54.070 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 4.371916013, 2024-05-20T17:19:54.070 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.001783000 2024-05-20T17:19:54.070 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.070 INFO:teuthology.orchestra.run.smithi171.stdout: "op_inflight": 0, 2024-05-20T17:19:54.071 INFO:teuthology.orchestra.run.smithi171.stdout: "oplen_avg": { 2024-05-20T17:19:54.071 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2452, 2024-05-20T17:19:54.071 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 2453 2024-05-20T17:19:54.071 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.071 INFO:teuthology.orchestra.run.smithi171.stdout: "op": 2452, 2024-05-20T17:19:54.071 INFO:teuthology.orchestra.run.smithi171.stdout: "op_r": 2452, 2024-05-20T17:19:54.071 INFO:teuthology.orchestra.run.smithi171.stdout: "op_w": 0, 2024-05-20T17:19:54.071 INFO:teuthology.orchestra.run.smithi171.stdout: "op_rmw": 0, 2024-05-20T17:19:54.071 INFO:teuthology.orchestra.run.smithi171.stdout: "op_pg": 0, 2024-05-20T17:19:54.071 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_stat": 1590, 2024-05-20T17:19:54.071 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_create": 0, 2024-05-20T17:19:54.071 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_read": 860, 2024-05-20T17:19:54.071 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_write": 0, 2024-05-20T17:19:54.071 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writefull": 0, 2024-05-20T17:19:54.072 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writesame": 0, 2024-05-20T17:19:54.072 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_append": 0, 2024-05-20T17:19:54.072 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_zero": 0, 2024-05-20T17:19:54.072 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_truncate": 0, 2024-05-20T17:19:54.072 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_delete": 0, 2024-05-20T17:19:54.072 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_mapext": 0, 2024-05-20T17:19:54.072 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_sparse_read": 0, 2024-05-20T17:19:54.072 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_clonerange": 0, 2024-05-20T17:19:54.072 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_getxattr": 1, 2024-05-20T17:19:54.072 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_setxattr": 0, 2024-05-20T17:19:54.072 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_cmpxattr": 0, 2024-05-20T17:19:54.072 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_rmxattr": 0, 2024-05-20T17:19:54.072 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_resetxattrs": 0, 2024-05-20T17:19:54.072 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_call": 0, 2024-05-20T17:19:54.073 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_watch": 0, 2024-05-20T17:19:54.073 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_notify": 0, 2024-05-20T17:19:54.073 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_src_cmpxattr": 0, 2024-05-20T17:19:54.073 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls": 0, 2024-05-20T17:19:54.073 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls_filter": 0, 2024-05-20T17:19:54.073 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_other": 0, 2024-05-20T17:19:54.073 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_active": 0, 2024-05-20T17:19:54.073 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_send": 0, 2024-05-20T17:19:54.073 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_resend": 0, 2024-05-20T17:19:54.073 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_ping": 0, 2024-05-20T17:19:54.073 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_active": 0, 2024-05-20T17:19:54.073 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_send": 0, 2024-05-20T17:19:54.074 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_resend": 0, 2024-05-20T17:19:54.074 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_active": 0, 2024-05-20T17:19:54.074 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_send": 0, 2024-05-20T17:19:54.074 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_resend": 0, 2024-05-20T17:19:54.074 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_active": 0, 2024-05-20T17:19:54.074 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_send": 0, 2024-05-20T17:19:54.074 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_resend": 0, 2024-05-20T17:19:54.074 INFO:teuthology.orchestra.run.smithi171.stdout: "command_active": 0, 2024-05-20T17:19:54.074 INFO:teuthology.orchestra.run.smithi171.stdout: "command_send": 0, 2024-05-20T17:19:54.074 INFO:teuthology.orchestra.run.smithi171.stdout: "command_resend": 0, 2024-05-20T17:19:54.074 INFO:teuthology.orchestra.run.smithi171.stdout: "map_epoch": 94, 2024-05-20T17:19:54.074 INFO:teuthology.orchestra.run.smithi171.stdout: "map_full": 0, 2024-05-20T17:19:54.075 INFO:teuthology.orchestra.run.smithi171.stdout: "map_inc": 4, 2024-05-20T17:19:54.075 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_sessions": 5, 2024-05-20T17:19:54.075 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_open": 5, 2024-05-20T17:19:54.075 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_close": 0, 2024-05-20T17:19:54.075 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_laggy": 0, 2024-05-20T17:19:54.075 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_wr": 0, 2024-05-20T17:19:54.075 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_rd": 2, 2024-05-20T17:19:54.075 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_del": 0 2024-05-20T17:19:54.075 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.075 INFO:teuthology.orchestra.run.smithi171.stdout: "oft": { 2024-05-20T17:19:54.075 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_objs": 0, 2024-05-20T17:19:54.075 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_kv_pairs": 0, 2024-05-20T17:19:54.075 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_updates": 0, 2024-05-20T17:19:54.076 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_removes": 0 2024-05-20T17:19:54.076 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.076 INFO:teuthology.orchestra.run.smithi171.stdout: "osd-slow-ops": { 2024-05-20T17:19:54.076 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_ops_count": 0 2024-05-20T17:19:54.076 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.076 INFO:teuthology.orchestra.run.smithi171.stdout: "purge_queue": { 2024-05-20T17:19:54.076 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops": 0, 2024-05-20T17:19:54.076 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops_high_water": 0, 2024-05-20T17:19:54.076 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing": 0, 2024-05-20T17:19:54.076 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_high_water": 0, 2024-05-20T17:19:54.076 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed_ops": 0, 2024-05-20T17:19:54.076 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed": 0, 2024-05-20T17:19:54.076 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_item_in_journal": 0 2024-05-20T17:19:54.076 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.076 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-20T17:19:54.077 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-20T17:19:54.077 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-05-20T17:19:54.077 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-20T17:19:54.077 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 2719, 2024-05-20T17:19:54.077 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 983749, 2024-05-20T17:19:54.077 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:54.077 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 2719, 2024-05-20T17:19:54.077 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-20T17:19:54.077 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-20T17:19:54.077 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2719, 2024-05-20T17:19:54.077 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 983749, 2024-05-20T17:19:54.077 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-20T17:19:54.077 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.077 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.078 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.078 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:54.078 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.078 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_bytes": { 2024-05-20T17:19:54.078 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-20T17:19:54.078 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-05-20T17:19:54.078 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-20T17:19:54.078 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-20T17:19:54.078 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-20T17:19:54.078 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:54.078 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:54.078 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 2452, 2024-05-20T17:19:54.078 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 1086, 2024-05-20T17:19:54.079 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2452, 2024-05-20T17:19:54.079 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 1086, 2024-05-20T17:19:54.079 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-20T17:19:54.079 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.079 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.079 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.079 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:54.079 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.079 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_ops": { 2024-05-20T17:19:54.079 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-20T17:19:54.079 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 1024, 2024-05-20T17:19:54.079 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-20T17:19:54.079 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-20T17:19:54.079 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-20T17:19:54.079 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:54.080 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:54.080 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 2452, 2024-05-20T17:19:54.080 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 2452, 2024-05-20T17:19:54.080 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2452, 2024-05-20T17:19:54.080 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 2452, 2024-05-20T17:19:54.080 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-20T17:19:54.080 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.080 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.080 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.080 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:54.080 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.080 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle": { 2024-05-20T17:19:54.080 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-20T17:19:54.080 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-05-20T17:19:54.080 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-20T17:19:54.081 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-20T17:19:54.081 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-20T17:19:54.081 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:54.081 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:54.081 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-20T17:19:54.081 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-20T17:19:54.081 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 0, 2024-05-20T17:19:54.081 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 0, 2024-05-20T17:19:54.081 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-20T17:19:54.081 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.081 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.081 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.081 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:54.082 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-20T17:19:54.082 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle-0x55f5173a0c30": { 2024-05-20T17:19:54.082 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-20T17:19:54.082 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-05-20T17:19:54.082 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-20T17:19:54.082 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-20T17:19:54.082 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-20T17:19:54.082 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-20T17:19:54.082 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-20T17:19:54.082 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-20T17:19:54.082 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-20T17:19:54.082 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 0, 2024-05-20T17:19:54.082 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 0, 2024-05-20T17:19:54.082 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-20T17:19:54.083 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-20T17:19:54.083 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-20T17:19:54.083 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-20T17:19:54.083 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:54.083 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-20T17:19:54.083 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-05-20T17:19:54.851 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-05-20T17:19:54.851 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-05-20T17:19:54.851 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-05-20T17:19:54.851 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-05-20T17:19:54.852 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-20T17:19:54.863 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-20T17:19:54.863 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:19:54.864 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:19:54.902 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:19:54.902 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:19:54.963 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:19:55.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.132+0000 7f3cc4b4b640 1 -- 172.21.15.6:0/781690638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cc0105bd0 msgr2=0x7f3cc01080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:55.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.132+0000 7f3cc4b4b640 1 --2- 172.21.15.6:0/781690638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cc0105bd0 0x7f3cc01080b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4009900 tx=0x7f3cb402a410 comp rx=0 tx=0).stop 2024-05-20T17:19:55.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.133+0000 7f3cc4b4b640 1 -- 172.21.15.6:0/781690638 shutdown_connections 2024-05-20T17:19:55.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.133+0000 7f3cc4b4b640 1 --2- 172.21.15.6:0/781690638 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3cc0108740 0x7f3cc010ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.133+0000 7f3cc4b4b640 1 --2- 172.21.15.6:0/781690638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cc0105bd0 0x7f3cc01080b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.133+0000 7f3cc4b4b640 1 --2- 172.21.15.6:0/781690638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cc01031e0 0x7f3cc0105600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.133+0000 7f3cc4b4b640 1 -- 172.21.15.6:0/781690638 >> 172.21.15.6:0/781690638 conn(0x7f3cc00fcba0 msgr2=0x7f3cc00ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:55.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.133+0000 7f3cc4b4b640 1 -- 172.21.15.6:0/781690638 shutdown_connections 2024-05-20T17:19:55.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.133+0000 7f3cc4b4b640 1 -- 172.21.15.6:0/781690638 wait complete. 2024-05-20T17:19:55.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.134+0000 7f3cc4b4b640 1 Processor -- start 2024-05-20T17:19:55.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.134+0000 7f3cc4b4b640 1 -- start start 2024-05-20T17:19:55.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.134+0000 7f3cc4b4b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3cc01031e0 0x7f3cc0199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:55.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.134+0000 7f3cc4b4b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cc0105bd0 0x7f3cc01995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:55.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.134+0000 7f3cc4b4b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cc0108740 0x7f3cc01a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:55.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.134+0000 7f3cc4b4b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc010e5b0 con 0x7f3cc0108740 2024-05-20T17:19:55.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.134+0000 7f3cc4b4b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc010e430 con 0x7f3cc0105bd0 2024-05-20T17:19:55.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.134+0000 7f3cc4b4b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc010e730 con 0x7f3cc01031e0 2024-05-20T17:19:55.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.134+0000 7f3cbed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cc0108740 0x7f3cc01a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:55.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.134+0000 7f3cbed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cc0108740 0x7f3cc01a0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41662/0 (socket says 172.21.15.6:41662) 2024-05-20T17:19:55.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.134+0000 7f3cbed9d640 1 -- 172.21.15.6:0/4130278700 learned_addr learned my addr 172.21.15.6:0/4130278700 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:19:55.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.134+0000 7f3cbe59c640 1 --2- 172.21.15.6:0/4130278700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3cc01031e0 0x7f3cc0199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:55.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.134+0000 7f3cbdd9b640 1 --2- 172.21.15.6:0/4130278700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cc0105bd0 0x7f3cc01995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:55.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.134+0000 7f3cbed9d640 1 -- 172.21.15.6:0/4130278700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3cc01031e0 msgr2=0x7f3cc0199090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:55.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.134+0000 7f3cbed9d640 1 --2- 172.21.15.6:0/4130278700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3cc01031e0 0x7f3cc0199090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.134+0000 7f3cbed9d640 1 -- 172.21.15.6:0/4130278700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cc0105bd0 msgr2=0x7f3cc01995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:55.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.134+0000 7f3cbed9d640 1 --2- 172.21.15.6:0/4130278700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cc0105bd0 0x7f3cc01995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.134+0000 7f3cbed9d640 1 -- 172.21.15.6:0/4130278700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc01a0bd0 con 0x7f3cc0108740 2024-05-20T17:19:55.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.134+0000 7f3cbdd9b640 1 --2- 172.21.15.6:0/4130278700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cc0105bd0 0x7f3cc01995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:19:55.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.135+0000 7f3cbed9d640 1 --2- 172.21.15.6:0/4130278700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cc0108740 0x7f3cc01a0560 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800eb10 tx=0x7f3cb800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:55.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.135+0000 7f3caf7fe640 1 -- 172.21.15.6:0/4130278700 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8004b20 con 0x7f3cc0108740 2024-05-20T17:19:55.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.135+0000 7f3caf7fe640 1 -- 172.21.15.6:0/4130278700 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3cb8004cc0 con 0x7f3cc0108740 2024-05-20T17:19:55.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.135+0000 7f3cc4b4b640 1 -- 172.21.15.6:0/4130278700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cc01a0ec0 con 0x7f3cc0108740 2024-05-20T17:19:55.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.135+0000 7f3caf7fe640 1 -- 172.21.15.6:0/4130278700 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8010690 con 0x7f3cc0108740 2024-05-20T17:19:55.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.135+0000 7f3cc4b4b640 1 -- 172.21.15.6:0/4130278700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cc01a1320 con 0x7f3cc0108740 2024-05-20T17:19:55.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.136+0000 7f3cc4b4b640 1 -- 172.21.15.6:0/4130278700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cc00691c0 con 0x7f3cc0108740 2024-05-20T17:19:55.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.137+0000 7f3caf7fe640 1 -- 172.21.15.6:0/4130278700 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f3cb8005020 con 0x7f3cc0108740 2024-05-20T17:19:55.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.138+0000 7f3caf7fe640 1 --2- 172.21.15.6:0/4130278700 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3ca80a2c30 0x7f3ca80a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:55.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.138+0000 7f3cbe59c640 1 --2- 172.21.15.6:0/4130278700 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3ca80a2c30 0x7f3ca80a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:55.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.138+0000 7f3caf7fe640 1 -- 172.21.15.6:0/4130278700 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f3cb80cfbc0 con 0x7f3cc0108740 2024-05-20T17:19:55.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.138+0000 7f3cbe59c640 1 --2- 172.21.15.6:0/4130278700 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3ca80a2c30 0x7f3ca80a5140 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0074740 tx=0x7f3cb000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:55.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.143+0000 7f3caf7fe640 1 -- 172.21.15.6:0/4130278700 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3cb809c710 con 0x7f3cc0108740 2024-05-20T17:19:55.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.331+0000 7f3cc4b4b640 1 -- 172.21.15.6:0/4130278700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3cc0062750 con 0x7f3cc0108740 2024-05-20T17:19:55.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.333+0000 7f3caf7fe640 1 -- 172.21.15.6:0/4130278700 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+24584 (secure 0 0 0) 0x7f3cb80bc0d0 con 0x7f3cc0108740 2024-05-20T17:19:55.334 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:19:55.334 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":94,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:06:44.581646+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:05:02.947896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:05:03.842231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:05:07.551471+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:19:55.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.335+0000 7f3cc4b4b640 1 -- 172.21.15.6:0/4130278700 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3ca80a2c30 msgr2=0x7f3ca80a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:55.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.335+0000 7f3cc4b4b640 1 --2- 172.21.15.6:0/4130278700 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3ca80a2c30 0x7f3ca80a5140 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0074740 tx=0x7f3cb000b390 comp rx=0 tx=0).stop 2024-05-20T17:19:55.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.335+0000 7f3cc4b4b640 1 -- 172.21.15.6:0/4130278700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cc0108740 msgr2=0x7f3cc01a0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:55.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.335+0000 7f3cc4b4b640 1 --2- 172.21.15.6:0/4130278700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cc0108740 0x7f3cc01a0560 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800eb10 tx=0x7f3cb800c2d0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.335+0000 7f3cc4b4b640 1 -- 172.21.15.6:0/4130278700 shutdown_connections 2024-05-20T17:19:55.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.335+0000 7f3cc4b4b640 1 --2- 172.21.15.6:0/4130278700 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f3ca80a2c30 0x7f3ca80a5140 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.335+0000 7f3cc4b4b640 1 --2- 172.21.15.6:0/4130278700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cc0108740 0x7f3cc01a0560 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.335+0000 7f3cc4b4b640 1 --2- 172.21.15.6:0/4130278700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cc0105bd0 0x7f3cc01995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.335+0000 7f3cc4b4b640 1 --2- 172.21.15.6:0/4130278700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3cc01031e0 0x7f3cc0199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.335+0000 7f3cc4b4b640 1 -- 172.21.15.6:0/4130278700 >> 172.21.15.6:0/4130278700 conn(0x7f3cc00fcba0 msgr2=0x7f3cc0103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:55.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.335+0000 7f3cc4b4b640 1 -- 172.21.15.6:0/4130278700 shutdown_connections 2024-05-20T17:19:55.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.335+0000 7f3cc4b4b640 1 -- 172.21.15.6:0/4130278700 wait complete. 2024-05-20T17:19:55.348 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:00:12.516679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:05:02.947896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:05:03.842231+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:05:07.551471+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:19:55.349 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:19:55.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.466+0000 7f8e6a39d640 1 -- 172.21.15.6:0/1203277728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e64102fd0 msgr2=0x7f8e641053f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:55.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.466+0000 7f8e6a39d640 1 --2- 172.21.15.6:0/1203277728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e64102fd0 0x7f8e641053f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009900 tx=0x7f8e6002a410 comp rx=0 tx=0).stop 2024-05-20T17:19:55.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.466+0000 7f8e6a39d640 1 -- 172.21.15.6:0/1203277728 shutdown_connections 2024-05-20T17:19:55.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.466+0000 7f8e6a39d640 1 --2- 172.21.15.6:0/1203277728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e64108550 0x7f8e6410aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.466+0000 7f8e6a39d640 1 --2- 172.21.15.6:0/1203277728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e641059e0 0x7f8e64107ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.466+0000 7f8e6a39d640 1 --2- 172.21.15.6:0/1203277728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e64102fd0 0x7f8e641053f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.466+0000 7f8e6a39d640 1 -- 172.21.15.6:0/1203277728 >> 172.21.15.6:0/1203277728 conn(0x7f8e640fc990 msgr2=0x7f8e640fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.466+0000 7f8e6a39d640 1 -- 172.21.15.6:0/1203277728 shutdown_connections 2024-05-20T17:19:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.466+0000 7f8e6a39d640 1 -- 172.21.15.6:0/1203277728 wait complete. 2024-05-20T17:19:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.467+0000 7f8e6a39d640 1 Processor -- start 2024-05-20T17:19:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.467+0000 7f8e6a39d640 1 -- start start 2024-05-20T17:19:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.467+0000 7f8e6a39d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e64102fd0 0x7f8e64198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.467+0000 7f8e6a39d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e641059e0 0x7f8e64199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.467+0000 7f8e6a39d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e64108550 0x7f8e641a0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.467+0000 7f8e6a39d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6410e3b0 con 0x7f8e64102fd0 2024-05-20T17:19:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.467+0000 7f8e6a39d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6410e230 con 0x7f8e641059e0 2024-05-20T17:19:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.467+0000 7f8e6a39d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6410e530 con 0x7f8e64108550 2024-05-20T17:19:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.467+0000 7f8e6939b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e64102fd0 0x7f8e64198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.468+0000 7f8e6939b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e64102fd0 0x7f8e64198fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41682/0 (socket says 172.21.15.6:41682) 2024-05-20T17:19:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.468+0000 7f8e6939b640 1 -- 172.21.15.6:0/2241734594 learned_addr learned my addr 172.21.15.6:0/2241734594 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:19:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.468+0000 7f8e69b9c640 1 --2- 172.21.15.6:0/2241734594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e64108550 0x7f8e641a0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.468+0000 7f8e68b9a640 1 --2- 172.21.15.6:0/2241734594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e641059e0 0x7f8e64199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.468+0000 7f8e6939b640 1 -- 172.21.15.6:0/2241734594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e64108550 msgr2=0x7f8e641a0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.468+0000 7f8e6939b640 1 --2- 172.21.15.6:0/2241734594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e64108550 0x7f8e641a0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.468+0000 7f8e6939b640 1 -- 172.21.15.6:0/2241734594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e641059e0 msgr2=0x7f8e64199500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:55.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.468+0000 7f8e6939b640 1 --2- 172.21.15.6:0/2241734594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e641059e0 0x7f8e64199500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.468+0000 7f8e6939b640 1 -- 172.21.15.6:0/2241734594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e641a0b00 con 0x7f8e64102fd0 2024-05-20T17:19:55.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.468+0000 7f8e6939b640 1 --2- 172.21.15.6:0/2241734594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e64102fd0 0x7f8e64198fc0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8e600314e0 tx=0x7f8e600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:55.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.468+0000 7f8e5a7fc640 1 -- 172.21.15.6:0/2241734594 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6003f030 con 0x7f8e64102fd0 2024-05-20T17:19:55.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.468+0000 7f8e5a7fc640 1 -- 172.21.15.6:0/2241734594 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8e600318f0 con 0x7f8e64102fd0 2024-05-20T17:19:55.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.468+0000 7f8e5a7fc640 1 -- 172.21.15.6:0/2241734594 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e60035070 con 0x7f8e64102fd0 2024-05-20T17:19:55.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.468+0000 7f8e6a39d640 1 -- 172.21.15.6:0/2241734594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e641a0d90 con 0x7f8e64102fd0 2024-05-20T17:19:55.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.468+0000 7f8e6a39d640 1 -- 172.21.15.6:0/2241734594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e641a11d0 con 0x7f8e64102fd0 2024-05-20T17:19:55.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.469+0000 7f8e6a39d640 1 -- 172.21.15.6:0/2241734594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e640fe4b0 con 0x7f8e64102fd0 2024-05-20T17:19:55.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.471+0000 7f8e5a7fc640 1 -- 172.21.15.6:0/2241734594 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f8e60042030 con 0x7f8e64102fd0 2024-05-20T17:19:55.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.471+0000 7f8e5a7fc640 1 --2- 172.21.15.6:0/2241734594 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8e500a2b90 0x7f8e500a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:55.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.472+0000 7f8e68b9a640 1 --2- 172.21.15.6:0/2241734594 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8e500a2b90 0x7f8e500a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:55.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.472+0000 7f8e5a7fc640 1 -- 172.21.15.6:0/2241734594 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f8e600efbd0 con 0x7f8e64102fd0 2024-05-20T17:19:55.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.472+0000 7f8e68b9a640 1 --2- 172.21.15.6:0/2241734594 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8e500a2b90 0x7f8e500a50a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8e6419a060 tx=0x7f8e54005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:55.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.475+0000 7f8e5a7fc640 1 -- 172.21.15.6:0/2241734594 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8e600bc130 con 0x7f8e64102fd0 2024-05-20T17:19:55.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:55 smithi006 ceph-mon[32486]: pgmap v750: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-20T17:19:55.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:55 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/4130278700' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:19:55.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.660+0000 7f8e6a39d640 1 -- 172.21.15.6:0/2241734594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8e6402d4f0 con 0x7f8e64102fd0 2024-05-20T17:19:55.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.661+0000 7f8e5a7fc640 1 -- 172.21.15.6:0/2241734594 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) ==== 93+0+10 (secure 0 0 0) 0x7f8e600dc140 con 0x7f8e64102fd0 2024-05-20T17:19:55.662 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:19:55.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.663+0000 7f8e6a39d640 1 -- 172.21.15.6:0/2241734594 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8e500a2b90 msgr2=0x7f8e500a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:55.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.663+0000 7f8e6a39d640 1 --2- 172.21.15.6:0/2241734594 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8e500a2b90 0x7f8e500a50a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8e6419a060 tx=0x7f8e54005f90 comp rx=0 tx=0).stop 2024-05-20T17:19:55.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.663+0000 7f8e6a39d640 1 -- 172.21.15.6:0/2241734594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e64102fd0 msgr2=0x7f8e64198fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:55.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.663+0000 7f8e6a39d640 1 --2- 172.21.15.6:0/2241734594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e64102fd0 0x7f8e64198fc0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8e600314e0 tx=0x7f8e600042f0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.663+0000 7f8e6a39d640 1 -- 172.21.15.6:0/2241734594 shutdown_connections 2024-05-20T17:19:55.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.663+0000 7f8e6a39d640 1 --2- 172.21.15.6:0/2241734594 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f8e500a2b90 0x7f8e500a50a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.663+0000 7f8e6a39d640 1 --2- 172.21.15.6:0/2241734594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e64108550 0x7f8e641a0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.663+0000 7f8e6a39d640 1 --2- 172.21.15.6:0/2241734594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e641059e0 0x7f8e64199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.663+0000 7f8e6a39d640 1 --2- 172.21.15.6:0/2241734594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e64102fd0 0x7f8e64198fc0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.663+0000 7f8e6a39d640 1 -- 172.21.15.6:0/2241734594 >> 172.21.15.6:0/2241734594 conn(0x7f8e640fc990 msgr2=0x7f8e64105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:55.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.663+0000 7f8e6a39d640 1 -- 172.21.15.6:0/2241734594 shutdown_connections 2024-05-20T17:19:55.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.663+0000 7f8e6a39d640 1 -- 172.21.15.6:0/2241734594 wait complete. 2024-05-20T17:19:55.676 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:19:55.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.792+0000 7fd01c85f640 1 -- 172.21.15.6:0/1384907684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0181019b0 msgr2=0x7fd0181026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.792+0000 7fd01c85f640 1 --2- 172.21.15.6:0/1384907684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0181019b0 0x7fd0181026b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd008009900 tx=0x7fd00802a410 comp rx=0 tx=0).stop 2024-05-20T17:19:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.793+0000 7fd01c85f640 1 -- 172.21.15.6:0/1384907684 shutdown_connections 2024-05-20T17:19:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.793+0000 7fd01c85f640 1 --2- 172.21.15.6:0/1384907684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0181078f0 0x7fd018109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.793+0000 7fd01c85f640 1 --2- 172.21.15.6:0/1384907684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd018102bf0 0x7fd018103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.793+0000 7fd01c85f640 1 --2- 172.21.15.6:0/1384907684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0181019b0 0x7fd0181026b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.793+0000 7fd01c85f640 1 -- 172.21.15.6:0/1384907684 >> 172.21.15.6:0/1384907684 conn(0x7fd0180fcbe0 msgr2=0x7fd0180ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.793+0000 7fd01c85f640 1 -- 172.21.15.6:0/1384907684 shutdown_connections 2024-05-20T17:19:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.793+0000 7fd01c85f640 1 -- 172.21.15.6:0/1384907684 wait complete. 2024-05-20T17:19:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.793+0000 7fd01c85f640 1 Processor -- start 2024-05-20T17:19:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.794+0000 7fd01c85f640 1 -- start start 2024-05-20T17:19:55.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.794+0000 7fd01c85f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0181019b0 0x7fd0180747f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:55.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.794+0000 7fd01c85f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd018102bf0 0x7fd01819df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:55.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.794+0000 7fd01c85f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0181078f0 0x7fd0181a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:55.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.794+0000 7fd01c85f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd01810d500 con 0x7fd0181019b0 2024-05-20T17:19:55.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.794+0000 7fd01c85f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd01810d380 con 0x7fd018102bf0 2024-05-20T17:19:55.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.794+0000 7fd01c85f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd01810d680 con 0x7fd0181078f0 2024-05-20T17:19:55.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.794+0000 7fd01659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0181019b0 0x7fd0180747f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:55.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.794+0000 7fd01659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0181019b0 0x7fd0180747f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41686/0 (socket says 172.21.15.6:41686) 2024-05-20T17:19:55.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.794+0000 7fd01659c640 1 -- 172.21.15.6:0/2578532481 learned_addr learned my addr 172.21.15.6:0/2578532481 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:19:55.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.794+0000 7fd00dd9b640 1 --2- 172.21.15.6:0/2578532481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd018102bf0 0x7fd01819df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:55.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.794+0000 7fd016d9d640 1 --2- 172.21.15.6:0/2578532481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0181078f0 0x7fd0181a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:55.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.794+0000 7fd01659c640 1 -- 172.21.15.6:0/2578532481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0181078f0 msgr2=0x7fd0181a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:55.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.794+0000 7fd01659c640 1 --2- 172.21.15.6:0/2578532481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0181078f0 0x7fd0181a04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.794+0000 7fd01659c640 1 -- 172.21.15.6:0/2578532481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd018102bf0 msgr2=0x7fd01819df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.794+0000 7fd01659c640 1 --2- 172.21.15.6:0/2578532481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd018102bf0 0x7fd01819df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.794+0000 7fd01659c640 1 -- 172.21.15.6:0/2578532481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0181a0cc0 con 0x7fd0181019b0 2024-05-20T17:19:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.794+0000 7fd00dd9b640 1 --2- 172.21.15.6:0/2578532481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd018102bf0 0x7fd01819df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:19:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.795+0000 7fd01659c640 1 --2- 172.21.15.6:0/2578532481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0181019b0 0x7fd0180747f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd0080314e0 tx=0x7fd008003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.795+0000 7fd00ffff640 1 -- 172.21.15.6:0/2578532481 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00803f070 con 0x7fd0181019b0 2024-05-20T17:19:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.795+0000 7fd00ffff640 1 -- 172.21.15.6:0/2578532481 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd008031e40 con 0x7fd0181019b0 2024-05-20T17:19:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.795+0000 7fd01c85f640 1 -- 172.21.15.6:0/2578532481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0181a0f50 con 0x7fd0181019b0 2024-05-20T17:19:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.795+0000 7fd00ffff640 1 -- 172.21.15.6:0/2578532481 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd008035030 con 0x7fd0181019b0 2024-05-20T17:19:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.795+0000 7fd01c85f640 1 -- 172.21.15.6:0/2578532481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0181a1350 con 0x7fd0181019b0 2024-05-20T17:19:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.796+0000 7fd01c85f640 1 -- 172.21.15.6:0/2578532481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd018106700 con 0x7fd0181019b0 2024-05-20T17:19:55.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.797+0000 7fd00ffff640 1 -- 172.21.15.6:0/2578532481 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fd008042070 con 0x7fd0181019b0 2024-05-20T17:19:55.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.798+0000 7fd00ffff640 1 --2- 172.21.15.6:0/2578532481 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd0040a2b90 0x7fd0040a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:55.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.798+0000 7fd00dd9b640 1 --2- 172.21.15.6:0/2578532481 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd0040a2b90 0x7fd0040a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:55.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.798+0000 7fd00ffff640 1 -- 172.21.15.6:0/2578532481 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fd0080efde0 con 0x7fd0181019b0 2024-05-20T17:19:55.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.799+0000 7fd00dd9b640 1 --2- 172.21.15.6:0/2578532481 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd0040a2b90 0x7fd0040a50a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd000005fd0 tx=0x7fd000005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:55.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.803+0000 7fd00ffff640 1 -- 172.21.15.6:0/2578532481 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd0080bc930 con 0x7fd0181019b0 2024-05-20T17:19:55.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:55 smithi171 ceph-mon[35901]: pgmap v750: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-20T17:19:55.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:55 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/4130278700' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:19:55.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.987+0000 7fd01c85f640 1 -- 172.21.15.6:0/2578532481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd01802d4e0 con 0x7fd0181019b0 2024-05-20T17:19:55.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.988+0000 7fd00ffff640 1 -- 172.21.15.6:0/2578532481 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) ==== 104+0+11 (secure 0 0 0) 0x7fd0080bc230 con 0x7fd0181019b0 2024-05-20T17:19:55.989 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:19:55.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.990+0000 7fd01c85f640 1 -- 172.21.15.6:0/2578532481 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd0040a2b90 msgr2=0x7fd0040a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:55.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.990+0000 7fd01c85f640 1 --2- 172.21.15.6:0/2578532481 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd0040a2b90 0x7fd0040a50a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd000005fd0 tx=0x7fd000005850 comp rx=0 tx=0).stop 2024-05-20T17:19:55.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.990+0000 7fd01c85f640 1 -- 172.21.15.6:0/2578532481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0181019b0 msgr2=0x7fd0180747f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:55.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.990+0000 7fd01c85f640 1 --2- 172.21.15.6:0/2578532481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0181019b0 0x7fd0180747f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd0080314e0 tx=0x7fd008003d50 comp rx=0 tx=0).stop 2024-05-20T17:19:55.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.990+0000 7fd01c85f640 1 -- 172.21.15.6:0/2578532481 shutdown_connections 2024-05-20T17:19:55.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.990+0000 7fd01c85f640 1 --2- 172.21.15.6:0/2578532481 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fd0040a2b90 0x7fd0040a50a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.990+0000 7fd01c85f640 1 --2- 172.21.15.6:0/2578532481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0181078f0 0x7fd0181a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.990+0000 7fd01c85f640 1 --2- 172.21.15.6:0/2578532481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd018102bf0 0x7fd01819df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.990+0000 7fd01c85f640 1 --2- 172.21.15.6:0/2578532481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0181019b0 0x7fd0180747f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.990+0000 7fd01c85f640 1 -- 172.21.15.6:0/2578532481 >> 172.21.15.6:0/2578532481 conn(0x7fd0180fcbe0 msgr2=0x7fd0181038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.990+0000 7fd01c85f640 1 -- 172.21.15.6:0/2578532481 shutdown_connections 2024-05-20T17:19:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:55.990+0000 7fd01c85f640 1 -- 172.21.15.6:0/2578532481 wait complete. 2024-05-20T17:19:56.003 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:19:56.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:55 smithi062 ceph-mon[35425]: pgmap v750: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-20T17:19:56.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:55 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/4130278700' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:19:56.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.120+0000 7fdf49757640 1 -- 172.21.15.6:0/754033331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf44105f00 msgr2=0x7fdf44108320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:56.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.120+0000 7fdf49757640 1 --2- 172.21.15.6:0/754033331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf44105f00 0x7fdf44108320 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009900 tx=0x7fdf3802a410 comp rx=0 tx=0).stop 2024-05-20T17:19:56.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.120+0000 7fdf49757640 1 -- 172.21.15.6:0/754033331 shutdown_connections 2024-05-20T17:19:56.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.120+0000 7fdf49757640 1 --2- 172.21.15.6:0/754033331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf44108860 0x7fdf4410ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.120+0000 7fdf49757640 1 --2- 172.21.15.6:0/754033331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf44105f00 0x7fdf44108320 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.120+0000 7fdf49757640 1 --2- 172.21.15.6:0/754033331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf441035a0 0x7fdf441059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.120+0000 7fdf49757640 1 -- 172.21.15.6:0/754033331 >> 172.21.15.6:0/754033331 conn(0x7fdf440fcbe0 msgr2=0x7fdf440ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:56.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.120+0000 7fdf49757640 1 -- 172.21.15.6:0/754033331 shutdown_connections 2024-05-20T17:19:56.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.120+0000 7fdf49757640 1 -- 172.21.15.6:0/754033331 wait complete. 2024-05-20T17:19:56.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.121+0000 7fdf49757640 1 Processor -- start 2024-05-20T17:19:56.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.121+0000 7fdf49757640 1 -- start start 2024-05-20T17:19:56.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.121+0000 7fdf49757640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf441035a0 0x7fdf44199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:56.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.121+0000 7fdf49757640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf44105f00 0x7fdf44199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:56.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.122+0000 7fdf49757640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf44108860 0x7fdf441a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:56.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.122+0000 7fdf49757640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4410e5c0 con 0x7fdf441035a0 2024-05-20T17:19:56.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.122+0000 7fdf49757640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4410e440 con 0x7fdf44108860 2024-05-20T17:19:56.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.122+0000 7fdf49757640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4410e740 con 0x7fdf44105f00 2024-05-20T17:19:56.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.122+0000 7fdf42ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf441035a0 0x7fdf44199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:56.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.122+0000 7fdf42ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf441035a0 0x7fdf44199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41712/0 (socket says 172.21.15.6:41712) 2024-05-20T17:19:56.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.122+0000 7fdf42ffd640 1 -- 172.21.15.6:0/3087168002 learned_addr learned my addr 172.21.15.6:0/3087168002 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:19:56.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.122+0000 7fdf427fc640 1 --2- 172.21.15.6:0/3087168002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf44105f00 0x7fdf44199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:56.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.122+0000 7fdf437fe640 1 --2- 172.21.15.6:0/3087168002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf44108860 0x7fdf441a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:56.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.122+0000 7fdf42ffd640 1 -- 172.21.15.6:0/3087168002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf44105f00 msgr2=0x7fdf44199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:56.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.122+0000 7fdf42ffd640 1 --2- 172.21.15.6:0/3087168002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf44105f00 0x7fdf44199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.122+0000 7fdf42ffd640 1 -- 172.21.15.6:0/3087168002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf44108860 msgr2=0x7fdf441a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.122+0000 7fdf42ffd640 1 --2- 172.21.15.6:0/3087168002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf44108860 0x7fdf441a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.122+0000 7fdf42ffd640 1 -- 172.21.15.6:0/3087168002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf441a0d40 con 0x7fdf441035a0 2024-05-20T17:19:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.122+0000 7fdf42ffd640 1 --2- 172.21.15.6:0/3087168002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf441035a0 0x7fdf44199200 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fdf34005fd0 tx=0x7fdf3400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.123+0000 7fdf2bfff640 1 -- 172.21.15.6:0/3087168002 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf34017070 con 0x7fdf441035a0 2024-05-20T17:19:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.123+0000 7fdf2bfff640 1 -- 172.21.15.6:0/3087168002 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdf34009c30 con 0x7fdf441035a0 2024-05-20T17:19:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.123+0000 7fdf49757640 1 -- 172.21.15.6:0/3087168002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf441a0fd0 con 0x7fdf441035a0 2024-05-20T17:19:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.123+0000 7fdf2bfff640 1 -- 172.21.15.6:0/3087168002 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf34003d40 con 0x7fdf441035a0 2024-05-20T17:19:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.123+0000 7fdf49757640 1 -- 172.21.15.6:0/3087168002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf441a1490 con 0x7fdf441035a0 2024-05-20T17:19:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.124+0000 7fdf49757640 1 -- 172.21.15.6:0/3087168002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf440fe700 con 0x7fdf441035a0 2024-05-20T17:19:56.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.125+0000 7fdf2bfff640 1 -- 172.21.15.6:0/3087168002 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fdf34003ee0 con 0x7fdf441035a0 2024-05-20T17:19:56.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.126+0000 7fdf2bfff640 1 --2- 172.21.15.6:0/3087168002 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdf2c0a2b90 0x7fdf2c0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:56.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.126+0000 7fdf427fc640 1 --2- 172.21.15.6:0/3087168002 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdf2c0a2b90 0x7fdf2c0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:56.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.126+0000 7fdf2bfff640 1 -- 172.21.15.6:0/3087168002 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fdf340cf7f0 con 0x7fdf441035a0 2024-05-20T17:19:56.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.126+0000 7fdf427fc640 1 --2- 172.21.15.6:0/3087168002 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdf2c0a2b90 0x7fdf2c0a50a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdf4419a2a0 tx=0x7fdf38031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:56.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.130+0000 7fdf2bfff640 1 -- 172.21.15.6:0/3087168002 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fdf34020030 con 0x7fdf441035a0 2024-05-20T17:19:56.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.314+0000 7fdf49757640 1 -- 172.21.15.6:0/3087168002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdf4402d430 con 0x7fdf441035a0 2024-05-20T17:19:56.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.315+0000 7fdf2bfff640 1 -- 172.21.15.6:0/3087168002 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) ==== 100+0+11 (secure 0 0 0) 0x7fdf3409c3a0 con 0x7fdf441035a0 2024-05-20T17:19:56.316 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:19:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.316+0000 7fdf49757640 1 -- 172.21.15.6:0/3087168002 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdf2c0a2b90 msgr2=0x7fdf2c0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.316+0000 7fdf49757640 1 --2- 172.21.15.6:0/3087168002 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdf2c0a2b90 0x7fdf2c0a50a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdf4419a2a0 tx=0x7fdf38031400 comp rx=0 tx=0).stop 2024-05-20T17:19:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.317+0000 7fdf49757640 1 -- 172.21.15.6:0/3087168002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf441035a0 msgr2=0x7fdf44199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.317+0000 7fdf49757640 1 --2- 172.21.15.6:0/3087168002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf441035a0 0x7fdf44199200 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fdf34005fd0 tx=0x7fdf3400dde0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.317+0000 7fdf49757640 1 -- 172.21.15.6:0/3087168002 shutdown_connections 2024-05-20T17:19:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.317+0000 7fdf49757640 1 --2- 172.21.15.6:0/3087168002 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdf2c0a2b90 0x7fdf2c0a50a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.317+0000 7fdf49757640 1 --2- 172.21.15.6:0/3087168002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf44108860 0x7fdf441a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.317+0000 7fdf49757640 1 --2- 172.21.15.6:0/3087168002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf44105f00 0x7fdf44199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.317+0000 7fdf49757640 1 --2- 172.21.15.6:0/3087168002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf441035a0 0x7fdf44199200 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.317+0000 7fdf49757640 1 -- 172.21.15.6:0/3087168002 >> 172.21.15.6:0/3087168002 conn(0x7fdf440fcbe0 msgr2=0x7fdf44104250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:56.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.317+0000 7fdf49757640 1 -- 172.21.15.6:0/3087168002 shutdown_connections 2024-05-20T17:19:56.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.317+0000 7fdf49757640 1 -- 172.21.15.6:0/3087168002 wait complete. 2024-05-20T17:19:56.330 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:19:56.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.447+0000 7f0b5bf57640 1 -- 172.21.15.6:0/4145740885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b54105ed0 msgr2=0x7f0b541082f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:56.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.447+0000 7f0b5bf57640 1 --2- 172.21.15.6:0/4145740885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b54105ed0 0x7f0b541082f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009900 tx=0x7f0b4802a410 comp rx=0 tx=0).stop 2024-05-20T17:19:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.447+0000 7f0b5bf57640 1 -- 172.21.15.6:0/4145740885 shutdown_connections 2024-05-20T17:19:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.447+0000 7f0b5bf57640 1 --2- 172.21.15.6:0/4145740885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b54108830 0x7f0b5410ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.447+0000 7f0b5bf57640 1 --2- 172.21.15.6:0/4145740885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b54105ed0 0x7f0b541082f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.447+0000 7f0b5bf57640 1 --2- 172.21.15.6:0/4145740885 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b54103570 0x7f0b54105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.447+0000 7f0b5bf57640 1 -- 172.21.15.6:0/4145740885 >> 172.21.15.6:0/4145740885 conn(0x7f0b540fcb70 msgr2=0x7f0b540ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.447+0000 7f0b5bf57640 1 -- 172.21.15.6:0/4145740885 shutdown_connections 2024-05-20T17:19:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.447+0000 7f0b5bf57640 1 -- 172.21.15.6:0/4145740885 wait complete. 2024-05-20T17:19:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.448+0000 7f0b5bf57640 1 Processor -- start 2024-05-20T17:19:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.448+0000 7f0b5bf57640 1 -- start start 2024-05-20T17:19:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.448+0000 7f0b5bf57640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b54103570 0x7f0b541991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.448+0000 7f0b5bf57640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b54105ed0 0x7f0b54199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.448+0000 7f0b5bf57640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b54108830 0x7f0b541a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.448+0000 7f0b5bf57640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5410e590 con 0x7f0b54108830 2024-05-20T17:19:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.448+0000 7f0b5bf57640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5410e410 con 0x7f0b54103570 2024-05-20T17:19:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.448+0000 7f0b5bf57640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5410e710 con 0x7f0b54105ed0 2024-05-20T17:19:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.448+0000 7f0b5a4f4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b54108830 0x7f0b541a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.448+0000 7f0b5a4f4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b54108830 0x7f0b541a0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41730/0 (socket says 172.21.15.6:41730) 2024-05-20T17:19:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.448+0000 7f0b5a4f4640 1 -- 172.21.15.6:0/4038839570 learned_addr learned my addr 172.21.15.6:0/4038839570 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:19:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.448+0000 7f0b59cf3640 1 --2- 172.21.15.6:0/4038839570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b54103570 0x7f0b541991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.448+0000 7f0b594f2640 1 --2- 172.21.15.6:0/4038839570 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b54105ed0 0x7f0b54199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.449+0000 7f0b5a4f4640 1 -- 172.21.15.6:0/4038839570 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b54105ed0 msgr2=0x7f0b54199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.449+0000 7f0b5a4f4640 1 --2- 172.21.15.6:0/4038839570 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b54105ed0 0x7f0b54199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.449+0000 7f0b5a4f4640 1 -- 172.21.15.6:0/4038839570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b54103570 msgr2=0x7f0b541991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.449+0000 7f0b5a4f4640 1 --2- 172.21.15.6:0/4038839570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b54103570 0x7f0b541991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.449+0000 7f0b5a4f4640 1 -- 172.21.15.6:0/4038839570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b541a0d00 con 0x7f0b54108830 2024-05-20T17:19:56.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.449+0000 7f0b5a4f4640 1 --2- 172.21.15.6:0/4038839570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b54108830 0x7f0b541a0690 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00d950 tx=0x7f0b4c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:56.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.449+0000 7f0b52ffd640 1 -- 172.21.15.6:0/4038839570 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c017070 con 0x7f0b54108830 2024-05-20T17:19:56.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.449+0000 7f0b52ffd640 1 -- 172.21.15.6:0/4038839570 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0b4c009c30 con 0x7f0b54108830 2024-05-20T17:19:56.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.449+0000 7f0b5bf57640 1 -- 172.21.15.6:0/4038839570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b541a0ff0 con 0x7f0b54108830 2024-05-20T17:19:56.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.449+0000 7f0b52ffd640 1 -- 172.21.15.6:0/4038839570 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c00f620 con 0x7f0b54108830 2024-05-20T17:19:56.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.449+0000 7f0b5bf57640 1 -- 172.21.15.6:0/4038839570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b541a1450 con 0x7f0b54108830 2024-05-20T17:19:56.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.450+0000 7f0b5bf57640 1 -- 172.21.15.6:0/4038839570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b540fe690 con 0x7f0b54108830 2024-05-20T17:19:56.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.452+0000 7f0b52ffd640 1 -- 172.21.15.6:0/4038839570 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f0b4c01a070 con 0x7f0b54108830 2024-05-20T17:19:56.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.453+0000 7f0b52ffd640 1 --2- 172.21.15.6:0/4038839570 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0b3c0a2b90 0x7f0b3c0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:56.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.453+0000 7f0b52ffd640 1 -- 172.21.15.6:0/4038839570 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f0b4c0ceca0 con 0x7f0b54108830 2024-05-20T17:19:56.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.453+0000 7f0b59cf3640 1 --2- 172.21.15.6:0/4038839570 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0b3c0a2b90 0x7f0b3c0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.453+0000 7f0b59cf3640 1 --2- 172.21.15.6:0/4038839570 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0b3c0a2b90 0x7f0b3c0a50a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0b540699d0 tx=0x7f0b44009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.457+0000 7f0b52ffd640 1 -- 172.21.15.6:0/4038839570 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0b4c009de0 con 0x7f0b54108830 2024-05-20T17:19:56.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:56 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2241734594' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:19:56.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:56 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2578532481' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:19:56.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:56 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3087168002' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:19:56.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.646+0000 7f0b5bf57640 1 -- 172.21.15.6:0/4038839570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f0b5402d4f0 con 0x7f0b54108830 2024-05-20T17:19:56.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.647+0000 7f0b52ffd640 1 -- 172.21.15.6:0/4038839570 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) ==== 103+0+11 (secure 0 0 0) 0x7f0b4c09b200 con 0x7f0b54108830 2024-05-20T17:19:56.648 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:19:56.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.649+0000 7f0b5bf57640 1 -- 172.21.15.6:0/4038839570 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0b3c0a2b90 msgr2=0x7f0b3c0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:56.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.649+0000 7f0b5bf57640 1 --2- 172.21.15.6:0/4038839570 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0b3c0a2b90 0x7f0b3c0a50a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0b540699d0 tx=0x7f0b44009500 comp rx=0 tx=0).stop 2024-05-20T17:19:56.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.649+0000 7f0b5bf57640 1 -- 172.21.15.6:0/4038839570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b54108830 msgr2=0x7f0b541a0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:56.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.649+0000 7f0b5bf57640 1 --2- 172.21.15.6:0/4038839570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b54108830 0x7f0b541a0690 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00d950 tx=0x7f0b4c00de10 comp rx=0 tx=0).stop 2024-05-20T17:19:56.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.649+0000 7f0b5bf57640 1 -- 172.21.15.6:0/4038839570 shutdown_connections 2024-05-20T17:19:56.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.649+0000 7f0b5bf57640 1 --2- 172.21.15.6:0/4038839570 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f0b3c0a2b90 0x7f0b3c0a50a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.649+0000 7f0b5bf57640 1 --2- 172.21.15.6:0/4038839570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b54108830 0x7f0b541a0690 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.649+0000 7f0b5bf57640 1 --2- 172.21.15.6:0/4038839570 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b54105ed0 0x7f0b54199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.649+0000 7f0b5bf57640 1 --2- 172.21.15.6:0/4038839570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b54103570 0x7f0b541991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.649+0000 7f0b5bf57640 1 -- 172.21.15.6:0/4038839570 >> 172.21.15.6:0/4038839570 conn(0x7f0b540fcb70 msgr2=0x7f0b54104180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:56.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.649+0000 7f0b5bf57640 1 -- 172.21.15.6:0/4038839570 shutdown_connections 2024-05-20T17:19:56.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.649+0000 7f0b5bf57640 1 -- 172.21.15.6:0/4038839570 wait complete. 2024-05-20T17:19:56.662 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:19:56.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.777+0000 7fea7d94b640 1 -- 172.21.15.6:0/1572920326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea781078d0 msgr2=0x7fea78109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:56.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.777+0000 7fea7d94b640 1 --2- 172.21.15.6:0/1572920326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea781078d0 0x7fea78109cf0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fea70009ca0 tx=0x7fea7002a8c0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.778+0000 7fea7d94b640 1 -- 172.21.15.6:0/1572920326 shutdown_connections 2024-05-20T17:19:56.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.778+0000 7fea7d94b640 1 --2- 172.21.15.6:0/1572920326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea781078d0 0x7fea78109cf0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.778+0000 7fea7d94b640 1 --2- 172.21.15.6:0/1572920326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea78102bd0 0x7fea78102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.778+0000 7fea7d94b640 1 --2- 172.21.15.6:0/1572920326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea78101990 0x7fea78102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.778+0000 7fea7d94b640 1 -- 172.21.15.6:0/1572920326 >> 172.21.15.6:0/1572920326 conn(0x7fea780fcb80 msgr2=0x7fea780ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.778+0000 7fea7d94b640 1 -- 172.21.15.6:0/1572920326 shutdown_connections 2024-05-20T17:19:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.778+0000 7fea7d94b640 1 -- 172.21.15.6:0/1572920326 wait complete. 2024-05-20T17:19:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.778+0000 7fea7d94b640 1 Processor -- start 2024-05-20T17:19:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.778+0000 7fea7d94b640 1 -- start start 2024-05-20T17:19:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.779+0000 7fea7d94b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea78101990 0x7fea781990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.779+0000 7fea7d94b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea78102bd0 0x7fea78199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.779+0000 7fea7d94b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea781078d0 0x7fea781a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.779+0000 7fea7d94b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fea7810e620 con 0x7fea78101990 2024-05-20T17:19:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.779+0000 7fea7d94b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fea7810e4a0 con 0x7fea78102bd0 2024-05-20T17:19:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.779+0000 7fea7d94b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fea7810e7a0 con 0x7fea781078d0 2024-05-20T17:19:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.779+0000 7fea76ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea78101990 0x7fea781990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.779+0000 7fea76ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea78101990 0x7fea781990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41746/0 (socket says 172.21.15.6:41746) 2024-05-20T17:19:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.779+0000 7fea76ffd640 1 -- 172.21.15.6:0/388082018 learned_addr learned my addr 172.21.15.6:0/388082018 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:19:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.779+0000 7fea777fe640 1 --2- 172.21.15.6:0/388082018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea781078d0 0x7fea781a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.779+0000 7fea767fc640 1 --2- 172.21.15.6:0/388082018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea78102bd0 0x7fea78199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.779+0000 7fea76ffd640 1 -- 172.21.15.6:0/388082018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea781078d0 msgr2=0x7fea781a05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.779+0000 7fea76ffd640 1 --2- 172.21.15.6:0/388082018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea781078d0 0x7fea781a05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.779+0000 7fea76ffd640 1 -- 172.21.15.6:0/388082018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea78102bd0 msgr2=0x7fea78199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.779+0000 7fea76ffd640 1 --2- 172.21.15.6:0/388082018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea78102bd0 0x7fea78199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.779+0000 7fea76ffd640 1 -- 172.21.15.6:0/388082018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea781a0c30 con 0x7fea78101990 2024-05-20T17:19:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.779+0000 7fea767fc640 1 --2- 172.21.15.6:0/388082018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea78102bd0 0x7fea78199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:19:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.779+0000 7fea76ffd640 1 --2- 172.21.15.6:0/388082018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea78101990 0x7fea781990f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fea68005fd0 tx=0x7fea6800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.780+0000 7fea7c949640 1 -- 172.21.15.6:0/388082018 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea68017070 con 0x7fea78101990 2024-05-20T17:19:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.780+0000 7fea7c949640 1 -- 172.21.15.6:0/388082018 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fea68009c30 con 0x7fea78101990 2024-05-20T17:19:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.780+0000 7fea7d94b640 1 -- 172.21.15.6:0/388082018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea781a0f20 con 0x7fea78101990 2024-05-20T17:19:56.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.780+0000 7fea7c949640 1 -- 172.21.15.6:0/388082018 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea68003d10 con 0x7fea78101990 2024-05-20T17:19:56.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.780+0000 7fea7d94b640 1 -- 172.21.15.6:0/388082018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea781a1380 con 0x7fea78101990 2024-05-20T17:19:56.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.781+0000 7fea7d94b640 1 -- 172.21.15.6:0/388082018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea780691f0 con 0x7fea78101990 2024-05-20T17:19:56.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.782+0000 7fea7c949640 1 -- 172.21.15.6:0/388082018 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fea68003eb0 con 0x7fea78101990 2024-05-20T17:19:56.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.783+0000 7fea7c949640 1 --2- 172.21.15.6:0/388082018 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fea600a2b90 0x7fea600a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:56.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.783+0000 7fea767fc640 1 --2- 172.21.15.6:0/388082018 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fea600a2b90 0x7fea600a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:56.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.783+0000 7fea7c949640 1 -- 172.21.15.6:0/388082018 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fea680cf120 con 0x7fea78101990 2024-05-20T17:19:56.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.783+0000 7fea767fc640 1 --2- 172.21.15.6:0/388082018 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fea600a2b90 0x7fea600a50a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0058c0 tx=0x7fea6c005cd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:56.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.788+0000 7fea7c949640 1 -- 172.21.15.6:0/388082018 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fea780691f0 con 0x7fea78101990 2024-05-20T17:19:56.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:56 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2241734594' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:19:56.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:56 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2578532481' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:19:56.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:56 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3087168002' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:19:56.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.985+0000 7fea7d94b640 1 -- 172.21.15.6:0/388082018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fea78106710 con 0x7fea78101990 2024-05-20T17:19:56.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.986+0000 7fea7c949640 1 -- 172.21.15.6:0/388082018 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v94) ==== 81+0+579 (secure 0 0 0) 0x7fea68020030 con 0x7fea78101990 2024-05-20T17:19:56.987 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/3509827796 2024-05-21T16:57:41.985704+0000 2024-05-20T17:19:56.987 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/3509827796 2024-05-21T16:57:41.985704+0000 2024-05-20T17:19:56.987 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/173523304 2024-05-21T16:57:41.985704+0000 2024-05-20T17:19:56.987 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/741681069 2024-05-21T16:57:14.356112+0000 2024-05-20T17:19:56.988 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2415124466 2024-05-21T16:57:14.356112+0000 2024-05-20T17:19:56.988 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3427029758 2024-05-21T16:57:14.356112+0000 2024-05-20T17:19:56.988 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/741681069 2024-05-21T16:57:14.356112+0000 2024-05-20T17:19:56.988 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3324031224 2024-05-21T16:57:14.356112+0000 2024-05-20T17:19:56.988 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3781923966 2024-05-21T16:57:41.985704+0000 2024-05-20T17:19:56.988 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2979361383 2024-05-21T16:57:41.985704+0000 2024-05-20T17:19:56.988 INFO:teuthology.orchestra.run.smithi006.stderr:listed 10 entries 2024-05-20T17:19:56.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.988+0000 7fea7d94b640 1 -- 172.21.15.6:0/388082018 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fea600a2b90 msgr2=0x7fea600a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:56.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.988+0000 7fea7d94b640 1 --2- 172.21.15.6:0/388082018 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fea600a2b90 0x7fea600a50a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0058c0 tx=0x7fea6c005cd0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.988+0000 7fea7d94b640 1 -- 172.21.15.6:0/388082018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea78101990 msgr2=0x7fea781990f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:56.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.988+0000 7fea7d94b640 1 --2- 172.21.15.6:0/388082018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea78101990 0x7fea781990f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fea68005fd0 tx=0x7fea6800dde0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.988+0000 7fea7d94b640 1 -- 172.21.15.6:0/388082018 shutdown_connections 2024-05-20T17:19:56.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.988+0000 7fea7d94b640 1 --2- 172.21.15.6:0/388082018 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fea600a2b90 0x7fea600a50a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.988+0000 7fea7d94b640 1 --2- 172.21.15.6:0/388082018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea781078d0 0x7fea781a05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.988+0000 7fea7d94b640 1 --2- 172.21.15.6:0/388082018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea78102bd0 0x7fea78199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.988+0000 7fea7d94b640 1 --2- 172.21.15.6:0/388082018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea78101990 0x7fea781990f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:56.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.988+0000 7fea7d94b640 1 -- 172.21.15.6:0/388082018 >> 172.21.15.6:0/388082018 conn(0x7fea780fcb80 msgr2=0x7fea781038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:56.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.988+0000 7fea7d94b640 1 -- 172.21.15.6:0/388082018 shutdown_connections 2024-05-20T17:19:56.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:56.988+0000 7fea7d94b640 1 -- 172.21.15.6:0/388082018 wait complete. 2024-05-20T17:19:57.001 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:19:57.001 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:19:57.018 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:19:57.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:56 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2241734594' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:19:57.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:56 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2578532481' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:19:57.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:56 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3087168002' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:19:57.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.172+0000 7ff2aae1b640 1 -- 172.21.15.6:0/440170796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2a4104120 msgr2=0x7ff2a41022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.172+0000 7ff2aae1b640 1 --2- 172.21.15.6:0/440170796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2a4104120 0x7ff2a41022a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff298009900 tx=0x7ff29802a3f0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.172+0000 7ff2aae1b640 1 -- 172.21.15.6:0/440170796 shutdown_connections 2024-05-20T17:19:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.172+0000 7ff2aae1b640 1 --2- 172.21.15.6:0/440170796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2a4108a20 0x7ff2a410ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.172+0000 7ff2aae1b640 1 --2- 172.21.15.6:0/440170796 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2a41027e0 0x7ff2a4102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.172+0000 7ff2aae1b640 1 --2- 172.21.15.6:0/440170796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2a4104120 0x7ff2a41022a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.172+0000 7ff2aae1b640 1 -- 172.21.15.6:0/440170796 >> 172.21.15.6:0/440170796 conn(0x7ff2a40fdcf0 msgr2=0x7ff2a4100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.172+0000 7ff2aae1b640 1 -- 172.21.15.6:0/440170796 shutdown_connections 2024-05-20T17:19:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.173+0000 7ff2aae1b640 1 -- 172.21.15.6:0/440170796 wait complete. 2024-05-20T17:19:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.173+0000 7ff2aae1b640 1 Processor -- start 2024-05-20T17:19:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.173+0000 7ff2aae1b640 1 -- start start 2024-05-20T17:19:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.173+0000 7ff2aae1b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2a41027e0 0x7ff2a4199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.173+0000 7ff2aae1b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2a4104120 0x7ff2a41997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.173+0000 7ff2aae1b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2a4108a20 0x7ff2a41a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.173+0000 7ff2aae1b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a410e6f0 con 0x7ff2a41027e0 2024-05-20T17:19:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.173+0000 7ff2aae1b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a410e570 con 0x7ff2a4104120 2024-05-20T17:19:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.173+0000 7ff2aae1b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a410e870 con 0x7ff2a4108a20 2024-05-20T17:19:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.173+0000 7ff2a8bb7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2a41027e0 0x7ff2a4199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.174+0000 7ff2a8bb7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2a41027e0 0x7ff2a4199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41764/0 (socket says 172.21.15.6:41764) 2024-05-20T17:19:57.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.174+0000 7ff2a8bb7640 1 -- 172.21.15.6:0/809212483 learned_addr learned my addr 172.21.15.6:0/809212483 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:19:57.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.174+0000 7ff2a3fff640 1 --2- 172.21.15.6:0/809212483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2a4104120 0x7ff2a41997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:57.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.174+0000 7ff2a93b8640 1 --2- 172.21.15.6:0/809212483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2a4108a20 0x7ff2a41a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:57.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.174+0000 7ff2a8bb7640 1 -- 172.21.15.6:0/809212483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2a4108a20 msgr2=0x7ff2a41a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:57.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.174+0000 7ff2a8bb7640 1 --2- 172.21.15.6:0/809212483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2a4108a20 0x7ff2a41a0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.174+0000 7ff2a8bb7640 1 -- 172.21.15.6:0/809212483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2a4104120 msgr2=0x7ff2a41997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:57.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.174+0000 7ff2a8bb7640 1 --2- 172.21.15.6:0/809212483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2a4104120 0x7ff2a41997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.174+0000 7ff2a8bb7640 1 -- 172.21.15.6:0/809212483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a41a0d20 con 0x7ff2a41027e0 2024-05-20T17:19:57.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.174+0000 7ff2a8bb7640 1 --2- 172.21.15.6:0/809212483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2a41027e0 0x7ff2a4199290 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff2980314e0 tx=0x7ff298004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:57.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.174+0000 7ff2a1ffb640 1 -- 172.21.15.6:0/809212483 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29803f030 con 0x7ff2a41027e0 2024-05-20T17:19:57.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.174+0000 7ff2a1ffb640 1 -- 172.21.15.6:0/809212483 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff298003cb0 con 0x7ff2a41027e0 2024-05-20T17:19:57.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.174+0000 7ff2a1ffb640 1 -- 172.21.15.6:0/809212483 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff298035070 con 0x7ff2a41027e0 2024-05-20T17:19:57.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.174+0000 7ff2aae1b640 1 -- 172.21.15.6:0/809212483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a41a0fb0 con 0x7ff2a41027e0 2024-05-20T17:19:57.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.175+0000 7ff2aae1b640 1 -- 172.21.15.6:0/809212483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a41a1360 con 0x7ff2a41027e0 2024-05-20T17:19:57.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.175+0000 7ff2aae1b640 1 -- 172.21.15.6:0/809212483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2a40691c0 con 0x7ff2a41027e0 2024-05-20T17:19:57.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.177+0000 7ff2a1ffb640 1 -- 172.21.15.6:0/809212483 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7ff298042030 con 0x7ff2a41027e0 2024-05-20T17:19:57.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.177+0000 7ff2a1ffb640 1 --2- 172.21.15.6:0/809212483 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff2940a2c30 0x7ff2940a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:57.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.178+0000 7ff2a3fff640 1 --2- 172.21.15.6:0/809212483 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff2940a2c30 0x7ff2940a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:57.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.178+0000 7ff2a1ffb640 1 -- 172.21.15.6:0/809212483 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7ff2980efe40 con 0x7ff2a41027e0 2024-05-20T17:19:57.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.178+0000 7ff2a3fff640 1 --2- 172.21.15.6:0/809212483 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff2940a2c30 0x7ff2940a5140 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff2900058c0 tx=0x7ff29000a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:57.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.181+0000 7ff2a1ffb640 1 -- 172.21.15.6:0/809212483 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff2980bc990 con 0x7ff2a41027e0 2024-05-20T17:19:57.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.369+0000 7ff2aae1b640 1 -- 172.21.15.6:0/809212483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2a402d340 con 0x7ff2a41027e0 2024-05-20T17:19:57.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.371+0000 7ff2a1ffb640 1 -- 172.21.15.6:0/809212483 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+24584 (secure 0 0 0) 0x7ff2a402d340 con 0x7ff2a41027e0 2024-05-20T17:19:57.372 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:19:57.373 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":94,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:06:44.581646+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:05:02.947896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:05:03.842231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:05:07.551471+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:19:57.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.373+0000 7ff2aae1b640 1 -- 172.21.15.6:0/809212483 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff2940a2c30 msgr2=0x7ff2940a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:57.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.373+0000 7ff2aae1b640 1 --2- 172.21.15.6:0/809212483 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff2940a2c30 0x7ff2940a5140 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff2900058c0 tx=0x7ff29000a250 comp rx=0 tx=0).stop 2024-05-20T17:19:57.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.373+0000 7ff2aae1b640 1 -- 172.21.15.6:0/809212483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2a41027e0 msgr2=0x7ff2a4199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:57.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.373+0000 7ff2aae1b640 1 --2- 172.21.15.6:0/809212483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2a41027e0 0x7ff2a4199290 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff2980314e0 tx=0x7ff298004360 comp rx=0 tx=0).stop 2024-05-20T17:19:57.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.373+0000 7ff2aae1b640 1 -- 172.21.15.6:0/809212483 shutdown_connections 2024-05-20T17:19:57.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.373+0000 7ff2aae1b640 1 --2- 172.21.15.6:0/809212483 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff2940a2c30 0x7ff2940a5140 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.373+0000 7ff2aae1b640 1 --2- 172.21.15.6:0/809212483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2a4108a20 0x7ff2a41a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.373+0000 7ff2aae1b640 1 --2- 172.21.15.6:0/809212483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2a4104120 0x7ff2a41997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.373+0000 7ff2aae1b640 1 --2- 172.21.15.6:0/809212483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2a41027e0 0x7ff2a4199290 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.373+0000 7ff2aae1b640 1 -- 172.21.15.6:0/809212483 >> 172.21.15.6:0/809212483 conn(0x7ff2a40fdcf0 msgr2=0x7ff2a4104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:57.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.373+0000 7ff2aae1b640 1 -- 172.21.15.6:0/809212483 shutdown_connections 2024-05-20T17:19:57.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.373+0000 7ff2aae1b640 1 -- 172.21.15.6:0/809212483 wait complete. 2024-05-20T17:19:57.386 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:00:12.516679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:05:02.947896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:05:03.842231+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:05:07.551471+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:19:57.387 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:19:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.505+0000 7ff8fa813640 1 -- 172.21.15.6:0/3631276095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f4101990 msgr2=0x7ff8f4102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.505+0000 7ff8fa813640 1 --2- 172.21.15.6:0/3631276095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f4101990 0x7ff8f4102690 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4009900 tx=0x7ff8e402a410 comp rx=0 tx=0).stop 2024-05-20T17:19:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.505+0000 7ff8fa813640 1 -- 172.21.15.6:0/3631276095 shutdown_connections 2024-05-20T17:19:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.505+0000 7ff8fa813640 1 --2- 172.21.15.6:0/3631276095 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8f41078d0 0x7ff8f4109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.505+0000 7ff8fa813640 1 --2- 172.21.15.6:0/3631276095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8f4102bd0 0x7ff8f4102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.505+0000 7ff8fa813640 1 --2- 172.21.15.6:0/3631276095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f4101990 0x7ff8f4102690 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.505+0000 7ff8fa813640 1 -- 172.21.15.6:0/3631276095 >> 172.21.15.6:0/3631276095 conn(0x7ff8f40fcb80 msgr2=0x7ff8f40ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.505+0000 7ff8fa813640 1 -- 172.21.15.6:0/3631276095 shutdown_connections 2024-05-20T17:19:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.505+0000 7ff8fa813640 1 -- 172.21.15.6:0/3631276095 wait complete. 2024-05-20T17:19:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.506+0000 7ff8fa813640 1 Processor -- start 2024-05-20T17:19:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.506+0000 7ff8fa813640 1 -- start start 2024-05-20T17:19:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.506+0000 7ff8fa813640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8f4101990 0x7ff8f41992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.506+0000 7ff8fa813640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f4102bd0 0x7ff8f41997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.506+0000 7ff8fa813640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8f41078d0 0x7ff8f41a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.506+0000 7ff8fa813640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f410e600 con 0x7ff8f4102bd0 2024-05-20T17:19:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.506+0000 7ff8fa813640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f410e480 con 0x7ff8f41078d0 2024-05-20T17:19:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.506+0000 7ff8fa813640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f410e780 con 0x7ff8f4101990 2024-05-20T17:19:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.507+0000 7ff8f37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f4102bd0 0x7ff8f41997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.507+0000 7ff8f37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f4102bd0 0x7ff8f41997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41774/0 (socket says 172.21.15.6:41774) 2024-05-20T17:19:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.507+0000 7ff8f37fe640 1 -- 172.21.15.6:0/1019584699 learned_addr learned my addr 172.21.15.6:0/1019584699 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:19:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.507+0000 7ff8f8db0640 1 --2- 172.21.15.6:0/1019584699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8f41078d0 0x7ff8f41a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.507+0000 7ff8f3fff640 1 --2- 172.21.15.6:0/1019584699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8f4101990 0x7ff8f41992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.507+0000 7ff8f37fe640 1 -- 172.21.15.6:0/1019584699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8f4101990 msgr2=0x7ff8f41992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.507+0000 7ff8f37fe640 1 --2- 172.21.15.6:0/1019584699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8f4101990 0x7ff8f41992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.507+0000 7ff8f37fe640 1 -- 172.21.15.6:0/1019584699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8f41078d0 msgr2=0x7ff8f41a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.507+0000 7ff8f37fe640 1 --2- 172.21.15.6:0/1019584699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8f41078d0 0x7ff8f41a0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.507+0000 7ff8f37fe640 1 -- 172.21.15.6:0/1019584699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f41a0d70 con 0x7ff8f4102bd0 2024-05-20T17:19:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.507+0000 7ff8f3fff640 1 --2- 172.21.15.6:0/1019584699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8f4101990 0x7ff8f41992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:19:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.507+0000 7ff8f37fe640 1 --2- 172.21.15.6:0/1019584699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f4102bd0 0x7ff8f41997e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800e9f0 tx=0x7ff8e800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.507+0000 7ff8f17fa640 1 -- 172.21.15.6:0/1019584699 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e800cd80 con 0x7ff8f4102bd0 2024-05-20T17:19:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.507+0000 7ff8f17fa640 1 -- 172.21.15.6:0/1019584699 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff8e80108e0 con 0x7ff8f4102bd0 2024-05-20T17:19:57.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.507+0000 7ff8fa813640 1 -- 172.21.15.6:0/1019584699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f41a1060 con 0x7ff8f4102bd0 2024-05-20T17:19:57.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.507+0000 7ff8f17fa640 1 -- 172.21.15.6:0/1019584699 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8018920 con 0x7ff8f4102bd0 2024-05-20T17:19:57.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.507+0000 7ff8fa813640 1 -- 172.21.15.6:0/1019584699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f41a1630 con 0x7ff8f4102bd0 2024-05-20T17:19:57.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.508+0000 7ff8fa813640 1 -- 172.21.15.6:0/1019584699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8f41066e0 con 0x7ff8f4102bd0 2024-05-20T17:19:57.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.510+0000 7ff8f17fa640 1 -- 172.21.15.6:0/1019584699 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7ff8e8010a90 con 0x7ff8f4102bd0 2024-05-20T17:19:57.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.511+0000 7ff8f17fa640 1 --2- 172.21.15.6:0/1019584699 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff8dc0a2b90 0x7ff8dc0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:57.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.511+0000 7ff8f3fff640 1 --2- 172.21.15.6:0/1019584699 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff8dc0a2b90 0x7ff8dc0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:57.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.511+0000 7ff8f17fa640 1 -- 172.21.15.6:0/1019584699 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7ff8e80cfc20 con 0x7ff8f4102bd0 2024-05-20T17:19:57.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.511+0000 7ff8f3fff640 1 --2- 172.21.15.6:0/1019584699 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff8dc0a2b90 0x7ff8dc0a50a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4006010 tx=0x7ff8e4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.514+0000 7ff8f17fa640 1 -- 172.21.15.6:0/1019584699 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff8e809c7d0 con 0x7ff8f4102bd0 2024-05-20T17:19:57.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.701+0000 7ff8fa813640 1 -- 172.21.15.6:0/1019584699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff8f402d430 con 0x7ff8f4102bd0 2024-05-20T17:19:57.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.702+0000 7ff8f17fa640 1 -- 172.21.15.6:0/1019584699 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) ==== 93+0+10 (secure 0 0 0) 0x7ff8f402d430 con 0x7ff8f4102bd0 2024-05-20T17:19:57.703 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:19:57.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.704+0000 7ff8fa813640 1 -- 172.21.15.6:0/1019584699 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff8dc0a2b90 msgr2=0x7ff8dc0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:57.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.704+0000 7ff8fa813640 1 --2- 172.21.15.6:0/1019584699 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff8dc0a2b90 0x7ff8dc0a50a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4006010 tx=0x7ff8e4000bc0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.704+0000 7ff8fa813640 1 -- 172.21.15.6:0/1019584699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f4102bd0 msgr2=0x7ff8f41997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:57.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.704+0000 7ff8fa813640 1 --2- 172.21.15.6:0/1019584699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f4102bd0 0x7ff8f41997e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800e9f0 tx=0x7ff8e800eeb0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.704+0000 7ff8fa813640 1 -- 172.21.15.6:0/1019584699 shutdown_connections 2024-05-20T17:19:57.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.704+0000 7ff8fa813640 1 --2- 172.21.15.6:0/1019584699 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7ff8dc0a2b90 0x7ff8dc0a50a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.704+0000 7ff8fa813640 1 --2- 172.21.15.6:0/1019584699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8f41078d0 0x7ff8f41a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.704+0000 7ff8fa813640 1 --2- 172.21.15.6:0/1019584699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f4102bd0 0x7ff8f41997e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.704+0000 7ff8fa813640 1 --2- 172.21.15.6:0/1019584699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8f4101990 0x7ff8f41992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.704+0000 7ff8fa813640 1 -- 172.21.15.6:0/1019584699 >> 172.21.15.6:0/1019584699 conn(0x7ff8f40fcb80 msgr2=0x7ff8f41038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:57.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.704+0000 7ff8fa813640 1 -- 172.21.15.6:0/1019584699 shutdown_connections 2024-05-20T17:19:57.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.704+0000 7ff8fa813640 1 -- 172.21.15.6:0/1019584699 wait complete. 2024-05-20T17:19:57.716 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:57 smithi006 ceph-mon[32486]: pgmap v751: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-20T17:19:57.716 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:57 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/4038839570' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:19:57.716 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:57 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/388082018' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-20T17:19:57.716 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:57 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/809212483' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:19:57.717 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:19:57.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.835+0000 7f78f47a3640 1 -- 172.21.15.6:0/4028323715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ec101980 msgr2=0x7f78ec102680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:57.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.835+0000 7f78f47a3640 1 --2- 172.21.15.6:0/4028323715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ec101980 0x7f78ec102680 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f78e8009900 tx=0x7f78e802a410 comp rx=0 tx=0).stop 2024-05-20T17:19:57.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.835+0000 7f78f47a3640 1 -- 172.21.15.6:0/4028323715 shutdown_connections 2024-05-20T17:19:57.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.835+0000 7f78f47a3640 1 --2- 172.21.15.6:0/4028323715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78ec1078c0 0x7f78ec109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.835+0000 7f78f47a3640 1 --2- 172.21.15.6:0/4028323715 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78ec102bc0 0x7f78ec102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.835+0000 7f78f47a3640 1 --2- 172.21.15.6:0/4028323715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ec101980 0x7f78ec102680 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.835+0000 7f78f47a3640 1 -- 172.21.15.6:0/4028323715 >> 172.21.15.6:0/4028323715 conn(0x7f78ec0fcb70 msgr2=0x7f78ec0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:57.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.835+0000 7f78f47a3640 1 -- 172.21.15.6:0/4028323715 shutdown_connections 2024-05-20T17:19:57.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.835+0000 7f78f47a3640 1 -- 172.21.15.6:0/4028323715 wait complete. 2024-05-20T17:19:57.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.835+0000 7f78f47a3640 1 Processor -- start 2024-05-20T17:19:57.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.836+0000 7f78f47a3640 1 -- start start 2024-05-20T17:19:57.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.836+0000 7f78f47a3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78ec101980 0x7f78ec199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:57.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.836+0000 7f78f47a3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78ec102bc0 0x7f78ec1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:57.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.836+0000 7f78f47a3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ec1078c0 0x7f78ec1a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:57.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.836+0000 7f78f47a3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec10e5f0 con 0x7f78ec1078c0 2024-05-20T17:19:57.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.836+0000 7f78f47a3640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec10e470 con 0x7f78ec102bc0 2024-05-20T17:19:57.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.836+0000 7f78f47a3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec10e770 con 0x7f78ec101980 2024-05-20T17:19:57.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.836+0000 7f78f2d40640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ec1078c0 0x7f78ec1a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:57.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.836+0000 7f78f2d40640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ec1078c0 0x7f78ec1a06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41798/0 (socket says 172.21.15.6:41798) 2024-05-20T17:19:57.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.836+0000 7f78f2d40640 1 -- 172.21.15.6:0/2538404905 learned_addr learned my addr 172.21.15.6:0/2538404905 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:19:57.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.836+0000 7f78f253f640 1 --2- 172.21.15.6:0/2538404905 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78ec101980 0x7f78ec199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:57.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.836+0000 7f78f2d40640 1 -- 172.21.15.6:0/2538404905 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78ec101980 msgr2=0x7f78ec199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:57.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.836+0000 7f78f2d40640 1 --2- 172.21.15.6:0/2538404905 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78ec101980 0x7f78ec199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.836+0000 7f78f2d40640 1 -- 172.21.15.6:0/2538404905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78ec102bc0 msgr2=0x7f78ec1997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:57.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.836+0000 7f78f2d40640 1 --2- 172.21.15.6:0/2538404905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78ec102bc0 0x7f78ec1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:57.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.836+0000 7f78f2d40640 1 -- 172.21.15.6:0/2538404905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ec1a0d60 con 0x7f78ec1078c0 2024-05-20T17:19:57.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.836+0000 7f78f2d40640 1 --2- 172.21.15.6:0/2538404905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ec1078c0 0x7f78ec1a06f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f78e400eaa0 tx=0x7f78e400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:57.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.836+0000 7f78e37fe640 1 -- 172.21.15.6:0/2538404905 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e400cdb0 con 0x7f78ec1078c0 2024-05-20T17:19:57.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.837+0000 7f78e37fe640 1 -- 172.21.15.6:0/2538404905 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78e4005020 con 0x7f78ec1078c0 2024-05-20T17:19:57.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.837+0000 7f78f47a3640 1 -- 172.21.15.6:0/2538404905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78ec1a0ff0 con 0x7f78ec1078c0 2024-05-20T17:19:57.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.837+0000 7f78e37fe640 1 -- 172.21.15.6:0/2538404905 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e40116d0 con 0x7f78ec1078c0 2024-05-20T17:19:57.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.837+0000 7f78f47a3640 1 -- 172.21.15.6:0/2538404905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78ec1a1540 con 0x7f78ec1078c0 2024-05-20T17:19:57.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.837+0000 7f78f47a3640 1 -- 172.21.15.6:0/2538404905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78ec1066d0 con 0x7f78ec1078c0 2024-05-20T17:19:57.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.840+0000 7f78e37fe640 1 -- 172.21.15.6:0/2538404905 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f78e40051d0 con 0x7f78ec1078c0 2024-05-20T17:19:57.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.841+0000 7f78e37fe640 1 --2- 172.21.15.6:0/2538404905 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f78d80a2b90 0x7f78d80a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:57.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.841+0000 7f78f253f640 1 --2- 172.21.15.6:0/2538404905 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f78d80a2b90 0x7f78d80a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:57.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.841+0000 7f78e37fe640 1 -- 172.21.15.6:0/2538404905 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f78e40cfa90 con 0x7f78ec1078c0 2024-05-20T17:19:57.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.841+0000 7f78f253f640 1 --2- 172.21.15.6:0/2538404905 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f78d80a2b90 0x7f78d80a50a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f78e8006010 tx=0x7f78e8031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:57.845+0000 7f78e37fe640 1 -- 172.21.15.6:0/2538404905 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f78e4016030 con 0x7f78ec1078c0 2024-05-20T17:19:57.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:57 smithi171 ceph-mon[35901]: pgmap v751: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-20T17:19:57.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:57 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/4038839570' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:19:57.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:57 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/388082018' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-20T17:19:57.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:57 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/809212483' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:19:58.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:57 smithi062 ceph-mon[35425]: pgmap v751: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-20T17:19:58.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:57 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/4038839570' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:19:58.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:57 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/388082018' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-20T17:19:58.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:57 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/809212483' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:19:58.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.027+0000 7f78f47a3640 1 -- 172.21.15.6:0/2538404905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f78ec02d430 con 0x7f78ec1078c0 2024-05-20T17:19:58.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.027+0000 7f78e37fe640 1 -- 172.21.15.6:0/2538404905 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) ==== 104+0+11 (secure 0 0 0) 0x7f78e409c5e0 con 0x7f78ec1078c0 2024-05-20T17:19:58.028 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:19:58.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.029+0000 7f78f47a3640 1 -- 172.21.15.6:0/2538404905 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f78d80a2b90 msgr2=0x7f78d80a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:58.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.029+0000 7f78f47a3640 1 --2- 172.21.15.6:0/2538404905 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f78d80a2b90 0x7f78d80a50a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f78e8006010 tx=0x7f78e8031400 comp rx=0 tx=0).stop 2024-05-20T17:19:58.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.029+0000 7f78f47a3640 1 -- 172.21.15.6:0/2538404905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ec1078c0 msgr2=0x7f78ec1a06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:58.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.029+0000 7f78f47a3640 1 --2- 172.21.15.6:0/2538404905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ec1078c0 0x7f78ec1a06f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f78e400eaa0 tx=0x7f78e400ef60 comp rx=0 tx=0).stop 2024-05-20T17:19:58.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.030+0000 7f78f47a3640 1 -- 172.21.15.6:0/2538404905 shutdown_connections 2024-05-20T17:19:58.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.030+0000 7f78f47a3640 1 --2- 172.21.15.6:0/2538404905 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f78d80a2b90 0x7f78d80a50a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.030+0000 7f78f47a3640 1 --2- 172.21.15.6:0/2538404905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78ec1078c0 0x7f78ec1a06f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.030+0000 7f78f47a3640 1 --2- 172.21.15.6:0/2538404905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78ec102bc0 0x7f78ec1997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.030+0000 7f78f47a3640 1 --2- 172.21.15.6:0/2538404905 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78ec101980 0x7f78ec199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.030+0000 7f78f47a3640 1 -- 172.21.15.6:0/2538404905 >> 172.21.15.6:0/2538404905 conn(0x7f78ec0fcb70 msgr2=0x7f78ec1038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:58.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.030+0000 7f78f47a3640 1 -- 172.21.15.6:0/2538404905 shutdown_connections 2024-05-20T17:19:58.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.030+0000 7f78f47a3640 1 -- 172.21.15.6:0/2538404905 wait complete. 2024-05-20T17:19:58.043 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:19:58.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.160+0000 7fbe487a8640 1 -- 172.21.15.6:0/2751175364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe40101210 msgr2=0x7fbe4010ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:58.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.160+0000 7fbe487a8640 1 --2- 172.21.15.6:0/2751175364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe40101210 0x7fbe4010ac70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fbe38009ca0 tx=0x7fbe3802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.160+0000 7fbe487a8640 1 -- 172.21.15.6:0/2751175364 shutdown_connections 2024-05-20T17:19:58.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.160+0000 7fbe487a8640 1 --2- 172.21.15.6:0/2751175364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe40101210 0x7fbe4010ac70 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.160+0000 7fbe487a8640 1 --2- 172.21.15.6:0/2751175364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbe40100710 0x7fbe40100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.160+0000 7fbe487a8640 1 --2- 172.21.15.6:0/2751175364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe40104060 0x7fbe40104470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.160+0000 7fbe487a8640 1 -- 172.21.15.6:0/2751175364 >> 172.21.15.6:0/2751175364 conn(0x7fbe400fc330 msgr2=0x7fbe400fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:58.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.160+0000 7fbe487a8640 1 -- 172.21.15.6:0/2751175364 shutdown_connections 2024-05-20T17:19:58.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.160+0000 7fbe487a8640 1 -- 172.21.15.6:0/2751175364 wait complete. 2024-05-20T17:19:58.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.161+0000 7fbe487a8640 1 Processor -- start 2024-05-20T17:19:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.161+0000 7fbe487a8640 1 -- start start 2024-05-20T17:19:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.161+0000 7fbe487a8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbe40100710 0x7fbe40199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.161+0000 7fbe487a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe40101210 0x7fbe40199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.161+0000 7fbe487a8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe40104060 0x7fbe401a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.161+0000 7fbe487a8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4010e640 con 0x7fbe40101210 2024-05-20T17:19:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.161+0000 7fbe487a8640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4010e4c0 con 0x7fbe40104060 2024-05-20T17:19:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.161+0000 7fbe487a8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4010e7c0 con 0x7fbe40100710 2024-05-20T17:19:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.161+0000 7fbe45d43640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe40101210 0x7fbe40199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.162+0000 7fbe45d43640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe40101210 0x7fbe40199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41814/0 (socket says 172.21.15.6:41814) 2024-05-20T17:19:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.162+0000 7fbe45d43640 1 -- 172.21.15.6:0/2187425286 learned_addr learned my addr 172.21.15.6:0/2187425286 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:19:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.162+0000 7fbe46544640 1 --2- 172.21.15.6:0/2187425286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbe40100710 0x7fbe40199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.162+0000 7fbe46d45640 1 --2- 172.21.15.6:0/2187425286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe40104060 0x7fbe401a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.162+0000 7fbe45d43640 1 -- 172.21.15.6:0/2187425286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbe40100710 msgr2=0x7fbe40199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.162+0000 7fbe45d43640 1 --2- 172.21.15.6:0/2187425286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbe40100710 0x7fbe40199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.162+0000 7fbe45d43640 1 -- 172.21.15.6:0/2187425286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe40104060 msgr2=0x7fbe401a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.162+0000 7fbe45d43640 1 --2- 172.21.15.6:0/2187425286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe40104060 0x7fbe401a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.162+0000 7fbe45d43640 1 -- 172.21.15.6:0/2187425286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe401a0c60 con 0x7fbe40101210 2024-05-20T17:19:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.162+0000 7fbe46d45640 1 --2- 172.21.15.6:0/2187425286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe40104060 0x7fbe401a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:19:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.162+0000 7fbe45d43640 1 --2- 172.21.15.6:0/2187425286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe40101210 0x7fbe40199660 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000e9f0 tx=0x7fbe3000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.162+0000 7fbe377fe640 1 -- 172.21.15.6:0/2187425286 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3000cd80 con 0x7fbe40101210 2024-05-20T17:19:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.162+0000 7fbe377fe640 1 -- 172.21.15.6:0/2187425286 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbe300054d0 con 0x7fbe40101210 2024-05-20T17:19:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.162+0000 7fbe487a8640 1 -- 172.21.15.6:0/2187425286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe401a0f50 con 0x7fbe40101210 2024-05-20T17:19:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.162+0000 7fbe377fe640 1 -- 172.21.15.6:0/2187425286 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe30010490 con 0x7fbe40101210 2024-05-20T17:19:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.162+0000 7fbe487a8640 1 -- 172.21.15.6:0/2187425286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe401a13b0 con 0x7fbe40101210 2024-05-20T17:19:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.163+0000 7fbe487a8640 1 -- 172.21.15.6:0/2187425286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe40109a00 con 0x7fbe40101210 2024-05-20T17:19:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.165+0000 7fbe377fe640 1 -- 172.21.15.6:0/2187425286 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fbe30005000 con 0x7fbe40101210 2024-05-20T17:19:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.165+0000 7fbe377fe640 1 --2- 172.21.15.6:0/2187425286 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbe2c0a2b90 0x7fbe2c0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.166+0000 7fbe377fe640 1 -- 172.21.15.6:0/2187425286 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fbe300cfa20 con 0x7fbe40101210 2024-05-20T17:19:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.166+0000 7fbe46544640 1 --2- 172.21.15.6:0/2187425286 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbe2c0a2b90 0x7fbe2c0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:58.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.166+0000 7fbe46544640 1 --2- 172.21.15.6:0/2187425286 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbe2c0a2b90 0x7fbe2c0a50a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbe4006a310 tx=0x7fbe3c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:58.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.169+0000 7fbe377fe640 1 -- 172.21.15.6:0/2187425286 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbe30053850 con 0x7fbe40101210 2024-05-20T17:19:58.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.355+0000 7fbe487a8640 1 -- 172.21.15.6:0/2187425286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbe4002d430 con 0x7fbe40101210 2024-05-20T17:19:58.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.356+0000 7fbe377fe640 1 -- 172.21.15.6:0/2187425286 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) ==== 100+0+11 (secure 0 0 0) 0x7fbe300052f0 con 0x7fbe40101210 2024-05-20T17:19:58.357 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:19:58.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.358+0000 7fbe487a8640 1 -- 172.21.15.6:0/2187425286 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbe2c0a2b90 msgr2=0x7fbe2c0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:58.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.358+0000 7fbe487a8640 1 --2- 172.21.15.6:0/2187425286 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbe2c0a2b90 0x7fbe2c0a50a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbe4006a310 tx=0x7fbe3c005f90 comp rx=0 tx=0).stop 2024-05-20T17:19:58.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.358+0000 7fbe487a8640 1 -- 172.21.15.6:0/2187425286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe40101210 msgr2=0x7fbe40199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:58.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.358+0000 7fbe487a8640 1 --2- 172.21.15.6:0/2187425286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe40101210 0x7fbe40199660 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000e9f0 tx=0x7fbe3000edf0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.358+0000 7fbe487a8640 1 -- 172.21.15.6:0/2187425286 shutdown_connections 2024-05-20T17:19:58.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.358+0000 7fbe487a8640 1 --2- 172.21.15.6:0/2187425286 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbe2c0a2b90 0x7fbe2c0a50a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.358+0000 7fbe487a8640 1 --2- 172.21.15.6:0/2187425286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe40104060 0x7fbe401a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.358+0000 7fbe487a8640 1 --2- 172.21.15.6:0/2187425286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe40101210 0x7fbe40199660 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.358+0000 7fbe487a8640 1 --2- 172.21.15.6:0/2187425286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbe40100710 0x7fbe40199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.358+0000 7fbe487a8640 1 -- 172.21.15.6:0/2187425286 >> 172.21.15.6:0/2187425286 conn(0x7fbe400fc330 msgr2=0x7fbe40106bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:58.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.358+0000 7fbe487a8640 1 -- 172.21.15.6:0/2187425286 shutdown_connections 2024-05-20T17:19:58.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.358+0000 7fbe487a8640 1 -- 172.21.15.6:0/2187425286 wait complete. 2024-05-20T17:19:58.371 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:19:58.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.488+0000 7fbc378d3640 1 -- 172.21.15.6:0/50782232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc301078c0 msgr2=0x7fbc30109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:58.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.488+0000 7fbc378d3640 1 --2- 172.21.15.6:0/50782232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc301078c0 0x7fbc30109ce0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009ca0 tx=0x7fbc2802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.488+0000 7fbc378d3640 1 -- 172.21.15.6:0/50782232 shutdown_connections 2024-05-20T17:19:58.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.488+0000 7fbc378d3640 1 --2- 172.21.15.6:0/50782232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc301078c0 0x7fbc30109ce0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.488+0000 7fbc378d3640 1 --2- 172.21.15.6:0/50782232 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc30102bc0 0x7fbc30102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.488+0000 7fbc378d3640 1 --2- 172.21.15.6:0/50782232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc30101980 0x7fbc30102680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.488+0000 7fbc378d3640 1 -- 172.21.15.6:0/50782232 >> 172.21.15.6:0/50782232 conn(0x7fbc300fcb70 msgr2=0x7fbc300ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:58.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.488+0000 7fbc378d3640 1 -- 172.21.15.6:0/50782232 shutdown_connections 2024-05-20T17:19:58.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.488+0000 7fbc378d3640 1 -- 172.21.15.6:0/50782232 wait complete. 2024-05-20T17:19:58.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.489+0000 7fbc378d3640 1 Processor -- start 2024-05-20T17:19:58.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.489+0000 7fbc378d3640 1 -- start start 2024-05-20T17:19:58.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.489+0000 7fbc378d3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc30101980 0x7fbc30199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:58.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.489+0000 7fbc378d3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc30102bc0 0x7fbc30199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:58.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.489+0000 7fbc378d3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc301078c0 0x7fbc301a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:58.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.489+0000 7fbc378d3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3010d490 con 0x7fbc30102bc0 2024-05-20T17:19:58.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.489+0000 7fbc378d3640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3010d310 con 0x7fbc30101980 2024-05-20T17:19:58.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.489+0000 7fbc378d3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3010d610 con 0x7fbc301078c0 2024-05-20T17:19:58.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.489+0000 7fbc34e6e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc30102bc0 0x7fbc30199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:58.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.489+0000 7fbc34e6e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc30102bc0 0x7fbc30199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41830/0 (socket says 172.21.15.6:41830) 2024-05-20T17:19:58.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.489+0000 7fbc34e6e640 1 -- 172.21.15.6:0/1974603964 learned_addr learned my addr 172.21.15.6:0/1974603964 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:19:58.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.489+0000 7fbc35e70640 1 --2- 172.21.15.6:0/1974603964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc301078c0 0x7fbc301a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:58.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.489+0000 7fbc3566f640 1 --2- 172.21.15.6:0/1974603964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc30101980 0x7fbc30199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:58.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.489+0000 7fbc34e6e640 1 -- 172.21.15.6:0/1974603964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc301078c0 msgr2=0x7fbc301a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:58.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.489+0000 7fbc34e6e640 1 --2- 172.21.15.6:0/1974603964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc301078c0 0x7fbc301a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.489+0000 7fbc34e6e640 1 -- 172.21.15.6:0/1974603964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc30101980 msgr2=0x7fbc30199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:58.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.489+0000 7fbc34e6e640 1 --2- 172.21.15.6:0/1974603964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc30101980 0x7fbc30199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.489+0000 7fbc34e6e640 1 -- 172.21.15.6:0/1974603964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc301a0c60 con 0x7fbc30102bc0 2024-05-20T17:19:58.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.489+0000 7fbc3566f640 1 --2- 172.21.15.6:0/1974603964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc30101980 0x7fbc30199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:19:58.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.490+0000 7fbc34e6e640 1 --2- 172.21.15.6:0/1974603964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc30102bc0 0x7fbc30199660 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000d950 tx=0x7fbc2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:58.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.490+0000 7fbc267fc640 1 -- 172.21.15.6:0/1974603964 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc20017070 con 0x7fbc30102bc0 2024-05-20T17:19:58.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.490+0000 7fbc267fc640 1 -- 172.21.15.6:0/1974603964 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc20009c30 con 0x7fbc30102bc0 2024-05-20T17:19:58.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.490+0000 7fbc378d3640 1 -- 172.21.15.6:0/1974603964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc301a0f50 con 0x7fbc30102bc0 2024-05-20T17:19:58.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.490+0000 7fbc267fc640 1 -- 172.21.15.6:0/1974603964 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2000f620 con 0x7fbc30102bc0 2024-05-20T17:19:58.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.490+0000 7fbc378d3640 1 -- 172.21.15.6:0/1974603964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc301a13c0 con 0x7fbc30102bc0 2024-05-20T17:19:58.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.491+0000 7fbc378d3640 1 -- 172.21.15.6:0/1974603964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc301a1620 con 0x7fbc30102bc0 2024-05-20T17:19:58.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.493+0000 7fbc267fc640 1 -- 172.21.15.6:0/1974603964 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fbc200109a0 con 0x7fbc30102bc0 2024-05-20T17:19:58.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.494+0000 7fbc267fc640 1 --2- 172.21.15.6:0/1974603964 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbc1c0a2b90 0x7fbc1c0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:58.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.494+0000 7fbc3566f640 1 --2- 172.21.15.6:0/1974603964 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbc1c0a2b90 0x7fbc1c0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:58.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.494+0000 7fbc267fc640 1 -- 172.21.15.6:0/1974603964 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fbc200cf060 con 0x7fbc30102bc0 2024-05-20T17:19:58.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.494+0000 7fbc3566f640 1 --2- 172.21.15.6:0/1974603964 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbc1c0a2b90 0x7fbc1c0a50a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbc30102580 tx=0x7fbc2c005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:58.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.498+0000 7fbc267fc640 1 -- 172.21.15.6:0/1974603964 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbc20009de0 con 0x7fbc30102bc0 2024-05-20T17:19:58.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:58 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1019584699' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:19:58.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:58 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2538404905' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:19:58.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:58 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/2187425286' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:19:58.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.682+0000 7fbc378d3640 1 -- 172.21.15.6:0/1974603964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fbc301a17f0 con 0x7fbc30102bc0 2024-05-20T17:19:58.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.682+0000 7fbc267fc640 1 -- 172.21.15.6:0/1974603964 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) ==== 103+0+11 (secure 0 0 0) 0x7fbc2009bbb0 con 0x7fbc30102bc0 2024-05-20T17:19:58.684 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:19:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.684+0000 7fbc378d3640 1 -- 172.21.15.6:0/1974603964 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbc1c0a2b90 msgr2=0x7fbc1c0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.684+0000 7fbc378d3640 1 --2- 172.21.15.6:0/1974603964 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbc1c0a2b90 0x7fbc1c0a50a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbc30102580 tx=0x7fbc2c005e70 comp rx=0 tx=0).stop 2024-05-20T17:19:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.684+0000 7fbc378d3640 1 -- 172.21.15.6:0/1974603964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc30102bc0 msgr2=0x7fbc30199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.684+0000 7fbc378d3640 1 --2- 172.21.15.6:0/1974603964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc30102bc0 0x7fbc30199660 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000d950 tx=0x7fbc2000de10 comp rx=0 tx=0).stop 2024-05-20T17:19:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.684+0000 7fbc378d3640 1 -- 172.21.15.6:0/1974603964 shutdown_connections 2024-05-20T17:19:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.684+0000 7fbc378d3640 1 --2- 172.21.15.6:0/1974603964 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fbc1c0a2b90 0x7fbc1c0a50a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.684+0000 7fbc378d3640 1 --2- 172.21.15.6:0/1974603964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc301078c0 0x7fbc301a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.684+0000 7fbc378d3640 1 --2- 172.21.15.6:0/1974603964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc30102bc0 0x7fbc30199660 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.684+0000 7fbc378d3640 1 --2- 172.21.15.6:0/1974603964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc30101980 0x7fbc30199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.684+0000 7fbc378d3640 1 -- 172.21.15.6:0/1974603964 >> 172.21.15.6:0/1974603964 conn(0x7fbc300fcb70 msgr2=0x7fbc30108d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:58.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.685+0000 7fbc378d3640 1 -- 172.21.15.6:0/1974603964 shutdown_connections 2024-05-20T17:19:58.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.685+0000 7fbc378d3640 1 -- 172.21.15.6:0/1974603964 wait complete. 2024-05-20T17:19:58.698 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:19:58.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.813+0000 7f17dd2fe640 1 -- 172.21.15.6:0/3852490941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d81027e0 msgr2=0x7f17d8102bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:58.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.813+0000 7f17dd2fe640 1 --2- 172.21.15.6:0/3852490941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d81027e0 0x7f17d8102bf0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f17cc009900 tx=0x7f17cc02a410 comp rx=0 tx=0).stop 2024-05-20T17:19:58.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.813+0000 7f17dd2fe640 1 -- 172.21.15.6:0/3852490941 shutdown_connections 2024-05-20T17:19:58.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.813+0000 7f17dd2fe640 1 --2- 172.21.15.6:0/3852490941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17d8108a20 0x7f17d810ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.813+0000 7f17dd2fe640 1 --2- 172.21.15.6:0/3852490941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d81027e0 0x7f17d8102bf0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.813+0000 7f17dd2fe640 1 --2- 172.21.15.6:0/3852490941 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17d8104120 0x7f17d81022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.813+0000 7f17dd2fe640 1 -- 172.21.15.6:0/3852490941 >> 172.21.15.6:0/3852490941 conn(0x7f17d80fdcf0 msgr2=0x7f17d8100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:58.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.813+0000 7f17dd2fe640 1 -- 172.21.15.6:0/3852490941 shutdown_connections 2024-05-20T17:19:58.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.813+0000 7f17dd2fe640 1 -- 172.21.15.6:0/3852490941 wait complete. 2024-05-20T17:19:58.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.814+0000 7f17dd2fe640 1 Processor -- start 2024-05-20T17:19:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.814+0000 7f17dd2fe640 1 -- start start 2024-05-20T17:19:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.814+0000 7f17dd2fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17d81027e0 0x7f17d81992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.814+0000 7f17dd2fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d8104120 0x7f17d8199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.814+0000 7f17dd2fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17d8108a20 0x7f17d81a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.814+0000 7f17dd2fe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f17d810e720 con 0x7f17d8104120 2024-05-20T17:19:58.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.814+0000 7f17dd2fe640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f17d810e5a0 con 0x7f17d81027e0 2024-05-20T17:19:58.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.814+0000 7f17dd2fe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f17d810e8a0 con 0x7f17d8108a20 2024-05-20T17:19:58.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.814+0000 7f17d67fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d8104120 0x7f17d8199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:58.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.814+0000 7f17d67fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d8104120 0x7f17d8199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41850/0 (socket says 172.21.15.6:41850) 2024-05-20T17:19:58.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.814+0000 7f17d67fc640 1 -- 172.21.15.6:0/1418386919 learned_addr learned my addr 172.21.15.6:0/1418386919 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:19:58.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.814+0000 7f17d77fe640 1 --2- 172.21.15.6:0/1418386919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17d8108a20 0x7f17d81a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:58.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.814+0000 7f17d6ffd640 1 --2- 172.21.15.6:0/1418386919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17d81027e0 0x7f17d81992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:58.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.815+0000 7f17d67fc640 1 -- 172.21.15.6:0/1418386919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17d8108a20 msgr2=0x7f17d81a07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:58.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.815+0000 7f17d67fc640 1 --2- 172.21.15.6:0/1418386919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17d8108a20 0x7f17d81a07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.815+0000 7f17d67fc640 1 -- 172.21.15.6:0/1418386919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17d81027e0 msgr2=0x7f17d81992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:58.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.815+0000 7f17d67fc640 1 --2- 172.21.15.6:0/1418386919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17d81027e0 0x7f17d81992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:58.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.815+0000 7f17d67fc640 1 -- 172.21.15.6:0/1418386919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d81a0e30 con 0x7f17d8104120 2024-05-20T17:19:58.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.815+0000 7f17d67fc640 1 --2- 172.21.15.6:0/1418386919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d8104120 0x7f17d8199830 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f17cc031440 tx=0x7f17cc0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:58.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.815+0000 7f17bffff640 1 -- 172.21.15.6:0/1418386919 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc03f030 con 0x7f17d8104120 2024-05-20T17:19:58.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.815+0000 7f17bffff640 1 -- 172.21.15.6:0/1418386919 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f17cc003cb0 con 0x7f17d8104120 2024-05-20T17:19:58.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.815+0000 7f17dd2fe640 1 -- 172.21.15.6:0/1418386919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17d81a10c0 con 0x7f17d8104120 2024-05-20T17:19:58.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.815+0000 7f17bffff640 1 -- 172.21.15.6:0/1418386919 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc035070 con 0x7f17d8104120 2024-05-20T17:19:58.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.815+0000 7f17dd2fe640 1 -- 172.21.15.6:0/1418386919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17d81a15b0 con 0x7f17d8104120 2024-05-20T17:19:58.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.816+0000 7f17dd2fe640 1 -- 172.21.15.6:0/1418386919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17d80691c0 con 0x7f17d8104120 2024-05-20T17:19:58.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.817+0000 7f17bffff640 1 -- 172.21.15.6:0/1418386919 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f17cc042030 con 0x7f17d8104120 2024-05-20T17:19:58.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.818+0000 7f17bffff640 1 --2- 172.21.15.6:0/1418386919 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f17c00a2b90 0x7f17c00a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:19:58.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.818+0000 7f17d6ffd640 1 --2- 172.21.15.6:0/1418386919 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f17c00a2b90 0x7f17c00a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:19:58.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.818+0000 7f17bffff640 1 -- 172.21.15.6:0/1418386919 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f17cc0efff0 con 0x7f17d8104120 2024-05-20T17:19:58.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.819+0000 7f17d6ffd640 1 --2- 172.21.15.6:0/1418386919 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f17c00a2b90 0x7f17c00a50a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f17c8005fd0 tx=0x7f17c800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:19:58.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:58.822+0000 7f17bffff640 1 -- 172.21.15.6:0/1418386919 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f17cc0bc550 con 0x7f17d8104120 2024-05-20T17:19:58.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:58 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1019584699' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:19:58.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:58 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2538404905' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:19:58.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:58 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/2187425286' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:19:59.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:59.019+0000 7f17dd2fe640 1 -- 172.21.15.6:0/1418386919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f17d8107830 con 0x7f17d8104120 2024-05-20T17:19:59.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:59.020+0000 7f17bffff640 1 -- 172.21.15.6:0/1418386919 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v94) ==== 81+0+579 (secure 0 0 0) 0x7f17cc0c0850 con 0x7f17d8104120 2024-05-20T17:19:59.021 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/3509827796 2024-05-21T16:57:41.985704+0000 2024-05-20T17:19:59.021 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/3509827796 2024-05-21T16:57:41.985704+0000 2024-05-20T17:19:59.021 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/173523304 2024-05-21T16:57:41.985704+0000 2024-05-20T17:19:59.021 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/741681069 2024-05-21T16:57:14.356112+0000 2024-05-20T17:19:59.022 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2415124466 2024-05-21T16:57:14.356112+0000 2024-05-20T17:19:59.022 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3427029758 2024-05-21T16:57:14.356112+0000 2024-05-20T17:19:59.022 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/741681069 2024-05-21T16:57:14.356112+0000 2024-05-20T17:19:59.022 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3324031224 2024-05-21T16:57:14.356112+0000 2024-05-20T17:19:59.022 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3781923966 2024-05-21T16:57:41.985704+0000 2024-05-20T17:19:59.022 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2979361383 2024-05-21T16:57:41.985704+0000 2024-05-20T17:19:59.023 INFO:teuthology.orchestra.run.smithi006.stderr:listed 10 entries 2024-05-20T17:19:59.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:59.022+0000 7f17dd2fe640 1 -- 172.21.15.6:0/1418386919 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f17c00a2b90 msgr2=0x7f17c00a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:59.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:59.022+0000 7f17dd2fe640 1 --2- 172.21.15.6:0/1418386919 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f17c00a2b90 0x7f17c00a50a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f17c8005fd0 tx=0x7f17c800b390 comp rx=0 tx=0).stop 2024-05-20T17:19:59.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:59.022+0000 7f17dd2fe640 1 -- 172.21.15.6:0/1418386919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d8104120 msgr2=0x7f17d8199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:19:59.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:59.022+0000 7f17dd2fe640 1 --2- 172.21.15.6:0/1418386919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d8104120 0x7f17d8199830 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f17cc031440 tx=0x7f17cc0043b0 comp rx=0 tx=0).stop 2024-05-20T17:19:59.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:59.022+0000 7f17dd2fe640 1 -- 172.21.15.6:0/1418386919 shutdown_connections 2024-05-20T17:19:59.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:59.022+0000 7f17dd2fe640 1 --2- 172.21.15.6:0/1418386919 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f17c00a2b90 0x7f17c00a50a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:59.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:59.022+0000 7f17dd2fe640 1 --2- 172.21.15.6:0/1418386919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17d8108a20 0x7f17d81a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:59.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:59.022+0000 7f17dd2fe640 1 --2- 172.21.15.6:0/1418386919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d8104120 0x7f17d8199830 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:59.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:59.022+0000 7f17dd2fe640 1 --2- 172.21.15.6:0/1418386919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17d81027e0 0x7f17d81992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:19:59.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:59.022+0000 7f17dd2fe640 1 -- 172.21.15.6:0/1418386919 >> 172.21.15.6:0/1418386919 conn(0x7f17d80fdcf0 msgr2=0x7f17d8104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:19:59.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:59.022+0000 7f17dd2fe640 1 -- 172.21.15.6:0/1418386919 shutdown_connections 2024-05-20T17:19:59.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:19:59.022+0000 7f17dd2fe640 1 -- 172.21.15.6:0/1418386919 wait complete. 2024-05-20T17:19:59.024 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:58 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1019584699' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-20T17:19:59.024 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:58 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2538404905' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-20T17:19:59.025 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:58 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/2187425286' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-20T17:19:59.035 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2024-05-20T17:19:59.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:19:59.035 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-20T17:19:59.079 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:19:59.079 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[86272]: fuse finished with error 0 and tester_r 0 2024-05-20T17:19:59.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:59 smithi006 ceph-mon[32486]: pgmap v752: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:19:59.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:59 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1974603964' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:19:59.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:19:59 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1418386919' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-20T17:19:59.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:59 smithi171 ceph-mon[35901]: pgmap v752: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:19:59.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:59 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1974603964' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:19:59.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:19:59 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1418386919' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-20T17:20:00.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:59 smithi062 ceph-mon[35425]: pgmap v752: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-20T17:20:00.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:59 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1974603964' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-20T17:20:00.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:19:59 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1418386919' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-20T17:20:00.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:00 smithi171 ceph-mon[35901]: overall HEALTH_OK 2024-05-20T17:20:00.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:00 smithi006 ceph-mon[32486]: overall HEALTH_OK 2024-05-20T17:20:01.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:00 smithi062 ceph-mon[35425]: overall HEALTH_OK 2024-05-20T17:20:01.856 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:01 smithi171 ceph-mon[35901]: pgmap v753: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 11 op/s 2024-05-20T17:20:01.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:01 smithi006 ceph-mon[32486]: pgmap v753: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 11 op/s 2024-05-20T17:20:02.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:01 smithi062 ceph-mon[35425]: pgmap v753: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 11 op/s 2024-05-20T17:20:03.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:03 smithi171 ceph-mon[35901]: pgmap v754: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-20T17:20:03.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:03 smithi006 ceph-mon[32486]: pgmap v754: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-20T17:20:04.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:03 smithi062 ceph-mon[35425]: pgmap v754: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-20T17:20:05.181 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T17:20:05.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:20:05.182 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-20T17:20:05.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:20:05.221 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T17:20:05.301 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-20T17:20:05.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:20:05.302 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T17:20:05.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:20:05.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2024-05-20T17:20:05.502 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-20T17:20:05.512 INFO:tasks.cephadm:Teardown begin 2024-05-20T17:20:05.513 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-20T17:20:05.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:20:05.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:05 smithi006 ceph-mon[32486]: pgmap v755: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-20T17:20:05.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.634+0000 7f6ec3a0d640 1 -- 172.21.15.6:0/3896417083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ebc102bf0 msgr2=0x7f6ebc103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:05.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.634+0000 7f6ec3a0d640 1 --2- 172.21.15.6:0/3896417083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ebc102bf0 0x7f6ebc103000 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6eac009900 tx=0x7f6eac02a410 comp rx=0 tx=0).stop 2024-05-20T17:20:05.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.634+0000 7f6ec3a0d640 1 -- 172.21.15.6:0/3896417083 shutdown_connections 2024-05-20T17:20:05.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.634+0000 7f6ec3a0d640 1 --2- 172.21.15.6:0/3896417083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ebc1078f0 0x7f6ebc109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:05.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.634+0000 7f6ec3a0d640 1 --2- 172.21.15.6:0/3896417083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ebc102bf0 0x7f6ebc103000 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:05.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.634+0000 7f6ec3a0d640 1 --2- 172.21.15.6:0/3896417083 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ebc1019b0 0x7f6ebc1026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:05.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.634+0000 7f6ec3a0d640 1 -- 172.21.15.6:0/3896417083 >> 172.21.15.6:0/3896417083 conn(0x7f6ebc0fcba0 msgr2=0x7f6ebc0ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:20:05.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.634+0000 7f6ec3a0d640 1 -- 172.21.15.6:0/3896417083 shutdown_connections 2024-05-20T17:20:05.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.634+0000 7f6ec3a0d640 1 -- 172.21.15.6:0/3896417083 wait complete. 2024-05-20T17:20:05.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.634+0000 7f6ec3a0d640 1 Processor -- start 2024-05-20T17:20:05.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.634+0000 7f6ec3a0d640 1 -- start start 2024-05-20T17:20:05.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.635+0000 7f6ec3a0d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ebc1019b0 0x7f6ebc198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:05.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.635+0000 7f6ec3a0d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ebc102bf0 0x7f6ebc1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:05.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.635+0000 7f6ec3a0d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ebc1078f0 0x7f6ebc19f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:05.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.635+0000 7f6ec3a0d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc10d4d0 con 0x7f6ebc102bf0 2024-05-20T17:20:05.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.635+0000 7f6ec3a0d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc10d350 con 0x7f6ebc1019b0 2024-05-20T17:20:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.635+0000 7f6ec3a0d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc10d650 con 0x7f6ebc1078f0 2024-05-20T17:20:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.635+0000 7f6ec0fa8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ebc102bf0 0x7f6ebc1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.635+0000 7f6ec0fa8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ebc102bf0 0x7f6ebc1985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60730/0 (socket says 172.21.15.6:60730) 2024-05-20T17:20:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.635+0000 7f6ec0fa8640 1 -- 172.21.15.6:0/3925540021 learned_addr learned my addr 172.21.15.6:0/3925540021 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:20:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.635+0000 7f6ec17a9640 1 --2- 172.21.15.6:0/3925540021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ebc1019b0 0x7f6ebc198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.635+0000 7f6ec1faa640 1 --2- 172.21.15.6:0/3925540021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ebc1078f0 0x7f6ebc19f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.635+0000 7f6ec0fa8640 1 -- 172.21.15.6:0/3925540021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ebc1078f0 msgr2=0x7f6ebc19f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.635+0000 7f6ec0fa8640 1 --2- 172.21.15.6:0/3925540021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ebc1078f0 0x7f6ebc19f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.635+0000 7f6ec0fa8640 1 -- 172.21.15.6:0/3925540021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ebc1019b0 msgr2=0x7f6ebc198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.635+0000 7f6ec0fa8640 1 --2- 172.21.15.6:0/3925540021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ebc1019b0 0x7f6ebc198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.635+0000 7f6ec0fa8640 1 -- 172.21.15.6:0/3925540021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ebc19fbb0 con 0x7f6ebc102bf0 2024-05-20T17:20:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.635+0000 7f6ec17a9640 1 --2- 172.21.15.6:0/3925540021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ebc1019b0 0x7f6ebc198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:20:05.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.635+0000 7f6ec1faa640 1 --2- 172.21.15.6:0/3925540021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ebc1078f0 0x7f6ebc19f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:20:05.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.635+0000 7f6ec0fa8640 1 --2- 172.21.15.6:0/3925540021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ebc102bf0 0x7f6ebc1985b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6eac004770 tx=0x7f6eac004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:20:05.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.636+0000 7f6eb27fc640 1 -- 172.21.15.6:0/3925540021 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac03f030 con 0x7f6ebc102bf0 2024-05-20T17:20:05.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.636+0000 7f6eb27fc640 1 -- 172.21.15.6:0/3925540021 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6eac003aa0 con 0x7f6ebc102bf0 2024-05-20T17:20:05.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.636+0000 7f6eb27fc640 1 -- 172.21.15.6:0/3925540021 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac035070 con 0x7f6ebc102bf0 2024-05-20T17:20:05.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.636+0000 7f6ec3a0d640 1 -- 172.21.15.6:0/3925540021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ebc19fe40 con 0x7f6ebc102bf0 2024-05-20T17:20:05.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.636+0000 7f6ec3a0d640 1 -- 172.21.15.6:0/3925540021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ebc1a02a0 con 0x7f6ebc102bf0 2024-05-20T17:20:05.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.637+0000 7f6ec3a0d640 1 -- 172.21.15.6:0/3925540021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ebc106700 con 0x7f6ebc102bf0 2024-05-20T17:20:05.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.638+0000 7f6eb27fc640 1 -- 172.21.15.6:0/3925540021 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f6eac042030 con 0x7f6ebc102bf0 2024-05-20T17:20:05.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.639+0000 7f6eb27fc640 1 --2- 172.21.15.6:0/3925540021 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6ea80a2cb0 0x7f6ea80a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:05.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.639+0000 7f6ec17a9640 1 --2- 172.21.15.6:0/3925540021 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6ea80a2cb0 0x7f6ea80a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:05.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.639+0000 7f6eb27fc640 1 -- 172.21.15.6:0/3925540021 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f6eac0f02c0 con 0x7f6ebc102bf0 2024-05-20T17:20:05.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.639+0000 7f6ec17a9640 1 --2- 172.21.15.6:0/3925540021 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6ea80a2cb0 0x7f6ea80a51c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc1025b0 tx=0x7f6eb8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:20:05.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.642+0000 7f6eb27fc640 1 -- 172.21.15.6:0/3925540021 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6eac0bce70 con 0x7f6ebc102bf0 2024-05-20T17:20:05.839 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:05 smithi062 ceph-mon[35425]: pgmap v755: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-20T17:20:05.866 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:05 smithi171 ceph-mon[35901]: pgmap v755: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-20T17:20:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.869+0000 7f6ec3a0d640 1 -- 172.21.15.6:0/3925540021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ebc02d2a0 con 0x7f6ebc102bf0 2024-05-20T17:20:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.870+0000 7f6eb27fc640 1 -- 172.21.15.6:0/3925540021 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11915 (secure 0 0 0) 0x7f6eac0bc770 con 0x7f6ebc102bf0 2024-05-20T17:20:05.872 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:20:05.872 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:05:04.455743+0000","modified":"2024-05-20T17:19:10.106096+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24548,"mds_1":24526,"mds_2":24484,"mds_3":24470,"mds_4":24440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/3061403904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":3061403904},{"type":"v1","addr":"172.21.15.6:6839","nonce":3061403904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/223306009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":223306009},{"type":"v1","addr":"172.21.15.6:6841","nonce":223306009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.62:6835/78063155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":78063155},{"type":"v1","addr":"172.21.15.62:6835","nonce":78063155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.171:6835/1542537621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1542537621},{"type":"v1","addr":"172.21.15.171:6835","nonce":1542537621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/732693575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":732693575},{"type":"v1","addr":"172.21.15.171:6837","nonce":732693575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6837/1745943929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1745943929},{"type":"v1","addr":"172.21.15.62:6837","nonce":1745943929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.171:6839/3246292303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3246292303},{"type":"v1","addr":"172.21.15.171:6839","nonce":3246292303}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6839/3023093487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3023093487},{"type":"v1","addr":"172.21.15.62:6839","nonce":3023093487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24548,"qdb_cluster":[24548,24440,24526,24484,24470]},"id":1}]} 2024-05-20T17:20:05.872 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 34 2024-05-20T17:20:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.872+0000 7f6ec3a0d640 1 -- 172.21.15.6:0/3925540021 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6ea80a2cb0 msgr2=0x7f6ea80a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.872+0000 7f6ec3a0d640 1 --2- 172.21.15.6:0/3925540021 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6ea80a2cb0 0x7f6ea80a51c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc1025b0 tx=0x7f6eb8005f90 comp rx=0 tx=0).stop 2024-05-20T17:20:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.872+0000 7f6ec3a0d640 1 -- 172.21.15.6:0/3925540021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ebc102bf0 msgr2=0x7f6ebc1985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.872+0000 7f6ec3a0d640 1 --2- 172.21.15.6:0/3925540021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ebc102bf0 0x7f6ebc1985b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6eac004770 tx=0x7f6eac004270 comp rx=0 tx=0).stop 2024-05-20T17:20:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.872+0000 7f6ec3a0d640 1 -- 172.21.15.6:0/3925540021 shutdown_connections 2024-05-20T17:20:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.872+0000 7f6ec3a0d640 1 --2- 172.21.15.6:0/3925540021 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f6ea80a2cb0 0x7f6ea80a51c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.872+0000 7f6ec3a0d640 1 --2- 172.21.15.6:0/3925540021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ebc1078f0 0x7f6ebc19f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:05.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.872+0000 7f6ec3a0d640 1 --2- 172.21.15.6:0/3925540021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ebc102bf0 0x7f6ebc1985b0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:05.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.872+0000 7f6ec3a0d640 1 --2- 172.21.15.6:0/3925540021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ebc1019b0 0x7f6ebc198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:05.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.872+0000 7f6ec3a0d640 1 -- 172.21.15.6:0/3925540021 >> 172.21.15.6:0/3925540021 conn(0x7f6ebc0fcba0 msgr2=0x7f6ebc1038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:20:05.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.873+0000 7f6ec3a0d640 1 -- 172.21.15.6:0/3925540021 shutdown_connections 2024-05-20T17:20:05.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.873+0000 7f6ec3a0d640 1 -- 172.21.15.6:0/3925540021 wait complete. 2024-05-20T17:20:05.886 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:20:06.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.999+0000 7f7d10a7a640 1 -- 172.21.15.6:0/2282342619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d0c107080 msgr2=0x7f7d0c1094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:06.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.999+0000 7f7d10a7a640 1 --2- 172.21.15.6:0/2282342619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d0c107080 0x7f7d0c1094a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7d04009ca0 tx=0x7f7d0402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.999+0000 7f7d10a7a640 1 -- 172.21.15.6:0/2282342619 shutdown_connections 2024-05-20T17:20:06.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.999+0000 7f7d10a7a640 1 --2- 172.21.15.6:0/2282342619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d0c107080 0x7f7d0c1094a0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.999+0000 7f7d10a7a640 1 --2- 172.21.15.6:0/2282342619 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d0c102380 0x7f7d0c102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.999+0000 7f7d10a7a640 1 --2- 172.21.15.6:0/2282342619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d0c101140 0x7f7d0c101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.999+0000 7f7d10a7a640 1 -- 172.21.15.6:0/2282342619 >> 172.21.15.6:0/2282342619 conn(0x7f7d0c0fc330 msgr2=0x7f7d0c0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:20:06.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.999+0000 7f7d10a7a640 1 -- 172.21.15.6:0/2282342619 shutdown_connections 2024-05-20T17:20:06.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:05.999+0000 7f7d10a7a640 1 -- 172.21.15.6:0/2282342619 wait complete. 2024-05-20T17:20:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.000+0000 7f7d10a7a640 1 Processor -- start 2024-05-20T17:20:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.000+0000 7f7d10a7a640 1 -- start start 2024-05-20T17:20:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.000+0000 7f7d10a7a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d0c101140 0x7f7d0c1990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.000+0000 7f7d10a7a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d0c102380 0x7f7d0c1995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.000+0000 7f7d10a7a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d0c107080 0x7f7d0c1a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.000+0000 7f7d10a7a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0c10c3d0 con 0x7f7d0c101140 2024-05-20T17:20:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.000+0000 7f7d10a7a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0c10c250 con 0x7f7d0c102380 2024-05-20T17:20:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.000+0000 7f7d10a7a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0c10c550 con 0x7f7d0c107080 2024-05-20T17:20:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.001+0000 7f7d0a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d0c101140 0x7f7d0c1990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:06.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.001+0000 7f7d0a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d0c101140 0x7f7d0c1990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60748/0 (socket says 172.21.15.6:60748) 2024-05-20T17:20:06.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.001+0000 7f7d0a59c640 1 -- 172.21.15.6:0/3553808708 learned_addr learned my addr 172.21.15.6:0/3553808708 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:20:06.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.001+0000 7f7d01d9b640 1 --2- 172.21.15.6:0/3553808708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d0c102380 0x7f7d0c1995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:06.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.001+0000 7f7d0ad9d640 1 --2- 172.21.15.6:0/3553808708 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d0c107080 0x7f7d0c1a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:06.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.001+0000 7f7d0a59c640 1 -- 172.21.15.6:0/3553808708 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d0c107080 msgr2=0x7f7d0c1a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:06.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.001+0000 7f7d0a59c640 1 --2- 172.21.15.6:0/3553808708 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d0c107080 0x7f7d0c1a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.001+0000 7f7d0a59c640 1 -- 172.21.15.6:0/3553808708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d0c102380 msgr2=0x7f7d0c1995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:06.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.001+0000 7f7d0a59c640 1 --2- 172.21.15.6:0/3553808708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d0c102380 0x7f7d0c1995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.001+0000 7f7d0a59c640 1 -- 172.21.15.6:0/3553808708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0c1a0be0 con 0x7f7d0c101140 2024-05-20T17:20:06.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.001+0000 7f7d01d9b640 1 --2- 172.21.15.6:0/3553808708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d0c102380 0x7f7d0c1995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:20:06.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.001+0000 7f7d0a59c640 1 --2- 172.21.15.6:0/3553808708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d0c101140 0x7f7d0c1990a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc005fd0 tx=0x7f7cfc00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:20:06.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.001+0000 7f7d03fff640 1 -- 172.21.15.6:0/3553808708 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc017070 con 0x7f7d0c101140 2024-05-20T17:20:06.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.001+0000 7f7d03fff640 1 -- 172.21.15.6:0/3553808708 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7cfc009c30 con 0x7f7d0c101140 2024-05-20T17:20:06.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.001+0000 7f7d10a7a640 1 -- 172.21.15.6:0/3553808708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d0c1a0ed0 con 0x7f7d0c101140 2024-05-20T17:20:06.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.001+0000 7f7d03fff640 1 -- 172.21.15.6:0/3553808708 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc003d10 con 0x7f7d0c101140 2024-05-20T17:20:06.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.001+0000 7f7d10a7a640 1 -- 172.21.15.6:0/3553808708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d0c1a1330 con 0x7f7d0c101140 2024-05-20T17:20:06.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.003+0000 7f7d10a7a640 1 -- 172.21.15.6:0/3553808708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d0c0691f0 con 0x7f7d0c101140 2024-05-20T17:20:06.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.004+0000 7f7d03fff640 1 -- 172.21.15.6:0/3553808708 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f7cfc003eb0 con 0x7f7d0c101140 2024-05-20T17:20:06.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.005+0000 7f7d03fff640 1 --2- 172.21.15.6:0/3553808708 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7cf80a2c30 0x7f7cf80a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:06.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.005+0000 7f7d01d9b640 1 --2- 172.21.15.6:0/3553808708 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7cf80a2c30 0x7f7cf80a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:06.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.005+0000 7f7d03fff640 1 -- 172.21.15.6:0/3553808708 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f7cfc0cf920 con 0x7f7d0c101140 2024-05-20T17:20:06.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.005+0000 7f7d01d9b640 1 --2- 172.21.15.6:0/3553808708 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7cf80a2c30 0x7f7cf80a5140 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c19a140 tx=0x7f7cf4010040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:20:06.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.009+0000 7f7d03fff640 1 -- 172.21.15.6:0/3553808708 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7d0c0691f0 con 0x7f7d0c101140 2024-05-20T17:20:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.234+0000 7f7d10a7a640 1 -- 172.21.15.6:0/3553808708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d0c02d340 con 0x7f7d0c101140 2024-05-20T17:20:06.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.235+0000 7f7d03fff640 1 -- 172.21.15.6:0/3553808708 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11915 (secure 0 0 0) 0x7f7cfc020030 con 0x7f7d0c101140 2024-05-20T17:20:06.236 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:20:06.236 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1420996362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1420996362},{"type":"v1","addr":"172.21.15.6:6835","nonce":1420996362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1881023641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1881023641},{"type":"v1","addr":"172.21.15.6:6837","nonce":1881023641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-20T17:05:04.455743+0000","modified":"2024-05-20T17:19:10.106096+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24548,"mds_1":24526,"mds_2":24484,"mds_3":24470,"mds_4":24440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14631":{"gid":14631,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/3061403904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":3061403904},{"type":"v1","addr":"172.21.15.6:6839","nonce":3061403904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14643":{"gid":14643,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/223306009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":223306009},{"type":"v1","addr":"172.21.15.6:6841","nonce":223306009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1476847062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1476847062},{"type":"v1","addr":"172.21.15.171:6833","nonce":1476847062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"k","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.62:6833/3854589553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3854589553},{"type":"v1","addr":"172.21.15.62:6833","nonce":3854589553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.62:6835/78063155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":78063155},{"type":"v1","addr":"172.21.15.62:6835","nonce":78063155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.171:6835/1542537621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1542537621},{"type":"v1","addr":"172.21.15.171:6835","nonce":1542537621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/732693575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":732693575},{"type":"v1","addr":"172.21.15.171:6837","nonce":732693575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.62:6837/1745943929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":1745943929},{"type":"v1","addr":"172.21.15.62:6837","nonce":1745943929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.171:6839/3246292303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":3246292303},{"type":"v1","addr":"172.21.15.171:6839","nonce":3246292303}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6839/3023093487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3023093487},{"type":"v1","addr":"172.21.15.62:6839","nonce":3023093487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24548,"qdb_cluster":[24548,24440,24526,24484,24470]},"id":1}]} 2024-05-20T17:20:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 34 2024-05-20T17:20:06.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.237+0000 7f7d10a7a640 1 -- 172.21.15.6:0/3553808708 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7cf80a2c30 msgr2=0x7f7cf80a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:06.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.237+0000 7f7d10a7a640 1 --2- 172.21.15.6:0/3553808708 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7cf80a2c30 0x7f7cf80a5140 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c19a140 tx=0x7f7cf4010040 comp rx=0 tx=0).stop 2024-05-20T17:20:06.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.237+0000 7f7d10a7a640 1 -- 172.21.15.6:0/3553808708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d0c101140 msgr2=0x7f7d0c1990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.237+0000 7f7d10a7a640 1 --2- 172.21.15.6:0/3553808708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d0c101140 0x7f7d0c1990a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc005fd0 tx=0x7f7cfc00dde0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.237+0000 7f7d10a7a640 1 -- 172.21.15.6:0/3553808708 shutdown_connections 2024-05-20T17:20:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.237+0000 7f7d10a7a640 1 --2- 172.21.15.6:0/3553808708 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7cf80a2c30 0x7f7cf80a5140 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.237+0000 7f7d10a7a640 1 --2- 172.21.15.6:0/3553808708 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d0c107080 0x7f7d0c1a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.237+0000 7f7d10a7a640 1 --2- 172.21.15.6:0/3553808708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d0c102380 0x7f7d0c1995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.237+0000 7f7d10a7a640 1 --2- 172.21.15.6:0/3553808708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d0c101140 0x7f7d0c1990a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.237+0000 7f7d10a7a640 1 -- 172.21.15.6:0/3553808708 >> 172.21.15.6:0/3553808708 conn(0x7f7d0c0fc330 msgr2=0x7f7d0c103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:20:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.237+0000 7f7d10a7a640 1 -- 172.21.15.6:0/3553808708 shutdown_connections 2024-05-20T17:20:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.237+0000 7f7d10a7a640 1 -- 172.21.15.6:0/3553808708 wait complete. 2024-05-20T17:20:06.251 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:20:06.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.365+0000 7f0636365640 1 -- 172.21.15.6:0/1613431518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06301019b0 msgr2=0x7f06301026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.365+0000 7f0636365640 1 --2- 172.21.15.6:0/1613431518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06301019b0 0x7f06301026b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0620009900 tx=0x7f062002a410 comp rx=0 tx=0).stop 2024-05-20T17:20:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.365+0000 7f0636365640 1 -- 172.21.15.6:0/1613431518 shutdown_connections 2024-05-20T17:20:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.365+0000 7f0636365640 1 --2- 172.21.15.6:0/1613431518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06301078f0 0x7f0630109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.365+0000 7f0636365640 1 --2- 172.21.15.6:0/1613431518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0630102bf0 0x7f0630103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.365+0000 7f0636365640 1 --2- 172.21.15.6:0/1613431518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06301019b0 0x7f06301026b0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.365+0000 7f0636365640 1 -- 172.21.15.6:0/1613431518 >> 172.21.15.6:0/1613431518 conn(0x7f06300fcba0 msgr2=0x7f06300ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:20:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.365+0000 7f0636365640 1 -- 172.21.15.6:0/1613431518 shutdown_connections 2024-05-20T17:20:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.365+0000 7f0636365640 1 -- 172.21.15.6:0/1613431518 wait complete. 2024-05-20T17:20:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.366+0000 7f0636365640 1 Processor -- start 2024-05-20T17:20:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.366+0000 7f0636365640 1 -- start start 2024-05-20T17:20:06.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.366+0000 7f0636365640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06301019b0 0x7f0630199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:06.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.366+0000 7f0636365640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0630102bf0 0x7f0630199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:06.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.366+0000 7f0636365640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06301078f0 0x7f06301a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:06.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.366+0000 7f0636365640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f063010e5e0 con 0x7f0630102bf0 2024-05-20T17:20:06.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.366+0000 7f0636365640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f063010e460 con 0x7f06301078f0 2024-05-20T17:20:06.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.366+0000 7f0636365640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f063010e760 con 0x7f06301019b0 2024-05-20T17:20:06.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.366+0000 7f062f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0630102bf0 0x7f0630199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:06.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.366+0000 7f062f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0630102bf0 0x7f0630199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60766/0 (socket says 172.21.15.6:60766) 2024-05-20T17:20:06.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.366+0000 7f062f7fe640 1 -- 172.21.15.6:0/1473931874 learned_addr learned my addr 172.21.15.6:0/1473931874 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:20:06.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.366+0000 7f0634902640 1 --2- 172.21.15.6:0/1473931874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06301078f0 0x7f06301a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:06.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.366+0000 7f062ffff640 1 --2- 172.21.15.6:0/1473931874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06301019b0 0x7f0630199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:06.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.366+0000 7f062f7fe640 1 -- 172.21.15.6:0/1473931874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06301019b0 msgr2=0x7f0630199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:06.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.366+0000 7f062f7fe640 1 --2- 172.21.15.6:0/1473931874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06301019b0 0x7f0630199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.366+0000 7f062f7fe640 1 -- 172.21.15.6:0/1473931874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06301078f0 msgr2=0x7f06301a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:06.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.366+0000 7f062f7fe640 1 --2- 172.21.15.6:0/1473931874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06301078f0 0x7f06301a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.366+0000 7f062f7fe640 1 -- 172.21.15.6:0/1473931874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06301a0c50 con 0x7f0630102bf0 2024-05-20T17:20:06.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.366+0000 7f062ffff640 1 --2- 172.21.15.6:0/1473931874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06301019b0 0x7f0630199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:20:06.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.367+0000 7f062f7fe640 1 --2- 172.21.15.6:0/1473931874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0630102bf0 0x7f0630199650 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f062400e9f0 tx=0x7f062400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:20:06.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.367+0000 7f062d7fa640 1 -- 172.21.15.6:0/1473931874 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062400cd80 con 0x7f0630102bf0 2024-05-20T17:20:06.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.367+0000 7f062d7fa640 1 -- 172.21.15.6:0/1473931874 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f06240108e0 con 0x7f0630102bf0 2024-05-20T17:20:06.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.367+0000 7f0636365640 1 -- 172.21.15.6:0/1473931874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06301a0f40 con 0x7f0630102bf0 2024-05-20T17:20:06.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.367+0000 7f062d7fa640 1 -- 172.21.15.6:0/1473931874 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0624018920 con 0x7f0630102bf0 2024-05-20T17:20:06.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.367+0000 7f0636365640 1 -- 172.21.15.6:0/1473931874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06301a13a0 con 0x7f0630102bf0 2024-05-20T17:20:06.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.368+0000 7f0636365640 1 -- 172.21.15.6:0/1473931874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0630106700 con 0x7f0630102bf0 2024-05-20T17:20:06.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.370+0000 7f062d7fa640 1 -- 172.21.15.6:0/1473931874 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f0624010a90 con 0x7f0630102bf0 2024-05-20T17:20:06.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.371+0000 7f062d7fa640 1 --2- 172.21.15.6:0/1473931874 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f06180a2c30 0x7f06180a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:06.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.371+0000 7f062d7fa640 1 -- 172.21.15.6:0/1473931874 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f06240cfca0 con 0x7f0630102bf0 2024-05-20T17:20:06.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.371+0000 7f062ffff640 1 --2- 172.21.15.6:0/1473931874 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f06180a2c30 0x7f06180a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:06.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.372+0000 7f062ffff640 1 --2- 172.21.15.6:0/1473931874 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f06180a2c30 0x7f06180a5140 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0620006010 tx=0x7f06200314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:20:06.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.375+0000 7f062d7fa640 1 -- 172.21.15.6:0/1473931874 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f062409c850 con 0x7f0630102bf0 2024-05-20T17:20:06.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.562+0000 7f0636365640 1 -- 172.21.15.6:0/1473931874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0630062780 con 0x7f0630102bf0 2024-05-20T17:20:06.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.563+0000 7f062d7fa640 1 -- 172.21.15.6:0/1473931874 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+24584 (secure 0 0 0) 0x7f062409c150 con 0x7f0630102bf0 2024-05-20T17:20:06.565 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:20:06.565 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":94,"fsid":"c726c954-16c9-11ef-bc9a-c7b262605968","created":"2024-05-20T16:56:45.111458+0000","modified":"2024-05-20T17:06:44.581646+0000","last_up_change":"2024-05-20T17:04:11.182801+0000","last_in_change":"2024-05-20T17:03:50.058725+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:00:12.516679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:05:02.947896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:05:03.842231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:05:07.551471+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7fee8c26-c79a-4b9d-aa3a-d31d00941060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6803","nonce":25625798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6805","nonce":25625798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6809","nonce":25625798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":25625798},{"type":"v1","addr":"172.21.15.6:6807","nonce":25625798}]},"public_addr":"172.21.15.6:6803/25625798","cluster_addr":"172.21.15.6:6805/25625798","heartbeat_back_addr":"172.21.15.6:6809/25625798","heartbeat_front_addr":"172.21.15.6:6807/25625798","state":["exists","up"]},{"osd":1,"uuid":"f5f34ba7-73bc-4b7c-b02e-be24d5f9b458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6801","nonce":2080543878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6803","nonce":2080543878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6807","nonce":2080543878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2080543878},{"type":"v1","addr":"172.21.15.62:6805","nonce":2080543878}]},"public_addr":"172.21.15.62:6801/2080543878","cluster_addr":"172.21.15.62:6803/2080543878","heartbeat_back_addr":"172.21.15.62:6807/2080543878","heartbeat_front_addr":"172.21.15.62:6805/2080543878","state":["exists","up"]},{"osd":2,"uuid":"e3ceaced-2797-4274-8b88-18b9c6dedb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6801","nonce":56436737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6803","nonce":56436737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6807","nonce":56436737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":56436737},{"type":"v1","addr":"172.21.15.171:6805","nonce":56436737}]},"public_addr":"172.21.15.171:6801/56436737","cluster_addr":"172.21.15.171:6803/56436737","heartbeat_back_addr":"172.21.15.171:6807/56436737","heartbeat_front_addr":"172.21.15.171:6805/56436737","state":["exists","up"]},{"osd":3,"uuid":"8eabe078-e351-4877-9954-b472a88ca266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6811","nonce":4226183924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6813","nonce":4226183924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6817","nonce":4226183924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4226183924},{"type":"v1","addr":"172.21.15.6:6815","nonce":4226183924}]},"public_addr":"172.21.15.6:6811/4226183924","cluster_addr":"172.21.15.6:6813/4226183924","heartbeat_back_addr":"172.21.15.6:6817/4226183924","heartbeat_front_addr":"172.21.15.6:6815/4226183924","state":["exists","up"]},{"osd":4,"uuid":"20b150c9-3f76-40f5-af1d-9dc70923637a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6809","nonce":1161846805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6811","nonce":1161846805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6815","nonce":1161846805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1161846805},{"type":"v1","addr":"172.21.15.62:6813","nonce":1161846805}]},"public_addr":"172.21.15.62:6809/1161846805","cluster_addr":"172.21.15.62:6811/1161846805","heartbeat_back_addr":"172.21.15.62:6815/1161846805","heartbeat_front_addr":"172.21.15.62:6813/1161846805","state":["exists","up"]},{"osd":5,"uuid":"0183cc90-abec-4ad7-af28-03008fc59528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6809","nonce":2616695062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6811","nonce":2616695062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6815","nonce":2616695062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2616695062},{"type":"v1","addr":"172.21.15.171:6813","nonce":2616695062}]},"public_addr":"172.21.15.171:6809/2616695062","cluster_addr":"172.21.15.171:6811/2616695062","heartbeat_back_addr":"172.21.15.171:6815/2616695062","heartbeat_front_addr":"172.21.15.171:6813/2616695062","state":["exists","up"]},{"osd":6,"uuid":"b2be5095-5b84-41d2-ad24-7696926ebe47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6819","nonce":3806628023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6821","nonce":3806628023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6825","nonce":3806628023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3806628023},{"type":"v1","addr":"172.21.15.6:6823","nonce":3806628023}]},"public_addr":"172.21.15.6:6819/3806628023","cluster_addr":"172.21.15.6:6821/3806628023","heartbeat_back_addr":"172.21.15.6:6825/3806628023","heartbeat_front_addr":"172.21.15.6:6823/3806628023","state":["exists","up"]},{"osd":7,"uuid":"7b04311f-971f-4fff-b8bf-9b8103d97c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6817","nonce":598452691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6819","nonce":598452691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6823","nonce":598452691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":598452691},{"type":"v1","addr":"172.21.15.62:6821","nonce":598452691}]},"public_addr":"172.21.15.62:6817/598452691","cluster_addr":"172.21.15.62:6819/598452691","heartbeat_back_addr":"172.21.15.62:6823/598452691","heartbeat_front_addr":"172.21.15.62:6821/598452691","state":["exists","up"]},{"osd":8,"uuid":"d6c75e8b-23ac-4bfc-8621-11c533acf1a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6817","nonce":1159983887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6819","nonce":1159983887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6823","nonce":1159983887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1159983887},{"type":"v1","addr":"172.21.15.171:6821","nonce":1159983887}]},"public_addr":"172.21.15.171:6817/1159983887","cluster_addr":"172.21.15.171:6819/1159983887","heartbeat_back_addr":"172.21.15.171:6823/1159983887","heartbeat_front_addr":"172.21.15.171:6821/1159983887","state":["exists","up"]},{"osd":9,"uuid":"23515136-a538-4352-adf4-b988ea887720","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6827","nonce":500627917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6829","nonce":500627917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6833","nonce":500627917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":500627917},{"type":"v1","addr":"172.21.15.6:6831","nonce":500627917}]},"public_addr":"172.21.15.6:6827/500627917","cluster_addr":"172.21.15.6:6829/500627917","heartbeat_back_addr":"172.21.15.6:6833/500627917","heartbeat_front_addr":"172.21.15.6:6831/500627917","state":["exists","up"]},{"osd":10,"uuid":"5b0ed335-75bc-4a4a-aa69-c2d907d8cd7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6825","nonce":2012507198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6827","nonce":2012507198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6831","nonce":2012507198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2012507198},{"type":"v1","addr":"172.21.15.62:6829","nonce":2012507198}]},"public_addr":"172.21.15.62:6825/2012507198","cluster_addr":"172.21.15.62:6827/2012507198","heartbeat_back_addr":"172.21.15.62:6831/2012507198","heartbeat_front_addr":"172.21.15.62:6829/2012507198","state":["exists","up"]},{"osd":11,"uuid":"11cd0c8a-f493-4c30-8324-11adc674c650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6825","nonce":698174151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6827","nonce":698174151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6831","nonce":698174151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":698174151},{"type":"v1","addr":"172.21.15.171:6829","nonce":698174151}]},"public_addr":"172.21.15.171:6825/698174151","cluster_addr":"172.21.15.171:6827/698174151","heartbeat_back_addr":"172.21.15.171:6831/698174151","heartbeat_front_addr":"172.21.15.171:6829/698174151","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:20.004962+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T16:59:44.757895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:08.958650+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:00:37.385909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:03.702536+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:28.695270+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:01:55.529181+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:22.289750+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:02:47.901028+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:15.701563+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:03:41.926158+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:04:08.439316+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6801/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6800/3509827796":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/173523304":"2024-05-21T16:57:41.985704+0000","172.21.15.6:6801/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/2415124466":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3427029758":"2024-05-21T16:57:14.356112+0000","172.21.15.6:6800/741681069":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3324031224":"2024-05-21T16:57:14.356112+0000","172.21.15.6:0/3781923966":"2024-05-21T16:57:41.985704+0000","172.21.15.6:0/2979361383":"2024-05-21T16:57:41.985704+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:20:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.566+0000 7f0636365640 1 -- 172.21.15.6:0/1473931874 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f06180a2c30 msgr2=0x7f06180a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.566+0000 7f0636365640 1 --2- 172.21.15.6:0/1473931874 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f06180a2c30 0x7f06180a5140 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0620006010 tx=0x7f06200314a0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.566+0000 7f0636365640 1 -- 172.21.15.6:0/1473931874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0630102bf0 msgr2=0x7f0630199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.566+0000 7f0636365640 1 --2- 172.21.15.6:0/1473931874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0630102bf0 0x7f0630199650 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f062400e9f0 tx=0x7f062400eeb0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.566+0000 7f0636365640 1 -- 172.21.15.6:0/1473931874 shutdown_connections 2024-05-20T17:20:06.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.566+0000 7f0636365640 1 --2- 172.21.15.6:0/1473931874 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f06180a2c30 0x7f06180a5140 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.566+0000 7f0636365640 1 --2- 172.21.15.6:0/1473931874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06301078f0 0x7f06301a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.566+0000 7f0636365640 1 --2- 172.21.15.6:0/1473931874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0630102bf0 0x7f0630199650 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.566+0000 7f0636365640 1 --2- 172.21.15.6:0/1473931874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06301019b0 0x7f0630199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.566+0000 7f0636365640 1 -- 172.21.15.6:0/1473931874 >> 172.21.15.6:0/1473931874 conn(0x7f06300fcba0 msgr2=0x7f06301038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:20:06.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.566+0000 7f0636365640 1 -- 172.21.15.6:0/1473931874 shutdown_connections 2024-05-20T17:20:06.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.566+0000 7f0636365640 1 -- 172.21.15.6:0/1473931874 wait complete. 2024-05-20T17:20:06.579 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-20T17:20:06.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.694+0000 7f3a000ca640 1 -- 172.21.15.6:0/632903974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f8108740 msgr2=0x7f39f810ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:06.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.694+0000 7f3a000ca640 1 --2- 172.21.15.6:0/632903974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f8108740 0x7f39f810ac50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f39f0009ca0 tx=0x7f39f002a8c0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.694+0000 7f3a000ca640 1 -- 172.21.15.6:0/632903974 shutdown_connections 2024-05-20T17:20:06.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.694+0000 7f3a000ca640 1 --2- 172.21.15.6:0/632903974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f8108740 0x7f39f810ac50 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.694+0000 7f3a000ca640 1 --2- 172.21.15.6:0/632903974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39f8105bd0 0x7f39f81080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.694+0000 7f3a000ca640 1 --2- 172.21.15.6:0/632903974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39f81031e0 0x7f39f8105600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.694+0000 7f3a000ca640 1 -- 172.21.15.6:0/632903974 >> 172.21.15.6:0/632903974 conn(0x7f39f80fcbe0 msgr2=0x7f39f80ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:20:06.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.695+0000 7f3a000ca640 1 -- 172.21.15.6:0/632903974 shutdown_connections 2024-05-20T17:20:06.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.695+0000 7f3a000ca640 1 -- 172.21.15.6:0/632903974 wait complete. 2024-05-20T17:20:06.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.695+0000 7f3a000ca640 1 Processor -- start 2024-05-20T17:20:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.695+0000 7f3a000ca640 1 -- start start 2024-05-20T17:20:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.695+0000 7f3a000ca640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39f81031e0 0x7f39f81990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.695+0000 7f3a000ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f8105bd0 0x7f39f8199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.696+0000 7f3a000ca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39f8108740 0x7f39f81a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.696+0000 7f3a000ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f39f810e5b0 con 0x7f39f8105bd0 2024-05-20T17:20:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.696+0000 7f3a000ca640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f39f810e430 con 0x7f39f81031e0 2024-05-20T17:20:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.696+0000 7f3a000ca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f39f810e730 con 0x7f39f8108740 2024-05-20T17:20:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.696+0000 7f39fd665640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f8105bd0 0x7f39f8199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.696+0000 7f39fd665640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f8105bd0 0x7f39f8199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60776/0 (socket says 172.21.15.6:60776) 2024-05-20T17:20:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.696+0000 7f39fd665640 1 -- 172.21.15.6:0/842541662 learned_addr learned my addr 172.21.15.6:0/842541662 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:20:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.696+0000 7f39fde66640 1 --2- 172.21.15.6:0/842541662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39f81031e0 0x7f39f81990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.696+0000 7f39fe667640 1 --2- 172.21.15.6:0/842541662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39f8108740 0x7f39f81a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.696+0000 7f39fd665640 1 -- 172.21.15.6:0/842541662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39f8108740 msgr2=0x7f39f81a05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:06.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.696+0000 7f39fd665640 1 --2- 172.21.15.6:0/842541662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39f8108740 0x7f39f81a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.696+0000 7f39fd665640 1 -- 172.21.15.6:0/842541662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39f81031e0 msgr2=0x7f39f81990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:06.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.696+0000 7f39fd665640 1 --2- 172.21.15.6:0/842541662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39f81031e0 0x7f39f81990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.696+0000 7f39fd665640 1 -- 172.21.15.6:0/842541662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f81a0c20 con 0x7f39f8105bd0 2024-05-20T17:20:06.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.696+0000 7f39fd665640 1 --2- 172.21.15.6:0/842541662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f8105bd0 0x7f39f8199620 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f39e800ea60 tx=0x7f39e800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:20:06.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.696+0000 7f39eeffd640 1 -- 172.21.15.6:0/842541662 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e800cde0 con 0x7f39f8105bd0 2024-05-20T17:20:06.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.696+0000 7f39eeffd640 1 -- 172.21.15.6:0/842541662 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39e80035f0 con 0x7f39f8105bd0 2024-05-20T17:20:06.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.696+0000 7f3a000ca640 1 -- 172.21.15.6:0/842541662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f81a0f10 con 0x7f39f8105bd0 2024-05-20T17:20:06.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.696+0000 7f39eeffd640 1 -- 172.21.15.6:0/842541662 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e8010690 con 0x7f39f8105bd0 2024-05-20T17:20:06.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.696+0000 7f3a000ca640 1 -- 172.21.15.6:0/842541662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f81a13d0 con 0x7f39f8105bd0 2024-05-20T17:20:06.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.697+0000 7f3a000ca640 1 -- 172.21.15.6:0/842541662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39f80fe700 con 0x7f39f8105bd0 2024-05-20T17:20:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.699+0000 7f39eeffd640 1 -- 172.21.15.6:0/842541662 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f39e80037a0 con 0x7f39f8105bd0 2024-05-20T17:20:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.700+0000 7f39eeffd640 1 --2- 172.21.15.6:0/842541662 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f39e40a2c10 0x7f39e40a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.700+0000 7f39eeffd640 1 -- 172.21.15.6:0/842541662 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f39e80cf8e0 con 0x7f39f8105bd0 2024-05-20T17:20:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.700+0000 7f39fde66640 1 --2- 172.21.15.6:0/842541662 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f39e40a2c10 0x7f39e40a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.700+0000 7f39fde66640 1 --2- 172.21.15.6:0/842541662 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f39e40a2c10 0x7f39e40a5120 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f39f4005fd0 tx=0x7f39f400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:20:06.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.703+0000 7f39eeffd640 1 -- 172.21.15.6:0/842541662 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f39e8053850 con 0x7f39f8105bd0 2024-05-20T17:20:06.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:06 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3925540021' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:20:06.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:06 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3553808708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:20:06.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:06 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1473931874' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:20:06.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:06 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3925540021' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:20:06.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:06 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3553808708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:20:06.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:06 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1473931874' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:20:06.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.927+0000 7f3a000ca640 1 -- 172.21.15.6:0/842541662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f39f802d4f0 con 0x7f39f8105bd0 2024-05-20T17:20:06.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.929+0000 7f39eeffd640 1 -- 172.21.15.6:0/842541662 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) ==== 161+0+0 (secure 0 0 0) 0x7f39e809c490 con 0x7f39f8105bd0 2024-05-20T17:20:06.930 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-20T17:20:06.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.931+0000 7f3a000ca640 1 -- 172.21.15.6:0/842541662 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f39e40a2c10 msgr2=0x7f39e40a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:06.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.931+0000 7f3a000ca640 1 --2- 172.21.15.6:0/842541662 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f39e40a2c10 0x7f39e40a5120 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f39f4005fd0 tx=0x7f39f400b390 comp rx=0 tx=0).stop 2024-05-20T17:20:06.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.931+0000 7f3a000ca640 1 -- 172.21.15.6:0/842541662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f8105bd0 msgr2=0x7f39f8199620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:06.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.931+0000 7f3a000ca640 1 --2- 172.21.15.6:0/842541662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f8105bd0 0x7f39f8199620 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f39e800ea60 tx=0x7f39e800ef20 comp rx=0 tx=0).stop 2024-05-20T17:20:06.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.931+0000 7f3a000ca640 1 -- 172.21.15.6:0/842541662 shutdown_connections 2024-05-20T17:20:06.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.931+0000 7f3a000ca640 1 --2- 172.21.15.6:0/842541662 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f39e40a2c10 0x7f39e40a5120 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.931+0000 7f3a000ca640 1 --2- 172.21.15.6:0/842541662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39f8108740 0x7f39f81a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.931+0000 7f3a000ca640 1 --2- 172.21.15.6:0/842541662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f8105bd0 0x7f39f8199620 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.931+0000 7f3a000ca640 1 --2- 172.21.15.6:0/842541662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39f81031e0 0x7f39f81990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:06.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.931+0000 7f3a000ca640 1 -- 172.21.15.6:0/842541662 >> 172.21.15.6:0/842541662 conn(0x7f39f80fcbe0 msgr2=0x7f39f8103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:20:06.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.932+0000 7f3a000ca640 1 -- 172.21.15.6:0/842541662 shutdown_connections 2024-05-20T17:20:06.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:06.932+0000 7f3a000ca640 1 -- 172.21.15.6:0/842541662 wait complete. 2024-05-20T17:20:06.948 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-20T17:20:07.005 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:06 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3925540021' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:20:07.006 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:06 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3553808708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-20T17:20:07.006 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:06 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1473931874' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-20T17:20:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.071+0000 7fdce694c640 1 -- 172.21.15.6:0/2297019842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce0101980 msgr2=0x7fdce0102680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.071+0000 7fdce694c640 1 --2- 172.21.15.6:0/2297019842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce0101980 0x7fdce0102680 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009900 tx=0x7fdcd002a410 comp rx=0 tx=0).stop 2024-05-20T17:20:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.071+0000 7fdce694c640 1 -- 172.21.15.6:0/2297019842 shutdown_connections 2024-05-20T17:20:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.071+0000 7fdce694c640 1 --2- 172.21.15.6:0/2297019842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdce01078c0 0x7fdce0109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.071+0000 7fdce694c640 1 --2- 172.21.15.6:0/2297019842 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdce0102bc0 0x7fdce0102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.071+0000 7fdce694c640 1 --2- 172.21.15.6:0/2297019842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce0101980 0x7fdce0102680 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.071+0000 7fdce694c640 1 -- 172.21.15.6:0/2297019842 >> 172.21.15.6:0/2297019842 conn(0x7fdce00fcb70 msgr2=0x7fdce00ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:20:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.071+0000 7fdce694c640 1 -- 172.21.15.6:0/2297019842 shutdown_connections 2024-05-20T17:20:07.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.071+0000 7fdce694c640 1 -- 172.21.15.6:0/2297019842 wait complete. 2024-05-20T17:20:07.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.072+0000 7fdce694c640 1 Processor -- start 2024-05-20T17:20:07.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.072+0000 7fdce694c640 1 -- start start 2024-05-20T17:20:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.072+0000 7fdce694c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdce0101980 0x7fdce01991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.072+0000 7fdce694c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdce0102bc0 0x7fdce0199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.072+0000 7fdce694c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce01078c0 0x7fdce01a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.072+0000 7fdce694c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdce010d460 con 0x7fdce01078c0 2024-05-20T17:20:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.072+0000 7fdce694c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdce010d2e0 con 0x7fdce0102bc0 2024-05-20T17:20:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.072+0000 7fdce694c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdce010d5e0 con 0x7fdce0101980 2024-05-20T17:20:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.072+0000 7fdce4ee9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce01078c0 0x7fdce01a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.072+0000 7fdcdf7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdce0102bc0 0x7fdce0199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.072+0000 7fdce4ee9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce01078c0 0x7fdce01a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60832/0 (socket says 172.21.15.6:60832) 2024-05-20T17:20:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.072+0000 7fdcdf7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdce0102bc0 0x7fdce0199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.6:40796/0 (socket says 172.21.15.6:40796) 2024-05-20T17:20:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.072+0000 7fdce4ee9640 1 -- 172.21.15.6:0/1054706051 learned_addr learned my addr 172.21.15.6:0/1054706051 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:20:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.072+0000 7fdcdffff640 1 --2- 172.21.15.6:0/1054706051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdce0101980 0x7fdce01991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.073+0000 7fdce4ee9640 1 -- 172.21.15.6:0/1054706051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdce0101980 msgr2=0x7fdce01991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:07.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.073+0000 7fdce4ee9640 1 --2- 172.21.15.6:0/1054706051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdce0101980 0x7fdce01991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:07.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.073+0000 7fdce4ee9640 1 -- 172.21.15.6:0/1054706051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdce0102bc0 msgr2=0x7fdce0199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:07.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.073+0000 7fdce4ee9640 1 --2- 172.21.15.6:0/1054706051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdce0102bc0 0x7fdce0199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:07.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.073+0000 7fdce4ee9640 1 -- 172.21.15.6:0/1054706051 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce01a0d20 con 0x7fdce01078c0 2024-05-20T17:20:07.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.073+0000 7fdcdf7fe640 1 --2- 172.21.15.6:0/1054706051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdce0102bc0 0x7fdce0199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:20:07.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.073+0000 7fdce4ee9640 1 --2- 172.21.15.6:0/1054706051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce01078c0 0x7fdce01a06b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800efd0 tx=0x7fdcd800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:20:07.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.073+0000 7fdcdd7fa640 1 -- 172.21.15.6:0/1054706051 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8003b70 con 0x7fdce01078c0 2024-05-20T17:20:07.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.073+0000 7fdcdd7fa640 1 -- 172.21.15.6:0/1054706051 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdcd8003d10 con 0x7fdce01078c0 2024-05-20T17:20:07.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.073+0000 7fdce694c640 1 -- 172.21.15.6:0/1054706051 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce01a0fb0 con 0x7fdce01078c0 2024-05-20T17:20:07.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.073+0000 7fdcdd7fa640 1 -- 172.21.15.6:0/1054706051 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8010980 con 0x7fdce01078c0 2024-05-20T17:20:07.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.073+0000 7fdce694c640 1 -- 172.21.15.6:0/1054706051 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce01a1420 con 0x7fdce01078c0 2024-05-20T17:20:07.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.074+0000 7fdce694c640 1 -- 172.21.15.6:0/1054706051 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdce01a16b0 con 0x7fdce01078c0 2024-05-20T17:20:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.077+0000 7fdcdd7fa640 1 -- 172.21.15.6:0/1054706051 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fdcd8004b40 con 0x7fdce01078c0 2024-05-20T17:20:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.077+0000 7fdcdd7fa640 1 --2- 172.21.15.6:0/1054706051 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdccc0a2b90 0x7fdccc0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.077+0000 7fdcdd7fa640 1 -- 172.21.15.6:0/1054706051 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9609+0+0 (secure 0 0 0) 0x7fdcd80cfd30 con 0x7fdce01078c0 2024-05-20T17:20:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.077+0000 7fdcdffff640 1 --2- 172.21.15.6:0/1054706051 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdccc0a2b90 0x7fdccc0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.078+0000 7fdcdffff640 1 --2- 172.21.15.6:0/1054706051 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdccc0a2b90 0x7fdccc0a50a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00314e0 tx=0x7fdcd0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:20:07.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.081+0000 7fdcdd7fa640 1 -- 172.21.15.6:0/1054706051 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fdcd809c6d0 con 0x7fdce01078c0 2024-05-20T17:20:07.272 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:20:07 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-b[65260]: ignoring --setuser ceph since I am not root 2024-05-20T17:20:07.273 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:20:07 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-b[65260]: ignoring --setgroup ceph since I am not root 2024-05-20T17:20:07.273 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:20:07 smithi062 ceph-mds[65264]: -- 172.21.15.62:0/4076013566 <== mon.2 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562f3fe99a40 con 0x562f3ff11600 2024-05-20T17:20:07.273 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:20:07 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-b[65260]: starting mds.b at 2024-05-20T17:20:07.273 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:20:07 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-h[64956]: ignoring --setuser ceph since I am not root 2024-05-20T17:20:07.273 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:20:07 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-h[64956]: ignoring --setgroup ceph since I am not root 2024-05-20T17:20:07.273 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:20:07 smithi062 ceph-mds[64960]: -- 172.21.15.62:0/3550896253 <== mon.2 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560c8e867a40 con 0x560c8e8df600 2024-05-20T17:20:07.273 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:20:07 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-h[64956]: starting mds.h at 2024-05-20T17:20:07.274 INFO:journalctl@ceph.mds.k.smithi062.stdout:May 20 17:20:07 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-k[64354]: ignoring --setuser ceph since I am not root 2024-05-20T17:20:07.274 INFO:journalctl@ceph.mds.k.smithi062.stdout:May 20 17:20:07 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-k[64354]: ignoring --setgroup ceph since I am not root 2024-05-20T17:20:07.274 INFO:journalctl@ceph.mds.k.smithi062.stdout:May 20 17:20:07 smithi062 ceph-mds[64358]: -- 172.21.15.62:0/325099404 <== mon.2 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bd17f33a40 con 0x55bd17fab180 2024-05-20T17:20:07.274 INFO:journalctl@ceph.mds.k.smithi062.stdout:May 20 17:20:07 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-k[64354]: starting mds.k at 2024-05-20T17:20:07.274 INFO:journalctl@ceph.mds.e.smithi062.stdout:May 20 17:20:07 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-e[64657]: ignoring --setuser ceph since I am not root 2024-05-20T17:20:07.274 INFO:journalctl@ceph.mds.e.smithi062.stdout:May 20 17:20:07 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-e[64657]: ignoring --setgroup ceph since I am not root 2024-05-20T17:20:07.274 INFO:journalctl@ceph.mds.e.smithi062.stdout:May 20 17:20:07 smithi062 ceph-mds[64661]: -- 172.21.15.62:0/2458974004 <== mon.2 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5601ad24e4e0 con 0x5601ad2c9180 2024-05-20T17:20:07.274 INFO:journalctl@ceph.mds.e.smithi062.stdout:May 20 17:20:07 smithi062 ceph-mds[64661]: -- 172.21.15.62:0/2458974004 <== mon.2 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5601ad251a40 con 0x5601ad2c9180 2024-05-20T17:20:07.275 INFO:journalctl@ceph.mds.e.smithi062.stdout:May 20 17:20:07 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-e[64657]: starting mds.e at 2024-05-20T17:20:07.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.307+0000 7fdce694c640 1 -- 172.21.15.6:0/1054706051 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fdce01a1880 con 0x7fdce01078c0 2024-05-20T17:20:07.367 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 20 17:20:07 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-c[65877]: ignoring --setuser ceph since I am not root 2024-05-20T17:20:07.367 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 20 17:20:07 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-c[65877]: ignoring --setgroup ceph since I am not root 2024-05-20T17:20:07.367 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 20 17:20:07 smithi171 ceph-mds[65881]: -- 172.21.15.171:0/2097470112 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5645e2b0da40 con 0x5645e2b85a80 2024-05-20T17:20:07.367 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 20 17:20:07 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-c[65877]: starting mds.c at 2024-05-20T17:20:07.367 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 20 17:20:07 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-f[65574]: ignoring --setuser ceph since I am not root 2024-05-20T17:20:07.367 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 20 17:20:07 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-f[65574]: ignoring --setgroup ceph since I am not root 2024-05-20T17:20:07.367 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 20 17:20:07 smithi171 ceph-mds[65578]: -- 172.21.15.171:0/4290000121 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ce778ffa40 con 0x55ce77977180 2024-05-20T17:20:07.368 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 20 17:20:07 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-f[65574]: starting mds.f at 2024-05-20T17:20:07.368 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 20 17:20:07 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-i[66184]: ignoring --setuser ceph since I am not root 2024-05-20T17:20:07.368 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 20 17:20:07 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-i[66184]: ignoring --setgroup ceph since I am not root 2024-05-20T17:20:07.368 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 20 17:20:07 smithi171 ceph-mds[66188]: -- 172.21.15.171:0/1088324088 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555e018f7a40 con 0x555e0196f180 2024-05-20T17:20:07.368 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 20 17:20:07 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-i[66184]: starting mds.i at 2024-05-20T17:20:07.368 INFO:journalctl@ceph.mds.l.smithi171.stdout:May 20 17:20:07 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-l[65273]: ignoring --setuser ceph since I am not root 2024-05-20T17:20:07.368 INFO:journalctl@ceph.mds.l.smithi171.stdout:May 20 17:20:07 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-l[65273]: ignoring --setgroup ceph since I am not root 2024-05-20T17:20:07.368 INFO:journalctl@ceph.mds.l.smithi171.stdout:May 20 17:20:07 smithi171 ceph-mds[65277]: -- 172.21.15.171:0/4254328870 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cdfff13a40 con 0x55cdfff8b600 2024-05-20T17:20:07.369 INFO:journalctl@ceph.mds.l.smithi171.stdout:May 20 17:20:07 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-l[65273]: starting mds.l at 2024-05-20T17:20:07.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:06 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-a[32481]: 2024-05-20T17:20:06.927+0000 7f4ac7492700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-20T17:20:07.381 INFO:journalctl@ceph.mds.a.smithi006.stdout:May 20 17:20:07 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-a[73890]: ignoring --setuser ceph since I am not root 2024-05-20T17:20:07.381 INFO:journalctl@ceph.mds.a.smithi006.stdout:May 20 17:20:07 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-a[73890]: ignoring --setgroup ceph since I am not root 2024-05-20T17:20:07.381 INFO:journalctl@ceph.mds.a.smithi006.stdout:May 20 17:20:07 smithi006 ceph-mds[73894]: -- 172.21.15.6:0/4067670539 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5642e14ada40 con 0x5642e1525180 2024-05-20T17:20:07.381 INFO:journalctl@ceph.mds.a.smithi006.stdout:May 20 17:20:07 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-a[73890]: starting mds.a at 2024-05-20T17:20:07.381 INFO:journalctl@ceph.mds.g.smithi006.stdout:May 20 17:20:07 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-g[73539]: ignoring --setuser ceph since I am not root 2024-05-20T17:20:07.382 INFO:journalctl@ceph.mds.g.smithi006.stdout:May 20 17:20:07 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-g[73539]: ignoring --setgroup ceph since I am not root 2024-05-20T17:20:07.382 INFO:journalctl@ceph.mds.g.smithi006.stdout:May 20 17:20:07 smithi006 ceph-mds[73543]: -- 172.21.15.6:0/3869154185 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ef58307a40 con 0x55ef5837f600 2024-05-20T17:20:07.382 INFO:journalctl@ceph.mds.g.smithi006.stdout:May 20 17:20:07 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-g[73539]: starting mds.g at 2024-05-20T17:20:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:07 smithi171 ceph-mon[35901]: pgmap v756: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-20T17:20:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:07 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/842541662' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-20T17:20:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:07 smithi171 ceph-mon[35901]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-20T17:20:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:07 smithi171 ceph-mon[35901]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-20T17:20:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:07 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/842541662' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-20T17:20:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:07 smithi171 ceph-mon[35901]: osdmap e95: 12 total, 12 up, 12 in 2024-05-20T17:20:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:07 smithi171 ceph-mon[35901]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-20T17:20:07.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:07 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1054706051' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T17:20:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:07 smithi006 ceph-mon[32486]: pgmap v756: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-20T17:20:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:07 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/842541662' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-20T17:20:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:07 smithi006 ceph-mon[32486]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-20T17:20:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:07 smithi006 ceph-mon[32486]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-20T17:20:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:07 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/842541662' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-20T17:20:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:07 smithi006 ceph-mon[32486]: osdmap e95: 12 total, 12 up, 12 in 2024-05-20T17:20:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:07 smithi006 ceph-mon[32486]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-20T17:20:07.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:07 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1054706051' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T17:20:07.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.931+0000 7fdcdd7fa640 1 -- 172.21.15.6:0/1054706051 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) ==== 104+0+0 (secure 0 0 0) 0x7fdcd809bfd0 con 0x7fdce01078c0 2024-05-20T17:20:07.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.934+0000 7fdce694c640 1 -- 172.21.15.6:0/1054706051 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdccc0a2b90 msgr2=0x7fdccc0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:07.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.934+0000 7fdce694c640 1 --2- 172.21.15.6:0/1054706051 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdccc0a2b90 0x7fdccc0a50a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00314e0 tx=0x7fdcd0031400 comp rx=0 tx=0).stop 2024-05-20T17:20:07.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.934+0000 7fdce694c640 1 -- 172.21.15.6:0/1054706051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce01078c0 msgr2=0x7fdce01a06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:07.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.934+0000 7fdce694c640 1 --2- 172.21.15.6:0/1054706051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce01078c0 0x7fdce01a06b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800efd0 tx=0x7fdcd800c6a0 comp rx=0 tx=0).stop 2024-05-20T17:20:07.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.934+0000 7fdce694c640 1 -- 172.21.15.6:0/1054706051 shutdown_connections 2024-05-20T17:20:07.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.934+0000 7fdce694c640 1 --2- 172.21.15.6:0/1054706051 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fdccc0a2b90 0x7fdccc0a50a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:07.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.934+0000 7fdce694c640 1 --2- 172.21.15.6:0/1054706051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce01078c0 0x7fdce01a06b0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:07.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.934+0000 7fdce694c640 1 --2- 172.21.15.6:0/1054706051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdce0102bc0 0x7fdce0199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:07.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.934+0000 7fdce694c640 1 --2- 172.21.15.6:0/1054706051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdce0101980 0x7fdce01991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:07.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.934+0000 7fdce694c640 1 -- 172.21.15.6:0/1054706051 >> 172.21.15.6:0/1054706051 conn(0x7fdce00fcb70 msgr2=0x7fdce0108e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:20:07.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.934+0000 7fdce694c640 1 -- 172.21.15.6:0/1054706051 shutdown_connections 2024-05-20T17:20:07.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:07.934+0000 7fdce694c640 1 -- 172.21.15.6:0/1054706051 wait complete. 2024-05-20T17:20:07.953 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-20T17:20:08.022 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:07 smithi062 ceph-mon[35425]: pgmap v756: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-20T17:20:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:07 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/842541662' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-20T17:20:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:07 smithi062 ceph-mon[35425]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-20T17:20:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:07 smithi062 ceph-mon[35425]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-20T17:20:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:07 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/842541662' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-20T17:20:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:07 smithi062 ceph-mon[35425]: osdmap e95: 12 total, 12 up, 12 in 2024-05-20T17:20:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:07 smithi062 ceph-mon[35425]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-20T17:20:08.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:07 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1054706051' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-20T17:20:08.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.080+0000 7fe0f140d640 1 -- 172.21.15.6:0/119524159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0ec1031d0 msgr2=0x7fe0ec1055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:08.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.080+0000 7fe0f140d640 1 --2- 172.21.15.6:0/119524159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0ec1031d0 0x7fe0ec1055f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009900 tx=0x7fe0d402a410 comp rx=0 tx=0).stop 2024-05-20T17:20:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.080+0000 7fe0f140d640 1 -- 172.21.15.6:0/119524159 shutdown_connections 2024-05-20T17:20:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.080+0000 7fe0f140d640 1 --2- 172.21.15.6:0/119524159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0ec108730 0x7fe0ec10ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.080+0000 7fe0f140d640 1 --2- 172.21.15.6:0/119524159 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0ec105bc0 0x7fe0ec1080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.080+0000 7fe0f140d640 1 --2- 172.21.15.6:0/119524159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0ec1031d0 0x7fe0ec1055f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.080+0000 7fe0f140d640 1 -- 172.21.15.6:0/119524159 >> 172.21.15.6:0/119524159 conn(0x7fe0ec0fcb90 msgr2=0x7fe0ec0ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:20:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.080+0000 7fe0f140d640 1 -- 172.21.15.6:0/119524159 shutdown_connections 2024-05-20T17:20:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.080+0000 7fe0f140d640 1 -- 172.21.15.6:0/119524159 wait complete. 2024-05-20T17:20:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.081+0000 7fe0f140d640 1 Processor -- start 2024-05-20T17:20:08.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.081+0000 7fe0f140d640 1 -- start start 2024-05-20T17:20:08.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.081+0000 7fe0f140d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0ec1031d0 0x7fe0ec199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:08.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.081+0000 7fe0f140d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0ec105bc0 0x7fe0ec1996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:08.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.081+0000 7fe0f140d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0ec108730 0x7fe0ec1a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:08.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.081+0000 7fe0f140d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec10e570 con 0x7fe0ec1031d0 2024-05-20T17:20:08.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.081+0000 7fe0f140d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec10e3f0 con 0x7fe0ec108730 2024-05-20T17:20:08.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.081+0000 7fe0f140d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec10e6f0 con 0x7fe0ec105bc0 2024-05-20T17:20:08.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.081+0000 7fe0eaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0ec1031d0 0x7fe0ec199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:08.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.081+0000 7fe0eaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0ec1031d0 0x7fe0ec199180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60854/0 (socket says 172.21.15.6:60854) 2024-05-20T17:20:08.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.081+0000 7fe0eaffd640 1 -- 172.21.15.6:0/1946149593 learned_addr learned my addr 172.21.15.6:0/1946149593 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:20:08.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.081+0000 7fe0ea7fc640 1 --2- 172.21.15.6:0/1946149593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0ec105bc0 0x7fe0ec1996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:08.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.081+0000 7fe0eb7fe640 1 --2- 172.21.15.6:0/1946149593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0ec108730 0x7fe0ec1a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:08.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.082+0000 7fe0eaffd640 1 -- 172.21.15.6:0/1946149593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0ec105bc0 msgr2=0x7fe0ec1996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:08.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.082+0000 7fe0eaffd640 1 --2- 172.21.15.6:0/1946149593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0ec105bc0 0x7fe0ec1996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:08.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.082+0000 7fe0eaffd640 1 -- 172.21.15.6:0/1946149593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0ec108730 msgr2=0x7fe0ec1a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:08.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.082+0000 7fe0eaffd640 1 --2- 172.21.15.6:0/1946149593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0ec108730 0x7fe0ec1a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:08.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.082+0000 7fe0eaffd640 1 -- 172.21.15.6:0/1946149593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ec1a0cc0 con 0x7fe0ec1031d0 2024-05-20T17:20:08.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.082+0000 7fe0eb7fe640 1 --2- 172.21.15.6:0/1946149593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0ec108730 0x7fe0ec1a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:20:08.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.082+0000 7fe0eaffd640 1 --2- 172.21.15.6:0/1946149593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0ec1031d0 0x7fe0ec199180 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40314e0 tx=0x7fe0d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:20:08.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.082+0000 7fe0e3fff640 1 -- 172.21.15.6:0/1946149593 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d403f030 con 0x7fe0ec1031d0 2024-05-20T17:20:08.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.082+0000 7fe0f140d640 1 -- 172.21.15.6:0/1946149593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0ec1a0f50 con 0x7fe0ec1031d0 2024-05-20T17:20:08.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.082+0000 7fe0e3fff640 1 -- 172.21.15.6:0/1946149593 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0d40318f0 con 0x7fe0ec1031d0 2024-05-20T17:20:08.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.082+0000 7fe0e3fff640 1 -- 172.21.15.6:0/1946149593 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4035070 con 0x7fe0ec1031d0 2024-05-20T17:20:08.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.082+0000 7fe0f140d640 1 -- 172.21.15.6:0/1946149593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0ec1a1360 con 0x7fe0ec1031d0 2024-05-20T17:20:08.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.083+0000 7fe0f140d640 1 -- 172.21.15.6:0/1946149593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0ec0fe6b0 con 0x7fe0ec1031d0 2024-05-20T17:20:08.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.085+0000 7fe0e3fff640 1 -- 172.21.15.6:0/1946149593 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fe0d4042030 con 0x7fe0ec1031d0 2024-05-20T17:20:08.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.085+0000 7fe0e3fff640 1 --2- 172.21.15.6:0/1946149593 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe0d80a2b90 0x7fe0d80a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:08.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.085+0000 7fe0e3fff640 1 -- 172.21.15.6:0/1946149593 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9609+0+0 (secure 0 0 0) 0x7fe0d40effd0 con 0x7fe0ec1031d0 2024-05-20T17:20:08.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.085+0000 7fe0ea7fc640 1 --2- 172.21.15.6:0/1946149593 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe0d80a2b90 0x7fe0d80a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:08.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.086+0000 7fe0ea7fc640 1 --2- 172.21.15.6:0/1946149593 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe0d80a2b90 0x7fe0d80a50a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec19a220 tx=0x7fe0dc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:20:08.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.090+0000 7fe0e3fff640 1 -- 172.21.15.6:0/1946149593 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe0d40bcaf0 con 0x7fe0ec1031d0 2024-05-20T17:20:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.279+0000 7fe0f140d640 1 -- 172.21.15.6:0/1946149593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe0ec02d3c0 con 0x7fe0ec1031d0 2024-05-20T17:20:08.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-20T17:20:08.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-20T17:20:08.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: Cluster is now healthy 2024-05-20T17:20:08.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1054706051' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-20T17:20:08.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.171:6832/2959911073,v1:172.21.15.171:6834/2959911073] up:boot 2024-05-20T17:20:08.867 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.171:6833/3252222020,v1:172.21.15.171:6835/3252222020] up:boot 2024-05-20T17:20:08.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.62:6832/4258795981,v1:172.21.15.62:6833/4258795981] up:boot 2024-05-20T17:20:08.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.171:6836/2707980725,v1:172.21.15.171:6839/2707980725] up:boot 2024-05-20T17:20:08.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.171:6837/2959491385,v1:172.21.15.171:6838/2959491385] up:boot 2024-05-20T17:20:08.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.62:6834/618235300,v1:172.21.15.62:6835/618235300] up:boot 2024-05-20T17:20:08.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.6:6838/1917017706,v1:172.21.15.6:6840/1917017706] up:boot 2024-05-20T17:20:08.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.6:6839/3246828495,v1:172.21.15.6:6841/3246828495] up:boot 2024-05-20T17:20:08.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.62:6836/174537871,v1:172.21.15.62:6838/174537871] up:boot 2024-05-20T17:20:08.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: mds.? [v2:172.21.15.62:6837/2831806032,v1:172.21.15.62:6839/2831806032] up:boot 2024-05-20T17:20:08.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: fsmap 12 up:standby 2024-05-20T17:20:08.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-20T17:20:08.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-20T17:20:08.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-20T17:20:08.868 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-20T17:20:08.869 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-20T17:20:08.869 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-20T17:20:08.869 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-20T17:20:08.869 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-20T17:20:08.869 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-20T17:20:08.869 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-20T17:20:08.869 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-20T17:20:08.869 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:08 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1946149593' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T17:20:08.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-20T17:20:08.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-20T17:20:08.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: Cluster is now healthy 2024-05-20T17:20:08.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1054706051' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-20T17:20:08.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.171:6832/2959911073,v1:172.21.15.171:6834/2959911073] up:boot 2024-05-20T17:20:08.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.171:6833/3252222020,v1:172.21.15.171:6835/3252222020] up:boot 2024-05-20T17:20:08.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.62:6832/4258795981,v1:172.21.15.62:6833/4258795981] up:boot 2024-05-20T17:20:08.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.171:6836/2707980725,v1:172.21.15.171:6839/2707980725] up:boot 2024-05-20T17:20:08.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.171:6837/2959491385,v1:172.21.15.171:6838/2959491385] up:boot 2024-05-20T17:20:08.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.62:6834/618235300,v1:172.21.15.62:6835/618235300] up:boot 2024-05-20T17:20:08.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.6:6838/1917017706,v1:172.21.15.6:6840/1917017706] up:boot 2024-05-20T17:20:08.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.6:6839/3246828495,v1:172.21.15.6:6841/3246828495] up:boot 2024-05-20T17:20:08.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.62:6836/174537871,v1:172.21.15.62:6838/174537871] up:boot 2024-05-20T17:20:08.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: mds.? [v2:172.21.15.62:6837/2831806032,v1:172.21.15.62:6839/2831806032] up:boot 2024-05-20T17:20:08.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: fsmap 12 up:standby 2024-05-20T17:20:08.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-20T17:20:08.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-20T17:20:08.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-20T17:20:08.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-20T17:20:08.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-20T17:20:08.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-20T17:20:08.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-20T17:20:08.882 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-20T17:20:08.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-20T17:20:08.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-20T17:20:08.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-20T17:20:08.883 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:08 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1946149593' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T17:20:08.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.939+0000 7fe0e3fff640 1 -- 172.21.15.6:0/1946149593 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v96) ==== 181+0+0 (secure 0 0 0) 0x7fe0ec02d3c0 con 0x7fe0ec1031d0 2024-05-20T17:20:08.941 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2024-05-20T17:20:08.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.942+0000 7fe0f140d640 1 -- 172.21.15.6:0/1946149593 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe0d80a2b90 msgr2=0x7fe0d80a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:08.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.942+0000 7fe0f140d640 1 --2- 172.21.15.6:0/1946149593 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe0d80a2b90 0x7fe0d80a50a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec19a220 tx=0x7fe0dc00b410 comp rx=0 tx=0).stop 2024-05-20T17:20:08.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.942+0000 7fe0f140d640 1 -- 172.21.15.6:0/1946149593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0ec1031d0 msgr2=0x7fe0ec199180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:08.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.942+0000 7fe0f140d640 1 --2- 172.21.15.6:0/1946149593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0ec1031d0 0x7fe0ec199180 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40314e0 tx=0x7fe0d40042f0 comp rx=0 tx=0).stop 2024-05-20T17:20:08.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.942+0000 7fe0f140d640 1 -- 172.21.15.6:0/1946149593 shutdown_connections 2024-05-20T17:20:08.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.942+0000 7fe0f140d640 1 --2- 172.21.15.6:0/1946149593 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fe0d80a2b90 0x7fe0d80a50a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.942+0000 7fe0f140d640 1 --2- 172.21.15.6:0/1946149593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0ec108730 0x7fe0ec1a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.942+0000 7fe0f140d640 1 --2- 172.21.15.6:0/1946149593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0ec105bc0 0x7fe0ec1996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.942+0000 7fe0f140d640 1 --2- 172.21.15.6:0/1946149593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0ec1031d0 0x7fe0ec199180 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.942+0000 7fe0f140d640 1 -- 172.21.15.6:0/1946149593 >> 172.21.15.6:0/1946149593 conn(0x7fe0ec0fcb90 msgr2=0x7fe0ec1051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:20:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.942+0000 7fe0f140d640 1 -- 172.21.15.6:0/1946149593 shutdown_connections 2024-05-20T17:20:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:08.942+0000 7fe0f140d640 1 -- 172.21.15.6:0/1946149593 wait complete. 2024-05-20T17:20:08.958 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-20T17:20:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-20T17:20:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-20T17:20:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: Cluster is now healthy 2024-05-20T17:20:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1054706051' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-20T17:20:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.171:6832/2959911073,v1:172.21.15.171:6834/2959911073] up:boot 2024-05-20T17:20:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.171:6833/3252222020,v1:172.21.15.171:6835/3252222020] up:boot 2024-05-20T17:20:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.62:6832/4258795981,v1:172.21.15.62:6833/4258795981] up:boot 2024-05-20T17:20:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.171:6836/2707980725,v1:172.21.15.171:6839/2707980725] up:boot 2024-05-20T17:20:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.171:6837/2959491385,v1:172.21.15.171:6838/2959491385] up:boot 2024-05-20T17:20:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.62:6834/618235300,v1:172.21.15.62:6835/618235300] up:boot 2024-05-20T17:20:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.6:6838/1917017706,v1:172.21.15.6:6840/1917017706] up:boot 2024-05-20T17:20:09.023 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.6:6839/3246828495,v1:172.21.15.6:6841/3246828495] up:boot 2024-05-20T17:20:09.024 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.62:6836/174537871,v1:172.21.15.62:6838/174537871] up:boot 2024-05-20T17:20:09.024 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: mds.? [v2:172.21.15.62:6837/2831806032,v1:172.21.15.62:6839/2831806032] up:boot 2024-05-20T17:20:09.024 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: fsmap 12 up:standby 2024-05-20T17:20:09.024 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-20T17:20:09.024 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-20T17:20:09.024 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-20T17:20:09.024 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-20T17:20:09.024 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-20T17:20:09.024 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-20T17:20:09.024 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-20T17:20:09.024 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-20T17:20:09.024 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-20T17:20:09.024 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-20T17:20:09.024 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: from='mgr.14152 172.21.15.6:0/428456020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-20T17:20:09.025 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:08 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1946149593' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T17:20:09.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.078+0000 7f7e427aa640 1 -- 172.21.15.6:0/3589674574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e3c108830 msgr2=0x7f7e3c10ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:09.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.078+0000 7f7e427aa640 1 --2- 172.21.15.6:0/3589674574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e3c108830 0x7f7e3c10ac50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009ca0 tx=0x7f7e3402a8c0 comp rx=0 tx=0).stop 2024-05-20T17:20:09.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.078+0000 7f7e427aa640 1 -- 172.21.15.6:0/3589674574 shutdown_connections 2024-05-20T17:20:09.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.078+0000 7f7e427aa640 1 --2- 172.21.15.6:0/3589674574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e3c108830 0x7f7e3c10ac50 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:09.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.078+0000 7f7e427aa640 1 --2- 172.21.15.6:0/3589674574 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e3c105ed0 0x7f7e3c1082f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:09.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.078+0000 7f7e427aa640 1 --2- 172.21.15.6:0/3589674574 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e3c103570 0x7f7e3c105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:09.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.078+0000 7f7e427aa640 1 -- 172.21.15.6:0/3589674574 >> 172.21.15.6:0/3589674574 conn(0x7f7e3c0fcb70 msgr2=0x7f7e3c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:20:09.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.079+0000 7f7e427aa640 1 -- 172.21.15.6:0/3589674574 shutdown_connections 2024-05-20T17:20:09.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.079+0000 7f7e427aa640 1 -- 172.21.15.6:0/3589674574 wait complete. 2024-05-20T17:20:09.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.079+0000 7f7e427aa640 1 Processor -- start 2024-05-20T17:20:09.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.079+0000 7f7e427aa640 1 -- start start 2024-05-20T17:20:09.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.079+0000 7f7e427aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e3c103570 0x7f7e3c199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:09.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.080+0000 7f7e427aa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e3c105ed0 0x7f7e3c199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:09.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.080+0000 7f7e427aa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e3c108830 0x7f7e3c1a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:09.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.080+0000 7f7e427aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3c10e590 con 0x7f7e3c103570 2024-05-20T17:20:09.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.080+0000 7f7e427aa640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3c10e410 con 0x7f7e3c108830 2024-05-20T17:20:09.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.080+0000 7f7e427aa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3c10e710 con 0x7f7e3c105ed0 2024-05-20T17:20:09.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.080+0000 7f7e3bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e3c103570 0x7f7e3c199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:09.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.080+0000 7f7e3bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e3c103570 0x7f7e3c199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60872/0 (socket says 172.21.15.6:60872) 2024-05-20T17:20:09.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.080+0000 7f7e3bfff640 1 -- 172.21.15.6:0/38109394 learned_addr learned my addr 172.21.15.6:0/38109394 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:20:09.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.080+0000 7f7e33fff640 1 --2- 172.21.15.6:0/38109394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e3c105ed0 0x7f7e3c199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:09.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.080+0000 7f7e40d47640 1 --2- 172.21.15.6:0/38109394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e3c108830 0x7f7e3c1a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:09.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.080+0000 7f7e3bfff640 1 -- 172.21.15.6:0/38109394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e3c105ed0 msgr2=0x7f7e3c199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:09.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.080+0000 7f7e3bfff640 1 --2- 172.21.15.6:0/38109394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e3c105ed0 0x7f7e3c199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:09.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.080+0000 7f7e3bfff640 1 -- 172.21.15.6:0/38109394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e3c108830 msgr2=0x7f7e3c1a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:09.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.080+0000 7f7e3bfff640 1 --2- 172.21.15.6:0/38109394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e3c108830 0x7f7e3c1a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:09.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.080+0000 7f7e3bfff640 1 -- 172.21.15.6:0/38109394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e3c1a0c80 con 0x7f7e3c103570 2024-05-20T17:20:09.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.080+0000 7f7e40d47640 1 --2- 172.21.15.6:0/38109394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e3c108830 0x7f7e3c1a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:20:09.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.080+0000 7f7e3bfff640 1 --2- 172.21.15.6:0/38109394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e3c103570 0x7f7e3c199140 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00e9c0 tx=0x7f7e2c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:20:09.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.080+0000 7f7e39ffb640 1 -- 172.21.15.6:0/38109394 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c00cd80 con 0x7f7e3c103570 2024-05-20T17:20:09.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.080+0000 7f7e427aa640 1 -- 172.21.15.6:0/38109394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e3c1a0f70 con 0x7f7e3c103570 2024-05-20T17:20:09.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.081+0000 7f7e39ffb640 1 -- 172.21.15.6:0/38109394 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7e2c0054d0 con 0x7f7e3c103570 2024-05-20T17:20:09.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.081+0000 7f7e39ffb640 1 -- 172.21.15.6:0/38109394 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c010430 con 0x7f7e3c103570 2024-05-20T17:20:09.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.081+0000 7f7e427aa640 1 -- 172.21.15.6:0/38109394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e3c1a1430 con 0x7f7e3c103570 2024-05-20T17:20:09.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.082+0000 7f7e427aa640 1 -- 172.21.15.6:0/38109394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e3c0fe690 con 0x7f7e3c103570 2024-05-20T17:20:09.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.083+0000 7f7e39ffb640 1 -- 172.21.15.6:0/38109394 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f7e2c004fd0 con 0x7f7e3c103570 2024-05-20T17:20:09.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.084+0000 7f7e39ffb640 1 --2- 172.21.15.6:0/38109394 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7e280a2b90 0x7f7e280a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:09.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.084+0000 7f7e39ffb640 1 -- 172.21.15.6:0/38109394 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9055+0+0 (secure 0 0 0) 0x7f7e2c0cf860 con 0x7f7e3c103570 2024-05-20T17:20:09.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.084+0000 7f7e33fff640 1 --2- 172.21.15.6:0/38109394 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7e280a2b90 0x7f7e280a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:09.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.084+0000 7f7e33fff640 1 --2- 172.21.15.6:0/38109394 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7e280a2b90 0x7f7e280a50a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c19a1e0 tx=0x7f7e24005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:20:09.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.089+0000 7f7e39ffb640 1 -- 172.21.15.6:0/38109394 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7e2c09c490 con 0x7f7e3c103570 2024-05-20T17:20:09.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.280+0000 7f7e427aa640 1 -- 172.21.15.6:0/38109394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7e3c02d2a0 con 0x7f7e3c103570 2024-05-20T17:20:09.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.949+0000 7f7e39ffb640 1 -- 172.21.15.6:0/38109394 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v97) ==== 169+0+0 (secure 0 0 0) 0x7f7e2c09bd90 con 0x7f7e3c103570 2024-05-20T17:20:09.950 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2024-05-20T17:20:09.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.952+0000 7f7e427aa640 1 -- 172.21.15.6:0/38109394 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7e280a2b90 msgr2=0x7f7e280a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:09.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.952+0000 7f7e427aa640 1 --2- 172.21.15.6:0/38109394 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7e280a2b90 0x7f7e280a50a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c19a1e0 tx=0x7f7e24005f90 comp rx=0 tx=0).stop 2024-05-20T17:20:09.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.952+0000 7f7e427aa640 1 -- 172.21.15.6:0/38109394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e3c103570 msgr2=0x7f7e3c199140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:09.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.952+0000 7f7e427aa640 1 --2- 172.21.15.6:0/38109394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e3c103570 0x7f7e3c199140 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00e9c0 tx=0x7f7e2c00ee80 comp rx=0 tx=0).stop 2024-05-20T17:20:09.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.952+0000 7f7e427aa640 1 -- 172.21.15.6:0/38109394 shutdown_connections 2024-05-20T17:20:09.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.952+0000 7f7e427aa640 1 --2- 172.21.15.6:0/38109394 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7f7e280a2b90 0x7f7e280a50a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:09.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.952+0000 7f7e427aa640 1 --2- 172.21.15.6:0/38109394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e3c108830 0x7f7e3c1a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:09.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.952+0000 7f7e427aa640 1 --2- 172.21.15.6:0/38109394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e3c105ed0 0x7f7e3c199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:09.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.952+0000 7f7e427aa640 1 --2- 172.21.15.6:0/38109394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e3c103570 0x7f7e3c199140 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:09.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.952+0000 7f7e427aa640 1 -- 172.21.15.6:0/38109394 >> 172.21.15.6:0/38109394 conn(0x7f7e3c0fcb70 msgr2=0x7f7e3c104140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:20:09.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.953+0000 7f7e427aa640 1 -- 172.21.15.6:0/38109394 shutdown_connections 2024-05-20T17:20:09.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:09.953+0000 7f7e427aa640 1 -- 172.21.15.6:0/38109394 wait complete. 2024-05-20T17:20:09.973 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-20T17:20:10.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.099+0000 7fc645557640 1 -- 172.21.15.6:0/21366859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6401089d0 msgr2=0x7fc64010adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:10.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.099+0000 7fc645557640 1 --2- 172.21.15.6:0/21366859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6401089d0 0x7fc64010adf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc638009ca0 tx=0x7fc63802a8c0 comp rx=0 tx=0).stop 2024-05-20T17:20:10.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.099+0000 7fc645557640 1 -- 172.21.15.6:0/21366859 shutdown_connections 2024-05-20T17:20:10.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.099+0000 7fc645557640 1 --2- 172.21.15.6:0/21366859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6401089d0 0x7fc64010adf0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:10.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.099+0000 7fc645557640 1 --2- 172.21.15.6:0/21366859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc640103cd0 0x7fc6401040e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:10.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.099+0000 7fc645557640 1 --2- 172.21.15.6:0/21366859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc640102a90 0x7fc640103790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:10.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.099+0000 7fc645557640 1 -- 172.21.15.6:0/21366859 >> 172.21.15.6:0/21366859 conn(0x7fc6400fdc80 msgr2=0x7fc640100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:20:10.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.099+0000 7fc645557640 1 -- 172.21.15.6:0/21366859 shutdown_connections 2024-05-20T17:20:10.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.099+0000 7fc645557640 1 -- 172.21.15.6:0/21366859 wait complete. 2024-05-20T17:20:10.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.100+0000 7fc645557640 1 Processor -- start 2024-05-20T17:20:10.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.100+0000 7fc645557640 1 -- start start 2024-05-20T17:20:10.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.100+0000 7fc645557640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc640102a90 0x7fc640199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:10.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.100+0000 7fc645557640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc640103cd0 0x7fc640199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:10.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.100+0000 7fc645557640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6401089d0 0x7fc6401a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:10.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.100+0000 7fc645557640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc64010e5c0 con 0x7fc6401089d0 2024-05-20T17:20:10.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.100+0000 7fc645557640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc64010e440 con 0x7fc640103cd0 2024-05-20T17:20:10.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.100+0000 7fc645557640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc64010e740 con 0x7fc640102a90 2024-05-20T17:20:10.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.100+0000 7fc63f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6401089d0 0x7fc6401a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:10.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.100+0000 7fc63f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6401089d0 0x7fc6401a0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60892/0 (socket says 172.21.15.6:60892) 2024-05-20T17:20:10.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.100+0000 7fc63f7fe640 1 -- 172.21.15.6:0/3866579396 learned_addr learned my addr 172.21.15.6:0/3866579396 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:20:10.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.100+0000 7fc63effd640 1 --2- 172.21.15.6:0/3866579396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc640102a90 0x7fc640199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:10.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.100+0000 7fc637fff640 1 --2- 172.21.15.6:0/3866579396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc640103cd0 0x7fc640199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:10.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.100+0000 7fc63f7fe640 1 -- 172.21.15.6:0/3866579396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc640102a90 msgr2=0x7fc640199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:10.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.100+0000 7fc63f7fe640 1 --2- 172.21.15.6:0/3866579396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc640102a90 0x7fc640199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:10.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.100+0000 7fc63f7fe640 1 -- 172.21.15.6:0/3866579396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc640103cd0 msgr2=0x7fc640199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:10.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.100+0000 7fc63f7fe640 1 --2- 172.21.15.6:0/3866579396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc640103cd0 0x7fc640199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:10.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.100+0000 7fc63f7fe640 1 -- 172.21.15.6:0/3866579396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6401a0c70 con 0x7fc6401089d0 2024-05-20T17:20:10.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.100+0000 7fc637fff640 1 --2- 172.21.15.6:0/3866579396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc640103cd0 0x7fc640199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:20:10.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.101+0000 7fc63f7fe640 1 --2- 172.21.15.6:0/3866579396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6401089d0 0x7fc6401a0600 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc638006010 tx=0x7fc638003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:20:10.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.101+0000 7fc63cff9640 1 -- 172.21.15.6:0/3866579396 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638004040 con 0x7fc6401089d0 2024-05-20T17:20:10.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.101+0000 7fc63cff9640 1 -- 172.21.15.6:0/3866579396 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc638004690 con 0x7fc6401089d0 2024-05-20T17:20:10.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.101+0000 7fc645557640 1 -- 172.21.15.6:0/3866579396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6401a0f00 con 0x7fc6401089d0 2024-05-20T17:20:10.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.101+0000 7fc63cff9640 1 -- 172.21.15.6:0/3866579396 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638030bf0 con 0x7fc6401089d0 2024-05-20T17:20:10.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.101+0000 7fc645557640 1 -- 172.21.15.6:0/3866579396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6401a1360 con 0x7fc6401089d0 2024-05-20T17:20:10.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.102+0000 7fc645557640 1 -- 172.21.15.6:0/3866579396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc640068340 con 0x7fc6401089d0 2024-05-20T17:20:10.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.103+0000 7fc63cff9640 1 -- 172.21.15.6:0/3866579396 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fc6380041e0 con 0x7fc6401089d0 2024-05-20T17:20:10.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.104+0000 7fc63cff9640 1 --2- 172.21.15.6:0/3866579396 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc62c0a2b90 0x7fc62c0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:20:10.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.104+0000 7fc63effd640 1 --2- 172.21.15.6:0/3866579396 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc62c0a2b90 0x7fc62c0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:20:10.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.104+0000 7fc63cff9640 1 -- 172.21.15.6:0/3866579396 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8496+0+0 (secure 0 0 0) 0x7fc6380f0910 con 0x7fc6401089d0 2024-05-20T17:20:10.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.105+0000 7fc63effd640 1 --2- 172.21.15.6:0/3866579396 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc62c0a2b90 0x7fc62c0a50a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc630005fd0 tx=0x7fc630005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:20:10.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.108+0000 7fc63cff9640 1 -- 172.21.15.6:0/3866579396 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc6380bd730 con 0x7fc6401089d0 2024-05-20T17:20:10.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:09 smithi062 ceph-mon[35425]: pgmap v758: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-20T17:20:10.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:09 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/1946149593' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T17:20:10.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:09 smithi062 ceph-mon[35425]: osdmap e96: 12 total, 12 up, 12 in 2024-05-20T17:20:10.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:09 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/38109394' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T17:20:10.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.294+0000 7fc645557640 1 -- 172.21.15.6:0/3866579396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc640062780 con 0x7fc6401089d0 2024-05-20T17:20:10.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:09 smithi171 ceph-mon[35901]: pgmap v758: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-20T17:20:10.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:09 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/1946149593' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T17:20:10.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:09 smithi171 ceph-mon[35901]: osdmap e96: 12 total, 12 up, 12 in 2024-05-20T17:20:10.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:09 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/38109394' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T17:20:10.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:09 smithi006 ceph-mon[32486]: pgmap v758: 129 pgs: 129 active+clean; 1.3 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-20T17:20:10.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:09 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/1946149593' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T17:20:10.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:09 smithi006 ceph-mon[32486]: osdmap e96: 12 total, 12 up, 12 in 2024-05-20T17:20:10.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:09 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/38109394' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T17:20:10.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.955+0000 7fc63cff9640 1 -- 172.21.15.6:0/3866579396 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v98) ==== 178+0+0 (secure 0 0 0) 0x7fc6380bd030 con 0x7fc6401089d0 2024-05-20T17:20:10.957 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data_ec' removed 2024-05-20T17:20:10.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.958+0000 7fc645557640 1 -- 172.21.15.6:0/3866579396 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc62c0a2b90 msgr2=0x7fc62c0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:10.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.958+0000 7fc645557640 1 --2- 172.21.15.6:0/3866579396 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc62c0a2b90 0x7fc62c0a50a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc630005fd0 tx=0x7fc630005850 comp rx=0 tx=0).stop 2024-05-20T17:20:10.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.958+0000 7fc645557640 1 -- 172.21.15.6:0/3866579396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6401089d0 msgr2=0x7fc6401a0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:20:10.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.958+0000 7fc645557640 1 --2- 172.21.15.6:0/3866579396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6401089d0 0x7fc6401a0600 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc638006010 tx=0x7fc638003ba0 comp rx=0 tx=0).stop 2024-05-20T17:20:10.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.958+0000 7fc645557640 1 -- 172.21.15.6:0/3866579396 shutdown_connections 2024-05-20T17:20:10.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.958+0000 7fc645557640 1 --2- 172.21.15.6:0/3866579396 >> [v2:172.21.15.6:6800/3244338052,v1:172.21.15.6:6801/3244338052] conn(0x7fc62c0a2b90 0x7fc62c0a50a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:10.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.958+0000 7fc645557640 1 --2- 172.21.15.6:0/3866579396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6401089d0 0x7fc6401a0600 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:10.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.958+0000 7fc645557640 1 --2- 172.21.15.6:0/3866579396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc640103cd0 0x7fc640199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:10.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.958+0000 7fc645557640 1 --2- 172.21.15.6:0/3866579396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc640102a90 0x7fc640199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:20:10.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.958+0000 7fc645557640 1 -- 172.21.15.6:0/3866579396 >> 172.21.15.6:0/3866579396 conn(0x7fc6400fdc80 msgr2=0x7fc6401049b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:20:10.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.958+0000 7fc645557640 1 -- 172.21.15.6:0/3866579396 shutdown_connections 2024-05-20T17:20:10.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:20:10.958+0000 7fc645557640 1 -- 172.21.15.6:0/3866579396 wait complete. 2024-05-20T17:20:10.974 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-20T17:20:11.005 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-20T17:20:11.081 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-20T17:20:11.115 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-20T17:20:11.115 DEBUG:teuthology.orchestra.run.smithi006:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-20T17:20:11.140 DEBUG:teuthology.orchestra.run.smithi062:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-20T17:20:11.201 DEBUG:teuthology.orchestra.run.smithi171:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-20T17:20:11.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:10 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/38109394' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T17:20:11.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:10 smithi062 ceph-mon[35425]: osdmap e97: 12 total, 12 up, 12 in 2024-05-20T17:20:11.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:10 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3866579396' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T17:20:11.281 INFO:tasks.cephadm:Stopping all daemons... 2024-05-20T17:20:11.281 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-20T17:20:11.281 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mon.a 2024-05-20T17:20:11.350 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:10 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/38109394' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T17:20:11.351 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:10 smithi006 ceph-mon[32486]: osdmap e97: 12 total, 12 up, 12 in 2024-05-20T17:20:11.351 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:10 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3866579396' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T17:20:11.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:10 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/38109394' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T17:20:11.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:10 smithi171 ceph-mon[35901]: osdmap e97: 12 total, 12 up, 12 in 2024-05-20T17:20:11.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:10 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3866579396' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-20T17:20:11.631 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:11 smithi006 systemd[1]: Stopping Ceph mon.a for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:20:12.272 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:11 smithi062 ceph-mon[35425]: pgmap v761: 33 pgs: 33 active+clean; 577 KiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:20:12.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:11 smithi062 ceph-mon[35425]: from='client.? 172.21.15.6:0/3866579396' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T17:20:12.273 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:11 smithi062 ceph-mon[35425]: osdmap e98: 12 total, 12 up, 12 in 2024-05-20T17:20:12.366 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:11 smithi171 ceph-mon[35901]: pgmap v761: 33 pgs: 33 active+clean; 577 KiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:20:12.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:11 smithi171 ceph-mon[35901]: from='client.? 172.21.15.6:0/3866579396' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T17:20:12.367 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:11 smithi171 ceph-mon[35901]: osdmap e98: 12 total, 12 up, 12 in 2024-05-20T17:20:12.386 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:11 smithi006 ceph-mon[32486]: pgmap v761: 33 pgs: 33 active+clean; 577 KiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-20T17:20:12.386 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:11 smithi006 ceph-mon[32486]: from='client.? 172.21.15.6:0/3866579396' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-05-20T17:20:12.386 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:11 smithi006 ceph-mon[32486]: osdmap e98: 12 total, 12 up, 12 in 2024-05-20T17:20:12.386 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:11 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-a[32481]: 2024-05-20T17:20:11.996+0000 7f4accc9d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:20:12.386 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:11 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-a[32481]: 2024-05-20T17:20:11.996+0000 7f4accc9d700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-20T17:20:12.386 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:12 smithi006 podman[98977]: 2024-05-20 17:20:12.183162571 +0000 UTC m=+0.387659684 container died e83671806ab5bb8ea965bef154627552b536b5607941f87ffefd6624c4a90c35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-a, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-05-20T17:20:12.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:12 smithi006 podman[98977]: 2024-05-20 17:20:12.604327975 +0000 UTC m=+0.808825071 container cleanup e83671806ab5bb8ea965bef154627552b536b5607941f87ffefd6624c4a90c35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-a, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS) 2024-05-20T17:20:12.881 INFO:journalctl@ceph.mon.a.smithi006.stdout:May 20 17:20:12 smithi006 bash[98977]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-a 2024-05-20T17:20:13.141 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mon.a.service' 2024-05-20T17:20:13.183 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:20:13.183 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-20T17:20:13.183 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-05-20T17:20:13.184 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mon.b 2024-05-20T17:20:13.522 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:13 smithi062 systemd[1]: Stopping Ceph mon.b for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:20:13.789 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:13 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-b[35421]: 2024-05-20T17:20:13.527+0000 7f51f3e8a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:20:13.789 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:13 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-b[35421]: 2024-05-20T17:20:13.527+0000 7f51f3e8a700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-20T17:20:13.789 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:13 smithi062 podman[69779]: 2024-05-20 17:20:13.548672977 +0000 UTC m=+0.146677933 container died 4c3bf039545a5619f141774c51bd1f84e414bfea62ead462d598fe0fcf1a3662 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, io.buildah.version=1.33.5) 2024-05-20T17:20:14.122 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:13 smithi062 podman[69779]: 2024-05-20 17:20:13.878367475 +0000 UTC m=+0.476372429 container cleanup 4c3bf039545a5619f141774c51bd1f84e414bfea62ead462d598fe0fcf1a3662 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-05-20T17:20:14.122 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:13 smithi062 bash[69779]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-b 2024-05-20T17:20:14.349 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mon.b.service' 2024-05-20T17:20:14.372 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:14 smithi062 podman[69791]: 2024-05-20 17:20:14.121727749 +0000 UTC m=+0.569204532 container remove 4c3bf039545a5619f141774c51bd1f84e414bfea62ead462d598fe0fcf1a3662 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:20:14.373 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:14 smithi062 systemd[1]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mon.b.service: Deactivated successfully. 2024-05-20T17:20:14.373 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:14 smithi062 systemd[1]: Stopped Ceph mon.b for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T17:20:14.373 INFO:journalctl@ceph.mon.b.smithi062.stdout:May 20 17:20:14 smithi062 systemd[1]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mon.b.service: Consumed 14.874s CPU time. 2024-05-20T17:20:14.404 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:20:14.404 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-05-20T17:20:14.405 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-05-20T17:20:14.405 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mon.c 2024-05-20T17:20:14.729 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:14 smithi171 systemd[1]: Stopping Ceph mon.c for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:20:15.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:14 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-c[35897]: 2024-05-20T17:20:14.728+0000 7fb7bd5f1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:20:15.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:14 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-c[35897]: 2024-05-20T17:20:14.728+0000 7fb7bd5f1700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-20T17:20:15.117 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:14 smithi171 podman[70656]: 2024-05-20 17:20:14.891999371 +0000 UTC m=+0.281256177 container died 530c2ec498d058901ec2d39db85840f3f2f7b34c7975b88509484c8547237663 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514) 2024-05-20T17:20:15.616 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:15 smithi171 podman[70656]: 2024-05-20 17:20:15.279436799 +0000 UTC m=+0.668693596 container cleanup 530c2ec498d058901ec2d39db85840f3f2f7b34c7975b88509484c8547237663 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:20:15.617 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:15 smithi171 bash[70656]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-c 2024-05-20T17:20:15.869 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mon.c.service' 2024-05-20T17:20:15.891 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:15 smithi171 podman[70669]: 2024-05-20 17:20:15.640739976 +0000 UTC m=+0.743374660 container remove 530c2ec498d058901ec2d39db85840f3f2f7b34c7975b88509484c8547237663 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mon-c, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, GIT_BRANCH=HEAD) 2024-05-20T17:20:15.891 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:15 smithi171 systemd[1]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mon.c.service: Deactivated successfully. 2024-05-20T17:20:15.891 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:15 smithi171 systemd[1]: Stopped Ceph mon.c for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T17:20:15.891 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 20 17:20:15 smithi171 systemd[1]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mon.c.service: Consumed 14.831s CPU time. 2024-05-20T17:20:15.927 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:20:15.927 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-05-20T17:20:15.927 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-20T17:20:15.927 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mgr.x 2024-05-20T17:20:16.292 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 17:20:15 smithi006 systemd[1]: Stopping Ceph mgr.x for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:20:16.599 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 17:20:16 smithi006 podman[99088]: 2024-05-20 17:20:16.301080563 +0000 UTC m=+0.167059457 container died b111cb13d067acf250aa52a529675a04bf84bc58af78ddbe3e3841f28b2244d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:20:17.188 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 17:20:16 smithi006 podman[99088]: 2024-05-20 17:20:16.902549077 +0000 UTC m=+0.768527958 container cleanup b111cb13d067acf250aa52a529675a04bf84bc58af78ddbe3e3841f28b2244d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:20:17.188 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 17:20:16 smithi006 bash[99088]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x 2024-05-20T17:20:17.424 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mgr.x.service' 2024-05-20T17:20:17.448 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 17:20:17 smithi006 podman[99100]: 2024-05-20 17:20:17.187803382 +0000 UTC m=+0.889279060 container remove b111cb13d067acf250aa52a529675a04bf84bc58af78ddbe3e3841f28b2244d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2b507c724ef6c8295ee0a35d185cdab167fd61d, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-x, ceph=True, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:20:17.448 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 17:20:17 smithi006 systemd[1]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mgr.x.service: Deactivated successfully. 2024-05-20T17:20:17.448 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 17:20:17 smithi006 systemd[1]: Stopped Ceph mgr.x for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T17:20:17.448 INFO:journalctl@ceph.mgr.x.smithi006.stdout:May 20 17:20:17 smithi006 systemd[1]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mgr.x.service: Consumed 1min 23.464s CPU time. 2024-05-20T17:20:17.462 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:20:17.462 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-20T17:20:17.463 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-20T17:20:17.463 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mgr.y 2024-05-20T17:20:17.522 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 17:20:17 smithi062 systemd[1]: Stopping Ceph mgr.y for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:20:18.134 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 17:20:17 smithi062 podman[69902]: 2024-05-20 17:20:17.820963919 +0000 UTC m=+0.152693108 container died 30d3544b0d547bbff8cc8ef968b73792d5d8b8405911f1d5fc875bac52ea99bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-20T17:20:18.486 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 17:20:18 smithi062 podman[69902]: 2024-05-20 17:20:18.233981413 +0000 UTC m=+0.565710584 container cleanup 30d3544b0d547bbff8cc8ef968b73792d5d8b8405911f1d5fc875bac52ea99bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y, org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-05-20T17:20:18.486 INFO:journalctl@ceph.mgr.y.smithi062.stdout:May 20 17:20:18 smithi062 bash[69902]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-y 2024-05-20T17:20:18.616 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mgr.y.service' 2024-05-20T17:20:18.652 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:20:18.653 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-20T17:20:18.653 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-05-20T17:20:18.653 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mgr.z 2024-05-20T17:20:18.990 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 17:20:18 smithi171 systemd[1]: Stopping Ceph mgr.z for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:20:19.296 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 17:20:18 smithi171 podman[70779]: 2024-05-20 17:20:18.990027957 +0000 UTC m=+0.143397891 container died d51aa1f3ec89ae68b4dcd9a09b56b61db5434e333b755ce2f971f3c9b690a935 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z, GIT_CLEAN=True, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-05-20T17:20:19.617 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 17:20:19 smithi171 podman[70779]: 2024-05-20 17:20:19.387325763 +0000 UTC m=+0.540695694 container cleanup d51aa1f3ec89ae68b4dcd9a09b56b61db5434e333b755ce2f971f3c9b690a935 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-20T17:20:19.617 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 20 17:20:19 smithi171 bash[70779]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mgr-z 2024-05-20T17:20:19.866 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mgr.z.service' 2024-05-20T17:20:19.901 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:20:19.901 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-05-20T17:20:19.901 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-20T17:20:19.901 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.0 2024-05-20T17:20:20.226 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:20:19 smithi006 systemd[1]: Stopping Ceph osd.0 for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:20:20.631 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:20:20 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-0[47208]: 2024-05-20T17:20:20.223+0000 7f58718ff700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:20:20.631 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:20:20 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-0[47208]: 2024-05-20T17:20:20.223+0000 7f58718ff700 -1 osd.0 98 *** Got signal Terminated *** 2024-05-20T17:20:20.631 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:20:20 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-0[47208]: 2024-05-20T17:20:20.223+0000 7f58718ff700 -1 osd.0 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:20:25.881 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:20:25 smithi006 podman[99211]: 2024-05-20 17:20:25.62277617 +0000 UTC m=+5.518140597 container died eda791b4314387205ee77fb2cf6e6b7bb07ef6cadfd85b8a55df2412050862db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:20:26.286 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:20:26 smithi006 podman[99211]: 2024-05-20 17:20:26.058657296 +0000 UTC m=+5.954021719 container cleanup eda791b4314387205ee77fb2cf6e6b7bb07ef6cadfd85b8a55df2412050862db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-20T17:20:26.286 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:20:26 smithi006 bash[99211]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-0 2024-05-20T17:20:26.631 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:20:26 smithi006 podman[99227]: 2024-05-20 17:20:26.285495189 +0000 UTC m=+0.659524556 container remove eda791b4314387205ee77fb2cf6e6b7bb07ef6cadfd85b8a55df2412050862db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-0, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-05-20T17:20:27.056 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:20:26 smithi006 podman[99318]: 2024-05-20 17:20:26.657043979 +0000 UTC m=+0.018186171 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:20:27.056 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:20:26 smithi006 podman[99318]: 2024-05-20 17:20:26.778272227 +0000 UTC m=+0.139414400 container create 795b52a5b12acb2559f1db2f63c5cbd206ca73ccdf580d5f1daf8dc547889fd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-05-20T17:20:27.056 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:20:27 smithi006 podman[99318]: 2024-05-20 17:20:27.05611297 +0000 UTC m=+0.417255156 container init 795b52a5b12acb2559f1db2f63c5cbd206ca73ccdf580d5f1daf8dc547889fd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-20T17:20:27.381 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:20:27 smithi006 podman[99318]: 2024-05-20 17:20:27.059559784 +0000 UTC m=+0.420701956 container start 795b52a5b12acb2559f1db2f63c5cbd206ca73ccdf580d5f1daf8dc547889fd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240514) 2024-05-20T17:20:27.381 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:20:27 smithi006 podman[99318]: 2024-05-20 17:20:27.172793745 +0000 UTC m=+0.533935917 container attach 795b52a5b12acb2559f1db2f63c5cbd206ca73ccdf580d5f1daf8dc547889fd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-0-deactivate, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-05-20T17:20:27.881 INFO:journalctl@ceph.osd.0.smithi006.stdout:May 20 17:20:27 smithi006 podman[99318]: 2024-05-20 17:20:27.602449869 +0000 UTC m=+0.963592043 container died 795b52a5b12acb2559f1db2f63c5cbd206ca73ccdf580d5f1daf8dc547889fd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:20:28.281 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.0.service' 2024-05-20T17:20:28.328 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:20:28.328 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-20T17:20:28.328 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-20T17:20:28.328 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.1 2024-05-20T17:20:28.647 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:20:28 smithi062 systemd[1]: Stopping Ceph osd.1 for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:20:29.022 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:20:28 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-1[39980]: 2024-05-20T17:20:28.646+0000 7f91c0301700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:20:29.023 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:20:28 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-1[39980]: 2024-05-20T17:20:28.646+0000 7f91c0301700 -1 osd.1 98 *** Got signal Terminated *** 2024-05-20T17:20:29.023 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:20:28 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-1[39980]: 2024-05-20T17:20:28.646+0000 7f91c0301700 -1 osd.1 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:20:34.523 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:20:34 smithi062 podman[70022]: 2024-05-20 17:20:34.137380476 +0000 UTC m=+5.606431886 container died 43a497e2e37352d5e16a319fcc025b6775f907bc42e7d309dbada63cf9976a9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-20T17:20:34.933 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:20:34 smithi062 podman[70022]: 2024-05-20 17:20:34.689592613 +0000 UTC m=+6.158644001 container cleanup 43a497e2e37352d5e16a319fcc025b6775f907bc42e7d309dbada63cf9976a9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=) 2024-05-20T17:20:34.933 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:20:34 smithi062 bash[70022]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-1 2024-05-20T17:20:35.273 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:20:34 smithi062 podman[70039]: 2024-05-20 17:20:34.933040039 +0000 UTC m=+0.789979248 container remove 43a497e2e37352d5e16a319fcc025b6775f907bc42e7d309dbada63cf9976a9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-1, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:20:35.636 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:20:35 smithi062 podman[70126]: 2024-05-20 17:20:35.259825622 +0000 UTC m=+0.018404207 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:20:35.637 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:20:35 smithi062 podman[70126]: 2024-05-20 17:20:35.367394879 +0000 UTC m=+0.125973448 container create c2de8fd9597c61fca4ea9a0b8b390da1a86f3543bee78649c07b47d260348268 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-1-deactivate, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-05-20T17:20:35.965 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:20:35 smithi062 podman[70126]: 2024-05-20 17:20:35.636903314 +0000 UTC m=+0.395481877 container init c2de8fd9597c61fca4ea9a0b8b390da1a86f3543bee78649c07b47d260348268 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-1-deactivate, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-20T17:20:35.966 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:20:35 smithi062 podman[70126]: 2024-05-20 17:20:35.640752876 +0000 UTC m=+0.399331446 container start c2de8fd9597c61fca4ea9a0b8b390da1a86f3543bee78649c07b47d260348268 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-05-20T17:20:35.966 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:20:35 smithi062 podman[70126]: 2024-05-20 17:20:35.745318162 +0000 UTC m=+0.503896742 container attach c2de8fd9597c61fca4ea9a0b8b390da1a86f3543bee78649c07b47d260348268 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, ceph=True) 2024-05-20T17:20:36.272 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:20:35 smithi062 podman[70126]: 2024-05-20 17:20:35.966028544 +0000 UTC m=+0.724607115 container died c2de8fd9597c61fca4ea9a0b8b390da1a86f3543bee78649c07b47d260348268 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-20T17:20:36.667 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:20:36 smithi062 podman[70152]: 2024-05-20 17:20:36.649746018 +0000 UTC m=+0.675579285 container remove c2de8fd9597c61fca4ea9a0b8b390da1a86f3543bee78649c07b47d260348268 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-1-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:20:36.667 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:20:36 smithi062 systemd[1]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.1.service: Deactivated successfully. 2024-05-20T17:20:36.667 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 20 17:20:36 smithi062 systemd[1]: Stopped Ceph osd.1 for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T17:20:36.669 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.1.service' 2024-05-20T17:20:36.718 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:20:36.718 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-20T17:20:36.718 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-20T17:20:36.718 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.2 2024-05-20T17:20:37.043 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:20:36 smithi171 systemd[1]: Stopping Ceph osd.2 for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:20:37.367 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:20:37 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-2[41014]: 2024-05-20T17:20:37.042+0000 7f8845941700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:20:37.367 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:20:37 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-2[41014]: 2024-05-20T17:20:37.042+0000 7f8845941700 -1 osd.2 98 *** Got signal Terminated *** 2024-05-20T17:20:37.367 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:20:37 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-2[41014]: 2024-05-20T17:20:37.042+0000 7f8845941700 -1 osd.2 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:20:42.867 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:20:42 smithi171 podman[70906]: 2024-05-20 17:20:42.589081254 +0000 UTC m=+5.658998680 container died 4b9385aa862437471a7780cabbe8cd0660823efe6dd6f5324eb5e0442cf31b1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-05-20T17:20:43.221 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:20:42 smithi171 podman[70906]: 2024-05-20 17:20:42.993974236 +0000 UTC m=+6.063891652 container cleanup 4b9385aa862437471a7780cabbe8cd0660823efe6dd6f5324eb5e0442cf31b1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-2, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-20T17:20:43.221 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:20:42 smithi171 bash[70906]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-2 2024-05-20T17:20:43.559 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:20:43 smithi171 podman[70932]: 2024-05-20 17:20:43.220984836 +0000 UTC m=+0.632904692 container remove 4b9385aa862437471a7780cabbe8cd0660823efe6dd6f5324eb5e0442cf31b1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-2, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-20T17:20:43.833 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:20:43 smithi171 podman[71023]: 2024-05-20 17:20:43.462488885 +0000 UTC m=+0.017762728 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:20:43.833 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:20:43 smithi171 podman[71023]: 2024-05-20 17:20:43.588799732 +0000 UTC m=+0.144073553 container create 120ba21c6ca188705c23afdfddb7fc6194333f99d0f645ae83330fc9d1d13827 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-20T17:20:44.117 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:20:43 smithi171 podman[71023]: 2024-05-20 17:20:43.833694887 +0000 UTC m=+0.388968721 container init 120ba21c6ca188705c23afdfddb7fc6194333f99d0f645ae83330fc9d1d13827 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-05-20T17:20:44.117 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:20:43 smithi171 podman[71023]: 2024-05-20 17:20:43.837295556 +0000 UTC m=+0.392569382 container start 120ba21c6ca188705c23afdfddb7fc6194333f99d0f645ae83330fc9d1d13827 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:20:44.117 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:20:43 smithi171 podman[71023]: 2024-05-20 17:20:43.942360574 +0000 UTC m=+0.497634394 container attach 120ba21c6ca188705c23afdfddb7fc6194333f99d0f645ae83330fc9d1d13827 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240514, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-20T17:20:44.446 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 20 17:20:44 smithi171 podman[71023]: 2024-05-20 17:20:44.173281257 +0000 UTC m=+0.728555087 container died 120ba21c6ca188705c23afdfddb7fc6194333f99d0f645ae83330fc9d1d13827 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-05-20T17:20:44.783 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.2.service' 2024-05-20T17:20:44.824 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:20:44.824 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-20T17:20:44.824 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-20T17:20:44.824 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.3 2024-05-20T17:20:45.131 INFO:journalctl@ceph.osd.3.smithi006.stdout:May 20 17:20:44 smithi006 systemd[1]: Stopping Ceph osd.3 for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:20:45.413 INFO:journalctl@ceph.osd.3.smithi006.stdout:May 20 17:20:45 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-3[54116]: 2024-05-20T17:20:45.154+0000 7f8c6889c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:20:45.414 INFO:journalctl@ceph.osd.3.smithi006.stdout:May 20 17:20:45 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-3[54116]: 2024-05-20T17:20:45.154+0000 7f8c6889c700 -1 osd.3 98 *** Got signal Terminated *** 2024-05-20T17:20:45.414 INFO:journalctl@ceph.osd.3.smithi006.stdout:May 20 17:20:45 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-3[54116]: 2024-05-20T17:20:45.154+0000 7f8c6889c700 -1 osd.3 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:20:49.381 INFO:journalctl@ceph.osd.3.smithi006.stdout:May 20 17:20:48 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-3[54116]: 2024-05-20T17:20:48.900+0000 7f8c64e52700 -1 osd.3 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:23.265968+0000 front 2024-05-20T17:20:23.265993+0000 (oldest deadline 2024-05-20T17:20:48.466769+0000) 2024-05-20T17:20:49.382 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:20:48 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:20:48.897+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:20:49.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:20:49 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:20:49.208+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:20:50.381 INFO:journalctl@ceph.osd.3.smithi006.stdout:May 20 17:20:49 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-3[54116]: 2024-05-20T17:20:49.896+0000 7f8c64e52700 -1 osd.3 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:23.265968+0000 front 2024-05-20T17:20:23.265993+0000 (oldest deadline 2024-05-20T17:20:48.466769+0000) 2024-05-20T17:20:50.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:20:49 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:20:49.924+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:20:50.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:20:50 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:20:50.245+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:20:50.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:20:50 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:20:50.343+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:21.986121+0000 front 2024-05-20T17:20:21.986173+0000 (oldest deadline 2024-05-20T17:20:49.586721+0000) 2024-05-20T17:20:50.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:20:50 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:20:50.336+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:20:51.131 INFO:journalctl@ceph.osd.3.smithi006.stdout:May 20 17:20:50 smithi006 podman[99423]: 2024-05-20 17:20:50.795318796 +0000 UTC m=+5.760404677 container died ecb903efb5f2e8744cb1d373b9f812cac809725779283a25d3f8e458946474cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:20:51.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:20:50 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:20:50.902+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:20:51.591 INFO:journalctl@ceph.osd.3.smithi006.stdout:May 20 17:20:51 smithi006 podman[99423]: 2024-05-20 17:20:51.222166644 +0000 UTC m=+6.187252516 container cleanup ecb903efb5f2e8744cb1d373b9f812cac809725779283a25d3f8e458946474cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-3, org.label-schema.build-date=20240514, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-20T17:20:51.591 INFO:journalctl@ceph.osd.3.smithi006.stdout:May 20 17:20:51 smithi006 bash[99423]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-3 2024-05-20T17:20:51.616 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:20:51 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:20:51.365+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:21.986121+0000 front 2024-05-20T17:20:21.986173+0000 (oldest deadline 2024-05-20T17:20:49.586721+0000) 2024-05-20T17:20:51.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:20:51 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:20:51.260+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:20:51.772 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:20:51 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:20:51.327+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:20:51.867 INFO:journalctl@ceph.osd.3.smithi006.stdout:May 20 17:20:51 smithi006 podman[99452]: 2024-05-20 17:20:51.590939616 +0000 UTC m=+0.789190387 container remove ecb903efb5f2e8744cb1d373b9f812cac809725779283a25d3f8e458946474cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-20T17:20:52.131 INFO:journalctl@ceph.osd.3.smithi006.stdout:May 20 17:20:52 smithi006 podman[99544]: 2024-05-20 17:20:51.916397447 +0000 UTC m=+0.018011346 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:20:52.131 INFO:journalctl@ceph.osd.3.smithi006.stdout:May 20 17:20:52 smithi006 podman[99544]: 2024-05-20 17:20:52.041918255 +0000 UTC m=+0.143532156 container create 26afa4a8843b4faed5577833b47622e3ed700c62c6e618b18b7a5e43691153d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-3-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=) 2024-05-20T17:20:52.132 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:20:51 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:20:51.865+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:20:52.592 INFO:journalctl@ceph.osd.3.smithi006.stdout:May 20 17:20:52 smithi006 podman[99544]: 2024-05-20 17:20:52.278295917 +0000 UTC m=+0.379909824 container init 26afa4a8843b4faed5577833b47622e3ed700c62c6e618b18b7a5e43691153d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-3-deactivate, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-05-20T17:20:52.592 INFO:journalctl@ceph.osd.3.smithi006.stdout:May 20 17:20:52 smithi006 podman[99544]: 2024-05-20 17:20:52.281874273 +0000 UTC m=+0.383488178 container start 26afa4a8843b4faed5577833b47622e3ed700c62c6e618b18b7a5e43691153d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True) 2024-05-20T17:20:52.592 INFO:journalctl@ceph.osd.3.smithi006.stdout:May 20 17:20:52 smithi006 podman[99544]: 2024-05-20 17:20:52.352824698 +0000 UTC m=+0.454438618 container attach 26afa4a8843b4faed5577833b47622e3ed700c62c6e618b18b7a5e43691153d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-3-deactivate, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-20T17:20:52.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:20:52 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:20:52.395+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:21.986121+0000 front 2024-05-20T17:20:21.986173+0000 (oldest deadline 2024-05-20T17:20:49.586721+0000) 2024-05-20T17:20:52.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:20:52 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:20:52.239+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:20:52.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:20:52 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:20:52.351+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:20:52.844 INFO:journalctl@ceph.osd.3.smithi006.stdout:May 20 17:20:52 smithi006 podman[99544]: 2024-05-20 17:20:52.592304807 +0000 UTC m=+0.693918709 container died 26afa4a8843b4faed5577833b47622e3ed700c62c6e618b18b7a5e43691153d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-3-deactivate, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux ) 2024-05-20T17:20:53.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:20:52 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:20:52.843+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:20:53.433 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.3.service' 2024-05-20T17:20:53.481 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:20:53.482 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-20T17:20:53.482 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-20T17:20:53.482 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.4 2024-05-20T17:20:53.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:20:53 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:20:53.398+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:21.986121+0000 front 2024-05-20T17:20:21.986173+0000 (oldest deadline 2024-05-20T17:20:49.586721+0000) 2024-05-20T17:20:53.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:20:53 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:20:53.230+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:20:53.772 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:20:53 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:20:53.316+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:20:53.773 INFO:journalctl@ceph.osd.4.smithi062.stdout:May 20 17:20:53 smithi062 systemd[1]: Stopping Ceph osd.4 for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:20:54.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:20:53 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:20:53.836+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:20:54.273 INFO:journalctl@ceph.osd.4.smithi062.stdout:May 20 17:20:53 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-4[46617]: 2024-05-20T17:20:53.801+0000 7feae8310700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:20:54.273 INFO:journalctl@ceph.osd.4.smithi062.stdout:May 20 17:20:53 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-4[46617]: 2024-05-20T17:20:53.801+0000 7feae8310700 -1 osd.4 98 *** Got signal Terminated *** 2024-05-20T17:20:54.273 INFO:journalctl@ceph.osd.4.smithi062.stdout:May 20 17:20:53 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-4[46617]: 2024-05-20T17:20:53.801+0000 7feae8310700 -1 osd.4 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:20:54.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:20:54 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:20:54.349+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:21.986121+0000 front 2024-05-20T17:20:21.986173+0000 (oldest deadline 2024-05-20T17:20:49.586721+0000) 2024-05-20T17:20:54.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:20:54 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:20:54.263+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:20:54.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:20:54 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:20:54.292+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:20:55.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:20:54 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:20:54.829+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:20:55.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:20:55 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:20:55.308+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:20:55.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:20:55 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:20:55.384+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:21.986121+0000 front 2024-05-20T17:20:21.986173+0000 (oldest deadline 2024-05-20T17:20:49.586721+0000) 2024-05-20T17:20:55.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:20:55 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:20:55.384+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:29.587367+0000 front 2024-05-20T17:20:29.587384+0000 (oldest deadline 2024-05-20T17:20:54.887166+0000) 2024-05-20T17:20:55.772 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:20:55 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:20:55.273+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:20:56.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:20:55 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:20:55.863+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:20:56.256 INFO:journalctl@ceph.osd.4.smithi062.stdout:May 20 17:20:56 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-4[46617]: 2024-05-20T17:20:56.217+0000 7feae08be700 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.067061+0000 front 2024-05-20T17:20:30.067098+0000 (oldest deadline 2024-05-20T17:20:55.367228+0000) 2024-05-20T17:20:56.256 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:20:55 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:20:55.979+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:20:56.522 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:20:56 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:20:56.255+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:20:56.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:20:56 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:20:56.299+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:20:56.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:20:56 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:20:56.356+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:21.986121+0000 front 2024-05-20T17:20:21.986173+0000 (oldest deadline 2024-05-20T17:20:49.586721+0000) 2024-05-20T17:20:56.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:20:56 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:20:56.356+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:29.587367+0000 front 2024-05-20T17:20:29.587384+0000 (oldest deadline 2024-05-20T17:20:54.887166+0000) 2024-05-20T17:20:57.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:20:56 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:20:56.837+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:20:57.239 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:20:56 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:20:56.949+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:20:57.523 INFO:journalctl@ceph.osd.4.smithi062.stdout:May 20 17:20:57 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-4[46617]: 2024-05-20T17:20:57.238+0000 7feae08be700 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.067061+0000 front 2024-05-20T17:20:30.067098+0000 (oldest deadline 2024-05-20T17:20:55.367228+0000) 2024-05-20T17:20:57.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:20:57 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:20:57.275+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:20:57.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:20:57 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:20:57.275+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:20:57.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:20:57 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:20:57.327+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:20:57.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:20:57 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:20:57.393+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:21.986121+0000 front 2024-05-20T17:20:21.986173+0000 (oldest deadline 2024-05-20T17:20:49.586721+0000) 2024-05-20T17:20:57.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:20:57 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:20:57.393+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:29.587367+0000 front 2024-05-20T17:20:29.587384+0000 (oldest deadline 2024-05-20T17:20:54.887166+0000) 2024-05-20T17:20:58.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:20:57 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:20:57.743+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:20:58.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:20:57 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:20:57.879+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:20:58.131 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:20:57 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:20:57.945+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:33.458558+0000 front 2024-05-20T17:20:33.458481+0000 (oldest deadline 2024-05-20T17:20:56.958609+0000) 2024-05-20T17:20:58.272 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:20:57 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:20:57.916+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:20:58.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:20:58 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:20:58.436+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:21.986121+0000 front 2024-05-20T17:20:21.986173+0000 (oldest deadline 2024-05-20T17:20:49.586721+0000) 2024-05-20T17:20:58.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:20:58 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:20:58.436+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:29.587367+0000 front 2024-05-20T17:20:29.587384+0000 (oldest deadline 2024-05-20T17:20:54.887166+0000) 2024-05-20T17:20:58.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:20:58 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:20:58.321+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:20:58.773 INFO:journalctl@ceph.osd.4.smithi062.stdout:May 20 17:20:58 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-4[46617]: 2024-05-20T17:20:58.283+0000 7feae08be700 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.067061+0000 front 2024-05-20T17:20:30.067098+0000 (oldest deadline 2024-05-20T17:20:55.367228+0000) 2024-05-20T17:20:58.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:20:58 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:20:58.276+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:20:58.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:20:58 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:20:58.276+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:20:59.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:20:58 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:20:58.737+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:20:59.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:20:58 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:20:58.868+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:20:59.131 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:20:58 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:20:58.944+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:33.458558+0000 front 2024-05-20T17:20:33.458481+0000 (oldest deadline 2024-05-20T17:20:56.958609+0000) 2024-05-20T17:20:59.272 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:20:58 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:20:58.867+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:20:59.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:20:59 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:20:59.325+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:20:59.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:20:59 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:20:59.404+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:21.986121+0000 front 2024-05-20T17:20:21.986173+0000 (oldest deadline 2024-05-20T17:20:49.586721+0000) 2024-05-20T17:20:59.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:20:59 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:20:59.404+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:29.587367+0000 front 2024-05-20T17:20:29.587384+0000 (oldest deadline 2024-05-20T17:20:54.887166+0000) 2024-05-20T17:20:59.746 INFO:journalctl@ceph.osd.4.smithi062.stdout:May 20 17:20:59 smithi062 podman[70244]: 2024-05-20 17:20:59.338639742 +0000 UTC m=+5.647439199 container died 55e4ebca331fc7cdd8ec8819a2bb0c37e8c7a74d4a21acf21e36f4bc9577b719 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-4, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-20T17:20:59.746 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:20:59 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:20:59.288+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:20:59.746 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:20:59 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:20:59.288+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:00.022 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:20:59 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:20:59.916+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:00.023 INFO:journalctl@ceph.osd.4.smithi062.stdout:May 20 17:20:59 smithi062 podman[70244]: 2024-05-20 17:20:59.835735441 +0000 UTC m=+6.144534892 container cleanup 55e4ebca331fc7cdd8ec8819a2bb0c37e8c7a74d4a21acf21e36f4bc9577b719 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-4, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-20T17:21:00.023 INFO:journalctl@ceph.osd.4.smithi062.stdout:May 20 17:20:59 smithi062 bash[70244]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-4 2024-05-20T17:21:00.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:20:59 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:20:59.769+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:00.131 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:20:59 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:20:59.925+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:33.458558+0000 front 2024-05-20T17:20:33.458481+0000 (oldest deadline 2024-05-20T17:20:56.958609+0000) 2024-05-20T17:21:00.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:20:59 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:20:59.872+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:00.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:20:59 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:20:59.872+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:00.461 INFO:journalctl@ceph.osd.4.smithi062.stdout:May 20 17:21:00 smithi062 podman[70259]: 2024-05-20 17:21:00.104102398 +0000 UTC m=+0.763379608 container remove 55e4ebca331fc7cdd8ec8819a2bb0c37e8c7a74d4a21acf21e36f4bc9577b719 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:21:00.461 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:00 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:00.300+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:00.461 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:00 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:00.300+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:00.733 INFO:journalctl@ceph.osd.4.smithi062.stdout:May 20 17:21:00 smithi062 podman[70351]: 2024-05-20 17:21:00.363464634 +0000 UTC m=+0.017718328 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:21:00.733 INFO:journalctl@ceph.osd.4.smithi062.stdout:May 20 17:21:00 smithi062 podman[70351]: 2024-05-20 17:21:00.480439614 +0000 UTC m=+0.134693307 container create d738c9a4fe8bd439b7c476ff11d8995d045ba24c3aa1f3750ec704ba9fcb5ea9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True) 2024-05-20T17:21:00.779 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:00 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:00.374+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:00.780 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:00 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:21:00.406+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:21.986121+0000 front 2024-05-20T17:20:21.986173+0000 (oldest deadline 2024-05-20T17:20:49.586721+0000) 2024-05-20T17:21:00.780 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:00 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:21:00.406+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:29.587367+0000 front 2024-05-20T17:20:29.587384+0000 (oldest deadline 2024-05-20T17:20:54.887166+0000) 2024-05-20T17:21:01.023 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:00 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:00.962+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:01.023 INFO:journalctl@ceph.osd.4.smithi062.stdout:May 20 17:21:00 smithi062 podman[70351]: 2024-05-20 17:21:00.732849826 +0000 UTC m=+0.387103512 container init d738c9a4fe8bd439b7c476ff11d8995d045ba24c3aa1f3750ec704ba9fcb5ea9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True) 2024-05-20T17:21:01.023 INFO:journalctl@ceph.osd.4.smithi062.stdout:May 20 17:21:00 smithi062 podman[70351]: 2024-05-20 17:21:00.736605593 +0000 UTC m=+0.390859268 container start d738c9a4fe8bd439b7c476ff11d8995d045ba24c3aa1f3750ec704ba9fcb5ea9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-20T17:21:01.023 INFO:journalctl@ceph.osd.4.smithi062.stdout:May 20 17:21:00 smithi062 podman[70351]: 2024-05-20 17:21:00.833000883 +0000 UTC m=+0.487254575 container attach d738c9a4fe8bd439b7c476ff11d8995d045ba24c3aa1f3750ec704ba9fcb5ea9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-20T17:21:01.116 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:00 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:00.778+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:01.335 INFO:journalctl@ceph.osd.4.smithi062.stdout:May 20 17:21:01 smithi062 podman[70351]: 2024-05-20 17:21:01.039188709 +0000 UTC m=+0.693442384 container died d738c9a4fe8bd439b7c476ff11d8995d045ba24c3aa1f3750ec704ba9fcb5ea9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-05-20T17:21:01.336 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:01 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:01.279+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:01.336 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:01 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:01.279+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:01.381 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:00 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:00.919+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:33.458558+0000 front 2024-05-20T17:20:33.458481+0000 (oldest deadline 2024-05-20T17:20:56.958609+0000) 2024-05-20T17:21:01.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:00 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:00.892+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:01.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:00 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:00.892+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:01.645 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.4.service' 2024-05-20T17:21:01.686 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:21:01.686 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-20T17:21:01.686 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-20T17:21:01.686 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.5 2024-05-20T17:21:01.714 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:01 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:21:01.437+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:21.986121+0000 front 2024-05-20T17:20:21.986173+0000 (oldest deadline 2024-05-20T17:20:49.586721+0000) 2024-05-20T17:21:01.714 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:01 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:21:01.437+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:29.587367+0000 front 2024-05-20T17:20:29.587384+0000 (oldest deadline 2024-05-20T17:20:54.887166+0000) 2024-05-20T17:21:01.715 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:01 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:01.402+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:02.026 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:01 smithi171 systemd[1]: Stopping Ceph osd.5 for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:21:02.027 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:01 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:01.733+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:02.248 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:01 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:01.937+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:02.367 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:02 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:21:02.026+0000 7fdcf34cb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:21:02.367 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:02 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:21:02.026+0000 7fdcf34cb700 -1 osd.5 98 *** Got signal Terminated *** 2024-05-20T17:21:02.367 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:02 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:21:02.026+0000 7fdcf34cb700 -1 osd.5 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:21:02.381 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:01 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:01.908+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:33.458558+0000 front 2024-05-20T17:20:33.458481+0000 (oldest deadline 2024-05-20T17:20:56.958609+0000) 2024-05-20T17:21:02.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:01 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:01.928+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:02.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:01 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:01.928+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:02.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:02 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:02.248+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:02.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:02 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:02.248+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:02.709 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:02 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:02.389+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:02.709 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:02 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:21:02.438+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:21.986121+0000 front 2024-05-20T17:20:21.986173+0000 (oldest deadline 2024-05-20T17:20:49.586721+0000) 2024-05-20T17:21:02.710 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:02 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:21:02.438+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:29.587367+0000 front 2024-05-20T17:20:29.587384+0000 (oldest deadline 2024-05-20T17:20:54.887166+0000) 2024-05-20T17:21:03.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:02 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:02.709+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:03.131 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:02 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:02.929+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:33.458558+0000 front 2024-05-20T17:20:33.458481+0000 (oldest deadline 2024-05-20T17:20:56.958609+0000) 2024-05-20T17:21:03.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:02 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:02.878+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:03.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:02 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:02.879+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:03.213 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:02 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:02.947+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:03.522 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:03 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:03.212+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:03.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:03 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:03.212+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:03.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:03 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:03.212+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:03.616 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:03 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:21:03.471+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:21.986121+0000 front 2024-05-20T17:20:21.986173+0000 (oldest deadline 2024-05-20T17:20:49.586721+0000) 2024-05-20T17:21:03.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:03 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:21:03.471+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:29.587367+0000 front 2024-05-20T17:20:29.587384+0000 (oldest deadline 2024-05-20T17:20:54.887166+0000) 2024-05-20T17:21:03.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:03 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:03.346+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:04.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:03 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:03.675+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:04.131 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:03 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:03.881+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:33.458558+0000 front 2024-05-20T17:20:33.458481+0000 (oldest deadline 2024-05-20T17:20:56.958609+0000) 2024-05-20T17:21:04.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:03 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:03.840+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:04.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:03 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:03.840+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:04.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:03 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:03.841+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:04.272 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:03 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:03.937+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:04.273 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:04 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:04.174+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:04.273 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:04 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:04.174+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:04.273 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:04 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:04.174+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:04.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:04 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:21:04.459+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:21.986121+0000 front 2024-05-20T17:20:21.986173+0000 (oldest deadline 2024-05-20T17:20:49.586721+0000) 2024-05-20T17:21:04.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:04 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:21:04.459+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:29.587367+0000 front 2024-05-20T17:20:29.587384+0000 (oldest deadline 2024-05-20T17:20:54.887166+0000) 2024-05-20T17:21:04.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:04 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:04.298+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:05.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:04 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:04.649+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:05.131 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:04 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:04.867+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:33.458558+0000 front 2024-05-20T17:20:33.458481+0000 (oldest deadline 2024-05-20T17:20:56.958609+0000) 2024-05-20T17:21:05.132 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:04 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:04.867+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.362151+0000 front 2024-05-20T17:20:41.361724+0000 (oldest deadline 2024-05-20T17:21:04.861614+0000) 2024-05-20T17:21:05.132 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:04 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:04.841+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:05.132 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:04 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:04.841+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:05.132 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:04 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:04.841+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:05.189 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:04 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:04.929+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:05.465 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:05 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:05.215+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:05.465 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:05 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:05.215+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:05.465 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:05 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:05.215+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:05.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:05 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:21:05.504+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:21.986121+0000 front 2024-05-20T17:20:21.986173+0000 (oldest deadline 2024-05-20T17:20:49.586721+0000) 2024-05-20T17:21:05.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:05 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:21:05.504+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:29.587367+0000 front 2024-05-20T17:20:29.587384+0000 (oldest deadline 2024-05-20T17:20:54.887166+0000) 2024-05-20T17:21:05.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:05 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:21:05.504+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.088521+0000 front 2024-05-20T17:20:40.088560+0000 (oldest deadline 2024-05-20T17:21:05.388715+0000) 2024-05-20T17:21:05.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:05 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:05.298+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:05.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:05 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:05.298+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:06.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:05 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:05.661+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:06.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:05 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:05.661+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:06.131 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:05 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:05.888+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:33.458558+0000 front 2024-05-20T17:20:33.458481+0000 (oldest deadline 2024-05-20T17:20:56.958609+0000) 2024-05-20T17:21:06.131 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:05 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:05.888+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.362151+0000 front 2024-05-20T17:20:41.361724+0000 (oldest deadline 2024-05-20T17:21:04.861614+0000) 2024-05-20T17:21:06.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:05 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:05.871+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:06.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:05 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:05.871+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:06.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:05 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:05.871+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:06.197 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:05 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:05.894+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:06.197 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:05 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:05.894+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:39.733066+0000 front 2024-05-20T17:20:39.733169+0000 (oldest deadline 2024-05-20T17:21:05.632963+0000) 2024-05-20T17:21:06.450 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:06 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:06.197+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:06.451 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:06 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:06.197+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:06.451 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:06 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:06.197+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:06.456 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:06 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:06.336+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:06.456 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:06 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:06.336+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:06.867 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:06 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:06.646+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:06.867 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:06 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:06.646+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:06.867 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:06 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:21:06.456+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:21.986121+0000 front 2024-05-20T17:20:21.986173+0000 (oldest deadline 2024-05-20T17:20:49.586721+0000) 2024-05-20T17:21:06.867 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:06 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:21:06.456+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:29.587367+0000 front 2024-05-20T17:20:29.587384+0000 (oldest deadline 2024-05-20T17:20:54.887166+0000) 2024-05-20T17:21:06.867 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:06 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5[47474]: 2024-05-20T17:21:06.456+0000 7fdceba79700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.088521+0000 front 2024-05-20T17:20:40.088560+0000 (oldest deadline 2024-05-20T17:21:05.388715+0000) 2024-05-20T17:21:07.131 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:06 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:06.879+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:33.458558+0000 front 2024-05-20T17:20:33.458481+0000 (oldest deadline 2024-05-20T17:20:56.958609+0000) 2024-05-20T17:21:07.131 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:06 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:06.879+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.362151+0000 front 2024-05-20T17:20:41.361724+0000 (oldest deadline 2024-05-20T17:21:04.861614+0000) 2024-05-20T17:21:07.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:06 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:06.889+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:07.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:06 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:06.889+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:07.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:06 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:06.889+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:07.163 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:06 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:06.899+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:07.164 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:06 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:06.899+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:39.733066+0000 front 2024-05-20T17:20:39.733169+0000 (oldest deadline 2024-05-20T17:21:05.632963+0000) 2024-05-20T17:21:07.522 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:07 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:07.163+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:07.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:07 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:07.163+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:07.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:07 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:07.164+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:07.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:07 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:07.326+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:07.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:07 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:07.326+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:08.011 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:07 smithi171 podman[71127]: 2024-05-20 17:21:07.657070705 +0000 UTC m=+5.767430843 container died cc3806aeacf80efc032c635e5f2f092d1100c935f60e0ceb413ba8411d951b74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-05-20T17:21:08.011 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:07 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:07.628+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:08.011 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:07 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:07.628+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:08.131 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:07 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:07.894+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:33.458558+0000 front 2024-05-20T17:20:33.458481+0000 (oldest deadline 2024-05-20T17:20:56.958609+0000) 2024-05-20T17:21:08.131 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:07 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:07.894+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.362151+0000 front 2024-05-20T17:20:41.361724+0000 (oldest deadline 2024-05-20T17:21:04.861614+0000) 2024-05-20T17:21:08.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:07 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:07.862+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:08.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:07 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:07.862+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:08.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:07 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:07.862+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:08.203 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:07 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:07.897+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:08.203 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:07 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:07.897+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:39.733066+0000 front 2024-05-20T17:20:39.733169+0000 (oldest deadline 2024-05-20T17:21:05.632963+0000) 2024-05-20T17:21:08.367 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:08 smithi171 podman[71127]: 2024-05-20 17:21:08.109862277 +0000 UTC m=+6.220222416 container cleanup cc3806aeacf80efc032c635e5f2f092d1100c935f60e0ceb413ba8411d951b74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514) 2024-05-20T17:21:08.367 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:08 smithi171 bash[71127]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5 2024-05-20T17:21:08.522 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:08 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:08.203+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:08.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:08 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:08.203+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:08.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:08 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:08.203+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:08.662 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:08 smithi171 podman[71145]: 2024-05-20 17:21:08.420260544 +0000 UTC m=+0.757354379 container remove cc3806aeacf80efc032c635e5f2f092d1100c935f60e0ceb413ba8411d951b74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0) 2024-05-20T17:21:08.663 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:08 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:08.369+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:08.663 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:08 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:08.369+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:08.928 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:08 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:08.661+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:08.929 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:08 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:08.661+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:08.929 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:08 smithi171 podman[71236]: 2024-05-20 17:21:08.6793453 +0000 UTC m=+0.017425046 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:21:08.929 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:08 smithi171 podman[71236]: 2024-05-20 17:21:08.813317171 +0000 UTC m=+0.151396896 container create 785ef3788387cee6da593202d170afefefb36ed105bc2e4a507631c3b6d8ac5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5-deactivate, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-20T17:21:09.131 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:08 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:08.863+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:33.458558+0000 front 2024-05-20T17:20:33.458481+0000 (oldest deadline 2024-05-20T17:20:56.958609+0000) 2024-05-20T17:21:09.131 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:08 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:08.863+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.362151+0000 front 2024-05-20T17:20:41.361724+0000 (oldest deadline 2024-05-20T17:21:04.861614+0000) 2024-05-20T17:21:09.132 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:08 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:08.857+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:09.132 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:08 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:08.857+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:09.132 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:08 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:08.857+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:09.199 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:08 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:08.946+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:09.199 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:08 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:08.946+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:39.733066+0000 front 2024-05-20T17:20:39.733169+0000 (oldest deadline 2024-05-20T17:21:05.632963+0000) 2024-05-20T17:21:09.342 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:09 smithi171 podman[71236]: 2024-05-20 17:21:09.068840864 +0000 UTC m=+0.406920594 container init 785ef3788387cee6da593202d170afefefb36ed105bc2e4a507631c3b6d8ac5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True) 2024-05-20T17:21:09.342 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:09 smithi171 podman[71236]: 2024-05-20 17:21:09.072358009 +0000 UTC m=+0.410437746 container start 785ef3788387cee6da593202d170afefefb36ed105bc2e4a507631c3b6d8ac5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5-deactivate, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-20T17:21:09.342 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:09 smithi171 podman[71236]: 2024-05-20 17:21:09.160640849 +0000 UTC m=+0.498720592 container attach 785ef3788387cee6da593202d170afefefb36ed105bc2e4a507631c3b6d8ac5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:21:09.522 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:09 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:09.199+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:09.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:09 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:09.199+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:09.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:09 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:09.199+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:09.617 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 20 17:21:09 smithi171 podman[71236]: 2024-05-20 17:21:09.365382072 +0000 UTC m=+0.703461816 container died 785ef3788387cee6da593202d170afefefb36ed105bc2e4a507631c3b6d8ac5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-5-deactivate, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-20T17:21:09.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:09 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:09.339+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:09.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:09 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:09.339+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:09.957 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:09 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:09.682+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:09.957 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:09 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:09.682+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:09.974 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.5.service' 2024-05-20T17:21:10.052 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:21:10.052 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-20T17:21:10.053 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-20T17:21:10.053 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.6 2024-05-20T17:21:10.108 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:09 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:09.841+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:33.458558+0000 front 2024-05-20T17:20:33.458481+0000 (oldest deadline 2024-05-20T17:20:56.958609+0000) 2024-05-20T17:21:10.108 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:09 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:09.841+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.362151+0000 front 2024-05-20T17:20:41.361724+0000 (oldest deadline 2024-05-20T17:21:04.861614+0000) 2024-05-20T17:21:10.109 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:09 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:09.875+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:10.109 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:09 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:09.875+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:10.109 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:09 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:09.875+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:10.235 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:09 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:09.958+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:10.236 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:09 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:09.958+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:39.733066+0000 front 2024-05-20T17:20:39.733169+0000 (oldest deadline 2024-05-20T17:21:05.632963+0000) 2024-05-20T17:21:10.381 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:10 smithi006 systemd[1]: Stopping Ceph osd.6 for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:21:10.522 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:10 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:10.235+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:10.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:10 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:10.235+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:10.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:10 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:10.235+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:10.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:10 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:10.303+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:10.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:10 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:10.303+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:10.815 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:10 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:10.395+0000 7f6235bdd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:21:10.816 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:10 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:10.395+0000 7f6235bdd700 -1 osd.6 98 *** Got signal Terminated *** 2024-05-20T17:21:10.816 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:10 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:10.395+0000 7f6235bdd700 -1 osd.6 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:21:10.816 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:10 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:10.815+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:33.458558+0000 front 2024-05-20T17:20:33.458481+0000 (oldest deadline 2024-05-20T17:20:56.958609+0000) 2024-05-20T17:21:10.816 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:10 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:10.815+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.362151+0000 front 2024-05-20T17:20:41.361724+0000 (oldest deadline 2024-05-20T17:21:04.861614+0000) 2024-05-20T17:21:11.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:10 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:10.688+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:11.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:10 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:10.688+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:11.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:10 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:10.873+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:11.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:10 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:10.873+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:11.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:10 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:10.873+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:11.273 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:10 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:10.988+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:11.273 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:10 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:10.988+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:39.733066+0000 front 2024-05-20T17:20:39.733169+0000 (oldest deadline 2024-05-20T17:21:05.632963+0000) 2024-05-20T17:21:11.273 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:10 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:10.988+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.134327+0000 front 2024-05-20T17:20:49.134356+0000 (oldest deadline 2024-05-20T17:21:10.834293+0000) 2024-05-20T17:21:11.273 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:11 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:11.220+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:11.273 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:11 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:11.220+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:11.274 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:11 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:11.220+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:11.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:11 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:11.311+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:11.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:11 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:11.311+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:11.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:11 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:11.311+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:12.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:11 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:11.690+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:12.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:11 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:11.690+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:12.131 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:11 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:11.861+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:33.458558+0000 front 2024-05-20T17:20:33.458481+0000 (oldest deadline 2024-05-20T17:20:56.958609+0000) 2024-05-20T17:21:12.131 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:11 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:11.861+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.362151+0000 front 2024-05-20T17:20:41.361724+0000 (oldest deadline 2024-05-20T17:21:04.861614+0000) 2024-05-20T17:21:12.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:11 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:11.851+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:12.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:11 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:11.851+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:12.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:11 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:11.851+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:12.273 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:12 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:12.016+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:12.273 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:12 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:12.016+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:39.733066+0000 front 2024-05-20T17:20:39.733169+0000 (oldest deadline 2024-05-20T17:21:05.632963+0000) 2024-05-20T17:21:12.273 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:12 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:12.016+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.134327+0000 front 2024-05-20T17:20:49.134356+0000 (oldest deadline 2024-05-20T17:21:10.834293+0000) 2024-05-20T17:21:12.273 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:12 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:12.230+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:12.273 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:12 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:12.230+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:12.273 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:12 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:12.230+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:12.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:12 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:12.357+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:12.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:12 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:12.357+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:12.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:12 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:12.357+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:13.116 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:12 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:12.681+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:13.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:12 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:12.681+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:13.131 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:12 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:12.874+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:33.458558+0000 front 2024-05-20T17:20:33.458481+0000 (oldest deadline 2024-05-20T17:20:56.958609+0000) 2024-05-20T17:21:13.131 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:12 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:12.875+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.362151+0000 front 2024-05-20T17:20:41.361724+0000 (oldest deadline 2024-05-20T17:21:04.861614+0000) 2024-05-20T17:21:13.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:12 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:12.895+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:13.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:12 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:12.895+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:13.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:12 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:12.895+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:13.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:12 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:12.895+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:13.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:13 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:13.048+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:13.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:13 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:13.048+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:39.733066+0000 front 2024-05-20T17:20:39.733169+0000 (oldest deadline 2024-05-20T17:21:05.632963+0000) 2024-05-20T17:21:13.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:13 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:13.048+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.134327+0000 front 2024-05-20T17:20:49.134356+0000 (oldest deadline 2024-05-20T17:21:10.834293+0000) 2024-05-20T17:21:13.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:13 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:13.230+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:13.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:13 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:13.230+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:13.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:13 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:13.230+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:13.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:13 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:13.326+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:13.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:13 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:13.326+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:13.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:13 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:13.326+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:14.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:13 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:13.691+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:14.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:13 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:13.691+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:14.381 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:13 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:13.920+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:33.458558+0000 front 2024-05-20T17:20:33.458481+0000 (oldest deadline 2024-05-20T17:20:56.958609+0000) 2024-05-20T17:21:14.381 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:13 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:13.920+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.362151+0000 front 2024-05-20T17:20:41.361724+0000 (oldest deadline 2024-05-20T17:21:04.861614+0000) 2024-05-20T17:21:14.381 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:13 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:13.920+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.762503+0000 front 2024-05-20T17:20:47.762617+0000 (oldest deadline 2024-05-20T17:21:13.662681+0000) 2024-05-20T17:21:14.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:13 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:13.911+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:14.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:13 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:13.911+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:14.382 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:13 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:13.911+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:14.382 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:13 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:13.911+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:14.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:14 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:14.069+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:14.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:14 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:14.069+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:39.733066+0000 front 2024-05-20T17:20:39.733169+0000 (oldest deadline 2024-05-20T17:21:05.632963+0000) 2024-05-20T17:21:14.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:14 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:14.069+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.134327+0000 front 2024-05-20T17:20:49.134356+0000 (oldest deadline 2024-05-20T17:21:10.834293+0000) 2024-05-20T17:21:14.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:14 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:14.236+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:14.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:14 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:14.236+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:14.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:14 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:14.236+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:14.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:14 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:14.334+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:14.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:14 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:14.334+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:14.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:14 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:14.334+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:15.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:14 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:14.704+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:15.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:14 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:14.704+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:15.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:14 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:14.704+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:44.962480+0000 front 2024-05-20T17:20:44.962408+0000 (oldest deadline 2024-05-20T17:21:13.762960+0000) 2024-05-20T17:21:15.282 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:14 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:14.881+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:33.458558+0000 front 2024-05-20T17:20:33.458481+0000 (oldest deadline 2024-05-20T17:20:56.958609+0000) 2024-05-20T17:21:15.283 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:14 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:14.881+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.362151+0000 front 2024-05-20T17:20:41.361724+0000 (oldest deadline 2024-05-20T17:21:04.861614+0000) 2024-05-20T17:21:15.283 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:14 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6[60612]: 2024-05-20T17:21:14.881+0000 7f6232193700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.762503+0000 front 2024-05-20T17:20:47.762617+0000 (oldest deadline 2024-05-20T17:21:13.662681+0000) 2024-05-20T17:21:15.283 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:14 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:14.896+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:15.283 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:14 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:14.896+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:15.283 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:14 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:14.896+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:15.283 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:14 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:14.896+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:15.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:15 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:15.074+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:15.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:15 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:15.074+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:39.733066+0000 front 2024-05-20T17:20:39.733169+0000 (oldest deadline 2024-05-20T17:21:05.632963+0000) 2024-05-20T17:21:15.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:15 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:15.074+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.134327+0000 front 2024-05-20T17:20:49.134356+0000 (oldest deadline 2024-05-20T17:21:10.834293+0000) 2024-05-20T17:21:15.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:15 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:15.244+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:15.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:15 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:15.244+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:15.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:15 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:15.244+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:15.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:15 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:15.244+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:15.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:15 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:15.312+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:15.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:15 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:15.312+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:15.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:15 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:15.312+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:16.104 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:15 smithi006 podman[99651]: 2024-05-20 17:21:15.853134556 +0000 UTC m=+5.587483135 container died 0195247720b96e751bcd73d522e6c9c51ab741aff402b60ad5eb682877e1380e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-20T17:21:16.104 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:15 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:15.910+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:16.105 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:15 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:15.910+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:16.105 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:15 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:15.910+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:16.105 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:15 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:15.910+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:16.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:15 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:15.671+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:16.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:15 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:15.671+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:16.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:15 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:15.671+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:44.962480+0000 front 2024-05-20T17:20:44.962408+0000 (oldest deadline 2024-05-20T17:21:13.762960+0000) 2024-05-20T17:21:16.259 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:16 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:16.113+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:16.259 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:16 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:16.113+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:39.733066+0000 front 2024-05-20T17:20:39.733169+0000 (oldest deadline 2024-05-20T17:21:05.632963+0000) 2024-05-20T17:21:16.259 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:16 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:16.113+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.134327+0000 front 2024-05-20T17:20:49.134356+0000 (oldest deadline 2024-05-20T17:21:10.834293+0000) 2024-05-20T17:21:16.381 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:16 smithi006 podman[99651]: 2024-05-20 17:21:16.194436503 +0000 UTC m=+5.928785072 container cleanup 0195247720b96e751bcd73d522e6c9c51ab741aff402b60ad5eb682877e1380e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-05-20T17:21:16.381 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:16 smithi006 bash[99651]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6 2024-05-20T17:21:16.522 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:16 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:16.258+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:16.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:16 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:16.258+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:16.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:16 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:16.258+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:16.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:16 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:16.258+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:16.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:16 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:16.338+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:16.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:16 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:16.338+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:16.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:16 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:16.338+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:16.881 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:16 smithi006 podman[99667]: 2024-05-20 17:21:16.571283854 +0000 UTC m=+0.714402554 container remove 0195247720b96e751bcd73d522e6c9c51ab741aff402b60ad5eb682877e1380e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6, org.label-schema.build-date=20240514, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-05-20T17:21:17.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:16 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:16.657+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:17.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:16 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:16.657+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:17.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:16 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:16.657+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:44.962480+0000 front 2024-05-20T17:20:44.962408+0000 (oldest deadline 2024-05-20T17:21:13.762960+0000) 2024-05-20T17:21:17.280 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:17 smithi006 podman[99766]: 2024-05-20 17:21:17.027321999 +0000 UTC m=+0.017988486 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:21:17.280 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:17 smithi006 podman[99766]: 2024-05-20 17:21:17.172113173 +0000 UTC m=+0.162779640 container create c2c0c44860f1300aa1fb519f31af0f7aa40f7b975c3e53423ef0bd57d36f5ce2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240514, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-05-20T17:21:17.281 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:16 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:16.941+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:17.281 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:16 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:16.941+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:17.281 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:16 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:16.941+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:17.281 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:16 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:16.941+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:17.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:17 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:17.097+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:17.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:17 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:17.097+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:39.733066+0000 front 2024-05-20T17:20:39.733169+0000 (oldest deadline 2024-05-20T17:21:05.632963+0000) 2024-05-20T17:21:17.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:17 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:17.097+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.134327+0000 front 2024-05-20T17:20:49.134356+0000 (oldest deadline 2024-05-20T17:21:10.834293+0000) 2024-05-20T17:21:17.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:17 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:17.250+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:17.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:17 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:17.250+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:17.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:17 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:17.250+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:17.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:17 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:17.250+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:17.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:17 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:17.319+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:17.631 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:17 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:17.319+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:17.631 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:17 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:17.319+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:17.631 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:17 smithi006 podman[99766]: 2024-05-20 17:21:17.433418362 +0000 UTC m=+0.424084836 container init c2c0c44860f1300aa1fb519f31af0f7aa40f7b975c3e53423ef0bd57d36f5ce2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:21:17.631 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:17 smithi006 podman[99766]: 2024-05-20 17:21:17.437200684 +0000 UTC m=+0.427867143 container start c2c0c44860f1300aa1fb519f31af0f7aa40f7b975c3e53423ef0bd57d36f5ce2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:21:17.631 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:17 smithi006 podman[99766]: 2024-05-20 17:21:17.524844936 +0000 UTC m=+0.515511422 container attach c2c0c44860f1300aa1fb519f31af0f7aa40f7b975c3e53423ef0bd57d36f5ce2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514) 2024-05-20T17:21:18.071 INFO:journalctl@ceph.osd.6.smithi006.stdout:May 20 17:21:17 smithi006 podman[99766]: 2024-05-20 17:21:17.742846933 +0000 UTC m=+0.733513401 container died c2c0c44860f1300aa1fb519f31af0f7aa40f7b975c3e53423ef0bd57d36f5ce2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-6-deactivate, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-05-20T17:21:18.071 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:17 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:17.964+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:18.071 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:17 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:17.964+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:18.071 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:17 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:17.964+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:18.071 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:17 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:17.964+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:18.116 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:17 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:17.652+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:18.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:17 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:17.652+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:18.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:17 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:17.652+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:44.962480+0000 front 2024-05-20T17:20:44.962408+0000 (oldest deadline 2024-05-20T17:21:13.762960+0000) 2024-05-20T17:21:18.479 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.6.service' 2024-05-20T17:21:18.523 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:21:18.523 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-20T17:21:18.523 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-20T17:21:18.523 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.7 2024-05-20T17:21:18.524 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:18 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:18.124+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:18.524 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:18 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:18.124+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:39.733066+0000 front 2024-05-20T17:20:39.733169+0000 (oldest deadline 2024-05-20T17:21:05.632963+0000) 2024-05-20T17:21:18.524 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:18 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:18.124+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.134327+0000 front 2024-05-20T17:20:49.134356+0000 (oldest deadline 2024-05-20T17:21:10.834293+0000) 2024-05-20T17:21:18.524 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:18 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:18.297+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:18.525 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:18 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:18.297+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:18.525 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:18 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:18.297+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:18.525 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:18 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:18.297+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:18.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:18 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:18.274+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:18.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:18 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:18.274+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:18.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:18 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:18.274+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:18.832 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:18 smithi062 systemd[1]: Stopping Ceph osd.7 for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:21:19.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:18 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:18.661+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:19.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:18 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:18.661+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:19.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:18 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:18.661+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:44.962480+0000 front 2024-05-20T17:20:44.962408+0000 (oldest deadline 2024-05-20T17:21:13.762960+0000) 2024-05-20T17:21:19.145 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:18 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:18.830+0000 7f02118ed700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:21:19.145 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:18 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:18.831+0000 7f02118ed700 -1 osd.7 98 *** Got signal Terminated *** 2024-05-20T17:21:19.145 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:18 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:18.831+0000 7f02118ed700 -1 osd.7 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:21:19.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:18 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:18.956+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:19.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:18 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:18.956+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:19.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:18 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:18.956+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:19.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:18 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:18.956+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:19.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:19 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:19.144+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:19.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:19 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:19.144+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:39.733066+0000 front 2024-05-20T17:20:39.733169+0000 (oldest deadline 2024-05-20T17:21:05.632963+0000) 2024-05-20T17:21:19.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:19 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:19.144+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.134327+0000 front 2024-05-20T17:20:49.134356+0000 (oldest deadline 2024-05-20T17:21:10.834293+0000) 2024-05-20T17:21:19.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:19 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:19.307+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:19.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:19 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:19.307+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:19.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:19 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:19.307+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:19.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:19 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:19.307+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:19.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:19 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:19.234+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:19.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:19 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:19.234+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:19.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:19 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:19.234+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:20.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:19 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:19.629+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:20.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:19 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:19.629+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:20.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:19 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:19.629+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:44.962480+0000 front 2024-05-20T17:20:44.962408+0000 (oldest deadline 2024-05-20T17:21:13.762960+0000) 2024-05-20T17:21:20.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:19.908+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:20.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:19.908+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:20.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:19.908+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:20.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:19 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:19.908+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:20.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:20 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:20.125+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:20.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:20 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:20.125+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:39.733066+0000 front 2024-05-20T17:20:39.733169+0000 (oldest deadline 2024-05-20T17:21:05.632963+0000) 2024-05-20T17:21:20.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:20 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:20.125+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.134327+0000 front 2024-05-20T17:20:49.134356+0000 (oldest deadline 2024-05-20T17:21:10.834293+0000) 2024-05-20T17:21:20.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:20 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:20.316+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:20.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:20 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:20.316+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:20.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:20 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:20.316+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:20.524 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:20 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:20.316+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:20.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:20 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:20.247+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:20.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:20 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:20.247+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:20.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:20 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:20.247+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:20.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:20 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:20.247+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:21.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:20 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:20.661+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:21.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:20 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:20.661+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:21.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:20 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:20.661+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:44.962480+0000 front 2024-05-20T17:20:44.962408+0000 (oldest deadline 2024-05-20T17:21:13.762960+0000) 2024-05-20T17:21:21.118 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:20 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:20.661+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:53.763546+0000 front 2024-05-20T17:20:53.763472+0000 (oldest deadline 2024-05-20T17:21:19.663399+0000) 2024-05-20T17:21:21.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:20 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:20.931+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:21.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:20 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:20.931+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:21.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:20 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:20.931+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:21.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:20 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:20.931+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:21.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:21 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:21.173+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:21.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:21 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:21.173+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:39.733066+0000 front 2024-05-20T17:20:39.733169+0000 (oldest deadline 2024-05-20T17:21:05.632963+0000) 2024-05-20T17:21:21.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:21 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:21.173+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.134327+0000 front 2024-05-20T17:20:49.134356+0000 (oldest deadline 2024-05-20T17:21:10.834293+0000) 2024-05-20T17:21:21.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:21 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:21.281+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:21.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:21 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:21.281+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:21.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:21 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:21.281+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:21.524 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:21 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:21.281+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:21.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:21 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:21.236+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:21.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:21 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:21.236+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:21.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:21 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:21.236+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:21.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:21 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:21.236+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:22.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:21 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:21.700+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:22.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:21 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:21.700+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:22.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:21 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:21.700+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:44.962480+0000 front 2024-05-20T17:20:44.962408+0000 (oldest deadline 2024-05-20T17:21:13.762960+0000) 2024-05-20T17:21:22.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:21 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:21.700+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:53.763546+0000 front 2024-05-20T17:20:53.763472+0000 (oldest deadline 2024-05-20T17:21:19.663399+0000) 2024-05-20T17:21:22.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:21 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:21.902+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:22.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:21 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:21.902+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:22.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:21 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:21.902+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:22.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:21 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:21.902+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:22.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:21 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:21.902+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.500474+0000 front 2024-05-20T17:20:57.500460+0000 (oldest deadline 2024-05-20T17:21:21.600284+0000) 2024-05-20T17:21:22.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:22 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:22.141+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:22.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:22 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:22.141+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:39.733066+0000 front 2024-05-20T17:20:39.733169+0000 (oldest deadline 2024-05-20T17:21:05.632963+0000) 2024-05-20T17:21:22.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:22 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:22.141+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.134327+0000 front 2024-05-20T17:20:49.134356+0000 (oldest deadline 2024-05-20T17:21:10.834293+0000) 2024-05-20T17:21:22.523 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:22 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:22.141+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.236117+0000 front 2024-05-20T17:20:57.236140+0000 (oldest deadline 2024-05-20T17:21:21.336240+0000) 2024-05-20T17:21:22.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:22 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:22.328+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:22.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:22 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:22.328+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:22.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:22 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:22.328+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:22.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:22 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:22.328+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:22.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:22 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:22.202+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:22.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:22 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:22.202+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:22.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:22 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:22.202+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:22.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:22 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:22.202+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:23.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:22 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:22.714+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:23.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:22 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:22.714+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:23.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:22 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:22.714+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:44.962480+0000 front 2024-05-20T17:20:44.962408+0000 (oldest deadline 2024-05-20T17:21:13.762960+0000) 2024-05-20T17:21:23.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:22 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:22.714+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:53.763546+0000 front 2024-05-20T17:20:53.763472+0000 (oldest deadline 2024-05-20T17:21:19.663399+0000) 2024-05-20T17:21:23.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:22 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:22.857+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:23.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:22 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:22.857+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:23.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:22 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:22.857+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:23.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:22 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:22.857+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:23.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:22 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:22.857+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.500474+0000 front 2024-05-20T17:20:57.500460+0000 (oldest deadline 2024-05-20T17:21:21.600284+0000) 2024-05-20T17:21:23.373 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:23 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:23.106+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.831226+0000 front 2024-05-20T17:20:32.831295+0000 (oldest deadline 2024-05-20T17:20:55.131309+0000) 2024-05-20T17:21:23.373 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:23 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:23.106+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:39.733066+0000 front 2024-05-20T17:20:39.733169+0000 (oldest deadline 2024-05-20T17:21:05.632963+0000) 2024-05-20T17:21:23.374 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:23 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:23.106+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.134327+0000 front 2024-05-20T17:20:49.134356+0000 (oldest deadline 2024-05-20T17:21:10.834293+0000) 2024-05-20T17:21:23.374 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:23 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7[53569]: 2024-05-20T17:21:23.106+0000 7f020dea3700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.236117+0000 front 2024-05-20T17:20:57.236140+0000 (oldest deadline 2024-05-20T17:21:21.336240+0000) 2024-05-20T17:21:23.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:23 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:23.230+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:23.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:23 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:23.230+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:23.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:23 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:23.230+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:23.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:23 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:23.230+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:23.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:23 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:23.372+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:23.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:23 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:23.372+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:23.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:23 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:23.372+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:23.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:23 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:23.372+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:24.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:23 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:23.685+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:24.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:23 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:23.685+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:24.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:23 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:23.685+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:44.962480+0000 front 2024-05-20T17:20:44.962408+0000 (oldest deadline 2024-05-20T17:21:13.762960+0000) 2024-05-20T17:21:24.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:23 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:23.685+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:53.763546+0000 front 2024-05-20T17:20:53.763472+0000 (oldest deadline 2024-05-20T17:21:19.663399+0000) 2024-05-20T17:21:24.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:23 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:23.883+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:24.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:23 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:23.883+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:24.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:23 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:23.883+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:24.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:23 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:23.883+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:24.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:23 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:23.883+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.500474+0000 front 2024-05-20T17:20:57.500460+0000 (oldest deadline 2024-05-20T17:21:21.600284+0000) 2024-05-20T17:21:24.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:24 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:24.245+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:24.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:24 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:24.245+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:24.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:24 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:24.245+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:24.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:24 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:24.245+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:24.773 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:24 smithi062 podman[70469]: 2024-05-20 17:21:24.523106507 +0000 UTC m=+5.788692046 container died c634c5aaa36986f7806b955b4895b24ea4aa986e202dfd40bd7fae8a5c1d2ea1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux ) 2024-05-20T17:21:24.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:24 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:24.345+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:24.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:24 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:24.345+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:24.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:24 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:24.345+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:24.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:24 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:24.345+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:25.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:24 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:24.726+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:25.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:24 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:24.726+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:25.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:24 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:24.726+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:44.962480+0000 front 2024-05-20T17:20:44.962408+0000 (oldest deadline 2024-05-20T17:21:13.762960+0000) 2024-05-20T17:21:25.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:24 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:24.726+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:53.763546+0000 front 2024-05-20T17:20:53.763472+0000 (oldest deadline 2024-05-20T17:21:19.663399+0000) 2024-05-20T17:21:25.273 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:25 smithi062 podman[70469]: 2024-05-20 17:21:25.02263581 +0000 UTC m=+6.288221339 container cleanup c634c5aaa36986f7806b955b4895b24ea4aa986e202dfd40bd7fae8a5c1d2ea1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-20T17:21:25.273 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:25 smithi062 bash[70469]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7 2024-05-20T17:21:25.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:24 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:24.925+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:25.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:24 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:24.925+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:25.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:24 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:24.925+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:25.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:24 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:24.925+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:25.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:24 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:24.925+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.500474+0000 front 2024-05-20T17:20:57.500460+0000 (oldest deadline 2024-05-20T17:21:21.600284+0000) 2024-05-20T17:21:25.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:25 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:25.269+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:25.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:25 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:25.269+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:25.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:25 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:25.269+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:25.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:25 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:25.269+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:25.653 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:25 smithi062 podman[70486]: 2024-05-20 17:21:25.307473147 +0000 UTC m=+0.780899479 container remove c634c5aaa36986f7806b955b4895b24ea4aa986e202dfd40bd7fae8a5c1d2ea1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-05-20T17:21:25.653 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:25 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:25.379+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:25.653 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:25 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:25.379+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:25.653 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:25 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:25.379+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:25.653 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:25 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:25.379+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:25.653 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:25 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:25.379+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:25.936 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:25 smithi062 podman[70576]: 2024-05-20 17:21:25.556057068 +0000 UTC m=+0.017514972 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:21:25.936 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:25 smithi062 podman[70576]: 2024-05-20 17:21:25.666807946 +0000 UTC m=+0.128265825 container create 37b8b7e3c2b57d198538ca6ab59130219b2e48b510cff99312953f41b3ce434e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, GIT_CLEAN=True) 2024-05-20T17:21:25.937 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:25 smithi062 podman[70576]: 2024-05-20 17:21:25.877811021 +0000 UTC m=+0.339268919 container init 37b8b7e3c2b57d198538ca6ab59130219b2e48b510cff99312953f41b3ce434e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240514) 2024-05-20T17:21:25.937 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:25 smithi062 podman[70576]: 2024-05-20 17:21:25.881087886 +0000 UTC m=+0.342545782 container start 37b8b7e3c2b57d198538ca6ab59130219b2e48b510cff99312953f41b3ce434e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:21:25.937 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:25 smithi062 podman[70576]: 2024-05-20 17:21:25.935983895 +0000 UTC m=+0.397441802 container attach 37b8b7e3c2b57d198538ca6ab59130219b2e48b510cff99312953f41b3ce434e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-20T17:21:26.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:25 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:25.767+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:26.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:25 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:25.767+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:26.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:25 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:25.767+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:44.962480+0000 front 2024-05-20T17:20:44.962408+0000 (oldest deadline 2024-05-20T17:21:13.762960+0000) 2024-05-20T17:21:26.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:25 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:25.767+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:53.763546+0000 front 2024-05-20T17:20:53.763472+0000 (oldest deadline 2024-05-20T17:21:19.663399+0000) 2024-05-20T17:21:26.211 INFO:journalctl@ceph.osd.7.smithi062.stdout:May 20 17:21:26 smithi062 podman[70576]: 2024-05-20 17:21:26.18570736 +0000 UTC m=+0.647165251 container died 37b8b7e3c2b57d198538ca6ab59130219b2e48b510cff99312953f41b3ce434e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-7-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:21:26.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:25 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:25.895+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:26.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:25 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:25.895+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:26.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:25 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:25.895+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:26.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:25 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:25.895+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:26.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:25 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:25.895+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.500474+0000 front 2024-05-20T17:20:57.500460+0000 (oldest deadline 2024-05-20T17:21:21.600284+0000) 2024-05-20T17:21:26.476 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:26 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:26.407+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:26.477 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:26 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:26.407+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:26.477 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:26 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:26.407+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:26.477 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:26 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:26.407+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:26.477 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:26 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:26.407+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:26.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:26 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:26.305+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:26.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:26 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:26.305+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:26.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:26 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:26.305+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:26.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:26 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:26.305+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:26.883 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.7.service' 2024-05-20T17:21:26.924 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:21:26.924 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-20T17:21:26.924 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-05-20T17:21:26.924 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.8 2024-05-20T17:21:27.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:26 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:26.788+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:27.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:26 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:26.788+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:27.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:26 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:26.788+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:44.962480+0000 front 2024-05-20T17:20:44.962408+0000 (oldest deadline 2024-05-20T17:21:13.762960+0000) 2024-05-20T17:21:27.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:26 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:26.788+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:53.763546+0000 front 2024-05-20T17:20:53.763472+0000 (oldest deadline 2024-05-20T17:21:19.663399+0000) 2024-05-20T17:21:27.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:26 smithi171 systemd[1]: Stopping Ceph osd.8 for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:21:27.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:26 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:26.891+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:27.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:26 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:26.891+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:27.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:26 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:26.891+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:27.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:26 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:26.891+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:27.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:26 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:26.891+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.500474+0000 front 2024-05-20T17:20:57.500460+0000 (oldest deadline 2024-05-20T17:21:21.600284+0000) 2024-05-20T17:21:27.617 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:27 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:27.235+0000 7f439e95b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:21:27.617 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:27 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:27.235+0000 7f439e95b700 -1 osd.8 98 *** Got signal Terminated *** 2024-05-20T17:21:27.617 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:27 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:27.235+0000 7f439e95b700 -1 osd.8 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:21:27.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:27 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:27.259+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:27.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:27 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:27.259+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:27.618 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:27 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:27.259+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:27.618 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:27 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:27.259+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:27.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:27 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:27.441+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:27.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:27 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:27.441+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:27.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:27 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:27.441+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:27.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:27 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:27.441+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:27.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:27 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:27.441+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:28.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:27 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:27.809+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:28.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:27 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:27.809+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:28.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:27 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:27.809+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:44.962480+0000 front 2024-05-20T17:20:44.962408+0000 (oldest deadline 2024-05-20T17:21:13.762960+0000) 2024-05-20T17:21:28.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:27 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:27.809+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:53.763546+0000 front 2024-05-20T17:20:53.763472+0000 (oldest deadline 2024-05-20T17:21:19.663399+0000) 2024-05-20T17:21:28.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:27 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:27.888+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:28.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:27 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:27.888+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:28.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:27 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:27.888+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:28.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:27 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:27.888+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:28.382 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:27 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:27.888+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.500474+0000 front 2024-05-20T17:20:57.500460+0000 (oldest deadline 2024-05-20T17:21:21.600284+0000) 2024-05-20T17:21:28.618 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:28 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:28.300+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:28.618 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:28 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:28.300+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:28.618 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:28 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:28.300+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:28.618 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:28 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:28.300+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:28.618 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:28 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:28.300+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:28.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:28 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:28.407+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:28.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:28 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:28.407+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:28.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:28 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:28.407+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:28.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:28 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:28.407+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:28.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:28 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:28.407+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:28.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:28 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:28.407+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:29.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:28 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:28.789+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:29.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:28 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:28.789+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:29.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:28 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:28.789+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:44.962480+0000 front 2024-05-20T17:20:44.962408+0000 (oldest deadline 2024-05-20T17:21:13.762960+0000) 2024-05-20T17:21:29.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:28 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:28.789+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:53.763546+0000 front 2024-05-20T17:20:53.763472+0000 (oldest deadline 2024-05-20T17:21:19.663399+0000) 2024-05-20T17:21:29.118 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:28 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:28.789+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:03.664966+0000 front 2024-05-20T17:21:03.665002+0000 (oldest deadline 2024-05-20T17:21:28.265853+0000) 2024-05-20T17:21:29.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:28 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:28.885+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:29.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:28 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:28.885+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:29.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:28 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:28.885+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:29.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:28 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:28.885+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:29.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:28 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:28.885+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.500474+0000 front 2024-05-20T17:20:57.500460+0000 (oldest deadline 2024-05-20T17:21:21.600284+0000) 2024-05-20T17:21:29.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:29 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:29.265+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:29.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:29 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:29.265+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:29.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:29 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:29.265+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:29.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:29 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:29.265+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:29.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:29 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:29.265+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:29.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:29 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:29.446+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:29.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:29 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:29.446+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:29.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:29 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:29.446+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:29.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:29 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:29.446+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:29.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:29 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:29.446+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:29.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:29 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:29.446+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:30.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:29 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:29.801+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:30.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:29 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:29.801+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:30.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:29 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:29.801+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:44.962480+0000 front 2024-05-20T17:20:44.962408+0000 (oldest deadline 2024-05-20T17:21:13.762960+0000) 2024-05-20T17:21:30.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:29 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:29.801+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:53.763546+0000 front 2024-05-20T17:20:53.763472+0000 (oldest deadline 2024-05-20T17:21:19.663399+0000) 2024-05-20T17:21:30.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:29 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:29.801+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:03.664966+0000 front 2024-05-20T17:21:03.665002+0000 (oldest deadline 2024-05-20T17:21:28.265853+0000) 2024-05-20T17:21:30.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:29 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:29.839+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:30.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:29 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:29.839+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:30.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:29 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:29.839+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:30.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:29 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:29.839+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:30.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:29 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:29.839+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.500474+0000 front 2024-05-20T17:20:57.500460+0000 (oldest deadline 2024-05-20T17:21:21.600284+0000) 2024-05-20T17:21:30.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:30 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:30.287+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:30.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:30 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:30.287+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:30.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:30 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:30.287+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:30.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:30 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:30.287+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:30.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:30 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:30.287+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:30.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:30 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:30.450+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:30.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:30 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:30.450+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:30.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:30 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:30.450+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:30.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:30 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:30.450+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:30.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:30 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:30.450+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:30.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:30 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:30.450+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:31.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:30 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:30.840+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:31.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:30 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:30.840+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:31.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:30 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:30.840+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:44.962480+0000 front 2024-05-20T17:20:44.962408+0000 (oldest deadline 2024-05-20T17:21:13.762960+0000) 2024-05-20T17:21:31.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:30 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:30.840+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:53.763546+0000 front 2024-05-20T17:20:53.763472+0000 (oldest deadline 2024-05-20T17:21:19.663399+0000) 2024-05-20T17:21:31.117 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:30 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:30.840+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:03.664966+0000 front 2024-05-20T17:21:03.665002+0000 (oldest deadline 2024-05-20T17:21:28.265853+0000) 2024-05-20T17:21:31.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:30 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:30.814+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:31.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:30 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:30.814+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:31.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:30 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:30.814+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:31.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:30 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:30.814+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:31.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:30 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:30.814+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.500474+0000 front 2024-05-20T17:20:57.500460+0000 (oldest deadline 2024-05-20T17:21:21.600284+0000) 2024-05-20T17:21:31.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:31 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:31.319+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:31.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:31 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:31.319+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:31.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:31 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:31.319+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:31.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:31 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:31.319+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:31.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:31 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:31.319+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:31.772 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:31 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:31.427+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:31.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:31 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:31.427+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:31.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:31 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:31.427+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:31.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:31 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:31.427+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:31.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:31 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:31.427+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:31.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:31 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:31.427+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:32.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:31 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:31.775+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:32.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:31 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:31.775+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:32.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:31 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:31.775+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:32.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:31 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:31.775+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:32.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:31 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:31.775+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.500474+0000 front 2024-05-20T17:20:57.500460+0000 (oldest deadline 2024-05-20T17:21:21.600284+0000) 2024-05-20T17:21:32.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:31 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:31.775+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:03.901432+0000 front 2024-05-20T17:21:03.901447+0000 (oldest deadline 2024-05-20T17:21:31.501653+0000) 2024-05-20T17:21:32.358 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:31 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:31.880+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:32.160197+0000 front 2024-05-20T17:20:32.160361+0000 (oldest deadline 2024-05-20T17:20:56.860271+0000) 2024-05-20T17:21:32.358 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:31 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:31.880+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:40.261849+0000 front 2024-05-20T17:20:40.261974+0000 (oldest deadline 2024-05-20T17:21:04.961988+0000) 2024-05-20T17:21:32.358 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:31 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:31.880+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:44.962480+0000 front 2024-05-20T17:20:44.962408+0000 (oldest deadline 2024-05-20T17:21:13.762960+0000) 2024-05-20T17:21:32.358 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:31 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:31.880+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:53.763546+0000 front 2024-05-20T17:20:53.763472+0000 (oldest deadline 2024-05-20T17:21:19.663399+0000) 2024-05-20T17:21:32.358 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:31 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8[53966]: 2024-05-20T17:21:31.880+0000 7f4396f09700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:03.664966+0000 front 2024-05-20T17:21:03.665002+0000 (oldest deadline 2024-05-20T17:21:28.265853+0000) 2024-05-20T17:21:32.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:32 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:32.357+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:32.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:32 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:32.357+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:32.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:32 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:32.357+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:32.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:32 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:32.357+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:32.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:32 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:32.357+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:32.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:32 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:32.435+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:32.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:32 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:32.435+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:32.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:32 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:32.435+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:32.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:32 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:32.435+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:32.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:32 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:32.435+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:32.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:32 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:32.435+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:33.053 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:32 smithi171 podman[71341]: 2024-05-20 17:21:32.773153499 +0000 UTC m=+5.653227612 container died d8e318438dad123f0b223a9b6de4598d170db02f2930678bb1d591a476435e52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-20T17:21:33.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:32 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:32.811+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:33.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:32 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:32.811+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:33.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:32 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:32.811+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:33.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:32 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:32.811+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:33.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:32 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:32.811+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.500474+0000 front 2024-05-20T17:20:57.500460+0000 (oldest deadline 2024-05-20T17:21:21.600284+0000) 2024-05-20T17:21:33.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:32 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:32.811+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:03.901432+0000 front 2024-05-20T17:21:03.901447+0000 (oldest deadline 2024-05-20T17:21:31.501653+0000) 2024-05-20T17:21:33.341 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:33 smithi171 podman[71341]: 2024-05-20 17:21:33.171063274 +0000 UTC m=+6.051137390 container cleanup d8e318438dad123f0b223a9b6de4598d170db02f2930678bb1d591a476435e52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-20T17:21:33.341 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:33 smithi171 bash[71341]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8 2024-05-20T17:21:33.617 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:33 smithi171 podman[71355]: 2024-05-20 17:21:33.413255812 +0000 UTC m=+0.640565404 container remove d8e318438dad123f0b223a9b6de4598d170db02f2930678bb1d591a476435e52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-05-20T17:21:33.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:33 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:33.340+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:33.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:33 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:33.340+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:33.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:33 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:33.340+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:33.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:33 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:33.340+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:33.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:33 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:33.340+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:33.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:33 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:33.443+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:33.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:33 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:33.443+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:33.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:33 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:33.443+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:33.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:33 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:33.443+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:33.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:33 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:33.443+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:33.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:33 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:33.443+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:34.026 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:33 smithi171 podman[71446]: 2024-05-20 17:21:33.64415479 +0000 UTC m=+0.017230050 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:21:34.027 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:33 smithi171 podman[71446]: 2024-05-20 17:21:33.756084142 +0000 UTC m=+0.129159383 container create b2f4752ba7251f5cf49cc4f3b221fd63ec6e65f018e477f51e96342f85515a57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8-deactivate, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-20T17:21:34.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:33 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:33.818+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:34.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:33 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:33.818+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:34.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:33 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:33.818+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:34.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:33 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:33.818+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:34.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:33 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:33.818+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.500474+0000 front 2024-05-20T17:20:57.500460+0000 (oldest deadline 2024-05-20T17:21:21.600284+0000) 2024-05-20T17:21:34.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:33 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:33.818+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:03.901432+0000 front 2024-05-20T17:21:03.901447+0000 (oldest deadline 2024-05-20T17:21:31.501653+0000) 2024-05-20T17:21:34.309 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:34 smithi171 podman[71446]: 2024-05-20 17:21:34.026932374 +0000 UTC m=+0.400007625 container init b2f4752ba7251f5cf49cc4f3b221fd63ec6e65f018e477f51e96342f85515a57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8-deactivate, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, ceph=True) 2024-05-20T17:21:34.309 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:34 smithi171 podman[71446]: 2024-05-20 17:21:34.030622378 +0000 UTC m=+0.403697623 container start b2f4752ba7251f5cf49cc4f3b221fd63ec6e65f018e477f51e96342f85515a57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, ceph=True) 2024-05-20T17:21:34.309 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:34 smithi171 podman[71446]: 2024-05-20 17:21:34.110459422 +0000 UTC m=+0.483534678 container attach b2f4752ba7251f5cf49cc4f3b221fd63ec6e65f018e477f51e96342f85515a57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0) 2024-05-20T17:21:34.617 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 20 17:21:34 smithi171 podman[71446]: 2024-05-20 17:21:34.336883938 +0000 UTC m=+0.709959180 container died b2f4752ba7251f5cf49cc4f3b221fd63ec6e65f018e477f51e96342f85515a57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240514, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:21:34.618 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:34 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:34.308+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:34.618 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:34 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:34.308+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:34.618 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:34 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:34.308+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:34.618 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:34 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:34.308+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:34.618 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:34 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:34.308+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:34.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:34 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:34.423+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:34.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:34 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:34.423+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:34.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:34 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:34.423+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:34.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:34 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:34.423+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:34.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:34 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:34.423+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:34.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:34 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:34.423+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:35.015 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.8.service' 2024-05-20T17:21:35.053 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:21:35.053 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-05-20T17:21:35.053 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-05-20T17:21:35.053 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.9 2024-05-20T17:21:35.082 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:34 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:34.801+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:35.082 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:34 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:34.801+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:35.082 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:34 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:34.801+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:35.082 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:34 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:34.801+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:35.082 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:34 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:34.801+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.500474+0000 front 2024-05-20T17:20:57.500460+0000 (oldest deadline 2024-05-20T17:21:21.600284+0000) 2024-05-20T17:21:35.082 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:34 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:34.801+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:03.901432+0000 front 2024-05-20T17:21:03.901447+0000 (oldest deadline 2024-05-20T17:21:31.501653+0000) 2024-05-20T17:21:35.381 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:35 smithi006 systemd[1]: Stopping Ceph osd.9 for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:21:35.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:35 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:35.315+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:35.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:35 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:35.315+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:35.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:35 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:35.315+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:35.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:35 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:35.315+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:35.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:35 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:35.315+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:35.674 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:35 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:35.375+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:35.674 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:35 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:35.375+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:35.674 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:35 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:35.375+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:35.675 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:35 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:35.375+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:35.675 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:35 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:35.375+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:35.675 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:35 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:35.375+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:35.846 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:35 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:35.425+0000 7fef6e49a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:21:35.846 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:35 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:35.425+0000 7fef6e49a700 -1 osd.9 98 *** Got signal Terminated *** 2024-05-20T17:21:35.846 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:35 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:35.425+0000 7fef6e49a700 -1 osd.9 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:21:35.846 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:35 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:35.844+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:36.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:35 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:35.844+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:36.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:35 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:35.844+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:36.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:35 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:35.844+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:36.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:35 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:35.844+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.500474+0000 front 2024-05-20T17:20:57.500460+0000 (oldest deadline 2024-05-20T17:21:21.600284+0000) 2024-05-20T17:21:36.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:35 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:35.844+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:03.901432+0000 front 2024-05-20T17:21:03.901447+0000 (oldest deadline 2024-05-20T17:21:31.501653+0000) 2024-05-20T17:21:36.540 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:36 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:36.281+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:36.540 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:36 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:36.281+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:36.540 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:36 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:36.281+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:36.540 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:36 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:36.281+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:36.540 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:36 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:36.281+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:36.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:36 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:36.416+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:36.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:36 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:36.416+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:36.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:36 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:36.416+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:36.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:36 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:36.416+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:36.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:36 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:36.416+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:36.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:36 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:36.416+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:37.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:36 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:36.841+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:37.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:36 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:36.841+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:37.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:36 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:36.841+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:37.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:36 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:36.841+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:37.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:36 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:36.841+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.500474+0000 front 2024-05-20T17:20:57.500460+0000 (oldest deadline 2024-05-20T17:21:21.600284+0000) 2024-05-20T17:21:37.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:36 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:36.841+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:03.901432+0000 front 2024-05-20T17:21:03.901447+0000 (oldest deadline 2024-05-20T17:21:31.501653+0000) 2024-05-20T17:21:37.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:37 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:37.241+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:37.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:37 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:37.241+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:37.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:37 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:37.241+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:37.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:37 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:37.241+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:37.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:37 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:37.241+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:37.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:37 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:37.401+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:37.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:37 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:37.401+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:37.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:37 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:37.401+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:37.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:37 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:37.401+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:37.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:37 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:37.401+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:37.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:37 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:37.401+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:37.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:37 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:37.401+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:15.350358+0000 front 2024-05-20T17:21:15.350445+0000 (oldest deadline 2024-05-20T17:21:37.050195+0000) 2024-05-20T17:21:38.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:37 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:37.853+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:38.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:37 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:37.853+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:38.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:37 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:37.853+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:38.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:37 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:37.853+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:38.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:37 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:37.853+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.500474+0000 front 2024-05-20T17:20:57.500460+0000 (oldest deadline 2024-05-20T17:21:21.600284+0000) 2024-05-20T17:21:38.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:37 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:37.853+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:03.901432+0000 front 2024-05-20T17:21:03.901447+0000 (oldest deadline 2024-05-20T17:21:31.501653+0000) 2024-05-20T17:21:38.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:38 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:38.192+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:38.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:38 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:38.192+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:38.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:38 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:38.192+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:38.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:38 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:38.192+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:38.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:38 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:38.192+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:38.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:38 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:38.374+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:38.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:38 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:38.374+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:38.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:38 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:38.374+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:38.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:38 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:38.374+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:38.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:38 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:38.374+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:38.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:38 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:38.374+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:38.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:38 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:38.374+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:15.350358+0000 front 2024-05-20T17:21:15.350445+0000 (oldest deadline 2024-05-20T17:21:37.050195+0000) 2024-05-20T17:21:39.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:38 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:38.815+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:39.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:38 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:38.815+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:39.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:38 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:38.815+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:39.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:38 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:38.815+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:39.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:38 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:38.815+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.500474+0000 front 2024-05-20T17:20:57.500460+0000 (oldest deadline 2024-05-20T17:21:21.600284+0000) 2024-05-20T17:21:39.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:38 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:38.815+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:03.901432+0000 front 2024-05-20T17:21:03.901447+0000 (oldest deadline 2024-05-20T17:21:31.501653+0000) 2024-05-20T17:21:39.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:39 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:39.191+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:39.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:39 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:39.191+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:39.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:39 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:39.191+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:39.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:39 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:39.191+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:39.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:39 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:39.191+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:39.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:39 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:39.334+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:39.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:39 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:39.334+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:39.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:39 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:39.334+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:39.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:39 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:39.334+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:39.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:39 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:39.334+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:39.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:39 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:39.334+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:39.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:39 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:39.334+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:15.350358+0000 front 2024-05-20T17:21:15.350445+0000 (oldest deadline 2024-05-20T17:21:37.050195+0000) 2024-05-20T17:21:40.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:39 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:39.846+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.393794+0000 front 2024-05-20T17:20:24.393522+0000 (oldest deadline 2024-05-20T17:20:47.893536+0000) 2024-05-20T17:21:40.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:39 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:39.846+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.194968+0000 front 2024-05-20T17:20:30.194725+0000 (oldest deadline 2024-05-20T17:20:58.995534+0000) 2024-05-20T17:21:40.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:39 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:39.846+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.296854+0000 front 2024-05-20T17:20:41.297035+0000 (oldest deadline 2024-05-20T17:21:02.996912+0000) 2024-05-20T17:21:40.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:39 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:39.846+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.899287+0000 front 2024-05-20T17:20:49.899312+0000 (oldest deadline 2024-05-20T17:21:12.199327+0000) 2024-05-20T17:21:40.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:39 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:39.846+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:57.500474+0000 front 2024-05-20T17:20:57.500460+0000 (oldest deadline 2024-05-20T17:21:21.600284+0000) 2024-05-20T17:21:40.131 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:39 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9[67152]: 2024-05-20T17:21:39.846+0000 7fef6aa50700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:03.901432+0000 front 2024-05-20T17:21:03.901447+0000 (oldest deadline 2024-05-20T17:21:31.501653+0000) 2024-05-20T17:21:40.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:40 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:40.143+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:40.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:40 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:40.143+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:40.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:40 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:40.143+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:40.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:40 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:40.143+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:40.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:40 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:40.143+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:40.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:40 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:40.300+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:40.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:40 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:40.300+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:40.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:40 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:40.300+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:40.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:40 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:40.300+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:40.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:40 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:40.300+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:40.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:40 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:40.300+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:40.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:40 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:40.300+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:15.350358+0000 front 2024-05-20T17:21:15.350445+0000 (oldest deadline 2024-05-20T17:21:37.050195+0000) 2024-05-20T17:21:41.168 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:40 smithi006 podman[99871]: 2024-05-20 17:21:40.894553866 +0000 UTC m=+5.633630559 container died 14ad608f277d182330c790187004b92f68290342db74f6b3b48f5195ac92e071 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-20T17:21:41.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:41 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:41.266+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:41.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:41 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:41.266+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:41.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:41 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:41.266+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:41.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:41 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:41.266+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:41.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:41 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:41.266+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:41.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:41 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:41.266+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:41.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:41 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:41.266+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:15.350358+0000 front 2024-05-20T17:21:15.350445+0000 (oldest deadline 2024-05-20T17:21:37.050195+0000) 2024-05-20T17:21:41.535 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:41 smithi006 podman[99871]: 2024-05-20 17:21:41.258659311 +0000 UTC m=+5.997735996 container cleanup 14ad608f277d182330c790187004b92f68290342db74f6b3b48f5195ac92e071 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:21:41.535 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:41 smithi006 bash[99871]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9 2024-05-20T17:21:41.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:41 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:41.178+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:41.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:41 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:41.178+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:41.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:41 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:41.178+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:41.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:41 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:41.178+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:41.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:41 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:41.178+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:41.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:41 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:41.178+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:14.789920+0000 front 2024-05-20T17:21:14.789869+0000 (oldest deadline 2024-05-20T17:21:40.689634+0000) 2024-05-20T17:21:41.881 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:41 smithi006 podman[99887]: 2024-05-20 17:21:41.534937433 +0000 UTC m=+0.641315251 container remove 14ad608f277d182330c790187004b92f68290342db74f6b3b48f5195ac92e071 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514) 2024-05-20T17:21:42.221 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:41 smithi006 podman[99977]: 2024-05-20 17:21:41.894289756 +0000 UTC m=+0.111835820 container create e4fa1795c35da8b6b87d5615eee4fa012a0841d3cd35089128432a57dae81864 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9-deactivate, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-20T17:21:42.222 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:41 smithi006 podman[99977]: 2024-05-20 17:21:41.800205792 +0000 UTC m=+0.017751878 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:21:42.222 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:42 smithi006 podman[99977]: 2024-05-20 17:21:42.139347526 +0000 UTC m=+0.356893606 container init e4fa1795c35da8b6b87d5615eee4fa012a0841d3cd35089128432a57dae81864 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-20T17:21:42.222 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:42 smithi006 podman[99977]: 2024-05-20 17:21:42.142957624 +0000 UTC m=+0.360503690 container start e4fa1795c35da8b6b87d5615eee4fa012a0841d3cd35089128432a57dae81864 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-20T17:21:42.222 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:42 smithi006 podman[99977]: 2024-05-20 17:21:42.221580209 +0000 UTC m=+0.439126283 container attach e4fa1795c35da8b6b87d5615eee4fa012a0841d3cd35089128432a57dae81864 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240514, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:21:42.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:42 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:42.217+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:42.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:42 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:42.217+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:42.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:42 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:42.217+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:42.524 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:42 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:42.217+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:42.524 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:42 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:42.217+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:42.524 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:42 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:42.217+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:42.524 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:42 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:42.217+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:15.350358+0000 front 2024-05-20T17:21:15.350445+0000 (oldest deadline 2024-05-20T17:21:37.050195+0000) 2024-05-20T17:21:42.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:42 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:42.169+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:42.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:42 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:42.169+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:42.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:42 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:42.169+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:42.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:42 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:42.169+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:42.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:42 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:42.169+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:42.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:42 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:42.169+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:14.789920+0000 front 2024-05-20T17:21:14.789869+0000 (oldest deadline 2024-05-20T17:21:40.689634+0000) 2024-05-20T17:21:42.631 INFO:journalctl@ceph.osd.9.smithi006.stdout:May 20 17:21:42 smithi006 podman[99977]: 2024-05-20 17:21:42.447756953 +0000 UTC m=+0.665303028 container died e4fa1795c35da8b6b87d5615eee4fa012a0841d3cd35089128432a57dae81864 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:21:43.029 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.9.service' 2024-05-20T17:21:43.113 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:21:43.113 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-05-20T17:21:43.113 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-05-20T17:21:43.113 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.10 2024-05-20T17:21:43.434 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:43 smithi062 systemd[1]: Stopping Ceph osd.10 for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:21:43.434 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:43 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:43.199+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:43.435 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:43 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:43.199+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:43.435 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:43 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:43.199+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:43.435 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:43 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:43.199+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:43.435 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:43 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:43.199+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:43.435 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:43 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:43.199+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:43.435 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:43 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:43.199+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:15.350358+0000 front 2024-05-20T17:21:15.350445+0000 (oldest deadline 2024-05-20T17:21:37.050195+0000) 2024-05-20T17:21:43.435 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:43 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:43.433+0000 7f55e440a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:21:43.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:43 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:43.152+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:43.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:43 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:43.152+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:43.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:43 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:43.152+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:43.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:43 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:43.152+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:43.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:43 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:43.152+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:43.617 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:43 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:43.152+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:14.789920+0000 front 2024-05-20T17:21:14.789869+0000 (oldest deadline 2024-05-20T17:21:40.689634+0000) 2024-05-20T17:21:43.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:43 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:43.433+0000 7f55e440a700 -1 osd.10 98 *** Got signal Terminated *** 2024-05-20T17:21:43.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:43 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:43.433+0000 7f55e440a700 -1 osd.10 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:21:44.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:44 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:44.105+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:44.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:44 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:44.105+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:44.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:44 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:44.105+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:44.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:44 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:44.105+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:44.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:44 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:44.105+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:44.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:44 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:44.105+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:14.789920+0000 front 2024-05-20T17:21:14.789869+0000 (oldest deadline 2024-05-20T17:21:40.689634+0000) 2024-05-20T17:21:44.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:44 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:44.229+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:44.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:44 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:44.229+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:44.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:44 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:44.229+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:44.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:44 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:44.229+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:44.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:44 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:44.229+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:44.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:44 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:44.229+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:44.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:44 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:44.229+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:15.350358+0000 front 2024-05-20T17:21:15.350445+0000 (oldest deadline 2024-05-20T17:21:37.050195+0000) 2024-05-20T17:21:45.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:45 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:45.100+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:45.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:45 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:45.100+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:45.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:45 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:45.100+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:45.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:45 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:45.100+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:45.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:45 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:45.100+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:45.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:45 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:45.100+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:14.789920+0000 front 2024-05-20T17:21:14.789869+0000 (oldest deadline 2024-05-20T17:21:40.689634+0000) 2024-05-20T17:21:45.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:45 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:45.245+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:45.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:45 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:45.245+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:45.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:45 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:45.245+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:45.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:45 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:45.245+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:45.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:45 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:45.245+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:45.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:45 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:45.245+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:45.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:45 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:45.245+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:15.350358+0000 front 2024-05-20T17:21:15.350445+0000 (oldest deadline 2024-05-20T17:21:37.050195+0000) 2024-05-20T17:21:46.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:46 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:46.064+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:46.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:46 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:46.064+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:46.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:46 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:46.064+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:46.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:46 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:46.064+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:46.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:46 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:46.064+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:46.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:46 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:46.064+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:14.789920+0000 front 2024-05-20T17:21:14.789869+0000 (oldest deadline 2024-05-20T17:21:40.689634+0000) 2024-05-20T17:21:46.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:46 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:46.238+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:46.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:46 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:46.238+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:46.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:46 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:46.238+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:46.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:46 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:46.238+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:46.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:46 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:46.238+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:46.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:46 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:46.238+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:46.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:46 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:46.238+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:15.350358+0000 front 2024-05-20T17:21:15.350445+0000 (oldest deadline 2024-05-20T17:21:37.050195+0000) 2024-05-20T17:21:47.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:47 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:47.024+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:47.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:47 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:47.024+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:47.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:47 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:47.024+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:47.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:47 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:47.024+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:47.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:47 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:47.024+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:47.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:47 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:47.024+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:14.789920+0000 front 2024-05-20T17:21:14.789869+0000 (oldest deadline 2024-05-20T17:21:40.689634+0000) 2024-05-20T17:21:47.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:47 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:47.237+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:47.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:47 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:47.237+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:47.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:47 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:47.237+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:47.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:47 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:47.237+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:47.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:47 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:47.237+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:47.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:47 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:47.237+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:47.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:47 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:47.237+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:15.350358+0000 front 2024-05-20T17:21:15.350445+0000 (oldest deadline 2024-05-20T17:21:37.050195+0000) 2024-05-20T17:21:48.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:47 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:47.995+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:48.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:47 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:47.995+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:48.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:47 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:47.995+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:48.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:47 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:47.995+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:48.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:47 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:47.995+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:48.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:47 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:47.995+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:14.789920+0000 front 2024-05-20T17:21:14.789869+0000 (oldest deadline 2024-05-20T17:21:40.689634+0000) 2024-05-20T17:21:48.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:47 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:47.995+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6820 osd.7 since back 2024-05-20T17:21:20.690363+0000 front 2024-05-20T17:21:20.690376+0000 (oldest deadline 2024-05-20T17:21:47.690555+0000) 2024-05-20T17:21:48.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:48 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:48.211+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.642627+0000 front 2024-05-20T17:20:24.642775+0000 (oldest deadline 2024-05-20T17:20:49.342522+0000) 2024-05-20T17:21:48.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:48 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:48.211+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2024-05-20T17:20:30.443509+0000 front 2024-05-20T17:20:30.443463+0000 (oldest deadline 2024-05-20T17:20:56.844076+0000) 2024-05-20T17:21:48.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:48 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:48.211+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:36.844504+0000 front 2024-05-20T17:20:36.844519+0000 (oldest deadline 2024-05-20T17:21:02.744604+0000) 2024-05-20T17:21:48.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:48 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:48.211+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:49.746435+0000 front 2024-05-20T17:20:49.746458+0000 (oldest deadline 2024-05-20T17:21:14.446060+0000) 2024-05-20T17:21:48.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:48 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:48.211+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:54.446395+0000 front 2024-05-20T17:20:54.446413+0000 (oldest deadline 2024-05-20T17:21:25.047088+0000) 2024-05-20T17:21:48.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:48 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:48.211+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:06.748563+0000 front 2024-05-20T17:21:06.748530+0000 (oldest deadline 2024-05-20T17:21:27.848357+0000) 2024-05-20T17:21:48.523 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:48 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10[60108]: 2024-05-20T17:21:48.211+0000 7f55e09c0700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:15.350358+0000 front 2024-05-20T17:21:15.350445+0000 (oldest deadline 2024-05-20T17:21:37.050195+0000) 2024-05-20T17:21:49.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:48 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:48.967+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:49.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:48 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:48.967+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:49.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:48 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:48.967+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:49.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:48 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:48.967+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:49.368 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:48 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:48.967+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:49.368 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:48 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:48.967+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:14.789920+0000 front 2024-05-20T17:21:14.789869+0000 (oldest deadline 2024-05-20T17:21:40.689634+0000) 2024-05-20T17:21:49.368 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:48 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:48.967+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6820 osd.7 since back 2024-05-20T17:21:20.690363+0000 front 2024-05-20T17:21:20.690376+0000 (oldest deadline 2024-05-20T17:21:47.690555+0000) 2024-05-20T17:21:49.393 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:49 smithi062 podman[70696]: 2024-05-20 17:21:49.064618922 +0000 UTC m=+5.737743727 container died b65317c295cf956168e4a0e1b624d72eb708eaea490dd79bf152d7e73352fcef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-20T17:21:49.686 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:49 smithi062 podman[70696]: 2024-05-20 17:21:49.492377317 +0000 UTC m=+6.165502113 container cleanup b65317c295cf956168e4a0e1b624d72eb708eaea490dd79bf152d7e73352fcef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.build-date=20240514, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:21:49.686 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:49 smithi062 bash[70696]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10 2024-05-20T17:21:50.022 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:49 smithi062 podman[70713]: 2024-05-20 17:21:49.685426069 +0000 UTC m=+0.620400377 container remove b65317c295cf956168e4a0e1b624d72eb708eaea490dd79bf152d7e73352fcef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-05-20T17:21:50.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:49 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:49.987+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:50.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:49 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:49.987+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:50.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:49 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:49.987+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:50.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:49 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:49.987+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:50.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:49 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:49.987+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:50.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:49 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:49.987+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:14.789920+0000 front 2024-05-20T17:21:14.789869+0000 (oldest deadline 2024-05-20T17:21:40.689634+0000) 2024-05-20T17:21:50.368 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:49 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:49.987+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6820 osd.7 since back 2024-05-20T17:21:20.690363+0000 front 2024-05-20T17:21:20.690376+0000 (oldest deadline 2024-05-20T17:21:47.690555+0000) 2024-05-20T17:21:50.505 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:50 smithi062 podman[70802]: 2024-05-20 17:21:50.037612594 +0000 UTC m=+0.017911703 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:21:50.505 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:50 smithi062 podman[70802]: 2024-05-20 17:21:50.161109892 +0000 UTC m=+0.141408986 container create b4c4f2b8270baa2b2b480cd9febad08ed83a14706dee4212f5c7be0cf9fce4d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2) 2024-05-20T17:21:50.505 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:50 smithi062 podman[70802]: 2024-05-20 17:21:50.504911395 +0000 UTC m=+0.485210505 container init b4c4f2b8270baa2b2b480cd9febad08ed83a14706dee4212f5c7be0cf9fce4d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:21:50.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:50 smithi062 podman[70802]: 2024-05-20 17:21:50.508524571 +0000 UTC m=+0.488823673 container start b4c4f2b8270baa2b2b480cd9febad08ed83a14706dee4212f5c7be0cf9fce4d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_CLEAN=True, org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-05-20T17:21:50.773 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:50 smithi062 podman[70802]: 2024-05-20 17:21:50.596543344 +0000 UTC m=+0.576842456 container attach b4c4f2b8270baa2b2b480cd9febad08ed83a14706dee4212f5c7be0cf9fce4d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-20T17:21:51.115 INFO:journalctl@ceph.osd.10.smithi062.stdout:May 20 17:21:50 smithi062 podman[70802]: 2024-05-20 17:21:50.82487581 +0000 UTC m=+0.805174914 container died b4c4f2b8270baa2b2b480cd9febad08ed83a14706dee4212f5c7be0cf9fce4d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, org.label-schema.schema-version=1.0) 2024-05-20T17:21:51.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:51 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:51.028+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:51.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:51 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:51.028+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:51.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:51 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:51.028+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:51.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:51 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:51.028+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:51.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:51 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:51.028+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:51.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:51 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:51.028+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:14.789920+0000 front 2024-05-20T17:21:14.789869+0000 (oldest deadline 2024-05-20T17:21:40.689634+0000) 2024-05-20T17:21:51.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:51 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:51.028+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6820 osd.7 since back 2024-05-20T17:21:20.690363+0000 front 2024-05-20T17:21:20.690376+0000 (oldest deadline 2024-05-20T17:21:47.690555+0000) 2024-05-20T17:21:51.395 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.10.service' 2024-05-20T17:21:51.434 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:21:51.434 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-05-20T17:21:51.434 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-05-20T17:21:51.434 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.11 2024-05-20T17:21:51.752 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:51 smithi171 systemd[1]: Stopping Ceph osd.11 for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:21:52.027 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:51 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:51.751+0000 7fe70a408700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:21:52.027 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:51 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:51.751+0000 7fe70a408700 -1 osd.11 98 *** Got signal Terminated *** 2024-05-20T17:21:52.027 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:51 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:51.751+0000 7fe70a408700 -1 osd.11 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-20T17:21:52.028 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:52 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:52.026+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:52.028 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:52 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:52.026+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:52.028 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:52 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:52.026+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:52.028 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:52 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:52.026+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:52.028 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:52 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:52.026+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:52.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:52 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:52.026+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:14.789920+0000 front 2024-05-20T17:21:14.789869+0000 (oldest deadline 2024-05-20T17:21:40.689634+0000) 2024-05-20T17:21:52.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:52 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:52.026+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6820 osd.7 since back 2024-05-20T17:21:20.690363+0000 front 2024-05-20T17:21:20.690376+0000 (oldest deadline 2024-05-20T17:21:47.690555+0000) 2024-05-20T17:21:53.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:53 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:53.034+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:53.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:53 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:53.034+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:53.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:53 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:53.034+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:53.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:53 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:53.034+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:53.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:53 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:53.034+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:53.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:53 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:53.034+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:14.789920+0000 front 2024-05-20T17:21:14.789869+0000 (oldest deadline 2024-05-20T17:21:40.689634+0000) 2024-05-20T17:21:53.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:53 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:53.034+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6820 osd.7 since back 2024-05-20T17:21:20.690363+0000 front 2024-05-20T17:21:20.690376+0000 (oldest deadline 2024-05-20T17:21:47.690555+0000) 2024-05-20T17:21:54.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:54 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:54.049+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:54.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:54 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:54.049+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:54.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:54 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:54.049+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:54.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:54 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:54.049+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:54.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:54 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:54.049+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:54.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:54 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:54.049+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:14.789920+0000 front 2024-05-20T17:21:14.789869+0000 (oldest deadline 2024-05-20T17:21:40.689634+0000) 2024-05-20T17:21:54.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:54 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:54.049+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6820 osd.7 since back 2024-05-20T17:21:20.690363+0000 front 2024-05-20T17:21:20.690376+0000 (oldest deadline 2024-05-20T17:21:47.690555+0000) 2024-05-20T17:21:54.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:54 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:54.049+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6820 osd.8 since back 2024-05-20T17:21:27.690936+0000 front 2024-05-20T17:21:27.690903+0000 (oldest deadline 2024-05-20T17:21:53.590926+0000) 2024-05-20T17:21:55.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:55 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:55.079+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:55.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:55 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:55.079+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:55.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:55 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:55.079+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:55.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:55 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:55.079+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:55.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:55 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:55.079+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:55.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:55 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:55.079+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:14.789920+0000 front 2024-05-20T17:21:14.789869+0000 (oldest deadline 2024-05-20T17:21:40.689634+0000) 2024-05-20T17:21:55.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:55 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:55.079+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6820 osd.7 since back 2024-05-20T17:21:20.690363+0000 front 2024-05-20T17:21:20.690376+0000 (oldest deadline 2024-05-20T17:21:47.690555+0000) 2024-05-20T17:21:55.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:55 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:55.079+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6820 osd.8 since back 2024-05-20T17:21:27.690936+0000 front 2024-05-20T17:21:27.690903+0000 (oldest deadline 2024-05-20T17:21:53.590926+0000) 2024-05-20T17:21:56.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:56 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:56.056+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-05-20T17:20:24.279958+0000 front 2024-05-20T17:20:24.279934+0000 (oldest deadline 2024-05-20T17:20:48.380087+0000) 2024-05-20T17:21:56.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:56 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:56.056+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-20T17:20:41.783169+0000 front 2024-05-20T17:20:41.783034+0000 (oldest deadline 2024-05-20T17:21:04.683278+0000) 2024-05-20T17:21:56.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:56 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:56.056+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2024-05-20T17:20:47.484963+0000 front 2024-05-20T17:20:47.484906+0000 (oldest deadline 2024-05-20T17:21:10.984835+0000) 2024-05-20T17:21:56.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:56 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:56.056+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6812 osd.4 since back 2024-05-20T17:20:55.086075+0000 front 2024-05-20T17:20:55.086164+0000 (oldest deadline 2024-05-20T17:21:19.786045+0000) 2024-05-20T17:21:56.367 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:56 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:56.056+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-20T17:21:02.087121+0000 front 2024-05-20T17:21:02.087148+0000 (oldest deadline 2024-05-20T17:21:27.987138+0000) 2024-05-20T17:21:56.368 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:56 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:56.056+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2024-05-20T17:21:14.789920+0000 front 2024-05-20T17:21:14.789869+0000 (oldest deadline 2024-05-20T17:21:40.689634+0000) 2024-05-20T17:21:56.368 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:56 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:56.056+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.62:6820 osd.7 since back 2024-05-20T17:21:20.690363+0000 front 2024-05-20T17:21:20.690376+0000 (oldest deadline 2024-05-20T17:21:47.690555+0000) 2024-05-20T17:21:56.368 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:56 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11[60946]: 2024-05-20T17:21:56.056+0000 7fe7029b6700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6820 osd.8 since back 2024-05-20T17:21:27.690936+0000 front 2024-05-20T17:21:27.690903+0000 (oldest deadline 2024-05-20T17:21:53.590926+0000) 2024-05-20T17:21:57.519 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:57 smithi171 podman[71565]: 2024-05-20 17:21:57.242287471 +0000 UTC m=+5.615090217 container died 9ebf57a697c60f7c89791322bb65ae279b21f772d0bb9ebfc927e04335e10209 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_CLEAN=True, org.label-schema.build-date=20240514, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-20T17:21:57.867 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:57 smithi171 podman[71565]: 2024-05-20 17:21:57.59357457 +0000 UTC m=+5.966377305 container cleanup 9ebf57a697c60f7c89791322bb65ae279b21f772d0bb9ebfc927e04335e10209 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2) 2024-05-20T17:21:57.867 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:57 smithi171 bash[71565]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11 2024-05-20T17:21:58.217 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:57 smithi171 podman[71581]: 2024-05-20 17:21:57.879495362 +0000 UTC m=+0.632977441 container remove 9ebf57a697c60f7c89791322bb65ae279b21f772d0bb9ebfc927e04335e10209 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:21:58.514 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:58 smithi171 podman[71670]: 2024-05-20 17:21:58.11920272 +0000 UTC m=+0.017002546 image pull cfcc61b2d476f611479310eb042aa05f11dd5f60dbb65e3b0d7e0e11d024cdb3 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708 2024-05-20T17:21:58.514 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:58 smithi171 podman[71670]: 2024-05-20 17:21:58.227861797 +0000 UTC m=+0.125661696 container create 57efb771a29bf3a772841cfed225bee63d582a0e85af9367bfbdcaf9070d4e08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-05-20T17:21:58.514 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:58 smithi171 podman[71670]: 2024-05-20 17:21:58.430529284 +0000 UTC m=+0.328329114 container init 57efb771a29bf3a772841cfed225bee63d582a0e85af9367bfbdcaf9070d4e08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:21:58.514 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:58 smithi171 podman[71670]: 2024-05-20 17:21:58.433685169 +0000 UTC m=+0.331484989 container start 57efb771a29bf3a772841cfed225bee63d582a0e85af9367bfbdcaf9070d4e08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-20T17:21:58.514 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:58 smithi171 podman[71670]: 2024-05-20 17:21:58.514085905 +0000 UTC m=+0.411885721 container attach 57efb771a29bf3a772841cfed225bee63d582a0e85af9367bfbdcaf9070d4e08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, GIT_CLEAN=True, ceph=True) 2024-05-20T17:21:58.867 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 20 17:21:58 smithi171 podman[71670]: 2024-05-20 17:21:58.72771408 +0000 UTC m=+0.625513904 container died 57efb771a29bf3a772841cfed225bee63d582a0e85af9367bfbdcaf9070d4e08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS) 2024-05-20T17:21:59.318 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@osd.11.service' 2024-05-20T17:21:59.357 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:21:59.358 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-05-20T17:21:59.358 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-05-20T17:21:59.358 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.a 2024-05-20T17:21:59.687 INFO:journalctl@ceph.mds.a.smithi006.stdout:May 20 17:21:59 smithi006 systemd[1]: Stopping Ceph mds.a for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:22:00.131 INFO:journalctl@ceph.mds.a.smithi006.stdout:May 20 17:21:59 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-a[73890]: 2024-05-20T17:21:59.685+0000 7f147d845700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:22:00.131 INFO:journalctl@ceph.mds.a.smithi006.stdout:May 20 17:21:59 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-a[73890]: 2024-05-20T17:21:59.685+0000 7f147d845700 -1 mds.a *** got signal Terminated *** 2024-05-20T17:22:03.321 INFO:journalctl@ceph.mds.a.smithi006.stdout:May 20 17:22:03 smithi006 podman[100099]: 2024-05-20 17:22:03.062431028 +0000 UTC m=+3.496022482 container died feb726a4fc004a87523fe24ec11510093503362db38200b00b3ccb6f29a15658 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-a, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:22:03.631 INFO:journalctl@ceph.mds.a.smithi006.stdout:May 20 17:22:03 smithi006 podman[100099]: 2024-05-20 17:22:03.419154025 +0000 UTC m=+3.852745472 container cleanup feb726a4fc004a87523fe24ec11510093503362db38200b00b3ccb6f29a15658 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:22:03.631 INFO:journalctl@ceph.mds.a.smithi006.stdout:May 20 17:22:03 smithi006 bash[100099]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-a 2024-05-20T17:22:03.871 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.a.service' 2024-05-20T17:22:03.908 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:22:03.908 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-05-20T17:22:03.909 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-05-20T17:22:03.909 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.d 2024-05-20T17:22:04.257 INFO:journalctl@ceph.mds.d.smithi006.stdout:May 20 17:22:03 smithi006 systemd[1]: Stopping Ceph mds.d for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:22:04.631 INFO:journalctl@ceph.mds.d.smithi006.stdout:May 20 17:22:04 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-d[72948]: 2024-05-20T17:22:04.256+0000 7f6745c11700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:22:04.631 INFO:journalctl@ceph.mds.d.smithi006.stdout:May 20 17:22:04 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-d[72948]: 2024-05-20T17:22:04.256+0000 7f6745c11700 -1 mds.d *** got signal Terminated *** 2024-05-20T17:22:07.942 INFO:journalctl@ceph.mds.d.smithi006.stdout:May 20 17:22:07 smithi006 podman[100218]: 2024-05-20 17:22:07.681836692 +0000 UTC m=+3.539008287 container died 7a4a49691aa1bfc3ca5ca9aa9d327d61ad247052b3be7d501d0a786f7760dc93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-20T17:22:08.366 INFO:journalctl@ceph.mds.d.smithi006.stdout:May 20 17:22:08 smithi006 podman[100218]: 2024-05-20 17:22:08.039994293 +0000 UTC m=+3.897165888 container cleanup 7a4a49691aa1bfc3ca5ca9aa9d327d61ad247052b3be7d501d0a786f7760dc93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-d, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-20T17:22:08.367 INFO:journalctl@ceph.mds.d.smithi006.stdout:May 20 17:22:08 smithi006 bash[100218]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-d 2024-05-20T17:22:08.536 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.d.service' 2024-05-20T17:22:08.570 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:22:08.570 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-05-20T17:22:08.570 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-05-20T17:22:08.570 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.g 2024-05-20T17:22:08.936 INFO:journalctl@ceph.mds.g.smithi006.stdout:May 20 17:22:08 smithi006 systemd[1]: Stopping Ceph mds.g for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:22:09.381 INFO:journalctl@ceph.mds.g.smithi006.stdout:May 20 17:22:08 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-g[73539]: 2024-05-20T17:22:08.935+0000 7fd933392700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:22:09.381 INFO:journalctl@ceph.mds.g.smithi006.stdout:May 20 17:22:08 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-g[73539]: 2024-05-20T17:22:08.935+0000 7fd933392700 -1 mds.g *** got signal Terminated *** 2024-05-20T17:22:11.321 INFO:journalctl@ceph.mds.g.smithi006.stdout:May 20 17:22:11 smithi006 podman[100338]: 2024-05-20 17:22:11.069449399 +0000 UTC m=+2.272849304 container died 5956235ee2a27b719e3f850ecc554246c2cfb2b0fc1e418adec6aa70dd24faba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-g, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:22:11.579 INFO:journalctl@ceph.mds.g.smithi006.stdout:May 20 17:22:11 smithi006 podman[100338]: 2024-05-20 17:22:11.394266234 +0000 UTC m=+2.597666136 container cleanup 5956235ee2a27b719e3f850ecc554246c2cfb2b0fc1e418adec6aa70dd24faba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-g, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240514) 2024-05-20T17:22:11.579 INFO:journalctl@ceph.mds.g.smithi006.stdout:May 20 17:22:11 smithi006 bash[100338]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-g 2024-05-20T17:22:11.829 INFO:journalctl@ceph.mds.g.smithi006.stdout:May 20 17:22:11 smithi006 podman[100352]: 2024-05-20 17:22:11.57874907 +0000 UTC m=+0.502709547 container remove 5956235ee2a27b719e3f850ecc554246c2cfb2b0fc1e418adec6aa70dd24faba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-g, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:22:11.832 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.g.service' 2024-05-20T17:22:11.865 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:22:11.865 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-05-20T17:22:11.866 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-05-20T17:22:11.866 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.j 2024-05-20T17:22:12.131 INFO:journalctl@ceph.mds.j.smithi006.stdout:May 20 17:22:11 smithi006 systemd[1]: Stopping Ceph mds.j for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:22:12.631 INFO:journalctl@ceph.mds.j.smithi006.stdout:May 20 17:22:12 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-j[72603]: 2024-05-20T17:22:12.222+0000 7f35b430b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:22:12.631 INFO:journalctl@ceph.mds.j.smithi006.stdout:May 20 17:22:12 smithi006 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-j[72603]: 2024-05-20T17:22:12.222+0000 7f35b430b700 -1 mds.j *** got signal Terminated *** 2024-05-20T17:22:16.568 INFO:journalctl@ceph.mds.j.smithi006.stdout:May 20 17:22:16 smithi006 podman[100459]: 2024-05-20 17:22:16.245998997 +0000 UTC m=+4.148972778 container died f878d4d3ffd9c8bbdc5f92b2a369336a869d162ea382c95ae2bca1af3a0fb237 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-j, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514) 2024-05-20T17:22:16.866 INFO:journalctl@ceph.mds.j.smithi006.stdout:May 20 17:22:16 smithi006 podman[100459]: 2024-05-20 17:22:16.673178087 +0000 UTC m=+4.576151863 container cleanup f878d4d3ffd9c8bbdc5f92b2a369336a869d162ea382c95ae2bca1af3a0fb237 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-j, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-05-20T17:22:16.866 INFO:journalctl@ceph.mds.j.smithi006.stdout:May 20 17:22:16 smithi006 bash[100459]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-j 2024-05-20T17:22:17.111 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.j.service' 2024-05-20T17:22:17.131 INFO:journalctl@ceph.mds.j.smithi006.stdout:May 20 17:22:16 smithi006 podman[100471]: 2024-05-20 17:22:16.866142014 +0000 UTC m=+0.620348946 container remove f878d4d3ffd9c8bbdc5f92b2a369336a869d162ea382c95ae2bca1af3a0fb237 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-j, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240514, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-20T17:22:17.131 INFO:journalctl@ceph.mds.j.smithi006.stdout:May 20 17:22:17 smithi006 systemd[1]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.j.service: Deactivated successfully. 2024-05-20T17:22:17.131 INFO:journalctl@ceph.mds.j.smithi006.stdout:May 20 17:22:17 smithi006 systemd[1]: Stopped Ceph mds.j for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T17:22:17.131 INFO:journalctl@ceph.mds.j.smithi006.stdout:May 20 17:22:17 smithi006 systemd[1]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.j.service: Consumed 1.113s CPU time. 2024-05-20T17:22:17.144 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:22:17.145 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-05-20T17:22:17.145 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-05-20T17:22:17.145 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.b 2024-05-20T17:22:17.460 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:22:17 smithi062 systemd[1]: Stopping Ceph mds.b for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:22:17.735 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:22:17 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-b[65260]: 2024-05-20T17:22:17.459+0000 7f9e3faec700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:22:17.735 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:22:17 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-b[65260]: 2024-05-20T17:22:17.459+0000 7f9e3faec700 -1 mds.b *** got signal Terminated *** 2024-05-20T17:22:19.351 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:22:19 smithi062 podman[70907]: 2024-05-20 17:22:19.067476887 +0000 UTC m=+1.724650945 container died 4886ecbb7714e4d8106504e44280daf035956a11394ad62010542a9e4a2b49f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-b, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:22:19.685 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:22:19 smithi062 podman[70907]: 2024-05-20 17:22:19.450703665 +0000 UTC m=+2.107877713 container cleanup 4886ecbb7714e4d8106504e44280daf035956a11394ad62010542a9e4a2b49f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240514, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-20T17:22:19.685 INFO:journalctl@ceph.mds.b.smithi062.stdout:May 20 17:22:19 smithi062 bash[70907]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-b 2024-05-20T17:22:19.834 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.b.service' 2024-05-20T17:22:19.872 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:22:19.872 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-05-20T17:22:19.872 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-05-20T17:22:19.872 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.e 2024-05-20T17:22:20.273 INFO:journalctl@ceph.mds.e.smithi062.stdout:May 20 17:22:19 smithi062 systemd[1]: Stopping Ceph mds.e for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:22:20.273 INFO:journalctl@ceph.mds.e.smithi062.stdout:May 20 17:22:20 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-e[64657]: 2024-05-20T17:22:20.180+0000 7feb5c41e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:22:20.273 INFO:journalctl@ceph.mds.e.smithi062.stdout:May 20 17:22:20 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-e[64657]: 2024-05-20T17:22:20.180+0000 7feb5c41e700 -1 mds.e *** got signal Terminated *** 2024-05-20T17:22:23.305 INFO:journalctl@ceph.mds.e.smithi062.stdout:May 20 17:22:23 smithi062 podman[71041]: 2024-05-20 17:22:23.034247681 +0000 UTC m=+2.938337160 container died 5ef1e1076c9931487c65ca89583116f0582c383033f747bfcfa2745e0f677b9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240514, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-20T17:22:23.614 INFO:journalctl@ceph.mds.e.smithi062.stdout:May 20 17:22:23 smithi062 podman[71041]: 2024-05-20 17:22:23.404703552 +0000 UTC m=+3.308793025 container cleanup 5ef1e1076c9931487c65ca89583116f0582c383033f747bfcfa2745e0f677b9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-e, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, ceph=True, org.label-schema.license=GPLv2) 2024-05-20T17:22:23.614 INFO:journalctl@ceph.mds.e.smithi062.stdout:May 20 17:22:23 smithi062 bash[71041]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-e 2024-05-20T17:22:23.744 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.e.service' 2024-05-20T17:22:23.779 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:22:23.779 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-05-20T17:22:23.779 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-05-20T17:22:23.779 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.h 2024-05-20T17:22:24.151 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:22:23 smithi062 systemd[1]: Stopping Ceph mds.h for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:22:24.523 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:22:24 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-h[64956]: 2024-05-20T17:22:24.151+0000 7ffa79c37700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:22:24.523 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:22:24 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-h[64956]: 2024-05-20T17:22:24.151+0000 7ffa79c37700 -1 mds.h *** got signal Terminated *** 2024-05-20T17:22:27.443 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:22:27 smithi062 podman[71161]: 2024-05-20 17:22:27.064590339 +0000 UTC m=+3.053319131 container died 9c9396a4e44054ac4135b11bb9b94878311bcb1c3f383253cb549975ec24ec51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-h, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240514, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-20T17:22:27.710 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:22:27 smithi062 podman[71161]: 2024-05-20 17:22:27.516761569 +0000 UTC m=+3.505490359 container cleanup 9c9396a4e44054ac4135b11bb9b94878311bcb1c3f383253cb549975ec24ec51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-h, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-20T17:22:27.710 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:22:27 smithi062 bash[71161]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-h 2024-05-20T17:22:27.953 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.h.service' 2024-05-20T17:22:27.975 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:22:27 smithi062 podman[71173]: 2024-05-20 17:22:27.709808107 +0000 UTC m=+0.637759394 container remove 9c9396a4e44054ac4135b11bb9b94878311bcb1c3f383253cb549975ec24ec51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-h, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-20T17:22:27.975 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:22:27 smithi062 systemd[1]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.h.service: Deactivated successfully. 2024-05-20T17:22:27.975 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:22:27 smithi062 systemd[1]: Stopped Ceph mds.h for c726c954-16c9-11ef-bc9a-c7b262605968. 2024-05-20T17:22:27.975 INFO:journalctl@ceph.mds.h.smithi062.stdout:May 20 17:22:27 smithi062 systemd[1]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.h.service: Consumed 2.426s CPU time. 2024-05-20T17:22:27.986 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:22:27.987 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-05-20T17:22:27.987 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-05-20T17:22:27.987 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.k 2024-05-20T17:22:28.273 INFO:journalctl@ceph.mds.k.smithi062.stdout:May 20 17:22:28 smithi062 systemd[1]: Stopping Ceph mds.k for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:22:28.772 INFO:journalctl@ceph.mds.k.smithi062.stdout:May 20 17:22:28 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-k[64354]: 2024-05-20T17:22:28.303+0000 7fc43ee1b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:22:28.773 INFO:journalctl@ceph.mds.k.smithi062.stdout:May 20 17:22:28 smithi062 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-k[64354]: 2024-05-20T17:22:28.303+0000 7fc43ee1b700 -1 mds.k *** got signal Terminated *** 2024-05-20T17:22:31.455 INFO:journalctl@ceph.mds.k.smithi062.stdout:May 20 17:22:31 smithi062 podman[71282]: 2024-05-20 17:22:31.045726884 +0000 UTC m=+2.832144301 container died 8933224ead3cb50a7b8398c4072c4087a6db68b59027167e2e3eb3c8f2f42783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-k, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240514, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-05-20T17:22:31.738 INFO:journalctl@ceph.mds.k.smithi062.stdout:May 20 17:22:31 smithi062 podman[71282]: 2024-05-20 17:22:31.529158849 +0000 UTC m=+3.315576258 container cleanup 8933224ead3cb50a7b8398c4072c4087a6db68b59027167e2e3eb3c8f2f42783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-k, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240514, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0) 2024-05-20T17:22:31.738 INFO:journalctl@ceph.mds.k.smithi062.stdout:May 20 17:22:31 smithi062 bash[71282]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-k 2024-05-20T17:22:31.863 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.k.service' 2024-05-20T17:22:31.895 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:22:31.896 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-05-20T17:22:31.896 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-05-20T17:22:31.896 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.c 2024-05-20T17:22:32.227 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 20 17:22:31 smithi171 systemd[1]: Stopping Ceph mds.c for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:22:32.493 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 20 17:22:32 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-c[65877]: 2024-05-20T17:22:32.226+0000 7f882af9b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:22:32.494 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 20 17:22:32 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-c[65877]: 2024-05-20T17:22:32.226+0000 7f882af9b700 -1 mds.c *** got signal Terminated *** 2024-05-20T17:22:35.319 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 20 17:22:35 smithi171 podman[71777]: 2024-05-20 17:22:35.03670004 +0000 UTC m=+2.944315356 container died 7197dc4ef4609d151bc6a4d8ff7fd37781c1044d6b3b870f7574cd6d853c864d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-c, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, GIT_BRANCH=HEAD) 2024-05-20T17:22:35.617 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 20 17:22:35 smithi171 podman[71777]: 2024-05-20 17:22:35.418617103 +0000 UTC m=+3.326232418 container cleanup 7197dc4ef4609d151bc6a4d8ff7fd37781c1044d6b3b870f7574cd6d853c864d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-c, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-20T17:22:35.617 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 20 17:22:35 smithi171 bash[71777]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-c 2024-05-20T17:22:35.795 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.c.service' 2024-05-20T17:22:35.830 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:22:35.830 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-05-20T17:22:35.831 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-05-20T17:22:35.831 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.f 2024-05-20T17:22:36.367 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 20 17:22:35 smithi171 systemd[1]: Stopping Ceph mds.f for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:22:36.367 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 20 17:22:36 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-f[65574]: 2024-05-20T17:22:36.155+0000 7f34a3b7c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:22:36.367 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 20 17:22:36 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-f[65574]: 2024-05-20T17:22:36.156+0000 7f34a3b7c700 -1 mds.f *** got signal Terminated *** 2024-05-20T17:22:39.324 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 20 17:22:39 smithi171 podman[71908]: 2024-05-20 17:22:39.042460282 +0000 UTC m=+2.977632218 container died ece7236814011bdc3892e62a7a71588115a9e312bd4b0fd2d4be036ae7e265dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-f, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.vendor=CentOS) 2024-05-20T17:22:39.617 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 20 17:22:39 smithi171 podman[71908]: 2024-05-20 17:22:39.406834643 +0000 UTC m=+3.342006573 container cleanup ece7236814011bdc3892e62a7a71588115a9e312bd4b0fd2d4be036ae7e265dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-f, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:22:39.617 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 20 17:22:39 smithi171 bash[71908]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-f 2024-05-20T17:22:39.798 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.f.service' 2024-05-20T17:22:39.832 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:22:39.832 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-05-20T17:22:39.832 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-05-20T17:22:39.832 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.i 2024-05-20T17:22:40.117 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 20 17:22:39 smithi171 systemd[1]: Stopping Ceph mds.i for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:22:40.617 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 20 17:22:40 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-i[66184]: 2024-05-20T17:22:40.178+0000 7f6898710700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:22:40.617 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 20 17:22:40 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-i[66184]: 2024-05-20T17:22:40.178+0000 7f6898710700 -1 mds.i *** got signal Terminated *** 2024-05-20T17:22:43.298 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 20 17:22:43 smithi171 podman[72027]: 2024-05-20 17:22:43.029519096 +0000 UTC m=+2.968388053 container died 8a73ef594fabea55800b1fb7ed0bb16757037690eb08cbbf6d1e371ef38dd36c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-i, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c) 2024-05-20T17:22:43.617 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 20 17:22:43 smithi171 podman[72027]: 2024-05-20 17:22:43.395594001 +0000 UTC m=+3.334462948 container cleanup 8a73ef594fabea55800b1fb7ed0bb16757037690eb08cbbf6d1e371ef38dd36c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-i, org.label-schema.build-date=20240514, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-05-20T17:22:43.617 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 20 17:22:43 smithi171 bash[72027]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-i 2024-05-20T17:22:43.820 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.i.service' 2024-05-20T17:22:43.852 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:22:43.852 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-05-20T17:22:43.853 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-05-20T17:22:43.853 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.l 2024-05-20T17:22:44.167 INFO:journalctl@ceph.mds.l.smithi171.stdout:May 20 17:22:43 smithi171 systemd[1]: Stopping Ceph mds.l for c726c954-16c9-11ef-bc9a-c7b262605968... 2024-05-20T17:22:44.617 INFO:journalctl@ceph.mds.l.smithi171.stdout:May 20 17:22:44 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-l[65273]: 2024-05-20T17:22:44.166+0000 7fd07499b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-20T17:22:44.617 INFO:journalctl@ceph.mds.l.smithi171.stdout:May 20 17:22:44 smithi171 ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-l[65273]: 2024-05-20T17:22:44.166+0000 7fd07499b700 -1 mds.l *** got signal Terminated *** 2024-05-20T17:22:47.302 INFO:journalctl@ceph.mds.l.smithi171.stdout:May 20 17:22:47 smithi171 podman[72148]: 2024-05-20 17:22:47.03240673 +0000 UTC m=+2.958622483 container died 92cb114d916b6d7965bc1445cfc03ef0551f32705f902533027852bbf02322ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-l, org.label-schema.license=GPLv2, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240514, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-05-20T17:22:47.617 INFO:journalctl@ceph.mds.l.smithi171.stdout:May 20 17:22:47 smithi171 podman[72148]: 2024-05-20 17:22:47.383699983 +0000 UTC m=+3.309915737 container cleanup 92cb114d916b6d7965bc1445cfc03ef0551f32705f902533027852bbf02322ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d5395c4020ac9059aec12c85bcc41cf8b1b75bc8c18339e31fbf77c838aee708, name=ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-l, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240514, org.label-schema.schema-version=1.0, GIT_COMMIT=d4a0f93b06679a5c9148c9e9b367478b2a0d04e0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240517.203521-squid-debug-d2b507c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-05-20T17:22:47.617 INFO:journalctl@ceph.mds.l.smithi171.stdout:May 20 17:22:47 smithi171 bash[72148]: ceph-c726c954-16c9-11ef-bc9a-c7b262605968-mds-l 2024-05-20T17:22:47.837 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c726c954-16c9-11ef-bc9a-c7b262605968@mds.l.service' 2024-05-20T17:22:47.870 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-20T17:22:47.870 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-05-20T17:22:47.870 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c726c954-16c9-11ef-bc9a-c7b262605968 --force --keep-logs 2024-05-20T17:22:48.073 INFO:teuthology.orchestra.run.smithi006.stdout:Deleting cluster with fsid: c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T17:22:50.746 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c726c954-16c9-11ef-bc9a-c7b262605968 --force --keep-logs 2024-05-20T17:22:50.946 INFO:teuthology.orchestra.run.smithi062.stdout:Deleting cluster with fsid: c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T17:22:53.448 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c726c954-16c9-11ef-bc9a-c7b262605968 --force --keep-logs 2024-05-20T17:22:53.640 INFO:teuthology.orchestra.run.smithi171.stdout:Deleting cluster with fsid: c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T17:22:56.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-20T17:22:56.039 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-20T17:22:56.072 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-20T17:22:56.099 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-20T17:22:56.103 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715607/remote/smithi006/crash 2024-05-20T17:22:56.103 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/crash -- . 2024-05-20T17:22:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:tar: /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/crash: Cannot open: No such file or directory 2024-05-20T17:22:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:tar: Error is not recoverable: exiting now 2024-05-20T17:22:56.157 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715607/remote/smithi062/crash 2024-05-20T17:22:56.158 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/crash -- . 2024-05-20T17:22:56.198 INFO:teuthology.orchestra.run.smithi062.stderr:tar: /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/crash: Cannot open: No such file or directory 2024-05-20T17:22:56.198 INFO:teuthology.orchestra.run.smithi062.stderr:tar: Error is not recoverable: exiting now 2024-05-20T17:22:56.200 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715607/remote/smithi171/crash 2024-05-20T17:22:56.201 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/crash -- . 2024-05-20T17:22:56.238 INFO:teuthology.orchestra.run.smithi171.stderr:tar: /var/lib/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/crash: Cannot open: No such file or directory 2024-05-20T17:22:56.238 INFO:teuthology.orchestra.run.smithi171.stderr:tar: Error is not recoverable: exiting now 2024-05-20T17:22:56.240 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-20T17:22:56.240 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-05-20T17:22:56.316 INFO:tasks.cephadm:Compressing logs... 2024-05-20T17:22:56.316 DEBUG:teuthology.orchestra.run.smithi006:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-20T17:22:56.319 DEBUG:teuthology.orchestra.run.smithi062:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-20T17:22:56.321 DEBUG:teuthology.orchestra.run.smithi171:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-20T17:22:56.352 INFO:teuthology.orchestra.run.smithi006.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-20T17:22:56.354 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-05-20T17:22:56.354 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.log 2024-05-20T17:22:56.355 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.audit.log 2024-05-20T17:22:56.355 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.g.log 2024-05-20T17:22:56.355 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.j.log 2024-05-20T17:22:56.355 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.3.log 2024-05-20T17:22:56.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.0.log 2024-05-20T17:22:56.358 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mgr.x.log 2024-05-20T17:22:56.358 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mon.a.log 2024-05-20T17:22:56.359 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.6.log 2024-05-20T17:22:56.359 INFO:teuthology.orchestra.run.smithi006.stderr: 86.8% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.log.gz 2024-05-20T17:22:56.359 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.cephadm.log 2024-05-20T17:22:56.359 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mon.a.log: /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.a.log 2024-05-20T17:22:56.359 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-volume.log 2024-05-20T17:22:56.359 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.d.log 2024-05-20T17:22:56.359 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.a.log: /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.9.log 2024-05-20T17:22:56.359 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-20T17:22:56.359 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-05-20T17:22:56.360 INFO:teuthology.orchestra.run.smithi062.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-20T17:22:56.361 INFO:teuthology.orchestra.run.smithi171.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-20T17:22:56.361 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.log 2024-05-20T17:22:56.361 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.2.log 2024-05-20T17:22:56.361 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.f.log 2024-05-20T17:22:56.361 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.audit.log 2024-05-20T17:22:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.log 2024-05-20T17:22:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.audit.log 2024-05-20T17:22:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.7.log 2024-05-20T17:22:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.b.log 2024-05-20T17:22:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.4.log 2024-05-20T17:22:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.1.log 2024-05-20T17:22:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mgr.y.log 2024-05-20T17:22:56.368 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.h.log 2024-05-20T17:22:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mgr.y.log: -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.10.log 2024-05-20T17:22:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.cephadm.log 2024-05-20T17:22:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.e.log 2024-05-20T17:22:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.cephadm.log: -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-volume.log 2024-05-20T17:22:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mon.b.log 2024-05-20T17:22:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose --/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-volume.log: /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.k.log 2024-05-20T17:22:56.369 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-20T17:22:56.369 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.5.log 2024-05-20T17:22:56.369 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.c.log 2024-05-20T17:22:56.369 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mon.c.log 2024-05-20T17:22:56.370 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mgr.z.log 2024-05-20T17:22:56.370 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.i.log 2024-05-20T17:22:56.370 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.cephadm.log 2024-05-20T17:22:56.370 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.11.log 2024-05-20T17:22:56.370 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.8.log 2024-05-20T17:22:56.370 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-volume.log 2024-05-20T17:22:56.370 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.l.log 2024-05-20T17:22:56.370 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-20T17:22:56.370 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.l.log: /var/log/ceph/cephadm.log: 82.2% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.cephadm.log.gz 2024-05-20T17:22:56.374 INFO:teuthology.orchestra.run.smithi171.stderr: 86.8% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.log.gz 2024-05-20T17:22:56.403 INFO:teuthology.orchestra.run.smithi171.stderr: 93.1% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.f.log.gz 2024-05-20T17:22:56.415 INFO:teuthology.orchestra.run.smithi171.stderr: 93.0% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.i.log.gz 2024-05-20T17:22:56.434 INFO:teuthology.orchestra.run.smithi171.stderr: 93.0% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mgr.z.log.gz 2024-05-20T17:22:56.458 INFO:teuthology.orchestra.run.smithi171.stderr: 90.1% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.audit.log.gz 2024-05-20T17:22:56.492 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 93.1% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.k.log.gz 2024-05-20T17:22:56.496 INFO:teuthology.orchestra.run.smithi062.stderr: 92.9% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mgr.y.log.gz 2024-05-20T17:22:56.519 INFO:teuthology.orchestra.run.smithi062.stderr: 93.7% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.h.log.gz 2024-05-20T17:22:56.521 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ceph-client.admin.log: 94.6% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.j.log.gz 2024-05-20T17:22:56.524 INFO:teuthology.orchestra.run.smithi006.stderr: 82.5% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.cephadm.log.gz 2024-05-20T17:22:56.539 INFO:teuthology.orchestra.run.smithi006.stderr: 93.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-20T17:22:56.571 INFO:teuthology.orchestra.run.smithi006.stderr: 91.1% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-volume.log.gz 2024-05-20T17:22:56.601 INFO:teuthology.orchestra.run.smithi006.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-05-20T17:22:56.614 INFO:teuthology.orchestra.run.smithi171.stderr: 91.0% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-volume.log.gz 2024-05-20T17:22:56.685 INFO:teuthology.orchestra.run.smithi062.stderr: 93.1% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.e.log.gz 2024-05-20T17:22:56.727 INFO:teuthology.orchestra.run.smithi062.stderr: 91.1% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-volume.log.gz 2024-05-20T17:22:56.781 INFO:teuthology.orchestra.run.smithi171.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-20T17:22:56.796 INFO:teuthology.orchestra.run.smithi062.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-20T17:22:56.797 INFO:teuthology.orchestra.run.smithi062.stderr: 82.3% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.cephadm.log.gz 2024-05-20T17:22:56.798 INFO:teuthology.orchestra.run.smithi062.stderr: 86.8% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.log.gz 2024-05-20T17:22:56.799 INFO:teuthology.orchestra.run.smithi062.stderr: 90.1% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.audit.log.gz 2024-05-20T17:22:56.808 INFO:teuthology.orchestra.run.smithi006.stderr: 94.6% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.d.log.gz 2024-05-20T17:22:56.826 INFO:teuthology.orchestra.run.smithi006.stderr: 89.9% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph.audit.log.gz 2024-05-20T17:22:56.893 INFO:teuthology.orchestra.run.smithi171.stderr: 91.9% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mon.c.log.gz 2024-05-20T17:22:56.976 INFO:teuthology.orchestra.run.smithi062.stderr: 93.0% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.b.log.gz 2024-05-20T17:22:57.152 INFO:teuthology.orchestra.run.smithi171.stderr: 94.4% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.c.log.gz 2024-05-20T17:22:57.271 INFO:teuthology.orchestra.run.smithi171.stderr: 94.5% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.l.log.gz 2024-05-20T17:22:57.382 INFO:teuthology.orchestra.run.smithi062.stderr: 92.0% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mon.b.log.gz 2024-05-20T17:22:57.465 INFO:teuthology.orchestra.run.smithi006.stderr: 94.5% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.g.log.gz 2024-05-20T17:22:57.466 INFO:teuthology.orchestra.run.smithi006.stderr: 94.5% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mds.a.log.gz 2024-05-20T17:22:59.556 INFO:teuthology.orchestra.run.smithi006.stderr: 90.4% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mgr.x.log.gz 2024-05-20T17:23:12.643 INFO:teuthology.orchestra.run.smithi006.stderr: 90.4% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-mon.a.log.gz 2024-05-20T17:23:43.735 INFO:teuthology.orchestra.run.smithi062.stderr: 90.9% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.10.log.gz 2024-05-20T17:23:46.289 INFO:teuthology.orchestra.run.smithi171.stderr: 90.5% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.8.log.gz 2024-05-20T17:24:03.779 INFO:teuthology.orchestra.run.smithi062.stderr: 90.5% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.7.log.gz 2024-05-20T17:24:13.630 INFO:teuthology.orchestra.run.smithi171.stderr: 90.5% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.11.log.gz 2024-05-20T17:24:14.608 INFO:teuthology.orchestra.run.smithi062.stderr: 90.6% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.1.log.gz 2024-05-20T17:24:49.611 INFO:teuthology.orchestra.run.smithi171.stderr: 90.5% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.2.log.gz 2024-05-20T17:24:50.206 INFO:teuthology.orchestra.run.smithi062.stderr: 90.6% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.4.log.gz 2024-05-20T17:24:50.209 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-05-20T17:24:50.210 INFO:teuthology.orchestra.run.smithi062.stderr:real 1m53.872s 2024-05-20T17:24:50.210 INFO:teuthology.orchestra.run.smithi062.stderr:user 4m1.792s 2024-05-20T17:24:50.210 INFO:teuthology.orchestra.run.smithi062.stderr:sys 0m7.215s 2024-05-20T17:25:18.134 INFO:teuthology.orchestra.run.smithi171.stderr: 90.4% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.5.log.gz 2024-05-20T17:25:18.136 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-05-20T17:25:18.137 INFO:teuthology.orchestra.run.smithi171.stderr:real 2m21.800s 2024-05-20T17:25:18.137 INFO:teuthology.orchestra.run.smithi171.stderr:user 4m10.626s 2024-05-20T17:25:18.137 INFO:teuthology.orchestra.run.smithi171.stderr:sys 0m8.266s 2024-05-20T17:27:30.401 INFO:teuthology.orchestra.run.smithi006.stderr: 90.3% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.3.log.gz 2024-05-20T17:30:33.975 INFO:teuthology.orchestra.run.smithi006.stderr: 90.3% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.0.log.gz 2024-05-20T17:31:08.081 INFO:teuthology.orchestra.run.smithi006.stderr: 90.3% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.6.log.gz 2024-05-20T17:33:35.497 INFO:teuthology.orchestra.run.smithi006.stderr: 90.3% -- replaced with /var/log/ceph/c726c954-16c9-11ef-bc9a-c7b262605968/ceph-osd.9.log.gz 2024-05-20T17:34:06.610 INFO:teuthology.orchestra.run.smithi006.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-05-20T17:34:06.612 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T17:34:06.612 INFO:teuthology.orchestra.run.smithi006.stderr:real 11m10.278s 2024-05-20T17:34:06.612 INFO:teuthology.orchestra.run.smithi006.stderr:user 6m39.819s 2024-05-20T17:34:06.612 INFO:teuthology.orchestra.run.smithi006.stderr:sys 0m15.860s 2024-05-20T17:34:06.613 INFO:tasks.cephadm:Archiving logs... 2024-05-20T17:34:06.614 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715607/remote/smithi006/log 2024-05-20T17:34:06.615 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-20T17:35:10.599 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715607/remote/smithi062/log 2024-05-20T17:35:10.600 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-20T17:35:52.812 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715607/remote/smithi171/log 2024-05-20T17:35:52.814 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-20T17:36:38.188 INFO:tasks.cephadm:Removing cluster... 2024-05-20T17:36:38.189 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c726c954-16c9-11ef-bc9a-c7b262605968 --force 2024-05-20T17:36:38.393 INFO:teuthology.orchestra.run.smithi006.stdout:Deleting cluster with fsid: c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T17:36:39.063 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c726c954-16c9-11ef-bc9a-c7b262605968 --force 2024-05-20T17:36:39.266 INFO:teuthology.orchestra.run.smithi062.stdout:Deleting cluster with fsid: c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T17:36:39.896 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c726c954-16c9-11ef-bc9a-c7b262605968 --force 2024-05-20T17:36:40.088 INFO:teuthology.orchestra.run.smithi171.stdout:Deleting cluster with fsid: c726c954-16c9-11ef-bc9a-c7b262605968 2024-05-20T17:36:40.730 INFO:tasks.cephadm:Removing cephadm ... 2024-05-20T17:36:40.730 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-20T17:36:40.750 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-20T17:36:40.768 DEBUG:teuthology.orchestra.run.smithi171:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-20T17:36:40.784 INFO:tasks.cephadm:Teardown complete 2024-05-20T17:36:40.784 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-20T17:36:40.794 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-20T17:36:40.795 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-20T17:36:40.798 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-20T17:36:40.810 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-20T17:36:40.964 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-20T17:36:40.973 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-20T17:36:40.974 DEBUG:teuthology.orchestra.run.smithi006:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-20T17:36:40.976 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-20T17:36:40.979 DEBUG:teuthology.orchestra.run.smithi171:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-20T17:36:40.991 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-05-20T17:36:40.992 INFO:teuthology.orchestra.run.smithi006.stderr:bash: line 1: ntpq: command not found 2024-05-20T17:36:40.993 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-05-20T17:36:40.998 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-20T17:36:40.998 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2024-05-20T17:36:40.998 INFO:teuthology.orchestra.run.smithi006.stdout:^* hv01.front.sepia.ceph.com 3 6 377 15 +1512us[+1718us] +/- 40ms 2024-05-20T17:36:40.998 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 15 -2370us[-2164us] +/- 72ms 2024-05-20T17:36:40.998 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 -166us[ +40us] +/- 79ms 2024-05-20T17:36:40.998 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:36:41.006 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-20T17:36:41.007 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-05-20T17:36:41.007 INFO:teuthology.orchestra.run.smithi062.stdout:^* hv01.front.sepia.ceph.com 3 6 377 21 +1529us[+1762us] +/- 40ms 2024-05-20T17:36:41.007 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 -2379us[-2379us] +/- 72ms 2024-05-20T17:36:41.007 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 24 -159us[ +71us] +/- 79ms 2024-05-20T17:36:41.007 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:36:41.010 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-20T17:36:41.010 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-05-20T17:36:41.010 INFO:teuthology.orchestra.run.smithi171.stdout:^* hv01.front.sepia.ceph.com 3 6 377 20 +1526us[+1768us] +/- 40ms 2024-05-20T17:36:41.010 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 -2370us[-2370us] +/- 72ms 2024-05-20T17:36:41.010 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 -148us[ -148us] +/- 79ms 2024-05-20T17:36:41.010 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:36:41.011 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-20T17:36:41.022 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-20T17:36:41.022 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-20T17:36:41.106 DEBUG:teuthology.orchestra.run.smithi006:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-20T17:36:41.248 DEBUG:teuthology.orchestra.run.smithi062:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-20T17:36:41.332 DEBUG:teuthology.orchestra.run.smithi171:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-20T17:36:41.462 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-20T17:36:41.497 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:36:41.498 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-20T17:36:41.528 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:36:41.529 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-20T17:36:41.556 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:36:41.556 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-20T17:36:41.566 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-20T17:36:41.577 INFO:teuthology.task.internal:Duration was 2884.973353 seconds 2024-05-20T17:36:41.577 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-20T17:36:41.587 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-20T17:36:41.587 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-20T17:36:41.590 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-20T17:36:41.593 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-20T17:36:41.653 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-20T17:36:41.658 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-20T17:36:41.676 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-20T17:36:42.177 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-20T17:36:42.177 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T17:36:42.178 DEBUG:teuthology.orchestra.run.smithi006:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-20T17:36:42.204 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2024-05-20T17:36:42.204 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-20T17:36:42.236 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T17:36:42.237 DEBUG:teuthology.orchestra.run.smithi171:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-20T17:36:42.267 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-20T17:36:42.267 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-20T17:36:42.270 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-20T17:36:42.279 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-20T17:36:42.334 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-20T17:36:42.334 DEBUG:teuthology.orchestra.run.smithi006:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-20T17:36:42.342 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-20T17:36:42.346 DEBUG:teuthology.orchestra.run.smithi171:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-20T17:36:42.757 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-20T17:36:42.768 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-20T17:36:42.769 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-20T17:36:42.804 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-20T17:36:42.831 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-20T17:36:42.857 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-20T17:36:42.867 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-20T17:36:42.870 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-20T17:36:42.873 DEBUG:teuthology.orchestra.run.smithi171:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-20T17:36:42.895 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = core 2024-05-20T17:36:42.895 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2024-05-20T17:36:42.933 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = core 2024-05-20T17:36:42.968 DEBUG:teuthology.orchestra.run.smithi006:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-20T17:36:42.983 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:36:42.984 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-20T17:36:42.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:36:42.999 DEBUG:teuthology.orchestra.run.smithi171:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-20T17:36:43.024 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:36:43.024 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-20T17:36:43.035 INFO:teuthology.task.internal:Transferring archived files... 2024-05-20T17:36:43.037 DEBUG:teuthology.misc:Transferring archived files from smithi006:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715607/remote/smithi006 2024-05-20T17:36:43.037 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-20T17:36:43.081 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715607/remote/smithi062 2024-05-20T17:36:43.081 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-20T17:36:43.117 DEBUG:teuthology.misc:Transferring archived files from smithi171:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715607/remote/smithi171 2024-05-20T17:36:43.118 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-20T17:36:43.153 INFO:teuthology.task.internal:Removing archive directory... 2024-05-20T17:36:43.153 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-20T17:36:43.156 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-20T17:36:43.158 DEBUG:teuthology.orchestra.run.smithi171:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-20T17:36:43.203 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-20T17:36:43.215 INFO:teuthology.task.internal:Not uploading archives. 2024-05-20T17:36:43.216 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-20T17:36:43.226 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-20T17:36:43.226 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-20T17:36:43.229 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-20T17:36:43.231 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-20T17:36:43.242 INFO:teuthology.orchestra.run.smithi006.stdout: 265297 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 20 17:36 /home/ubuntu/cephtest 2024-05-20T17:36:43.244 INFO:teuthology.orchestra.run.smithi062.stdout: 266038 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 20 17:36 /home/ubuntu/cephtest 2024-05-20T17:36:43.258 INFO:teuthology.orchestra.run.smithi171.stdout: 265296 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 20 17:36 /home/ubuntu/cephtest 2024-05-20T17:36:43.260 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-20T17:36:43.270 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-20T17:36:43.294 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/iogen}} duration: 2884.9733526706696 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-20T17:36:43.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-20T17:36:43.376 INFO:teuthology.run:pass